What is the best way to handle prevent data loss in the event a hard drive goes bad in a server. We have never had one go yet but I can only imagine what a server load of domains suddenly losing their databases or sites. (giving that they didn't back their stuff up).
I know one was is a RAID setup. I just wanted to hear more.
What about if you need to move everyone from one server to another due to major upgrades? Like adding more hdd space.
I just had some thoughts cross my mind about oversold VPSes. If a hosting provider oversells their bandwidth and one or more of their clients demands more juice it just doesn't come; there is a lag and the system acts as if the internet itself is choked up. Everything waits for available bandwidth and adapts around it seamlessly.
Now supposing the same host oversells CPU power and has a ton of VPSes with tiny memory allotments. If one or more clients start pounding away then their load average, and to an extent the load of the physical server will go up and all tasks will slow down a bit, very similar to an isolated physical machine that was running some intense application that was slowing everything down. Well in this case too the system will adapt to it and just run things slower.
If a host oversells hard drive space nobody will know about it until space on the physical box runs out so until then it's totally transparent.
But what about RAM? If a host oversells RAM and the VPS thinks a certain block of memory is there but it's really not then what? Supposing 99% of the RAM in a physical box is currently in use and suddenly the demand rises to 110% of the available RAM. Seems to me like applications on the VPS will not slow down but rather crash and vanish into thin air. Or try to start and as they load more and more RAM up suddeny they will just go poof! Taking user data with them.
Am I wrong about this and has openvz impremented some failsafe mechanism to prevent this from happening? Because if not it means anyone who runs anything in an oversold(RAM) VPS is risking losing or at the very least corrupting their data.
I am noticing some packet loss on one of my boxes, most notably when i'm accessing the webmail (however i'm pretty sure it's not that)
Can anyone offer some tips as to how to nail this down?
i have two servers with whm/cpanel and centos,
i host my domain.com on server-A and create a account with subdomain sub.domain.com on server-A,
some days later,
i move the account website to server-B,
a> i change the domain of sub.domain.com to sub2.domain.com on server-A from whm,
b> and i edit the dns from whm and add a a address record to point to the server-B.
i think my setting is right and the link will run well,
but i am not sure why sometimes people can not link the sub.domain.com,
and they check do the check "ping sub.domain.com",
and they will get the ip of original server-A,
because it assail me for months and i'm not sure how to fix it completely.
I have a dedicated windows 2003 server at a colocation facility that i use for game server hosting. Over the past 7 months, packet loss has become horrible with random periods of massive lag. My host says it's something on my end. I use a firewall with SPI enabled. Could that be causing it?
Strange thing is, the first few months my server was at that colo, they only had around 40 other servers on a single OC-192 pipe and i never had packet loss despite having the same SPI firewall. But now they have over 300 servers on the same OC-192 pipe. Could the packet loss be caused by my SPI firewall or them overloading the network with servers?
Basically I registered with a new host. They sent me the details with obviously includes the IP address. I tested the IP address on just-ping.com and it came back with all of them having between 80% to 100% packet loss. Surely this is not normal is it? I havent moved my domain yet but it doesnt look good does it? Should I cancel?
View 14 Replies View RelatedAnyone else experiencing packet loss with a GoDaddy VDS?
I'm in the 208.109.93 subnet.
--- google.com ping statistics ---
200 packets transmitted, 53 received, 73% packet loss, time 199086ms
rtt min/avg/max/mdev = 41.970/42.813/46.022/0.994 ms
my server sql keeps loss db connection during 'cpbackup' in progresss.
below are my.cnf settings. can someone suggest me how to tweak to optimize?
[mysqld]
datadir=/var/lib/mysql
socket=/var/lib/mysql/mysql.sock
skip-locking
skip-innodb
query_cache_limit=1M
query_cache_size=128M
query_cache_type=1
max_user_connections=200
max_connections=500
interactive_timeout=10
wait_timeout=20
connect_timeout=20
thread_cache_size=128
key_buffer=512M
join_buffer=1M
max_allowed_packet=16M
table_cache=1024
record_buffer=1M
sort_buffer_size=4M
read_buffer_size=4M
max_connect_errors=10
thread_concurrency=8
myisam_sort_buffer_size=64M
server-id=1
We just had an issue with our colo provider. The thing is, from the day we ordered our colo with them we ordered, signed, and paid for a GigE (1000Mbps) port. We have been using and paying for a GigE pipe and 300Mbps worth of bandwidth for the past 11 months.
Just this month we find out that our colo provider actually only drop us a 100Mbit connection and not the GigE which we paid for and signed for on the contract.
I asked our sales rep there, he replied to us saying that we should have "asked" for a GigE drop, since many of their customers are buying GigE while their switches does not support GigE, so they said, they ussually drop 100Mbit anyway.
That does not seem right, right? Our switches from the first day has been GigE enabled even with 4 fiber optic port on each managed switch on every rack we have.
We have suffered loss and damages, as soon as they switched our port to GigE last week, our bandwidth usage immediately shows we are using 125Mbps with some spike of 800Mbps for a fracture of a moment.
All these times, we experience slowness, we always thought that it was our equipment or something, but it turns out that it's the pipe drop which is causing the problem.
Now, I have a dilema. If say we demand a compensation and become hostile asking for loss and damages compensation, which literally cost us hundreds of thousands of dollars of loss in these past 11 months, I am affraid that our colo provider will be giving us a hard time. We have hundreds of servers there. We don't plan to move, since it will be a lot of trouble.
The thing is they said that it was our fault, that we did not checked that the drop was not 1Gbps. We always have the impression that it was 1Gbps, but we did not checked it though. But still we bought 1Gbps and we paid for it and the contract also says so.
What do you think I should do? Should I "demand" the compensation? Or just leave it be, so we won't get a hard time for our growth in this provider. We will be moving to our own facility, but not anytime soon, probably in 2009, but again it depends on our cash flow, etc.
Anyway, who's fault is this? Is this our fault that we did not check what we bought? Or is it the provider fault, who dropped 100Mbit pipe while we buy and asked for GigE?
I would not want to come to a point wher there will be a legal complaint filed though. Would like to settle this for a good resolution. What steps would you suggest we take?
with two 3com 3870 switches.
Our setup looks like this
Computer A (GigE) Switch 1 (gigE) Media Converter (Fiber Run) Media Converter (gigE) Switch 2 (gigE) Computer B
We have a cross connect in our data center that uses media converters (fiber) to regular 1000FD on each end.
Each end of the 1000FD handoff is plugged into port 1 of the 3870's (switch 1 and switch 2).
Pinging from Computer A to Computer B we receive a 50% packet loss.
Pinging from Computer B to Switch 1, no packet loss.
Pinging from Computer A to Switch 2, 50% packet loss.
Looking in the interface, the port 1's on each switch auto negotiate to 1000FD, however flow control shows as off.
We asked our data center to run tests on the media converts and fiber runs and everything comes back 100% fine. Has anyone seen a weird issue like this before with 3com switches not playing nicely with media converters?
I have no clue whats going on and our data center said the fiber run/media converter is fine... [url]
I have smokeping monitoring my game servers and so far in the little time that it has been running all my game servers have been encountering an average of 4 to 10% packet loss. Are there are tweaks i can run on the server computer to reduce packet loss? (registry modifications, etc.)
I downloaded a TCP tweak program called "TCP Optimizer" is it safe to run on a Windows 2003 Server OS?
The colo connection is an OC 192 and i have a 100Mbit ethernet card.
Here are my current TCP settings:
Quote:
[SYSTEMCurrentControlSetServicesTcpipParameters]
TcpWindowSize=-1
GlobalMaxTcpWindowSize=-1
EnablePMTUDiscovery=-1
EnablePMTUBHDetect=-1
SackOpts=-1
DefaultTTL=-1
TcpMaxDupAcks=-1
Tcp1323Opts=-1
DisableUserTOSSetting=-1
DefaultTOSValue=-1
[SYSTEMCurrentControlSetServicesAfdParameters]
DefaultReceiveWindow=-1
[SoftwareMicrosoftWindowsCurrentVersionInternet Settings]
MaxConnectionsPerServer=-1
MaxConnectionsPer1_0Server=-1
[SYSTEMCurrentControlSetServicesICSharingSettingsGeneral]
InternetMTU=-1
[SOFTWAREMicrosoftWindowsCurrentVersionExplorerRemoteComputerNameSpace{D6277990-4C6A-11CF-8D87-00AA0060F5BF}]
{D6277990-4C6A-11CF-8D87-00AA0060F5BF}=-1
[SYSTEMCurrentControlSetServicesDnscacheParameters]
MaxNegativeCacheTtl=-1
NegativeCacheTime=-1
NetFailureCacheTime=-1
NegativeSOACacheTime=-1
[SOFTWAREPoliciesMicrosoftWindowsPsched]
NonBestEffortLimit=-5
[SYSTEMCurrentControlSetServicesTcpipServiceProvider]
LocalPriority=499
HostsPriority=500
DnsPriority=2000
NetbtPriority=2001
[SystemCurrentControlSetServicesLanmanServerParameters]
SizReqBuf=-1
[SYSTEMCurrentControlSetServicesNdisWanParametersProtocols]
ProtocolMTU=-2
[SYSTEMCurrentControlSetServicesTcpipParametersInterfaces{D63AC0FA-D2C9-4D83-B057-31A353516AB3}]
MTU=-1
TcpWindowSize=-1
[SYSTEMCurrentControlSetServicesPschedParametersAdapters{D63AC0FA-D2C9-4D83-B057-31A353516AB3}]
NonBestEffortLimit=-2
[SYSTEMCurrentControlSetServicesTcpipParametersInterfaces{8190D94A-3B2D-45C4-998D-312E99D6061D}]
MTU=-1
TcpWindowSize=-1
[SYSTEMCurrentControlSetServicesPschedParametersAdapters{8190D94A-3B2D-45C4-998D-312E99D6061D}]
NonBestEffortLimit=-2
I have a home CentOS server and here is my issue
When I try to connect to it via SSH its laggy and often times out. I also notice packet loss.
My home network is 100 Mbps and the router is a crappy netgear WPN824 V3
Recently I have been having this problem with two high traffic servers on two different network.
Both servers are Quad-Core Xeons with CentOS 4.5 x86_64 and they are on 100mbps full duplex network. Software configuration is Nginx+Apache+MYSQL control panel is Directadmin.
The servers are serving lots static files and some php scripts.
When the servers start push near or over 30mbps, there will be packet loss when I ping them. around 5% loss, push more bandwidth the more packet loss. I have checked all the log files, I don't see any unusual errors.
Server Load is fine. The NICs were on 100mbps full-duplex mode.
The datacenters claim the networks were fine and all the other servers running on the same switches were fine with no packet loss.
I'm trying to find out why a single interface is causing packet loss on my entire network.
The network consists of four 2924's trunked to a 3550. I have about 20 vlans and a single default route for all traffic my uplink.
The network is perfect until I enable a single server. After I issue a 'no shut' on the interface packet loss is anywhere from 5% to 20% for anything going through the 3550 or even pings from the 3550 to other switches or the uplink.
Here's the statistics/settings of the interface after 1 minute of activity:
Code:
interface FastEthernet0/1
description 228
switchport access vlan 58
switchport mode dynamic desirable
speed 100
duplex full
spanning-tree portfast
FastEthernet0/1 is up, line protocol is up (connected)
Hardware is Fast Ethernet, address is 0014.f2e6.df01 (bia 0014.f2e6.df01)
Description: 228
MTU 1500 bytes, BW 100000 Kbit, DLY 100 usec,
reliability 255/255, txload 1/255, rxload 6/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full-duplex, 100Mb/s, media type is 10/100BaseTX
input flow-control is off, output flow-control is unsupported
ARP type: ARPA, ARP Timeout 04:00:00
Last input never, output 00:00:00, output hang never
Last clearing of "show interface" counters 00:01:01
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 2536000 bits/sec, 924 packets/sec
5 minute output rate 341000 bits/sec, 469 packets/sec
60922 packets input, 21630544 bytes, 0 no buffer
Received 0 broadcasts (0 multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 2 ignored
0 watchdog, 0 multicast, 0 pause input
0 input packets with dribble condition detected
31585 packets output, 2859788 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier, 0 PAUSE output
0 output buffer failures, 0 output buffers swapped out
Transmit FastEthernet0/1 Receive
3583183 Bytes 27018085 Bytes
39516 Unicast frames 76403 Unicast frames
46 Multicast frames 0 Multicast frames
0 Broadcast frames 0 Broadcast frames
0 Discarded frames 0 No dest, unicast
0 Too old frames 0 No dest, multicast
0 Deferred frames 0 No dest, broadcast
0 1 collision frames
0 2 collision frames 0 FCS errors
0 3 collision frames 0 Oversize frames
0 4 collision frames 0 Undersize frames
0 5 collision frames 0 Collision fragments
0 6 collision frames
0 7 collision frames 4355 Minimum size frames
0 8 collision frames 56237 65 to 127 byte frames
0 9 collision frames 1205 128 to 255 byte frames
0 10 collision frames 14 256 to 511 byte frames
0 11 collision frames 67 512 to 1023 byte frames
0 12 collision frames 14528 1024 to 1518 byte frames
0 13 collision frames
0 14 collision frames 0 Flooded frames
0 15 collision frames 3 Overrun frames
0 Excessive collisions 0 VLAN filtered frames
0 Late collisions 0 Source routed frames
0 Good (1 coll) frames 0 Valid oversize frames
0 Good(>1 coll) frames 0 Pause frames
0 Pause frames 0 Symbol error frames
0 VLAN discard frames 0 Invalid frames, too large
0 Excess defer frames 0 Valid frames, too large
0 Too large frames 0 Invalid frames, too small
3672 64 byte frames 0 Valid frames, too small
34066 127 byte frames
2152 255 byte frames
110 511 byte frames
38 1023 byte frames
28 1518 byte frames
CPU utilization for five seconds: 13%/3%; one minute: 12%; five minutes: 9%
77 1317620 3220725 409 9.27% 8.35% 6.20% 0 IP Input
How does 1400 packets/second (4mbits) cause my 3550 to drop packets?
I am moving a couple clients over to my server tonight, but I wanted to make sure I took steps that they don't miss any e-mail that might be sent. It is my understanding that say the switch happens tonight at midnight. Any e-mails they did not download from the old server will be stuck on there correct? Because they would come in the next morning and hit outlook and download just from the new server?
Is there a set protocol for doing this move with minimal client hic-ups?
a tool that can measure how much packet loss we are having on a given server by looking at the packets being sent from it. I.e, something than looks at all TCP/80 connections and measures how many packets and bytes are being retransmitted vs actual packets and bytes sent.
This documents explains it:
[url]
We need this to measure network performance of different hosts where we have dedicated servers. This would be a good way of measuring performance with the actual data of our users.
Does anyone know of such tool? I.e, something that can say
2532 packets/second - 132 retransmits/second (4.8%)
25.43Mbps/sec total traffic - 24.84 Mbps/sec actual data sent - 0.59Mbps retransmits
Even better if it can then break it out on IP prefixes. like
192.0/16: 0.2% retransmits
192.1/16: 3.2% retransmits
192.2.16: 0.3% retransmits
192.3/16: 22.5% retransmits
192.4/16: 0.3% retransmits
This would be a good indicator of connectivity between the host where the tests are ran and other specific hosts.
I am facing high ping and packet loss issues with a server hosted at hetzner.de (CentOS + WHM)
For some unknown reason pings go high and stay like this (average 1500ms) until I reboot the server.
Here is a screenshot of tracert from server to me: [url]
I recently switched over to SoftLayer for dedicated hosting and the servers are great. However we've been getting hit on and off with massive (50-80%) packet loss, which has been crippling our performance and causing all sorts of problems
I put in a support ticket and they linked me to the Internet Health Report website and said it was due to one of their bandwidth providers (I think Global CrossinG) and not on their internal network and to be patient as it could take time to resolve
Are any other SoftLayer customers going through this? Is this an unusual occurrence? I feel like if it was really one of their partners that it would be affecting a lot of their customers and it would be a high priority issue right?
I'm kind of stuck on what to do; I just invested a lot of energy into moving content onto these new servers and am concerned about whether to wait it out or whether to start finding a new company. This kind of packet loss is really unacceptable...
root@server [~]# tail -f /var/log/messages
Jun 10 14:14:49 server kernel: printk: 56 messages suppressed.
Jun 10 14:14:49 server kernel: ip_conntrack: table full, dropping packet.
Jun 10 14:14:54 server kernel: printk: 59 messages suppressed.
Jun 10 14:14:54 server kernel: ip_conntrack: table full, dropping packet.
Jun 10 14:14:59 server kernel: printk: 85 messages suppressed.
Jun 10 14:14:59 server kernel: ip_conntrack: table full, dropping packet.
Jun 10 14:15:04 server kernel: printk: 90 messages suppressed.
Jun 10 14:15:04 server kernel: ip_conntrack: table full, dropping packet.
Jun 10 14:15:09 server kernel: printk: 58 messages suppressed.
Jun 10 14:15:09 server kernel: ip_conntrack: table full, dropping packet.
Jun 10 14:15:14 server kernel: printk: 70 messages suppressed.
Jun 10 14:15:14 server kernel: ip_conntrack: table full, dropping packet.
Jun 10 14:15:19 server kernel: printk: 193 messages suppressed.
Jun 10 14:15:19 server kernel: ip_conntrack: table full, dropping packet.
Anyone know what this is about?
Using Centos / Cpanel
Linux server.domain.com 2.6.9-67.0.15.ELsmp #1 SMP Thu May 8 10:52:19 EDT 2008 i686 i686 i386 GNU/Linux
root@server [~]# sysctl net.ipv4.netfilter.ip_conntrack_max
net.ipv4.netfilter.ip_conntrack_max = 65536
I ran this in the meantime.
sysctl -w net.ipv4.netfilter.ip_conntrack_max=72000
Upgrading was started not half an hour ago from the time this post goes out, all went well until the MySQL was started up. At this point it is screaming at me because it cannot access it due to a missing password. This shouldn't be to much of an issue, as you just follow this post here, [URL] .... However.. when I did that this happened.
Code:
/usr/local/psa/bin/admin --show-password
PHP Notice: Undefined index: PARAMETERS; File: /usr/local/psa/admin/plib/CommonPanel/Exception.php, Line: 266
SQLSTATE[HY000] [1045] Access denied for user 'admin'@'localhost' (using password: YES)
I rent through OVH, so we don't get support access or anything. We just get a 15 site license and that's it so I don't know who to turn to for this.. I haven't ever touched anything in regards to SQL and the likes, all I did was click the upgrade button and this failed me. And now I've pretty much lost everything until this is resolved.
I have 100+ sites on this hard drive, and one site in particular that meant the world to me.
My host sent the drive to Gillware first, but they failed saying that the file system was so severely damaged that they could not recover anything.
Then shortly after, my host sent it to DriveSavers, a very well-known company, but they also FAILED.
I'm extremely depressed because of this. Please don't post if you're going to say "make sure you do backups next time" because I've heard it 504329504395 times now, and while I do realize my mistake, saying that does NOT help me.
I am willing to spend ALOT to get my sites back. I still have hope. Are there any other companies out there BETTER than DriveSavers? Assuming that you'd still have hope even after two companies failed, where you would you go or what would you do?
How can I find the data transfer rate on the server. I have done ifconfig -a , it
display the amout of data has been received and transfered. I want to see the live data transfer date. Can I able to check it?
My host just recently sent the hard drive with my sites to a data recovery company called Gillware. Website is [url]- but they failed and gave the following reason:
Quote:
Originally Posted by Gillware
Unfortunately, your file system was so severely damaged that no data can be
recovered. We will make arrangements to return your drive via UPS. Sorry
we could not help you further.
Gillware Inc.
Do you guys think there's still hope?
The hard drive is now being shipped to a more well known company, Drive Savers - [url]and I'm guessing that this is the last hope, because the more the drive gets tampered with, the more chance of permanent data loss.
So yeah.. I was just wondering what you think? If the file system is so severely damaged, do you think it STILL can be recovered?
i am presently hosted with the planet.I have moved to another server at the planet.
Can someone please explain how data migration can be done...?
I run a small vbulletin forum ,LAMP with WHM/cPanel.
i have around 700 megabytes of data to transfer to my new server.The new server has all the required software installed on it.
Planet said they will do it for me for just 275 dollars.