Excess Bandwidth Charges For Traffic Between 2 Nodes On A Lan
Oct 7, 2008
Should excess bandwidth charges apply for traffic that occurs between 2 nodes on a lan?
We have 2 self service dedicated servers. One of them runs our production environment and the other is used for development and backups. We have a cron job which copies backup data from the production server to the development box. A few months ago a bug in our backup script resulted a $700 excess bandwidth charge from the hosting provider.
An analysis of the network stats showed this to be $350 for outbound traffic from the production server and $350 for inbound traffic to the development box. Internet traffic for the period in question was negligible. I disputed the charge but was unable to obtain a refund. I'm trying to decide whether to switch providers as a result.
Based on the information listed above what do you think most hosting providers would have done:
1. Exactly the same. The terms of service make the customer liable for all excess bandwidth.
2. Offered a $350 refund to avoid billing twice for the same traffic.
3. Refunded the full amount because the excess traffic did not touch the public wan.
I am just in the process of setting up a new rack for some lower end clients.
At present we have both a local (National) and international traffic split. We need to offer our clients a 100/100 port speed on the national route/bgp/ip range but only a set amount on the international range. The port speed/throughput for international traffic would need to be as low as 128k/128k.
I would also like to have the flexibility to impose data limits on the international link as apposed to bandwidth shaping.
I have a spare Cisco 3750G-48TS I was hoping to utilize for the main switch on this rack (SFP Ports for multiple uplinks, National/International)
Hardware/Server wise what will be the easiest way to achieve this?
I have a site that has become very popular and I feel that I will soon outgrow my hosting plan. The site uses sub-domains in a fashion similar to About.com. In other words, I have different sites under the umbrella of the main domain. How does a site like About handle this issue? Forgive me if this is an uneducated question, but, since I can't host the sub-domains under different accounts and relieve some of the bandwidth burden how do I handle the bandwidth issue? It's not like I can have one account dedicated to one sub-domain and another to the other sub-domain or can I? Also, can anyone recommend a good hosting plan for popular sites? I have 60gb of transfer right now, but I want to explore other options while there is still time.
Does anyone have a tutorial or instructions to show how to set up munin to monitor bandwidth/traffic utilization?
I have a VPS from a provider that has no monitoring tools, and I need something to monitor.
(The VPS uses the HyperVM software.)
I am using the CentOS version 4.x right now, and munin is already set up and configured with a basic install.
Anyone know how to add traffic/bandwidth monitoring? (Ideally, it would monitor all active ports.. but I only really need it to monitor port 1194 for openVPN software.)
What do you charge for adult oriented sites or you keep them on the same packages? I was going to offer some more BW in return for say, 40 percent more on the account.
Over the past 48 hours, we've been subjected to a packetflood of ~70mbit, varying by time of day. In a normal month, we use no more than 600mb of traffic in total, and are limited at 2TB. This attack has already used 1.7TB as of the end of Sunday and shows no signs of stopping yet.
Does anyone know what leaseweb charge for overages? I cannot seem to find the information anywhere on their site (and their support takes 3 days to reply, by which I will be over). Idealy, i'd like them to nullroute the UDP port which is being targeted (many services run off the IP that is targeted) however they refused to do this for a similar attack in the past despite the fact that it would solve the issue at hand.
Why is this so hard to find? I've been searching for hours. I want a ASP-enabled host that do not charge me yearly, but monthly or quarterly, within acceptable price range. Basic features, really. ASP + MySQL.
The trubbles comes when i try to check out. Godaddy for instance. Trying to finish my order, but they still want my creditcard information (dont use visa, master or amex).
EasyCGI was very close. They accept true paypal-payment, but only on a yearly basis. Do anyone know why this is so hard for them? And/or do you know any host that fit the requirements?
Today I was just going through some pricing and quotes trying to decide if multiple average priced servers ($150/mo - $400/mo) vs Powerhouse servers ($1,500/mo - $2,500/mo). The powerhouse servers look mathematically to pay off better in the end but I am thinking that they may bottleneck easier.
We are interested to know how many VPS providers.. ( not resellers ) have hardware firewalls in front of their VPS hardware nodes?
If so, Do you find this impacts customer vps's?
What kind of hardware firewall do you use?
If not, how do you protect your hardware nodes from attack?
After some research I seem to find most providers do not in fact have any hardware firewalls in front of their VPS hardware nodes. Mostly they say it causes too many problems and tickets due to port blocking, etc... and customers complain about being restricted..
I have set up a backup node in PPA, and set it to be ready to provide, however backup tasks are saving the backups to the apache web server nodes? How do I find the cause of this?
I am having network issues, local servers in the /24 are unable to connect to VPS's.
If I make the /etc/sysconfig/network-scripts/ifcfg-eth0 too especific by adding a netmask then Nodes with assigned IPs on a different /28 will stop working/ping.
Right now it works, but it doesn't allow local servers to connect to VPS's (a problem) as one of those nodes is a VPS backup center.
I'm testing PPA and have now a questions. How can restrict a subscription to a service node? I have try that over the subscriptions and custom atribute's. That work for the most thinks (Apache/Postfix) but not for MySQL, all customers can by a create to choose the database server (all database servers). How can i customer don't allow to choose the database server?
For a example (web1, mail1 only -> db1) (web2, mail2 only -> db2)
And for the DNS settings to create automaticly a DNS for the database service? (as a sample: db.domain.de -> database service node)....
I can't seem to find if there is a way to specify what hostname is used for a service on a service node. For instance, if one creates a service node named web01, and makes it a DNS service node, is web01 what will be used when creating NS records in zone files, or is there a way to change that?
The ppademo.com site is offline (and was unlicensed again last week).
after learning that server aliases are not available for PPA, we are needing to rename our service nodes. We have looked through the documentation, and did see the ppa.hostname command for the management node but there does not seem to be an equivalent for service nodes.
I'm attempting to run PPA on Azure but I only have one IP to work with, the public IP address. It's not possible to communicate between servers using the internal IP addresses as they are not necessarily on the same sub net. How can I get PPA and service nodes running on a single IP address per machine?
An example of the error I get when setting up a service node is
Failed to execute command 'cscript /Nologo http_download.js http://<private ip address>/tarballs/Win32Bin/support.cab'. Check logs in 'c:POA_Deploy' at host '<public ip address>' for more details about the reasons of failure.
I am working on a new install of PPA, and after installation on the management node Im trying to add the other nodes. Ive tried to add a Apache, Postfix, DNS & DB node, and they all have the same issue. The installation task fails with the following error:
Destination host 'node.domain.com' (#3), IP '192.168.1.*' : The operation can not be completed because the following component is missing or is not running: pleskd (sc_name '', sc_id #45)
(domain and IP are removed here, correct in the original error. The IP is a backchannel IP, and the public IP was properly set in the management node).
I've verified that pleskd was installed and is running on each node:
Code:
24710 ? S 0:00 /usr/local/pem/sbin/pleskd --props-file /usr/local/pem/etc/pleskd.props --send-signal 24712 ? S 0:00 /usr/local/pem/sbin/pleskd --props-file /usr/local/pem/etc/pleskd.props --send-signal 24714 ? S 0:00 /usr/local/pem/sbin/pleskd --props-file /usr/local/pem/etc/pleskd.props --send-signal ...
I've verified that my management node can connect to the nodes in question via 8532:
Code: ]# telnet 192.168.1.* 8352 Trying 192.168.1.*.. Connected to 192.168.1.*. Escape character is '^]'. ^] telnet> quit Connection closed.
So there shouldn't be any firewall or other networking issues.
how can I use to control or cap the traffic on a per server basis ? in other words, I have 15 servers in one cabinet, in this cabinet there is one switch to feed all 15 servers, the swith is a DELL 3448, one of the servers is eatingup almost all the traffic I have fro the cabinet itself, is there a way I can cap or limit traffic quota on a per port basis at the switch level? or what is the best way to manage this?
I'm up Games for Windows VPS servers with VMWare Server ESXi and wonders whether some option to control the traffic of each IP, I thought about using a "Cisco ASA 5500" but I do not know if it has this option:
Imagine you want a set of servers (VPSs would be a cheaper choice, that is why I am posting here) that do not have much outbound traffic but download from other servers (more or less as spiders, but I am not trying to create a web index). Disk space or memory size are not important, but port speed and monthly transfer should be as high as possible. As inbound traffic is less frequently used, I wonder if any provider offer cheaper rates if traffic is like this.
I have been searching the forums and have not found too much about this topic (a quite related post named "I want to download the Internet" or something similar did not get a conclusion).
I am not sure if my dedicated server is being attacked or if it is legitimate traffic. I need help figuring out the difference and if it is an attack, how to prevent it, and if it is legitimate traffic, how to configure the server to handle the load.
SoftwareCentOS 5.3-32 Apache2 MySQL 5 PHP 5 When I do ps aux|grep httpd|wc -l I get the count of current connected clients of 259 which is always maxing out my MaxClients of 256. I had increased it to 512, and it maxed out, I had increased it to 1024 and it maxed out, and lastly I had setup to 2048 and it works, but slows the entire server down.
Recently I noticed the load on one of my servers way beyound what I would expect it to be. I run multi processor servers and even during a backup the load is only around 1.5.
But lately I noticed peak loads that high under normal web traffic.
I know 1.5 is low on an multi processor server, but I am hoping to add much more to those machines and with sustained load that high it leaves no room for expansion. The servers are not cheap, so adding another server to the cluster can only be done if I make money from the last one I added.
I checked the traffic levels and they were very high. After further review I had some bots hitting sites at over 1200 pages a minute. Multiply that by a few hundred bots and clearly I could have a load issue. The potential is there to bring any server to its knees when delivering those volumes.
I created programing to watch connections and block the abusive bots. While logging I became aware of over 600 bots crawling my servers. Many bots from, Japan, China, Germany and so on and on, useless to my customers even if they are legit search indexes.
Another problem I see is that the bots are running from many ip addresses and hitting the same sites from multiple ips at the same time. Why would the need to do that?
Among other things I decided to validate googlebot, msn and yahoo with dns lookups so I could determine that they were actually their bots and not imposters. In 24 hours I found valid bots from the big three hitting one server from 1100 different ips.
Now we are looking at thousands of vaild bots and thousands more email harvesters and content theives.
As a host, the number of sites I can host on a server is greatly reduced by the bot traffic. My customers do not want to hear that their website was being crawled at 3,000 pages a minute and that is why they could not access it. Of course they will blame it on me.
I was able to filter the bots at a firewall level and drop connections based on reverse dns lookups and site crawl rates and my server sits around 0.05 most of the time even with hundreds of pages a minute being accessed.
I am wondering how the rest of you hosts deal with this problem. Do you leave it up to your hosting customers? Or do you have some type of filter to get rid of the bots.
When you have a few sites it is not really a problem, but as you grow it grows exponetially out of control.
