Creating A High Traffic Hosting Setup
Oct 3, 2008
creating a setup that will host a site which is expected to receive 50-60K visitors in the first few hours after its launch. The site is membership based and the backend (member system) runs on PHP5-MySQL5.
Here is what I have thought of until now.
Site's sales page (which also happens to be the first page that visitors hit) hosted with Amazon S3 service. All public media files are off loaded to amazon S3 service to keep the number of requests on the hosted setup to minimum.
At the front we can have a high performance firewall like Cisco ASA 5520 followed by two dedicated load balancers in Active/Active state.
Behind the load balancers we have 3 front end servers acting as web-servers. These have SAS disks, 4GB RAM, RAID 1 setup, Dual Xeon Quad core processors each.
Behind the front end servers - we have a dedicated load balancer for the database cluster.
The database cluster consists of 3 Storage/API nodes and one of the front end servers acts as the management node. Each storage node has 8GB RAM, Dual Xeon Quad core processors, 4x RAID 10, SAS setup.
The private network is on a GigaLan.
Do you see any possible/obvious flaw in this design or anything that should be added/subtracted from the setup?
View 14 Replies
ADVERTISEMENT
Jul 10, 2008
We expect a site on one of our boxes to receive a significantly high level of traffic tomorrow as it is an event that will be covered and has already been covered by the press. The site operator expects > 100,000 hits a second.
It's a PHP page that pulls records from a database and lets people submit a form to insert a record. We have already put a caching script in place so that refreshing the page does not result in doing another database query.
The site was overloading a shared server, and we've moved it to one of our VPS boxes - it's the only VPS on the system at the moment. The box is a Quad Xeon 5410 with 4GB RAM with a 4 10K RPM drives in a RAID5 setup.
View 3 Replies
View Related
Jul 23, 2007
I'm working on launching this online store for a poster designer, and we're becoming more and more aware that we need a really robust and fast server. This site is looking at extremely high levels of activity whenever this designer posts a new poster. We're talking 1700 people surfing the store (downloading med-high resolution poster images) and 300 posters sold in 16 seconds kind of thing.
So, we need a really robust hosting, to work with PHP5 and MYSQL.
My previous go-to hosting provider was Lunarpages, but their customer service has gone down the crapper, and I've just about had it with them. My main questions are:
Should I be looking into getting a dedicated server, or are there hosting companies that can handle this kind of traffic on a shared server? I don't have experience administrating a server, so if we got a dedicated one we would have to pay the host to do at least some of the setup/administration, I would assume?
Dedicated server or not, what's a hosting company that has really good customer service, where we can be assured of getting somebody knowledgeable without having to wait on hold for 20 (or even 10) minutes?
View 10 Replies
View Related
Nov 15, 2007
What traffic monitor would everyone recommend for sites that have as many as 5,000 to 10,000 hits an hour?
View 8 Replies
View Related
May 24, 2007
I'm using MRTG to display graphs of traffic to my server, and today noticed a period of several hours where there was a lot of *incoming* data over the network, which is unusual. There's a good chance it's some harmless script or service that I've forgotten about, but really I need more information on what services/ports are creating what traffic, which brings me to my question.
I'm wondering whether there's an easy way to check what services (or ports) are creating traffic, and what volumes of traffic. It would be nice if it was possible to graph or breakdown the traffic by service somehow, and determine which are the biggest users of bandwidth and when. This is a dedicated CentOS server that I can install basically anything on, but that doesn't use a control panel, so I'd like to see what great ideas you folks can come up with, or whether there's any nice software you can suggest. I'm only using the server for hobbyist stuff at the moment, so free software, or ideas using built in commands are preferable.
View 3 Replies
View Related
Aug 21, 2007
I just want to ask. my ISP told me my server is generating high traffic from outside and paste me their traffic log with 1 IP address (xx.xx.xx.xx)
They rebooted my server and the problem disappear but I need to check what has been going on and where do I start? The only information I have is the IP xx.xx.xx.xx
View 1 Replies
View Related
Feb 22, 2008
What are your recommendations for a high quality, high traffic firewall. Something for a colo center for a webserver, that is not too expensive.
View 8 Replies
View Related
Sep 10, 2009
good switch to support 1Gbps in 3 servers and more in a future.
Maybe a Procurve 3400CL? I need a very stable switch.
It is important to a physical firewall too? If so what?
View 14 Replies
View Related
Apr 18, 2009
We currently have a website for our client developed on ASP.net with SQL
Its a straight forward web application with 2000 visitors per day
The traffic is going too heavy and its now at 130 GB per month
Our Queries :
Can we still have this site on a shared environment ?
If yes, suggest few providers offering high bandwidth
What other alternatives are there?
View 14 Replies
View Related
May 11, 2008
I own an anime linking site which you guessed it links to anime. I have around 10000 hits a day and would like a vps with litespeed since it's so much faster.
View 7 Replies
View Related
Dec 18, 2008
Why did my inbound traffic jump? Any ideas what could be happening here? I have this server and do not upload anything on the server?
View 12 Replies
View Related
Feb 28, 2009
if anyone had any recommendations for what kind of specs I would need for my website which currently recieves approx 150,000 u/v a day. I don't use any databases and all files are basically simple html files. I use approximately 15,000 GB a month (it is a flash games website).
I currently use GoDaddy's dedicated server but I fear it may not be enough; here are my current specs:
Operating System: Red Hat Fedora Core 8
Processor: Intel Core 2 Quad - 2.83 GHz
RAM: 4 GB
RAID: None
Bandwidth: 15000 GB
View 14 Replies
View Related
May 9, 2008
We're expecting a large spike in traffic (40k visits in one day) soon. We’re running on a very powerful server with CentOS & cPanel.
Is there any specific configuration we can setup to prepare for the large visitor spike? The website is very database and PHP intensive. We want to avoid any downtime.
View 14 Replies
View Related
Sep 19, 2008
which processor for an high traffic server?
DELL Xeon 3065 or Intel Dual Core E 2140
View 6 Replies
View Related
May 27, 2007
My dedicated server has only one site hosted in it, and we have a forum (SMF), but it seems that it cant handle the traffic on peek hours.
Dual Processor Dual Core Intel Woodcrest 5140
4 Total 2.33 GHz Cores
Dual 1333 MHz Front-side Bus (FSB)
4 MB Shared L2 Cache
8 GB 667 MHz FB-DIMM Memory (Fully Buffered)
2 x 250 GB SATA HD in Hardware RAID 1
I've talked with several people and all said that this server is enough to handle such traffic. So the problem might be on the forum software.
I've already installed eAccelerator and tweaked everything, but it still hangs when spikes occur.
Do you think that phpBB will handle such traffic better?
View 4 Replies
View Related
Dec 2, 2007
We've found out a abnormal usage of one of our servers, our RTG graphs shows:
Last 24h
IfInOctets: 30.5GB
MAX: 6.9MBits/s
AVG: 3.4Mbits/s
Cur: 4.7Mbits/s
And a strage traffic:
IfOutOctets: 42.5GB
MAX: 76.6MBits/s
AVG: 4.7Mbits/s
Cur: 600Kbits/s
We are running two websites on this server, and we looked at raw log apache, we've compilers disabled, we block most of outgoing / incoming packets on firewall, we ran chkrootkit, rkhunter and nothing was found. We checked for cronjobs, suspect files, netstat, but we can't see anything strange. We use the latest server software (apache 2.2.x), PHP 5.2.x, MySQL 4.1.x, we have most of the server optimized.
We are running iptraf now, and it seems normal:
„ Incoming rates: 85.8 kbytes/sec
„ Outgoing rates: 636.4 kbytes/sec
Anyone have an idea? And some way to properly monitor incoming traffic? I'm looking to find how/where is the source of this traffic.
View 5 Replies
View Related
Jun 4, 2009
Is there any shared host which can easily drive a wordpress blog with 100,000-150,000 unique visitors every month?
The blog in question has wp-supercache and is quite a bit tweaked and consumes roughly 30-50GB of bandwidth every month (with mod deflate enabled on server). My priorities are good uptime, fast servers and network (especially to India) and good customer support.
View 14 Replies
View Related
Jan 14, 2009
do you suggest verio for high traffic video site?
View 3 Replies
View Related
Jan 5, 2009
I have a blog that gets about 50,000 unique users a month and I'm looking for a host that would fit the bill. I'm using wordpress so that's obviously a requirement, but also I would like RoR support. Other than that I'm pretty open. My fear is just that I'll get relegated to a slow server or have my account suspended. My budget is really whatever I need to pay. I'd like to find something at $15 a month or under but I'm willing to pay up to $50 or more if need be.
I'm planning on growing the traffic more in the future so I'm not sure if I should just go for dedicated hosting now or wait. I've checked out hostgator and they seem to have good reviews and fit the bill well, I'm just not sure if they are suited for high traffic sites or not.
View 14 Replies
View Related
Aug 19, 2009
I am writing a financial statement for my business plan and like to know what numbers should I expect from the the host. If the potential traffic will reach 405,000 visitors a month what my requirements for the hosting company should be?
View 9 Replies
View Related
Aug 24, 2008
I have a client with a site (wordpress blog) that gets 10,000 + hits a day. I need to find him a dedicated managed server so that his site runs smoothly and also has no outages. I just received a quote from another host for his Managed Dedicated Servers.
CPU1: Intel Xeon 5310 Clovertown (Quad Core)
CPU2: Intel Xeon 5310 Clovertown (Quad Core)
Total CPU Cores: Eight (8)
System RAM: 6144MB (6GB) DDR2 ECC Registered System RAM
Primary Hard Disk: 73GB Serial Attached SCSI (SAS) 15,000 RPM High-Performance Hard Disk
Second Hard Disk: 250GB SATA-II 7,200 RPM Hard Disk (nightly backup disk)
Data Transfer: 2000GB Premium Monthly Bandwidth (100Mbps uplinked port)
Operating System: CentOS Enterprise Linux 5 64-Bit (x86_64)
Control Panel License: cPanel / WHM + Fantastico Auto Installer$695 a month
He posts about 5-10 blogs a day too, so it's definitely a growing community website. He also has a forum with 6500 posts and 389 members.
Is this a reasonable price for a dedicated server? Would you recommend a different configuration of hardware that might make it cheaper? I would also like some examples of other sites on similar configurations if you have any, so that I can show my client what they use.
View 7 Replies
View Related
Mar 12, 2008
The server gets around 25k unique visitors per day, but one website in particular allows hotlinking and uses a lot of bandwidth. Last time I checked...according to whm apache status page, I was getting 180 requests per second. Not sure what time it was though. So it might be higher at a different time of the day.
Recently got mod_evasive installed, but I didn't want it to block out legitimate users. Currently it's set to this...
<IfModule mod_evasive20.c>
DOSHashTableSize 3097
DOSPageCount 5
DOSSiteCount 100
DOSPageInterval 2
DOSSiteInterval 2
DOSBlockingPeriod 10
DOSBlockingPeriod 600
</IfModule>
what a better configuration would be? When I run the log I already see it block out a bunch of IP's. I don't want to lose any visitors to this program, but I do get ddos a lot.
View 1 Replies
View Related
Mar 25, 2009
We are considering a new dedicated server host for a set of 25 domains, about 5 of which are very high traffic (80 million clicks a day each).
I am told that the biggest speed boost and performance comes from memory and fast hard disk. So I'm looking for at least a 16GB RAM and SCSI 10k 300GB hard disks.
I am also told that PHP etc is okay, but MySQL is the one that hogs resources after a while. So for the database server I need a high end server.
I like WHM/Cpanel so that should be alright.
A lot of email alerts may be sent through our system (about 500,000 a day on a good day as there's user subscription to updates functionality) so we may need a separate mail server?
My question: is the following config of 4 x quadcore Dunnington Intels be good enough for the above site? Can I run a database on this config for my kind of traffic or do I need a separate server too?
Code:
Quad Processor Hex Core Intel 7450 - 2.40GHz (Dunnington) - 6 x 9MB (L2) 12MB (L3) cache
Second Processor
Hex Core Intel 7450 - 2.40GHz (Dunnington) - 6 x 9MB (L2) 12MB (L3)
Third Processor
Hex Core Intel 7450 - 2.40GHz (Dunnington) - 6 x 9MB (L2) 12MB (L3) cache
Fourth Processor
Hex Core Intel 7450 - 2.40GHz (Dunnington) - 6 x 9MB (L2) 12MB (L3) cache
16 GB FB-DIMM Registered 533/667
1000 Mbps public uplink
1000 Mbps private uplink
Disk Controller RAID 10
HD1: 300GB SA-SCSI 10K RPM
HD2: 300GB SA-SCSI 10K RPM
HD3: 300GB SA-SCSI 10K RPM
HD4: 300GB SA-SCSI 10K RPM
CentOS 5 (32 bit)
View 7 Replies
View Related
Feb 28, 2008
My video sharing site has high traffic, alexa rate:3,000
My site has 2 servers to split the load. 2 servers share a mysql server. Using rrdns to load the balance.
Server A running mysql 5.0,lighttpd
Server B running lighttpd.
Server B connect to A's mysql database.
During peak time. B can not connect to A's mysql server. It says server not responding. But A still running fine.
When I check mysql log file.
/usr/libexec/mysqld: Forcing close of thread .....
And when run top, the load average is 20.
The spec of Server A
Intel(R) Xeon(TM) CPU 3.06GHz dual core.
2G Ram.
Here is the my.cnf
Quote:
[mysqld]
datadir=/var/lib/mysql
socket=/var/lib/mysql/mysql.sock
# Default to using old password format for compatibility with mysql 3.x
# clients (those using the mysqlclient10 compatibility package).
old_passwords=1
max_connections = 1000
wait_timeout=60
connect_timeout=10
interactive_timeout=120
join_buffer_size=1M
query_cache_size=128M
query_cache_limit=2M
max_allowed_packet=16M
table_cache=1024
sort_buffer_size=2M
read_buffer_size=2M
My question, do I need another maching C to run lighttpd, and just keep mysql on A.
Or I can do some mysql optimization on A.
Also, if my site keeps going, can I have 1 mysql server and 5 http servers?
View 11 Replies
View Related
Apr 24, 2008
hosting solution for 3 very high traffic blogs, all running on WordPress.
I have been researching dedicated and I came across a couple posts where people recommended Clustered hosting over Dedicated for better handling high traffic DB driven sites in the times of Digg or Slashdot frontpage exposure.
I would like your feedback, and your opinion on what to choose from the following options:
1. Netfirms Enterprise III (Clustered)
2. ResellerZoom Failover (Clustered)
3. LiquidWeb Dedicated Webmaster Series (Dedi w/ 2GB DDR and a 3Ghz Intel Hyperthreaded)
4. HiVelocity Dedicated (Dedi w/ Quad-Core Xeon 2.4GHz and 2GB DDR)
View 5 Replies
View Related
May 31, 2008
We just ordered a new Dell server and trying to decide which flavor of Linux to use. The server is going to be used exclusively for a MySQL 5 database.
The MySQL database is very large about 9 gigs, (GIS data), and will be hit quite hard.
I was looking at CentOS and Fedora.
Here is the server specs:
2 Intel Quad Core Xeon 5410 2.33GHZ
8 Gigs Ram
2 146GB 15000RPM SAS Drives In Raid 1
View 14 Replies
View Related
Mar 28, 2008
Calling on all hosting and server experts here. (If you're not an expert, still feel free to take an educated stab at this. But please leave out total made up answers or foolish answers like "Have LittleJoeShmoe Hosting services do it all for $9.99/month".)
Scenario:
If you knew or were planning on developing a site that you knew would generate millions to tens of millions of page views a day, how would you go about supporting a site of such traffic? The site would not serve up videos, but the average page size would contain up to 75-100kB. It would incorporate databases (user logins, accounts, user submitted content, server side scripting, CMS, etc.)
Don't assume anything. Don't assume you have too little or too much money. Just, what would you plan out to accomodate such a scenario?
What hosting companies would you use? Would you do it in-house and build your own datacenter? Farm out the server management? How much would it cost to implement your plan? What platform would you recommend for a site to handle this much traffic?
View 5 Replies
View Related
Sep 16, 2007
I am currently moving from my current dedicated servers because they simply cannot handle the load. I have a site which frequently makes it onto radio, digg and other similar sites.
I need a dedicated server that can take a beating from Digg and offline Media. For most of the month the server load is really low, the site hardly uses up anything. However, when it hits those sites, it suffers.
I am OK with using Shell, just basic tars/logs/sqldumping/httpd.conf editing/rebooting etc.. anything beyond that like installing and configuring software I cant really do.
I guess I am looking at a dedicated option (linux based) with a host that'll setup software/modules modules for me when I ask, but doesn't really need to hold my hand all the time.
How are ThePlanet.com's servers? Do they manage the servers?
View 14 Replies
View Related
Apr 8, 2009
How do i setup vpn server on windows 2003 so that client traffic go through the remote vpn server? Something like strongvpn.com service which change the client ip address.
I tried setting up, now client able to connect to the server using windows vpn. But once connected, internet cannot work. How to use the vpn server as gateway?
Server have only 1 network card.
Can windows xp act as vpn server for the same purpose?
View 1 Replies
View Related
Nov 7, 2009
i have ideas about clustering server with spread country/datacenter.
example: i have 5 Server spread around the world, server 1 in US, server 2 in German, and other country for next server.
server 1 will be main server, when server 1 down, it will goes to server 2, and continue to the next server.
all site/file and other stuff will be mirror on all server.
so it will be 100% Uptime!, and never LOSS anything!.
and my question is how to do that, maybe someone expert want to share with me.
View 11 Replies
View Related
Jun 15, 2008
if I could get some input on this. Currently I'm running an Opteron 246, 2GB RAM with 2TB bandwidth/mo. I run a single site which is currently 99% HTML, along with an invision forum which is fairly popular. I get about 300-400k pageviews per day.
Right now the server is able to handle this stuff without much of a problem, and the average CPU load is between .5 and 3 (after a TON of tweaking!) - the only exception is when the forum db is being backed up/optimized, which isn't a huge problem since it happens during the off hours.
The problem is that I'm running out of bandwidth quickly, and need to come up with some kind of solution soon. My current provider offers bandwidth at $1/GB, which to me seems crazy compared to other providers, so that's not really an option.
I was thinking about switching to a more affordable provider and upgrading hardware, but I'm not sure what the best approach would be. I'm in the process of moving my HTML content over to a PHP-powered CMS, so I need to make sure whatever I do can handle that... What might be a decent setup for a site like mine which consumes a lot of bandwidth and will probably need more CPU power in the near future for PHP/MySQL stuff?
View 8 Replies
View Related
