My video sharing site has high traffic, alexa rate:3,000
My site has 2 servers to split the load. 2 servers share a mysql server. Using rrdns to load the balance.
Server A running mysql 5.0,lighttpd
Server B running lighttpd.
Server B connect to A's mysql database.
During peak time. B can not connect to A's mysql server. It says server not responding. But A still running fine.
When I check mysql log file.
/usr/libexec/mysqld: Forcing close of thread .....
And when run top, the load average is 20.
The spec of Server A
Intel(R) Xeon(TM) CPU 3.06GHz dual core.
2G Ram.
Here is the my.cnf
Quote:
[mysqld]
datadir=/var/lib/mysql
socket=/var/lib/mysql/mysql.sock
# Default to using old password format for compatibility with mysql 3.x
# clients (those using the mysqlclient10 compatibility package).
old_passwords=1
max_connections = 1000
wait_timeout=60
connect_timeout=10
interactive_timeout=120
join_buffer_size=1M
query_cache_size=128M
query_cache_limit=2M
max_allowed_packet=16M
table_cache=1024
sort_buffer_size=2M
read_buffer_size=2M
My question, do I need another maching C to run lighttpd, and just keep mysql on A.
Or I can do some mysql optimization on A.
Also, if my site keeps going, can I have 1 mysql server and 5 http servers?
I own an anime linking site which you guessed it links to anime. I have around 10000 hits a day and would like a vps with litespeed since it's so much faster.
We expect a site on one of our boxes to receive a significantly high level of traffic tomorrow as it is an event that will be covered and has already been covered by the press. The site operator expects > 100,000 hits a second.
It's a PHP page that pulls records from a database and lets people submit a form to insert a record. We have already put a caching script in place so that refreshing the page does not result in doing another database query.
The site was overloading a shared server, and we've moved it to one of our VPS boxes - it's the only VPS on the system at the moment. The box is a Quad Xeon 5410 with 4GB RAM with a 4 10K RPM drives in a RAID5 setup.
I am writing a financial statement for my business plan and like to know what numbers should I expect from the the host. If the potential traffic will reach 405,000 visitors a month what my requirements for the hosting company should be?
We're expecting a large spike in traffic (40k visits in one day) soon. We’re running on a very powerful server with CentOS & cPanel.
Is there any specific configuration we can setup to prepare for the large visitor spike? The website is very database and PHP intensive. We want to avoid any downtime.
I have a client with a site (wordpress blog) that gets 10,000 + hits a day. I need to find him a dedicated managed server so that his site runs smoothly and also has no outages. I just received a quote from another host for his Managed Dedicated Servers.
CPU1: Intel Xeon 5310 Clovertown (Quad Core) CPU2: Intel Xeon 5310 Clovertown (Quad Core) Total CPU Cores: Eight (8) System RAM: 6144MB (6GB) DDR2 ECC Registered System RAM Primary Hard Disk: 73GB Serial Attached SCSI (SAS) 15,000 RPM High-Performance Hard Disk Second Hard Disk: 250GB SATA-II 7,200 RPM Hard Disk (nightly backup disk) Data Transfer: 2000GB Premium Monthly Bandwidth (100Mbps uplinked port) Operating System: CentOS Enterprise Linux 5 64-Bit (x86_64) Control Panel License: cPanel / WHM + Fantastico Auto Installer$695 a month
He posts about 5-10 blogs a day too, so it's definitely a growing community website. He also has a forum with 6500 posts and 389 members.
Is this a reasonable price for a dedicated server? Would you recommend a different configuration of hardware that might make it cheaper? I would also like some examples of other sites on similar configurations if you have any, so that I can show my client what they use.
The server gets around 25k unique visitors per day, but one website in particular allows hotlinking and uses a lot of bandwidth. Last time I checked...according to whm apache status page, I was getting 180 requests per second. Not sure what time it was though. So it might be higher at a different time of the day.
Recently got mod_evasive installed, but I didn't want it to block out legitimate users. Currently it's set to this...
what a better configuration would be? When I run the log I already see it block out a bunch of IP's. I don't want to lose any visitors to this program, but I do get ddos a lot.
I'm working on launching this online store for a poster designer, and we're becoming more and more aware that we need a really robust and fast server. This site is looking at extremely high levels of activity whenever this designer posts a new poster. We're talking 1700 people surfing the store (downloading med-high resolution poster images) and 300 posters sold in 16 seconds kind of thing.
So, we need a really robust hosting, to work with PHP5 and MYSQL.
My previous go-to hosting provider was Lunarpages, but their customer service has gone down the crapper, and I've just about had it with them. My main questions are: Should I be looking into getting a dedicated server, or are there hosting companies that can handle this kind of traffic on a shared server? I don't have experience administrating a server, so if we got a dedicated one we would have to pay the host to do at least some of the setup/administration, I would assume? Dedicated server or not, what's a hosting company that has really good customer service, where we can be assured of getting somebody knowledgeable without having to wait on hold for 20 (or even 10) minutes?
I have a site that is eating up my server resources and need to know what the best solution for this is. I'm thinking of getting another server just for mysql but do not know what specs the server should be to handle the current traffic/database load and have the site run smoothly without slowing down to a snail's pace.
An alternative is to get another server just for the videos being served and leave the database and html on the current server. This is where I'm stuck and don't know what route to take with this.
I've attached screenshots of top and bandwidth usage per day. Hopefully with this information you could tell me if I need another server or if there are any things I can do to the current server to help things move faster.
We have a client that is normally low use. about 200+ hits per day. They are a non-profit, and get TV coverage (like the Today show, Dateline, NBC nightly news, and coming up here soon final 4 news spot) about once a month. When this happens, they get 60k hits a day.
they crash my dedicated server a few times. I have a dual p4 w/ 2 gb of ram. I only have 60 clients on this server, but as they get more coverage, our server cant take this many hits.
I just want to ask. my ISP told me my server is generating high traffic from outside and paste me their traffic log with 1 IP address (xx.xx.xx.xx)
They rebooted my server and the problem disappear but I need to check what has been going on and where do I start? The only information I have is the IP xx.xx.xx.xx
if anyone had any recommendations for what kind of specs I would need for my website which currently recieves approx 150,000 u/v a day. I don't use any databases and all files are basically simple html files. I use approximately 15,000 GB a month (it is a flash games website).
I currently use GoDaddy's dedicated server but I fear it may not be enough; here are my current specs:
We've found out a abnormal usage of one of our servers, our RTG graphs shows:
Last 24h IfInOctets: 30.5GB MAX: 6.9MBits/s AVG: 3.4Mbits/s Cur: 4.7Mbits/s
And a strage traffic: IfOutOctets: 42.5GB MAX: 76.6MBits/s AVG: 4.7Mbits/s Cur: 600Kbits/s
We are running two websites on this server, and we looked at raw log apache, we've compilers disabled, we block most of outgoing / incoming packets on firewall, we ran chkrootkit, rkhunter and nothing was found. We checked for cronjobs, suspect files, netstat, but we can't see anything strange. We use the latest server software (apache 2.2.x), PHP 5.2.x, MySQL 4.1.x, we have most of the server optimized.
We are running iptraf now, and it seems normal: „ Incoming rates: 85.8 kbytes/sec „ Outgoing rates: 636.4 kbytes/sec Anyone have an idea? And some way to properly monitor incoming traffic? I'm looking to find how/where is the source of this traffic.
Whenever I run the "top" command, I see that some of the user "mysql" records always have very high CPU usage, anywhere from 20-80% on average (I've seen 100%). There are multiple records that show this, which means that the CPU is always above 100%. My cacti monitoring account also shows messed up CPU statistics.
I am not too knowledgeable with servers, but I believe that this is a problem. How much CPU usage is a mysqld command supposed to use on average? Here is a copy of the top part of a sample top command:
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 21663 mysql 24 6 63032 30m 3004 R 66 1.5 38:24.06 mysqld 28483 mysql 24 6 63032 30m 3004 R 66 1.5 35:52.86 mysqld 20538 mysql 22 6 63032 30m 3004 S 15 1.5 40:29.74 mysqld 20837 mysql 24 6 63032 30m 3004 R 15 1.5 13:44.15 mysqld 1209 mysql 22 6 63032 30m 3004 S 11 1.5 32:46.26 mysqld 20591 mysql 22 6 63032 30m 3004 S 11 1.5 40:02.76 mysqld 20592 mysql 23 6 63032 30m 3004 S 6 1.5 40:48.29 mysqld 15301 apache 19 4 29928 15m 3608 S 3 0.8 0:00.60 httpd 15317 apache 19 4 28380 14m 3640 S 3 0.7 0:00.58 httpd 15249 apache 19 4 28612 14m 3732 S 1 0.7 0:01.49 httpd 15349 apache 19 4 28876 14m 3324 S 1 0.7 0:00.10 httpd 15319 apache 19 4 28368 14m 3528 S 1 0.7 0:00.34 httpd 15334 apache 19 4 28612 14m 3404 S 1 0.7 0:00.35 httpd 12343 root 15 0 2324 1088 804 R 1 0.1 0:03.31 top 15336 apache 19 4 28876 14m 3500 S 0 0.7 0:00.63 httpd 1 root 15 0 2064 588 508 S 0 0.0 1:01.28 init 2 root RT -5 0 0 0 S 0 0.0 0:09.39 migration/0 3 root 34 19 0 0 0 S 0 0.0 0:01.25 ksoftirqd/0 4 root RT -5 0 0 0 S 0 0.0 0:00.00 watchdog/0 =================================
I told my system manager about the cpu problem, and he said that he installed the cpulimit function on my server. I'm not sure if this is a good solution.
MySQL the last few days seems to be constantly the most demanding process in top, which it never was before. As far as I can tell, nothing has substantially changed with regards to traffic to MySQL driven sites on the server. Is there anything that might be wrong with the databases, etc., that might throw MySQL into a tizzy?
So I requested a total of 5 to 6 times for a reboot from my DC. Whenever I try to start my AFP firewall, it just hang my server. Even after I reinstall AFP and start it, it still hang my server! Is there any log file where I can keep track of the problem?
Is there any shared host which can easily drive a wordpress blog with 100,000-150,000 unique visitors every month?
The blog in question has wp-supercache and is quite a bit tweaked and consumes roughly 30-50GB of bandwidth every month (with mod deflate enabled on server). My priorities are good uptime, fast servers and network (especially to India) and good customer support.
I have a blog that gets about 50,000 unique users a month and I'm looking for a host that would fit the bill. I'm using wordpress so that's obviously a requirement, but also I would like RoR support. Other than that I'm pretty open. My fear is just that I'll get relegated to a slow server or have my account suspended. My budget is really whatever I need to pay. I'd like to find something at $15 a month or under but I'm willing to pay up to $50 or more if need be.
I'm planning on growing the traffic more in the future so I'm not sure if I should just go for dedicated hosting now or wait. I've checked out hostgator and they seem to have good reviews and fit the bill well, I'm just not sure if they are suited for high traffic sites or not.
creating a setup that will host a site which is expected to receive 50-60K visitors in the first few hours after its launch. The site is membership based and the backend (member system) runs on PHP5-MySQL5.
Here is what I have thought of until now.
Site's sales page (which also happens to be the first page that visitors hit) hosted with Amazon S3 service. All public media files are off loaded to amazon S3 service to keep the number of requests on the hosted setup to minimum.
At the front we can have a high performance firewall like Cisco ASA 5520 followed by two dedicated load balancers in Active/Active state.
Behind the load balancers we have 3 front end servers acting as web-servers. These have SAS disks, 4GB RAM, RAID 1 setup, Dual Xeon Quad core processors each.
Behind the front end servers - we have a dedicated load balancer for the database cluster.
The database cluster consists of 3 Storage/API nodes and one of the front end servers acts as the management node. Each storage node has 8GB RAM, Dual Xeon Quad core processors, 4x RAID 10, SAS setup.
The private network is on a GigaLan.
Do you see any possible/obvious flaw in this design or anything that should be added/subtracted from the setup?
So the site got featured on [url]and now the server is drowning...
The Coppermine Gallery usually hovers around 30~50 users daily and now, 1800, and im at a lost as how I should configure mysql to take on such a load. right now it takes about 10 secs or more to load a page and sometimes it would time out. Because it si coppermine, all pages are dynamic and can't be cached -_-"
Here's the my.cnf right now after i played around with the numbers
server spec Opteron 170 (2ghz) 2gb ram 250 7200rpm
# # KeepAlive: Whether or not to allow persistent connections (more than # one request per connection). Set to "Off" to deactivate. # KeepAlive Off
# # MaxKeepAliveRequests: The maximum number of requests to allow # during a persistent connection. Set to 0 to allow an unlimited amount. # We recommend you leave this number high, for maximum performance. # MaxKeepAliveRequests 100
# # KeepAliveTimeout: Number of seconds to wait for the next request from the # same client on the same connection. # KeepAliveTimeout 15
# prefork MPM # StartServers: number of server processes to start # MinSpareServers: minimum number of server processes which are kept spare # MaxSpareServers: maximum number of server processes which are kept spare # ServerLimit: maximum value for MaxClients for the lifetime of the server # MaxClients: maximum number of server processes allowed to start # MaxRequestsPerChild: maximum number of requests a server process serves <IfModule prefork.c> StartServers 8 MinSpareServers 5 MaxSpareServers 20 ServerLimit 200 MaxClients 200 MaxRequestsPerChild 1500 </IfModule>
# worker MPM # StartServers: initial number of server processes to start # MaxClients: maximum number of simultaneous client connections # MinSpareThreads: minimum number of worker threads which are kept spare # MaxSpareThreads: maximum number of worker threads which are kept spare # ThreadsPerChild: constant number of worker threads in each server process # MaxRequestsPerChild: maximum number of requests a server process serves <IfModule worker.c> StartServers 2 MaxClients 150 MinSpareThreads 25 MaxSpareThreads 75 ThreadsPerChild 25 MaxRequestsPerChild 0 </IfModule>
if I could get some input on this. Currently I'm running an Opteron 246, 2GB RAM with 2TB bandwidth/mo. I run a single site which is currently 99% HTML, along with an invision forum which is fairly popular. I get about 300-400k pageviews per day.
Right now the server is able to handle this stuff without much of a problem, and the average CPU load is between .5 and 3 (after a TON of tweaking!) - the only exception is when the forum db is being backed up/optimized, which isn't a huge problem since it happens during the off hours.
The problem is that I'm running out of bandwidth quickly, and need to come up with some kind of solution soon. My current provider offers bandwidth at $1/GB, which to me seems crazy compared to other providers, so that's not really an option.
I was thinking about switching to a more affordable provider and upgrading hardware, but I'm not sure what the best approach would be. I'm in the process of moving my HTML content over to a PHP-powered CMS, so I need to make sure whatever I do can handle that... What might be a decent setup for a site like mine which consumes a lot of bandwidth and will probably need more CPU power in the near future for PHP/MySQL stuff?
I have a fairly high end server in which I have installed SIM. SIM is restarting Apache up to 10 times a day, presumably due to high load causing un-availability.
On restart, Apache / MYSQL is stable until the load / mem usage begins to climb then it is restarted again. Here are my 'load' stats for today:
Load for today High (2:18am): 4.63 Low (3:30am): 1.20 Mean: 1.84 Latest: 1.61
Mem usage for today High (1:36am): 9,192.9 MB Low (1:48am): 7,995.7 MB Mean: 8,683.1 MB Latest: 8,781.7 MB
I have seen it using 20GB RAM before.
I have tried to follow various optimisation guides but these seem tailored to less powerful servers.
The web application I run on this server is almost entirely MYSQL based, with thousands of DB calls a day. Across the entire system I probably get 200,000 bot hits per day or even more. At peak times search engine bots are literally hammering the server.
