Load Testing :: Server Load Testers ( Commercial )?
May 6, 2008
Anyone know of some good server load testers ( commercial )?
Im not looking for application based load testing, I need real web server load testing... need to see how much traffic this one site can take before it cries.
We have been doing some research on some colocation facilities lately and a question came up about load testing. I'm wondering what the standard is in regards to load testing a colocation facility.
Are they full load tests? How often are they done? How long are those tests done for?
Goggle has failed me most miserably on this..I find I need to do some serious load testing and user traffic simulation. Free software..I find..but it is almost all java-based..which..is not doable easily from a small vps. Uncle Bill has a windows based tool..but that requires a windows-based vps..and those are not cheap nor plentiful.
Ok..two directions this could go:
Linux based do-it-yourself testing and user/load simulation software
*or*
A hosted solution (with a free trial hopefully)
I had used mecury's loadrunner many moons ago..but now that hp has bought it...it seems to now be you-must-have-your-own-server solution now..and not a hosted one.
I'm having the oddest issue. For some reason, some of the websites on my server load fine, and some take a really long time to load (2 minutes).
Now, the server load is fine, and the size of the sites aren't the issue either. I've restarted Apache and a couple more services, and still the same sites seem to load very slow.
What could be causing this since it's only effecting certain websites?
I've been having trouble with my VPS for a while now. In the QoS alerts page in Virtuozzo it seems to be a problem with numtcpsock and tcprcvbuf, mainly numtcpsock.
Copy these into the browser: i18.photobucket.com/albums/b106/gnatfish/qosnumtcpsock2.jpg
I would like to know how to check load via ssh and check files causing load?
I want the ssh codes for 2 different set of control panels, one with cpanel+whm and other with kloxo+hypervm
and I would also know how to check the files causing the load, such as some files could have been interrupted while processing, so they could be causing load some times, so I want to stop such processes if any are running on the vps on my friends accounts
I built an online application using PHP / MySQL and it's pretty optimized (it's a very simple app). I've inadvertently picked up a huge client that could represent a few 1,000 "posts" per minute.
The process goes like this:
Consumer posts mobile data -> third party receives data -> third party sends data to my server -> my php script throws the data into a database.
I've got about a month to prepare things for these nightly "posts" before it's a real-life affair.
My questions are:
1) How can I "stress" or "load" test my machine and script to see what I'm up against.
2) What is my cheapest option for "redundancy" (Would something like MediaTemple's MySQL Grid products be a fix?)
When I say a few thousand posts per minute - each one is around 350 bytes.
I'm sure you may be wondering if I've bitten off more than I can chew - yea kind of but I made it perfectly clear to the client about my uncertainty and they are willing to give me benefit-of-a-doubt since I'm a very hard worker, very easy to deal with and loyal - not to mention my product is unlike any other that we have seen.
I have some serious server load issues on one of my web servers...
Hardware: Intel Pentium D 3.40GHz 1024 MB DDR RAM
Software: RH Linux with 2.6.9-42.0.3.ELsmp kernel cPanel with most recent Apache and PHP 5.2.x
Process list (top output, on a regular moment):
[url]
When everything is running normal (read: server load below 2) there's between 100 and 300 MB of free memory. Though sometimes (this happens about 2 times per day, at random times of the day) the server load dramatically increases.
I wrote a script (the chkApache.sh process in the top list) that constantly checks the server load and if it raises about 4, it will check if the sum of all httpd processes are consuming too much CPU or Memory. In this case, it will force a httpd restart... I need this to prevent Apache from crashing my server almost daily. If I let Apache do its thing without this script, it will happen that tons of httpd processes (50 and up) take in all the RAM and server load increases to 100 or more and the eventually I need to reboot the server using the SoftLayer control panel.
That chkApache script I wrote also sends me a detailed report of the state of the server when it needs to restart Apache, here's a report of an event that occurred today (includes server load info, memory info, top list, httpd processes info, netstat, etc):
[url]
In this case you would think that someone is attacking the youthforums.co.uk domain but I doubt that's the case... It doesn't always happen with that site, in fact I can't seem to find a pattern in the Apache status page so I don't think a single account is causing this...
Today I also used the Apache JMeter to "stress test" my server. I was shocked when I saw how easy it is to use that tool in order to make my server crash... I used 10 threads loading one PHP page (that makes some MySQL queries) and made a loop that kept requesting that information, with 10 connections at a time... The server load rapidly increased to 30 and above... I think it's unacceptable that something like this can happen so easilly...
I tried several things with my Apache configuration settings... Here's what I have at the moment:
LoadModule rewrite_module libexec/mod_rewrite.so LoadModule expires_module libexec/mod_expires.so LoadModule bwlimited_module libexec/mod_bwlimited.so LoadModule bytes_log_module libexec/mod_log_bytes.so LoadModule auth_passthrough_module libexec/mod_auth_passthrough.so LoadModule php5_module libexec/libphp5.so LoadModule security_module libexec/mod_security.so LoadModule evasive_module libexec/mod_evasive.so LoadModule limitipconn_module libexec/mod_limitipconn.so Does anyone have an idea what's wrong here? Anything I can do to get more detailed information on what's causing this? I've been on this problem for weeks now but I can't seem to find any proper solution.
In case it matters I'm also running: SIM, RPM, BFD, APF and SPRI
how the load on your web hosting machines looks like. I've seen companies that keep the load at values of 10-15 units and the server is still responsive. Though there might be different reasons for the high load and it's a sure indication for an upcoming problem it doesn't seem normal to have this high load on a hosting server. (well actually it would if the machine was running on 16 cpus but it's a normal dual xeon woodcrest for example).
I've very strange problem, server load reache to 290
I couldn't detrmine process casue it httpd, MySQL or exim, i typed small script to calculate server status every 5 minutes it's shoot of result of script
Code:
server time now is 20-01-07-11:40:00 AM -------------------------------- 11:41:01 up 2 days, 23:30, 0 users, load average: 18.69, 9.40, 5.21 ///////////////////////////// Uptime: 109830 Threads: 154 Questions: 7360473 Slow queries: 4330 Opens: 183336 Flush tables: 1 Open tables: 512 Queries per second avg: 67.017 ///////////////////////////// Current HTTP request: 106 *********************************** *********************************** server time now is 20-01-07-11:50:00 AM 11:53:16 up 2 days, 23:43, 0 users, load average: 205.83, 144.73, 74.31 ///////////////////////////// Uptime: 110565 Threads: 501 Questions: 7390472 Slow queries: 5156 Opens: 184687 Flush tables: 1 Open tables: 512 Queries per second avg: 66.843 ///////////////////////////// Current HTTP request: 260 *********************************** ***********************************
problem solved after restart httpd, MySQL and exim, but i need final solution. it's server specs:- CPU: Quad Xeon 3.0 GHz RAM: 2 GB O.S: CentOS 4.4
Also I installed apf firewall, but can not install ant ddos module on Apache because clients from arab Gulf area connected to internet using same IP.
I dont know much about what could be cuasing this so i come to you for advice, i am currently at wired tree on their VPS384 package with 348MB of ram and my site is really slow to load [url]sometimes it is so embaressing to show people i just dont bother, i am sure this is deferring visitors from my content how can i speed this up?
I can add more ram but it will push the price and if the price goes too high i might aswell move to a Hybrid with wiredtree.
Spent a lot of time on this and out of ideas so would appreciate any help. There is one site (database driven forum) with about 300 online at the peak. At peak the load spikes at 6-7 and CPU and RAM usage are very low...
I've never fully understood load averages, I've read articles about what it means but I still don't fully grasp what they are and their meaning.
For example, if I'm to understand correctly, if the amount of processors is greater than the load, then the server is not behind on processing. For example, if a server has a load average of 3.4 and is quad core, this would mean it's not 'under strain', correct?
I have a dedicated server, 2 3GHZ CPUs and the following load averages:
Quote:
Load Averages3.25 3.61 3.69
Does this equate to my server being strained, or handling fine?
Since the past few months I am facing cpu load on a server. The server is a Intel Xeon server with 4 gigs of RAM. Today the load average went over 150 which is very high. I could not access the server to check what is causing such a high load. I had to reboot the server using Remote Power switch. Is there a way I can find out the cause of the heavy load after the server is reboot? Is there any log where all the information is stored?
We've been running 2 web servers for our own use for a few years now. We're not sys admins, but have learned a lot in this time! We sometimes have a problem where a server gets high load and takes the server down effectively - we now have a couple of hundred domains on each server - and because we don't know as much about what we are doing than we should we are blind to how to determine what caused it. What would be useful is what other people do to monitor load (we have installed Cacti).
Ideally it would be great if we could pinpoint WHAT is causing the load and also WHO - ie which of the sites/domains on the server are causing it.
do you know what my server having very strange problem my server load suddenly increas after every 2 or 3 days some time after 1 days but when we talk about those days in which server load is fine then that time server load very low almost 0.4 to 0.1 .
But on that high load day server load reached upto 500.
when i try to find out what wrong then i only get that there is too much connection of http when i kill httpd through this killall -KILL httpd then server load suddenly decrease and then stable.
My server gets 300 - 600 concurrent connections to http port 80, has a CPU load of 1 - 2%, has practically all RAM of 1 GB used, is running apache 2 and centos 5.
It tends to get slow and when I ban IPs that use many connections to my server (raping it), it becomes fast again. But soon after that new ******* users come which I again ban and the process repeats itself
I'm starting to think that maybe I just don't have enough RAM to handle them because it seems at least some of those users are legit. I don't however have even that much content that needs to be cached so I'm not sure what good RAM would do but perhaps apache just needs more.