I currently have a vps server from GIGEServers, running at 512mb of dedicated and 1024mb spike it seems like apache is using alot of resources, does anyone know of a less hog, or tips on tweaking it, and the same for mysql server any tips on tweaking.
View 14 RepliesI have two vps's n ifferent hardware, after my hoster performed an update to node I am now seeing high loads on both vps's
When I reboot the problem goes for a while
My servers host very little websites and little activity and normally run fine
I have notice a process "unhide" running, what is this and where should I start looking for this issue
[root@vps ~]# top
top - 18:47:59 up 1 day, 6:51, 1 user, load average: 1.96, 1.95, 1.92
Tasks: 62 total, 2 running, 60 sleeping, 0 stopped, 0 zombie
Cpu(s): 0.0% us, 2.8% sy, 1.1% ni, 96.0% id, 0.0% wa, 0.0% hi, 0.0% si
Mem: 1048576k total, 143908k used, 904668k free, 0k buffers
Swap: 0k total, 0k used, 0k free, 0k cached
Unknown command - try 'h' for help
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
23980 root 26 10 1872 876 316 S 2.0 0.1 4:40.86 unhide
1 root 15 0 1644 568 484 S 0.0 0.1 0:03.76 init
1982 root 17 0 6412 1828 1124 S 0.0 0.2 0:00.00 crond
1985 root 18 0 2120 900 784 S 0.0 0.1 0:00.00 run-parts
3228 root 18 0 3252 1028 896 S 0.0 0.1 0:00.00 01-rkhunter
3229 root 18 0 1888 548 460 S 0.0 0.1 0:00.00 awk
3665 apache 15 0 39700 18m 6036 S 0.0 1.8 0:05.14 httpd
5771 apache 15 0 39540 16m 4516 S 0.0 1.6 0:01.14 httpd
7837 root 26 10 11320 9272 976 S 0.0 0.9 0:07.64 rkhunter
9958 apache 15 0 39608 18m 6024 S 0.0 1.8 0:02.84 httpd
11611 root 15 0 8584 2532 1964 S 0.0 0.2 0:00.01 sshd
11831 root 16 0 6144 476 324 S 0.0 0.0 0:00.00 vzctl
11836 root 16 0 2184 1264 1048 S 0.0 0.1 0:00.00 bash
13789 root 16 0 1548 528 436 S 0.0 0.1 0:00.38 syslogd
13794 root 18 0 1484 368 308 S 0.0 0.0 0:00.00 klogd
14022 apache 15 0 39432 15m 3868 S 0.0 1.6 0:00.72 httpd
17612 root 18 0 4056 1052 756 S 0.0 0.1 0:00.00 sshd
I have a Quad Core Xeon server with 2 GB RAM. The server has some high traffic websites & at peak hours (4-5 hrs a day) the server load remains 10.0 to 50.0.
The sites on the server load very slow at these times. Here's the top result during heavy load
[url]
I normally don't like too bother others with my problems but this time It seems I have no choice since I spent the whole afternoon trying to find out what the problem was and couldn't solve it "entirely".
Here's some hardware info:
Processor Information Processor #1 Vendor: GenuineIntel
Processor #1 Name: Intel(R) Xeon(R) CPU 3050 @ 2.13GHz
Processor #1 speed: 2133.418 MHz
Processor #1 cache size: 2048 KB
Processor #2 Vendor: GenuineIntel
Processor #2 Name: Intel(R) Xeon(R) CPU 3050 @ 2.13GHz
Processor #2 speed: 2133.418 MHz
Processor #2 cache size: 2048 KB
Memory Information Memory: 1031324k/1048320k available (2182k kernel code, 16308k reserved, 914k data, 240k init, 130816k highmem)
System Information Linux **************** 2.6.20-1.2320.fc5smp #1 SMP Tue Jun 12 19:40:16 EDT 2007 i686 i686 i386 GNU/Linux
Running Fedora Core 5 and working for over half year with almost no major problems, but today something totally weird just happened...
After waking up I logged to the server and realized how slow it was, I went to see more about that and for my surprise the loading was around 8 so I went to the mail queue to see if there were a few thousand mails, there were 16 mails... So I went to the see CPU % processes at WHM and I was stunted to see around 30 processes allegedly using over 11500% of the CPU or more!
My first thought was that cPanel smoked something before releasing a last update and I didn't realized it immediately so I downgraded from Release to Stable.
Nothing happened and I lost my time with this overheated overloaded and over-everything and I didn't changed any configuration.
I changed many old configs that... I don't know, might crashed with something that might changed... I was trying and looking for anything.
The load was getting up instead of down, it went up to around 60.
The final conclusion is that whenever I turn the MySQL on I got overwhelming loads otherwise the other services "only" give me around 1.5 of load but still very unstable.
I'm getting a little tired so my explanation may be a little confusing, sorry about that.
Anybody knows what this is? Did this ever happened to you? Extremely high loads without an obvious reason? If anyone could help me I would be thankful for that, I'm getting kind of desperate.
We are having a problem with our Linux dedicated server. At time we are getting high server loads witch is causing the server to go down and reboot. This problem has been going on for over a month now and still liquid web can not tell me what is the cause of the high loads. We have upgraded our RAM to 2 GB. This look to fix the problem for the first week but now we are back to having high loads and downtime.
I'm not a IT person so do not know how to find the problem. Can anyone tell me what I can do the locate the problem. I do know how to access and do some things in the root but do not know enough to find and fix this issue.
Recently, we've been getting a lot of high loads (every 30 mins or so..) This is what shows in the warning email that we receive:
---------------------------------
12.0 04:31:35 /usr/sbin/mysqld --basedir=/ --datadir=/var/lib/mysql --user=mysql --pid-file=/var/lib/mysql/swh.sellwebhost.com.pid --skip-external-locking
----------------------------------
We are using whm.. Any idea what might be causing this?
Two of my VPS's with a company are now showing very high memory loads, even after a reboot, both server are located on different nodes and they both shot up to high ram loads at the same time today(9amGMT) ....
View 4 Replies View Relatedhas anyone else noticed an unusually high load occurring from 9 till 11 EEST time on their servers?
I've been getting high loads everyday this week at exactly these times.
I'm thinking that this is a crawler/bot that is causing the loads, i've already installed dos deflate and there hasn't been more than 100 connections from the same ip, so I'm ruling out any DOS attack ... besides, what kind of attack only takes place for 2 hours a day at exactly the same time?
I'm on a cpanel system and would like to know which logs to take a look at to determine the cause.
We just upgraded to VBulletin 3.6.5, and are experiencing strange behavior. My forums are on a dedicated server, 27,000 users.
We'll be running along fine with loads of .5-2.00, etc. Then suddenly, the loads start climbing to 50, 70, 85+. We've been trying to figure out why. We even went on a different (much more robust) server, still the same result. This only started happening after the upgrade. Restarting the server corrects the problem, but only until it happens again. It can happen at anytime - during peak or off peak. The server may run for an hour or two until this happens, or it can happen 10 minutes after a restart.
Late last night when loads were normal we benched the server hard, and it ran just fine. We just can't figure out where this load spike is coming from.
Server info below:
Servers:
Mysql: server version: 5.0.27-log
PHP: PHP 5.1.6 (cli) Zend Engine v2.1.0,
Apache Server version: Apache/2.2.3
Kernel: 2.6.19-1.2911.fc6 #1 SMP
Server:
Pentium III with 1 gig of ram
15k RPM SCSI Raid 5
1 Gig RAM
-----------------------------------------------------------------------
[root@forums forums]# cat /proc/cpuinfo
processor : 0
vendor_id : GenuineIntel
cpu family : 6
model : 8
model name : Pentium III (Coppermine)
stepping : 6
cpu MHz : 861.001
cache size : 256 KB
fdiv_bug : no
hlt_bug : no
f00f_bug : no
coma_bug : no
fpu : yes
fpu_exception : yes
cpuid level : 2
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca
cmov pat pse36 mmx fxsr sse
bogomips : 1722.41
processor : 1
vendor_id : GenuineIntel
cpu family : 6
model : 8
model name : Pentium III (Coppermine)
stepping : 6
cpu MHz : 861.001
cache size : 256 KB
fdiv_bug : no
hlt_bug : no
f00f_bug : no
coma_bug : no
fpu : yes
fpu_exception : yes
cpuid level : 2
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca
cmov pat pse36 mmx fxsr sse
bogomips : 1721.51
--------------------------------------------------------------------------
my.cnf:
[root@forums forums]# cat /etc/my.cnf
[mysqld]
datadir=/var/lib/mysql
socket=/var/lib/mysql/mysql.sock
log_error = /var/log/mysql_error.log
log-slow-queries = /var/log/mysql_slow_queries.log
safe-show-database
old_passwords
back_log = 20
skip-innodb
key_buffer_size = 256M
myisam_sort_buffer_size = 64M
join_buffer_size = 1M
read_buffer_size = 1M
sort_buffer_size = 2M
table_cache = 600
thread_cache_size = 384
wait_timeout = 35
connect_timeout = 10
tmp_table_size = 64M
max_heap_table_size = 64M
max_allowed_packet = 64M
max_connect_errors = 10
read_rnd_buffer_size = 524288
bulk_insert_buffer_size = 8M
query_cache_limit = 4M
query_cache_size = 48M
query_cache_type = 1
query_prealloc_size = 163840
query_alloc_block_size = 32768
default-storage-engine = MyISAM
[mysql.server]
user=mysql
basedir=/var/lib
[mysqld_safe]
err-log=/var/log/mysqld.log
pid-file=/var/run/mysqld/mysqld.pid
open_files_limit = 8192
[mysqldump]
quick
max_allowed_packet = 16M
[myisamchk]
key_buffer = 64M
sort_buffer = 64M
read_buffer = 16M
write_buffer = 16M
-------------------------------------------------------
Relevant Apache:
StartServers 10
MinSpareServers 10
MaxSpareServers 15
ServerLimit 256
MaxClients 90
MaxRequestsPerChild 1000
---------------------------------------------------------
its 2am night here, and my sites are down....now there is no way i have too much traffic at midnight, also all my websites are new !
this is happening consistently since today morning and im getting no support apart from jargon filled replies from customer care
how do i tweak apache settings and what settings do i make to avoid this ?
im wondering what will happen after few months when my websites actually have good traffic coming in ?
We have checked your server. Please see the load average and process list given below:
The value 4.42 was the CPU load average at the time. A normal load should be below 1.00. I could see that Apache service is causing high load in your server.
So you can tweak Apache in order to reduce the CPU load. Please check and let us know if you need any further assistance.
++++++++++++++++++
[root@chi07 ~]# vzctl exec 18403 w
03:16:20 up 2 min, 0 users, load average: 4.42, 1.42, 0.50
USER TTY FROM LOGIN@ IDLE JCPU PCPU WHAT
Im using apache2.2 on Ubuntu 12.04. Im trying to password protect a page using htacces and/or the directory command.
Basically no matter what method I use to try and password the index page it doesnt work. I can protect pages and dir's below, but not in the root www of a vhost.
basically:
/home/cackles/mysite with index.html and .htaccess will allow index.html to load and wont prompt for a pass until the page is refreshed.
/home/cackles/mysite/subdir will prompt for a pass before it goes any further.
I purged and started from scratch again last night and for nothing, it would seem, well I learned/refreshed a few things so it wasnt a complete bust ... just 7hrs
My server is very slow, High CPU, High Apache load....
I got a new server and i had setup a script on it.
No server tweaks has been done.
I run a filehosting site so it gets very slow when traffic is high.
Here is some info:
Code:
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
4135 filedip 19 0 12812 8892 2212 R 18.9 0.4 0:00.74 index.cgi
3140 apache 15 0 22624 9604 2768 S 17.3 0.5 1:54.45 httpd
3556 apache 15 0 22792 9592 2768 S 17.3 0.5 0:43.53 httpd
3739 apache 15 0 22672 9556 2744 S 17.3 0.5 1:09.67 httpd
3884 apache 15 0 22664 9560 2744 S 17.3 0.5 0:23.98 httpd
3474 apache 15 0 22672 9572 2756 R 16.1 0.5 1:34.09 httpd
3548 apache 15 0 22792 9560 2740 S 16.1 0.5 1:33.67 httpd
3991 apache 15 0 22640 9588 2756 S 15.1 0.5 0:22.44 httpd
3475 apache 15 0 22672 9580 2756 S 13.2 0.5 1:31.42 httpd
3493 apache 15 0 22664 9592 2768 S 12.9 0.5 1:15.52 httpd
3769 apache 15 0 22664 9580 2756 S 12.9 0.5 0:45.19 httpd
3638 apache 15 0 22664 9576 2756 S 12.3 0.5 0:32.82 httpd
3724 apache 16 0 22664 9580 2756 R 12.3 0.5 0:34.25 httpd
3626 apache 15 0 22672 9580 2756 S 11.7 0.5 0:52.54 httpd
4023 apache 16 0 22792 9560 2740 R 11.3 0.5 0:13.16 httpd
3882 apache 15 0 22664 9576 2756 S 10.1 0.5 0:38.56 httpd
3005 apache 15 0 22672 9588 2768 R 9.1 0.5 2:06.61 httpd
I dont know much about server managment...
how to fix this so server doesnt go slow?
I'm considering the advantage of using some of my hosting space/accounts to offer an affordable reseller package. (Yes, I do have permission to do this)
Anybody got advice/tips on how you've/would set this up?
We have a linux server running cPanel/WHM and using Exim for mail, we're also using SpamAssassin to label messages as spam. I have made a few modifications to settings and installed things like DomainKeys, but am wondering if I am doing enough.
My objectives are to:
1) Prevent mail users on the server from being inundated with spam, and/or be able to effectively manage any spam that does come through.
2) Ensure that messages that my mail users send out remains as highly deliverable as possible.
3) Make it difficult for third parties to exploit my mail server for their own spamming needs.
Are there any good tutorials out there on this stuff that should at least cover some of my bases? Where should I begin? The only thing preventing me from hiring out the work to someone else is that I'd like to learn how to do it myself.
We're currently testing Postini after checking with Message Labs, etc and it seemed that Postini was the most highly recommended out of all of them. We shall see, as there does seem to be ALOT that get past their filters with spam level filtering set at their most sensative level.
However, what could I do for accounts with Hosting Firms. We have a couple on Pair, and while they use SA, their filters doesn't seem to be really effective at all. Users can come in over the weekend, and have 5 valid emails out of 200 junk......
BTW, has anyone used any of the spam appliances out there lately.
We tested them about 1.5 years back and none were really effective
Customer wants to move his website in-house along with his email. The hardware guy installed a windows 2003 64-bit exchange server. I logged in with logmein and created a directory c:Inetputwwwroot hewebsite. Copied iisstart.html to the new dir. Put the company name in the iisstart file. Opened IIS6. Went to properties of the default website and pointed to the new directory on the home dir page. Added iisstart.html the Documents page and moved it to the top. Closed everything. Opened Internet Explorer 7 and put in http://localhost. All worked well. Brought up the new start page. Opened IE7 on my pc and put there ip address in and it also brought up the new webpage (tested the port 80 in the router). Said we were ready to go.
The hardware guy sent me an email stating that he was having problems with the 64-bit version and took the server back to the 32-bit version of windows exchange server. I logged back in with logmein and followed the same exact steps as above but it will not show the new webpage. Am getting a page not found error.
I have done the above on several 2003 servers and several xp pro machines. Always works.
Have done one 2003 exchange server. Went to a couple of those servers and made sure the default website settings were exactly the same as the ones that work. Still no help.
Downloaded an iis6 troubleshooting program from microsoft but cannot locate the error. I have been studying the II6 documentation and 2003 exchange server documentation. Went thru all the tutorials in google on iis6 and exchange I can find no help.
I've search around quite a bit, but I can't seem to find a clear answer.
I've turned on mod_status, and on the status page, I'm worried Apache is being overworked.
Code:
CPU Usage: u334.883 s94.5703 cu177.422 cs0 - 43.3% CPU load
54.1 requests/sec - 181.5 kB/second - 3435 B/request
178 requests currently being processed, 52 idle workers
__RKKK__K___KW_CKCKC_KC_KCK_KKCCK_K_KKWCKCCKCWKKKCRCKKKK._K_C__K
KK_K__K_K_KK_C_KKKKK_KKW.KRCKWKKW_CCKWKRK..___KKCKKKKKKKR_KKKW.W
_KK_____RKRC.KKCKCCRK__CK._KWCK_KKRCCK.C__CR.CWCCKCRKK.RR.K_CR_K
C_KW._._K.K..KKK_KRCCKWKK__..R.CRWCKK.KCK.K.KK_K....._...KK.....
......KC.CK...C...CK......W........C............................
................................................................
................................................................
................................................................
At the time I took this particular snapshot, it's not near its peak... it's not uncommon for the CPU load approach 60%. Reading around, it seems the CPU load should normally be under 1% (such as 0.0139% or what-not). Is this true?
The weird thing though... I have no idea where that number is coming from, because according to "top", the CPU is actually 90% idle.
Here is my Apache MPM settings:
Code:
ServerLimit 512
<IfModule mpm_prefork_module>
StartServers 10
MinSpareServers 15
MaxSpareServers 50
MaxClients 1024
MaxRequestsPerChild 0
</IfModule>
I actually just raised the MaxClients from 512 to 1024 because I was hitting a constant cap of 40 requests/sec... and I was worried it was going to bottleneck. When I raised that value, the max requests per second now seem to be freed up.
If the actual CPU of the server is 90% idle... am I okay? Anyone know where Apache's getting the CPU Load info from?
if anyone has had problems with high cpu load after upgrading APACHE to 2.2.8. We were running 1.3.5 with comfortable CPU loads of 2-10 on dual Xeon 2.8's. Now the loads are 20-70 with most of the CPU being used by many many httpd processes. I've heard that APACHE v2 does consume more resources, but am wondering if there was a problem with the build, or is it that much more demanding.
OTHER INFO:
WHM:11.15
CPANEL: 11.18
OS: CENTOS 4.6
KERNAL: 2.6.20.4-ts.grh.mh.i386
We've a quadcore Xeon and start to have issues with its very high cpu load (which is made by apache & mysqld,).
So here is ps aux:
Code:
USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND
root 1 0.0 0.0 2040 620 ? Ss Jul13 0:13 init [3]
root 2 0.0 0.0 0 0 ? S Jul13 0:00 [migration/0]
root 3 0.0 0.0 0 0 ? SN Jul13 0:00 [ksoftirqd/0]
root 4 0.0 0.0 0 0 ? S Jul13 0:00 [watchdog/0]
root 5 0.0 0.0 0 0 ? S Jul13 0:00 [migration/1]
root 6 0.0 0.0 0 0 ? SN Jul13 0:00 [ksoftirqd/1]
root 7 0.0 0.0 0 0 ? S Jul13 0:00 [watchdog/1]
root 8 0.0 0.0 0 0 ? S Jul13 0:00 [migration/2]
root 9 0.0 0.0 0 0 ? SN Jul13 0:00 [ksoftirqd/2]
root 10 0.0 0.0 0 0 ? S Jul13 0:00 [watchdog/2]
root 11 0.0 0.0 0 0 ? S Jul13 0:00 [migration/3]
root 12 0.0 0.0 0 0 ? SN Jul13 0:00 [ksoftirqd/3]
root 13 0.0 0.0 0 0 ? S Jul13 0:00 [watchdog/3]
root 14 0.0 0.0 0 0 ? S< Jul13 0:00 [events/0]
root 15 0.0 0.0 0 0 ? S< Jul13 0:00 [events/1]
root 16 0.0 0.0 0 0 ? S< Jul13 0:00 [events/2]
root 17 0.0 0.0 0 0 ? S< Jul13 0:00 [events/3]
root 18 0.0 0.0 0 0 ? S< Jul13 0:00 [khelper]
root 19 0.0 0.0 0 0 ? S< Jul13 0:00 [kthread]
root 25 0.0 0.0 0 0 ? S< Jul13 0:01 [kblockd/0]
root 26 0.0 0.0 0 0 ? S< Jul13 0:01 [kblockd/1]
root 27 0.0 0.0 0 0 ? S< Jul13 0:01 [kblockd/2]
root 28 0.0 0.0 0 0 ? S< Jul13 0:03 [kblockd/3]
root 29 0.0 0.0 0 0 ? S< Jul13 0:00 [kacpid]
root 122 0.0 0.0 0 0 ? S< Jul13 0:00 [cqueue/0]
root 123 0.0 0.0 0 0 ? S< Jul13 0:00 [cqueue/1]
root 124 0.0 0.0 0 0 ? S< Jul13 0:00 [cqueue/2]
root 125 0.0 0.0 0 0 ? S< Jul13 0:00 [cqueue/3]
root 128 0.0 0.0 0 0 ? S< Jul13 0:00 [khubd]
root 130 0.0 0.0 0 0 ? S< Jul13 0:00 [kseriod]
root 205 0.0 0.0 0 0 ? S Jul13 0:46 [pdflush]
root 207 0.0 0.0 0 0 ? S< Jul13 0:43 [kswapd0]
root 208 0.0 0.0 0 0 ? S< Jul13 0:00 [aio/0]
root 209 0.0 0.0 0 0 ? S< Jul13 0:00 [aio/1]
root 210 0.0 0.0 0 0 ? S< Jul13 0:00 [aio/2]
root 211 0.0 0.0 0 0 ? S< Jul13 0:00 [aio/3]
root 383 0.0 0.0 0 0 ? S< Jul13 0:00 [kpsmoused]
root 433 0.0 0.0 0 0 ? S< Jul13 0:00 [ata/0]
root 434 0.0 0.0 0 0 ? S< Jul13 0:00 [ata/1]
root 435 0.0 0.0 0 0 ? S< Jul13 0:00 [ata/2]
root 436 0.0 0.0 0 0 ? S< Jul13 0:00 [ata/3]
root 437 0.0 0.0 0 0 ? S< Jul13 0:00 [ata_aux]
root 443 0.0 0.0 0 0 ? S< Jul13 0:00 [scsi_eh_0]
root 444 0.0 0.0 0 0 ? S< Jul13 0:00 [scsi_eh_1]...
They don't appear for some time if I kill them (a day or more). But it repeats again and again. One day there were 8 similar processes in total in max which used all 4 cores at 100% (and even ssh console was extremely slow to do something there).
I think that somebody is trying to make a small attack of some sort but I need to check it first. I tried to look at apache logs but there were too many posting requests from different IPs and no dublicates for little period of time so I had no success.
Anyway, that script worked for us for 4 years already and we didn't have any problems with it even on our old single core P4 2.8 ghz.
way to make sure is this an attack of some sort or just this script doesn't work correctly on our new machine?
Are there any ways to get IPs of visitors who are running posting.php with CPU overloading?
been checking out this site for a while and finally decided to register because I have a problem. Also hope this is the correct forum for this topic, sorry if it isn't.
So I have a problem with Apache. One of the sites that I run/host has a moderately large vBulletin board, and Apache just seems to eat up the CPU. Load averages have shot up between 20-30 and I've seen it as high as 80. Apache and MySQL are optimized already, I'm using suPHP for security because there are other sites on this box.
The funny thing about this is that it only started happening about a week ago. After checking for rootkits and all that garbage, I reinstalled the OS just to be on the safe side. Everything comes back clean still. I also got fed up and hired Platinum Server Management for a month, to see if they could find a solution (and I've been interested in reselling their services, but that's not relevant). So far the only thing they can come up with is disable suPHP, which isn't an option. I do realize that suPHP is ~20-25 times slower than mod_php, but what totally baffles me is that it worked beforehand and started going all crazy like this. I did try running the site using an dso configuration, the load did drop, but nothing to be proud of.
This site, and the server overall hasn't had any increase in load, I've held off putting new accounts on it until I get this fixed.
In the meantime, I have said forums running on lighttpd, which lowered the load. (Also writing a tutorial on having lighty work with cPanel)
write a cronjob so that apache will restart when the server reaches a load of 20.
View 13 Replies View RelatedI have server in LT, the network is so good, but i got problem with the apache, it keep going down because the process too high ( i think)
when i list the process it show me :
nobody
0.000.250.0 Top Process%CPU 98.9/usr/local/apache/bin/httpd -DSSL Top Process%CPU 98.8/usr/local/apache/bin/httpd -DSSL Top Process%CPU 2.9
Other than that all domain only use not more than 10% process, I use Cpanel X and Cpanel XP skin, please help
Now my domain , will get blank page when try to access, i dont know why, even though all service is running and i already reboot the server
In the last day or two I've been having issues with memory on one of by boxes.
Something eats it all up, so the OS starts swapping, the I/O wait shoots up, and soon the load is up in the hundreds and the thing is totally useless.
During the day today I've tracked the something to occational apache processes. It seems that occationally a thread is started which uses upwards of 150M of memory. These threads are obvioudly doing something heavyweight and take a while to complete. When I get a few of them running together it soons finishes off all my available memory. Below is an extract from top when a couple of these threads are running.
Code:
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
10230 nobody 25 0 197m 27m 9392 R 45.5 2.9 0:03.27 /usr/local/apache/bin/httpd -DSSL
10231 nobody 25 0 197m 25m 8376 R 52.8 2.7 0:01.60 /usr/local/apache/bin/httpd -DSSL
I was wondering if anyone could help out by suggesting some ways of tracking down what page/script it which uses so much memory. It's a cPanel server so it's not really practical to tail -f the apache logs (not knowing which account it is means I don't know which file to watch).
I have a VPS from KnownHost for about a year for developing purposes. Great place to go for VPS's, by the way.
Anyway I just installed a game server on it and now the loads are about 0.5 when I do a "top" command.
Should I be worried? The server isn't really used for anything right now, that is why I am using it as a L4D server. Max 8 people on it.
I was wondering about a specific VPS package I was considering. I have around 80~90 sites (and therefore accounts) that I need a nice place to call home, but I am wondering if maybe I would be asking too much of this VPS package:
40GB Disk Space
1000GB Transfer
P4 3.2GHz
800MHz Front Side Bus
1GB Guaranteed RAM | 2GB Burst RAM
CentOS 4
50% of CPU Guaranteed | Burst to...I don't remember.
All of the sites I would be hosting easily take up less than 100MB of space each. The most any of them use is 2-5GB of transfer. I know these levels are no where near my allotted resources, but do you think that serving 80-90 accounts like this is too much server load? There will only be 2 VPS' on each server, guaranteed.
Anyone with experience with a VPS and a decent set of accounts/domains, please let me know what you think.
We have flash files site hosted on dedicated server in that Apache is utilizing the more CPU. When the server reached more than 1000 connections server get down automatically.
Hard Server Limit : 2048
MaxClients : 2000
Please find below the TOP status.
8450 nobody 16 0 19 0:20.52 1.2 39404 23m 3008 R httpd
3242 nobody 15 0 16 1:07.17 1.2 39696 24m 3032 S httpd
9492 nobody 16 0 12 0:00.39 0.7 29616 14m 3000 R httpd
3372 nobody 15 0 12 1:23.31 0.5 24864 9992 3036 S httpd
9477 nobody 15 0 11 0:00.88 0.5 24692 9784 3000 S httpd
9021 nobody 15 0 10 0:01.69 1.2 39660 24m 2996 S httpd
3240 nobody 15 0 10 1:39.71 1.2 39664 24m 3420 R httpd
4141 nobody 16 0 10 1:30.65 1.2 39792 24m 3032 R httpd
5458 nobody 15 0 10 1:04.21 0.5 24720 9824 3012 S httpd
9466 nobody 15 0 10 0:00.96 0.5 24672 9764 3000 S httpd
9478 nobody 15 0 10 0:00.98 0.5 24676 9764 2996 S httpd
3354 nobody 16 0 10 1:23.78 0.5 25132 9m 3044 R httpd
3361 nobody 15 0 10 1:21.61 0.5 24864 10m 3576 S httpd
5451 nobody 16 0 10 1:09.14 1.2 39664 23m 3036 R httpd
5457 nobody 15 0 10 1:12.76 1.2 39664 24m 3556 S httpd
9444 nobody 16 0 10 0:01.72 1.2 39656 24m 2996 R httpd
9481 nobody 15 0 10 0:00.65 1.2 39652 24m 3000 R httpd
3338 nobody 16 0 9 1:32.72 1.2 39256 23m 3036 R httpd
3360 nobody 15 0 9 1:44.38 1.2 39772 24m 3440 R httpd
4142 nobody 15 0 9 1:40.64 1.2 39760 24m 3440 S httpd
9493 nobody 15 0 9 0:01.25 0.5 24704 9796 3024 S httpd
9504 nobody 15 0 9 0:00.29 0.5 24688 9744 2984 S httpd
3305 nobody 16 0 9 1:08.11 1.2 39404 23m 3012 R httpd
3359 nobody 15 0 9 0:47.17 0.5 24812 9936 3032 S httpd
3363 nobody 16 0 9 1:44.42 1.2 39432 23m 3044 R httpd
5450 nobody 15 0 9 1:18.81 0.5 24900 9996 3032 S httpd
9486 nobody 16 0 9 0:00.59 1.2 39664 23m 2996 R httpd
3358 nobody 16 0 9 1:46.50 1.2 39520 24m 3452 R httpd
9096 nobody 16 0 9 0:07.87 1.1 38612 23m 3004 R httpd
3370 nobody 16 0 8 1:32.55 1.2 39200 23m 3012 R httpd
8515 nobody 16 0 8 0:12.52 1.2 39404 23m 3024 R httpd
9445 nobody 16 0 8 0:02.70 1.2 39404 23m 3000 R httpd
Apache Compailed with following modules.
./configure' '--disable-pdo' '--enable-ftp' '--enable-gd-native-ttf' '--enable-libxml' '--enable-magic-quotes' '--enable-mbstring' '--enable-sockets' '--prefix=/usr/local' '--with-apxs=/usr/local/apache/bin/apxs' '--with-curl=/opt/curl/' '--with-freetype-dir=/usr' '--with-gd' '--with-jpeg-dir=/usr' '--with-libxml-dir=/opt/xml2/' '--with-mhash=/opt/mhash/' '--with-mysql' '--with-png-dir=/usr' '--with-ttf' '--with-xpm-dir=/usr/X11R6' '--with-zlib' '--with-zlib-dir=/usr'
Apache : 2.2.8
PHP : 5.2.4
MySQL : 4.1.1
RAM : 2 GB
CPU : Intel(R) Xeon(R)
Cpanel Installed
I have a fairly high end server in which I have installed SIM. SIM is restarting Apache up to 10 times a day, presumably due to high load causing un-availability.
On restart, Apache / MYSQL is stable until the load / mem usage begins to climb then it is restarted again. Here are my 'load' stats for today:
Load for today
High (2:18am): 4.63
Low (3:30am): 1.20
Mean: 1.84
Latest: 1.61
Mem usage for today
High (1:36am): 9,192.9 MB
Low (1:48am): 7,995.7 MB
Mean: 8,683.1 MB
Latest: 8,781.7 MB
I have seen it using 20GB RAM before.
I have tried to follow various optimisation guides but these seem tailored to less powerful servers.
The web application I run on this server is almost entirely MYSQL based, with thousands of DB calls a day. Across the entire system I probably get 200,000 bot hits per day or even more. At peak times search engine bots are literally hammering the server.
My server specs are:
# Processor: Quad-Core Xeon Processor * 8
# CPU Speed: 3Ghz
# RAM: 32 GB DDR2
# HDD: 36 GB 15k Raptor X2 + 1TB Sata
# OS: 32Bit CentOS
Changes / optimisation of the actual application is not possible.
My configuration files are:
My.cnf ....
I deal with a server that gets positivey slammed once a week for a few months per year. I'd tell you how many hits we got tonight, but I'm still waiting for AWSTATS to chew through the 2gb access_log file...
Tonight, I made some changes that SEEM to work, but I"mn not sure what the long-term effects could be. If we have any apache experts on the forums, I'd really like to bend your ear for a few to see what you know.
Obviously, with PHP, we're limited to prefork MPM.
First of all, I dropped Timeout from 300 to 120. That should be MORE than enough time to know that we've timed out. Then I dropped KeepAliveTimeout to 5 from 15.
Here's the radical one. Watching the process list and the load, it seemed that load spiked when the processes hit their end of useful life and respawned. Duh. This was happening every four seconds at the load we were under. MaxRequestsPerChild was set to 10,000. I upped this to 80,000 over a period of hours that we were under the load. I didn't see any significant memory leakage, but it's the change I'm worried about the most. I've seen Apache do some bad things when people allow this to go unlimited, and had always used the relatively low default as a guide.
Besides not loading a bunch of dynamic modules (also done, I usually do this so I'm not worried about it), what else can I do tuning-wise to keep load down? Please note that caching and load-balancing aren't acceptable solutions; I have one server to work with (for now) and the boss says no to caching because of how frequently our information updates. We also have extensive .htaccess files, so there's no LHTTPD in my future.