In my server iowait is causing high load, how do we find out which are all users taking memory that could cause my server to use swap memory.
server : linux centos/Cpanel
I have tried the below commands, but how do we locate user specific,
ps aux --sort -vsz | head -25
vmstat 1
Server is Xeon 3060, 3GB Ram, 250GB SATA-II HDD. I followed the recommendations made by mysqlprimer tuner script.
top - 11:54:33 up 237 days, 15:01, 1 user, load average: 6.06, 2.80, 1.65
Tasks: 133 total, 2 running, 131 sleeping, 0 stopped, 0 zombie
Cpu(s): 13.0% us, 4.9% sy, 0.0% ni, 24.3% id, 57.8% wa, 0.0% hi, 0.0% si
Mem: 3114144k total, 3096468k used, 17676k free, 30220k buffers
Swap: 2096440k total, 32348k used, 2064092k free, 2515412k cached
PID USER PR NI %CPU TIME+ %MEM VIRT RES SHR S COMMAND
8610 nobody 16 0 28 1:37.73 0.7 78908 20m 16m S lsphp4
10520 nobody 16 0 3 0:01.97 0.4 78788 10m 6884 S lsphp4
26474 nobody 15 0 2 15:04.07 0.4 14196 11m 3216 S lshttpd
28275 mysql 22 6 1 131:28.83 7.4 733m 224m 2700 S /usr/sbin/mysqld --basedir=/ --datadir=/var/lib/mysql --user=mysql --pi
Code:
[mysqld]
max_connections=500
max_user_connections=300
skip-locking
skip-innodb
query_cache_limit=1M
query_cache_size=64M
query_cache_type=1
interactive_timeout=60
wait_timeout=60
connect_timeout=6
thread_cache_size=128
key_buffer_size=640M
max_allowed_packet=16M
table_cache=2048
join_buffer=1M
sort_buffer=2M
record_buffer=1M
sort_buffer_size=2M
read_buffer_size=2M
safe-show-database
max_connect_errors=10
thread_concurrency=2
myisam_sort_buffer_size=64M
datadir=/var/lib/mysql
socket=/var/lib/mysql/mysql.sock
#log_slow_queries=/var/log/mysql/mysql_slow-queries.log
long_query_time=3
tmp_table_size=32M
max_heap_table_size=32M
#log-queries-not-using-indexes=/var/log/mysql/mysql_queries_no-indexes.log
join_buffer_size=2M
low_priority_updates=1
read_rnd_buffer_size=2M
[mysql.server]
user=mysql
basedir=/var/lib
[safe_mysqld]
err-log=/var/log/mysqld.log
var/lib/mysql/mysql.pid
open_files_limit=8192
[mysqldump]
quick
max_allowed_packet=16M
[mysql]
no-auto-rehash
[isamchk]
key_buffer=32M
sort_buffer=32M
read_buffer=16M
write_buffer=16M
[myisamchk]
key_buffer=32M
sort_buffer=32M
read_buffer=16M
write_buffer=16M
[mysqlhotcopy]
interactive-timeout
Whenever there are a lot of members online on my forum, the iowait shoot up, >30% and often times hovering at 60%. It'll eventually drop down to normal levels. However, during the high iowait, there are over 2.5GB of free memory according to the command, free -m
is it due to mysql not optimized or other processes? I don't think the bottleneck is on the cpu or ram.
I am running in a High load problem lately. I have one of those cheap 1and1 servers which was running fine until 2 weeks ago. Once I rebooted accidentaly, it did not come back with some unrepairable kernel errors and I had to re-image it.
I chose to reimage the server with CentOS 5, for better support. The new re-image worked fine for some days, at least so I thought and now I am having high loads. The server crashes if not monitored every moment as the load is unpredictable.
Just a restart of the Apache will bring the server back to normality, but I am not sure if it is apache or some other script to be blamed.
I have beeing monitoring through apache server-status, but I cannot organize something unusual in the high load moments.
At this moment for example:
top - 09:00:36 up 15:43, 3 users, load average: 3.57, 4.60, 5.32
Tasks: 144 total, 2 running, 142 sleeping, 0 stopped, 0 zombie
Cpu(s): 10.6%us, 6.5%sy, 0.0%ni, 18.7%id, 63.5%wa, 0.2%hi, 0.5%si, 0.0%st
12:00:29 AM CPU %user %nice %system %iowait %steal %idle
12:10:01 AM all 9.14 0.00 5.52 44.66 0.00 40.68
12:20:14 AM all 6.83 0.00 3.98 27.88 0.00 61.32
12:30:10 AM all 6.44 0.00 4.20 81.25 0.00 8.11
12:40:09 AM all 5.25 0.00 4.09 81.93 0.00 8.73
12:50:15 AM all 5.11 0.00 3.79 90.74 0.00 0.36
01:00:07 AM all 7.22 0.00 4.52 57.11 0.00 31.15
01:10:13 AM all 6.89 0.00 4.01 55.38 0.00 33.71
01:20:14 AM all 4.37 0.00 3.27 41.88 0.00 50.48
01:30:25 AM all 4.26 0.00 3.29 63.42 0.00 29.03
01:40:06 AM all 27.18 0.00 4.75 58.27 0.00 9.80
01:50:03 AM all 29.64 0.00 6.61 51.50 0.00 12.25
02:00:07 AM all 27.00 0.00 8.48 55.49 0.00 9.03
02:10:10 AM all 19.29 0.00 4.97 73.80 0.00 1.94
02:20:04 AM all 37.85 0.00 6.78 40.70 0.00 14.67
02:30:05 AM all 15.65 0.00 4.80 68.47 0.00 11.08
02:40:08 AM all 9.06 0.00 5.60 37.49 0.00 47.86
02:50:07 AM all 5.36 0.00 3.62 42.29 0.00 48.73
03:00:02 AM all 6.05 0.00 4.08 47.27 0.00 42.60
03:10:02 AM all 4.22 0.00 3.68 38.17 0.00 53.93
03:20:02 AM all 4.06 0.00 3.75 41.37 0.00 50.82
03:30:22 AM all 4.42 0.00 3.93 45.25 0.00 46.41
03:40:11 AM all 4.34 0.00 3.95 39.58 0.00 52.13
03:50:02 AM all 4.67 0.00 4.01 32.53 0.00 58.80
04:00:08 AM all 3.72 0.00 3.87 28.40 0.00 64.02
04:10:02 AM all 13.49 0.00 6.58 20.82 0.00 59.10
04:20:01 AM all 6.70 0.00 4.63 6.06 0.00 82.61
04:30:02 AM all 1.44 0.00 1.21 4.75 0.00 92.59
04:40:01 AM all 12.42 0.00 8.12 7.65 0.00 71.81
04:50:02 AM all 1.43 0.00 1.07 4.02 0.00 93.47
05:00:02 AM all 1.60 0.00 1.40 8.62 0.00 88.38
05:10:10 AM all 3.80 0.00 3.02 17.86 0.00 75.32
05:20:06 AM all 5.10 0.00 4.22 23.34 0.00 67.34
05:30:02 AM all 1.54 0.00 1.40 11.22 0.00 85.85
05:40:05 AM all 1.75 0.00 1.89 13.12 0.00 83.23
05:50:12 AM all 2.15 0.00 2.22 18.92 0.00 76.72
06:00:02 AM all 1.92 0.00 2.01 12.87 0.00 83.20
06:10:02 AM all 2.27 0.00 2.16 11.53 0.00 84.04
06:20:03 AM all 3.56 0.00 3.02 25.26 0.00 68.16
06:30:10 AM all 2.66 0.00 2.05 18.13 0.00 77.16
06:40:02 AM all 2.58 0.00 2.25 22.87 0.00 72.30
06:50:02 AM all 2.68 0.00 1.92 15.77 0.00 79.63
07:00:03 AM all 3.06 0.00 2.48 26.01 0.00 68.46
07:10:03 AM all 3.65 0.00 3.20 36.54 0.00 56.61
07:10:03 AM CPU %user %nice %system %iowait %steal %idle
07:20:03 AM all 4.40 0.00 3.28 43.86 0.00 48.46
07:30:02 AM all 4.10 0.00 3.17 31.30 0.00 61.43
07:40:06 AM all 7.67 0.00 3.95 50.79 0.00 37.59
07:50:02 AM all 4.72 0.00 3.11 44.30 0.00 47.86
08:00:03 AM all 5.57 0.00 3.72 47.15 0.00 43.56
08:10:07 AM all 10.66 0.00 3.59 71.62 0.00 14.13
08:20:17 AM all 5.67 0.00 3.42 58.81 0.00 32.10
08:30:10 AM all 11.12 0.00 3.49 76.71 0.00 8.67
08:40:03 AM all 7.00 0.00 3.36 47.94 0.00 41.71
Average: all 7.53 0.00 3.76 38.90 0.00 49.81
Some configurations:
The reimage partittioning looks like this:
/dev/sda1 950M 138M 765M 16% /
/dev/sda5 4.7G 1.9G 2.9G 40% /usr
/dev/sda7 63G 58G 5.0G 93% /var
/dev/sda6 4.7G 23M 4.7G 1% /home
none 1.0G 500K 1.0G 1% /tmp
KeepAlive On
MaxKeepAliveRequests 300
KeepAliveTimeout 15
<IfModule prefork.c>
StartServers 10
MinSpareServers 20
MaxSpareServers 50
ServerLimit 256
MaxClients 180
MaxRequestsPerChild 2000
</IfModule>
<IfModule worker.c>
StartServers 2
MaxClients 150
MinSpareThreads 25
MaxSpareThreads 75
ThreadsPerChild 25
MaxRequestsPerChild 0
</IfModule>
[mysqld]
datadir=/var/lib/mysql
socket=/var/lib/mysql/mysql.sock
skip-locking
query_cache_limit=1M
query_cache_size=32M
query_cache_type=1
max_connections=250
interactive_timeout=100
wait_timeout=20
connect_timeout=10
thread_cache_size=80
key_buffer=64M
join_buffer=1M
max_allowed_packet=16M
table_cache=512
record_buffer=1M
sort_buffer_size=1M
read_buffer_size=1M
max_connect_errors=10
thread_concurrency=2
read_rnd_buffer_size=1M
myisam_sort_buffer_size=64M
server-id=1
processor : 1
vendor_id : GenuineIntel
cpu family : 15
model : 3
model name : Intel(R) Pentium(R) 4 CPU 2.80GHz
stepping : 4
cpu MHz : 2793.324
cache size : 1024 KB
Which command do we type to see what is causing a high server load?
I've restarted the VPS numerous of times, and I wish to found out the problem
It's been a while since I've posted in this area of the forum, but was just wondering if by now someone or some company has developed a script/software that you can install on your server that will tell you the exact area where the high CPU load is coming from, such as from someone sending email, a certain users account, and etc?
Most times, you have to be mointoring your server at the time of the high load to be exactly sure of what is causing the high load, so, I'm talking about something that will email you right on the spot of the high load in case you are away and will know what caused it.
Most I've seen only tell you that you have a high load, but don't tell you what exactly caused it.
Recently I've noticed named causing high iowait.
If I stop named, iowait reduces to around 40%.
Code:
10:05:55 up 1:59, 2 users, load average: 5.09, 6.73, 6.23
192 processes: 185 sleeping, 7 running, 0 zombie, 0 stopped
CPU states: cpu user nice system irq softirq iowait idle
total 4.3% 0.0% 5.0% 0.3% 0.0% 89.2% 0.9%
cpu00 4.8% 0.0% 4.8% 0.0% 0.1% 89.3% 0.8%
cpu01 3.9% 0.0% 5.2% 0.7% 0.0% 89.0% 1.0%
Mem: 1023624k av, 966688k used, 56936k free, 0k shrd, 119500k buff
658244k actv, 130464k in_d, 16084k in_c
Swap: 1052248k av, 72096k used, 980152k free 496268k cached
PID USER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME CPU COMMAND
15 root 15 0 0 0 0 SW 0.8 0.0 2:23 1 kjournald
9182 named 15 0 3504 3504 2184 S 0.6 0.3 0:01 0 named
8301 apache 15 0 14564 11M 6832 S 0.5 1.1 0:00 0 httpd
1043 qmails 24 0 1196 1064 384 R 0.4 0.1 1:10 0 qmail-send
1047 qmailr 25 0 372 364 280 S 0.3 0.0 0:35 1 qmail-rspawn
30825 root 15 0 1140 1088 744 R 0.2 0.1 0:09 1 top
7025 apache 15 0 13536 10M 6820 S 0.2 1.0 0:00 0 httpd
7076 apache 15 0 13868 11M 6820 S 0.2 1.1 0:00 1 httpd
759 root 15 0 568 548 488 R 0.1 0.0 1:30 1 syslogd
I believe this isn't normal.
diagnosing my server which currently experiencing high iowait for weeks, I'm still figuring the root cause.
total used free shared buffers cached
Mem: 4051 3653 398 0 341 2847
-/+ buffers/cache: 464 3587
Swap: 8191 0 8191
The server spec as follow :
HP DL 380 G5
4G RAM
2.6.18-53.el5PAE
the load is around 1 or 2 , but iowait have been on the high side even the server currently is under utilized
I'm running LVM and hardware RAID 1 on the server.
Can someone figure out by the screenshot, if my CPU is really
97% iddle, and what can be causing these average load numbers?
For the past few days, one of the server is causing a bandwidth utilization surge for the entire rack on almost daily basis. It happen for a few minutes and it went off then it will be the same thing again the next day. When the surge is happening, most of the servers on the same segment will be inaccessible for the few minutes.
The bandwidth utilization graph for my rack is recording an abnormal surge from (6mbps --> 90mbps) for the few minutes. My MRTG is showing 2 of the Plesk servers giving the problem but the NOC guys said it the Cpanel that causing the problem.
I tried logging in to both servers but could not find what's the cause for this.
How to find what Perl script is causing high CPU usage?
I logged into my CentOS box tonight and notice after viewing the output of the "top" command that there are the following lines of output that have me concerned. What command can I use to find the source of the Perl script that is causing the CPU spike?
It seems it's been running for some time too.
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
30120 apache 25 0 6908 4544 1216 R 99.8 0.2 13416:07 perl
30654 apache 25 0 8028 4508 1212 R 99.4 0.2 13417:22 perl
21273 apache 25 0 7584 4528 1200 R 98.1 0.2 2225:12 perl
20516 apache 25 0 6760 4540 1232 R 96.8 0.2 2221:30 perl
I would like to know how to check load via ssh and check files causing load?
I want the ssh codes for 2 different set of control panels, one with cpanel+whm and other with kloxo+hypervm
and I would also know how to check the files causing the load, such as some files could have been interrupted while processing, so they could be causing load some times, so I want to stop such processes if any are running on the vps on my friends accounts
I have a cPanel server with 4GB RAM
My server hangs time to time, once or twice a day. This is the last status when it happens.
Server Load 75.90 (2 cpus)
Memory Used 92 %
Swap Used 65.78 %
When I was still inside SSH when it happens, the processes I can see inside "top" are a lot of httpd processes.
So I "killall -9 httpd", I had to do it 30~40 times
#killall -9 httpd
#killall -9 httpd
#killall -9 httpd
x 30~40 times until no pid process found & the server load is back to normal.
Before that, I check httpd fullstatus, they look very normal, same goes to what I see inside WHM Apache status & cpu usage status.
At first I thought it was a memory problem after consulting with a server admin, so I replaced all 4GB new ram stick (such a waste)
My server is very slow, High CPU, High Apache load....
I got a new server and i had setup a script on it.
No server tweaks has been done.
I run a filehosting site so it gets very slow when traffic is high.
Here is some info:
Code:
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
4135 filedip 19 0 12812 8892 2212 R 18.9 0.4 0:00.74 index.cgi
3140 apache 15 0 22624 9604 2768 S 17.3 0.5 1:54.45 httpd
3556 apache 15 0 22792 9592 2768 S 17.3 0.5 0:43.53 httpd
3739 apache 15 0 22672 9556 2744 S 17.3 0.5 1:09.67 httpd
3884 apache 15 0 22664 9560 2744 S 17.3 0.5 0:23.98 httpd
3474 apache 15 0 22672 9572 2756 R 16.1 0.5 1:34.09 httpd
3548 apache 15 0 22792 9560 2740 S 16.1 0.5 1:33.67 httpd
3991 apache 15 0 22640 9588 2756 S 15.1 0.5 0:22.44 httpd
3475 apache 15 0 22672 9580 2756 S 13.2 0.5 1:31.42 httpd
3493 apache 15 0 22664 9592 2768 S 12.9 0.5 1:15.52 httpd
3769 apache 15 0 22664 9580 2756 S 12.9 0.5 0:45.19 httpd
3638 apache 15 0 22664 9576 2756 S 12.3 0.5 0:32.82 httpd
3724 apache 16 0 22664 9580 2756 R 12.3 0.5 0:34.25 httpd
3626 apache 15 0 22672 9580 2756 S 11.7 0.5 0:52.54 httpd
4023 apache 16 0 22792 9560 2740 R 11.3 0.5 0:13.16 httpd
3882 apache 15 0 22664 9576 2756 S 10.1 0.5 0:38.56 httpd
3005 apache 15 0 22672 9588 2768 R 9.1 0.5 2:06.61 httpd
I dont know much about server managment...
how to fix this so server doesnt go slow?
I have a site that is eating up my server resources and need to know what the best solution for this is. I'm thinking of getting another server just for mysql but do not know what specs the server should be to handle the current traffic/database load and have the site run smoothly without slowing down to a snail's pace.
An alternative is to get another server just for the videos being served and leave the database and html on the current server. This is where I'm stuck and don't know what route to take with this.
My current server stats:
Dual Xeon 5130
4GB RAM
250GB
50 Mbit/sec
CentOS 3.9
Website traffic stats:
15,000 visitors/day
150,000 pageviews/day
Serving videos
I've attached screenshots of top and bandwidth usage per day. Hopefully with this information you could tell me if I need another server or if there are any things I can do to the current server to help things move faster.
I have extremely high CPU load average, but when I run TOP command there are not any process with high CPU
CPU load averages:
211.65 (1 min) 227.29 (5 mins) 247.89 (15 mins)
Tasks: 364 total, 2 running, 360 sleeping, 2 stopped, 0 zombie
Cpu(s): 0.0%us, 0.3%sy, 0.0%ni, 0.0%id, 99.7%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 2065460k total, 2012372k used, 53088k free, 60964k buffers
Swap: 2040212k total, 3280k used, 2036932k free, 619900k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
19871 root 15 0 4944 2488 1656 R 1 0.1 0:02.73 top
1 root 15 0 4208 1320 1136 S 0 0.1 0:01.55 init
2 root RT 0 0 0 0 S 0 0.0 0:00.00 migration/0
3 root 34 19 0 0 0 S 0 0.0 0:01.77 ksoftirqd/0
4 root RT 0 0 0 0 S 0 0.0 0:00.01 migration/1
5 root 34 19 0 0 0 S 0 0.0 0:01.16 ksoftirqd/1
6 root 10 -5 0 0 0 S 0 0.0 0:01.04 events/0
7 root 10 -5 0 0 0 S 0 0.0 0:00.65 events/1
8 root 10 -5 0 0 0 S 0 0.0 0:00.00 khelper
9 root 11 -5 0 0 0 S 0 0.0 0:00.00 kthread
35 root 10 -5 0 0 0 S 0 0.0 0:00.15 kblockd/0
36 root 10 -5 0 0 0 S 0 0.0 0:00.00 kblockd/1
37 root 15 -5 0 0 0 S 0 0.0 0:00.00 kacpid
127 root 10 -5 0 0 0 S 0 0.0 0:13.16 ata/0
128 root 16 -5 0 0 0 S 0 0.0 0:00.00 ata/1
129 root 10 -5 0 0 0 D 0 0.0 0:01.15 ata_aux
130 root 10 -5 0 0 0 S 0 0.0 0:00.00 kseriod
158 root 16 0 0 0 0 S 0 0.0 0:00.00 pdflush
159 root 15 0 0 0 0 D 0 0.0 0:01.00 pdflush
160 root 10 -5 0 0 0 S 0 0.0 0:10.68 kswapd0
161 root 11 -5 0 0 0 S 0 0.0 0:00.00 aio/0
So my server is "unresponsive" for abour 18 hours, burst net didnt answer my tickets and I dont know what to do. Ive been with this setup for almost 5 months with no problems, No changes have been made to hardware or software.
Im using Centos 5.0
My VPS holds about 80 domains and low-use accounts.
Every night, from around 1.30am, the load suddenly skyrockets and will usually be around 5 to 10 for a few hours. Occasionally it'll spike to 30+ for a few minutes.
I had some antispam software running, and a couple of other packages (mail queues, mail manage etc), so I disabled all of that and removed all the crontab entries etc.
It's not really made any difference.
I can see the load stats going back 8 hours, as part of the ASSP spam package (I've just left the ASSP server load cron running just so I can continue monitoring it!)
Can the apparent load on my VPS be caused by other VPS's on the same node?? So in reality, my load is fine but is being affected by other people's VPS's?
I hope that makes sense. I'm 99% sure that my VPS is 'clean' (in so far as cron entries)
I'm asking the question because I took a second VPS on the same node and that one too has high loads overnight when there's nothing running on it (ie, no add-on software, no Cpanel accounts added)
I have a VPS with LXadmin control panel and 1024 Ram.
the memory always 333-450 but now it is more than 800 and the VPS stopped I restarted it many times but after restarting it the memory gone crazy again.
So, how to know what causes high load and eating my Memory?
when i install BFD and APF on my server thie processes appears every time on "top" commad on my server and it cuse hight load
------------------------------
4766 root 25 0 100 10:22.56 3.2 165m 130m 420 R grep -vf /usr/local/bfd/tmp/attack.pool.tmp
7747 root 25 0 100 30:20.34 9.8 430m 397m 420 R grep -vf /usr/local/bfd/tmp/attack.pool.tmp
----------------------------
Just signed up for a VPS with solarvps, which so far is lightning fast compared to my shared reseller account with RZ.
I want to create a script which checks the server load and drops me a text message on my mobile if the server load hits a certain level.
Just wondering what I should consider a high server load?
The server is the JupiterLX UK one from solar vps with over just over 800mb of SLM RAM.
Im in a VPS and everyday at the same hour goes very slowly due to high load problems.
The main site is a vBulletin forum and I get this error:
Too many connections
Ive change some details in my.cnf:
Quote:
max_connections=500
max_user_connections=70
But it didnt solve the problem.
This high load occurs at the same hour, I think that it is a cron job related problem, but this is my /etc/crontab
Quote:
# cat crontab
SHELL=/bin/bash
PATH=/sbin:/bin:/usr/sbin:/usr/bin
MAILTO=root
HOME=/
# run-parts
01 * * * * root run-parts /etc/cron.hourly
02 4 * * * root run-parts /etc/cron.daily
22 4 * * 0 root run-parts /etc/cron.weekly
42 4 1 * * root run-parts /etc/cron.monthly
i was previously using maxclients 256 in httpd.conf and the load was normal even when the server was processing 256 requests..
recently i had changed it to 320 coz of which my load had increased a lot.. Now when i have decreased it back to 256 the load is still high even when the no of requests are just 150..
i have trouble with transport from company to another company
and i had problem with the best company ( resellerzoom.com )
i order one month this palnt ( Failover Plans ) then i swa this messeage
[PHP]
Hello,
Accounts usage is very high, MEMORY usage is very high than allowed limit of 3% for Daily average. You still have Cpanel/FTp access.
========================
Account usage Daily average
Average CPU%:- 1.23
Average MEM%:- 3.24
Top Process %CPU 58.0
PHP Code:
Top Process %CPU 54.0 /usr/bin/php forumdisplay.phpTop Process %CPU 52.0 /usr/bin/php showthread.php
i asked him what's can i do?
he toled me
PHP Code:
Upgrade to VPS or Semi-dedicated server
i don't want Upgrade vps with same company
How can you tell if your server was a victim of a DDOS attack? Server load goes so high that you cannot get in via SSH, and the server has to be power cycled to get back online. When it comes back online, load goes back up, we shut apache down, and the let the load come back down and then restart apache and everything is fine. Any way to determine what caused the load to skyrocket? System has APF, BFD, and mod_evasive installed.
View 3 Replies View RelatedI have 2 servers
Dual Quad Core 5310
One for Mysql and the other one for Httpd
I have one large website , when i put this website in one server i mean by one server is making the website work with mysql and httpd in one server no external server it's load seems to be on 1 - 5 but when i but the mysql on other server the load got high and i got high httpd connections , also when i try to see the the amount connections between the servers it's too high in one of them and low in the other and i am always suffering from load .
here the details
192.168.0.1 the mysql server
192.168.0.2 httpd server
[root@httpd etc]# netstat -n | grep 192.168 | wc -l
453
this the mysql server my.cnf conf
[root@mysql ~]# cat /etc/my.cnf
[mysqld]
safe-show-database
skip-name-resolve
skip-innodb
max_connections = 800
key_buffer = 96M
myisam_sort_buffer_size = 64M
join_buffer_size = 1M
read_buffer_size = 1M
sort_buffer_size = 2M
table_cache = 2500
thread_cache_size = 384
wait_timeout = 30
connect_timeout = 10
tmp_table_size = 128M
max_heap_table_size = 128M
max_allowed_packet = 64M
max_connect_errors = 10
thread_concurrency = 8
read_rnd_buffer_size = 1M
bulk_insert_buffer_size = 8M
query_cache_limit = 8M
query_cache_size = 128M
query_cache_type = 1
query_prealloc_size = 131072
query_alloc_block_size = 65536
[mysqld_safe]
nice = -10
open_files_limit = 8192
[mysqldump]
quick
max_allowed_packet = 16M
[myisamchk]
key_buffer = 64M
sort_buffer = 64M
read_buffer = 16M
write_buffer = 16M
[mysqlhotcopy]
interactive-timeout
[root@mysql ~]#
this the httpd.conf config
Timeout 30
KeepAlive On
MaxKeepAliveRequests 120
KeepAliveTimeout 1
MinSpareServers 15
MaxSpareServers 25
StartServers 15
MaxClients 256
MaxRequestsPerChild 1000
here the total connections in the mysql server
[root@mysql ~]# netstat -n | grep 192.168 | wc -l
25
[root@mysql ~]#
[root@mysql ~]# netstat -n | grep 192.168
tcp 0 0 192.168.0.1:3306 192.168.0.2:47876 ESTABLISHED
tcp 0 0 192.168.0.1:3306 192.168.0.2:48923 ESTABLISHED
tcp 0 0 192.168.0.1:3306 192.168.0.2:46610 ESTABLISHED
tcp 0 0 192.168.0.1:3306 192.168.0.2:47142 TIME_WAIT
tcp 0 0 192.168.0.1:3306 192.168.0.2:49209 ESTABLISHED
tcp 0 0 192.168.0.1:3306 192.168.0.2:44344 ESTABLISHED
tcp 0 0 192.168.0.1:3306 192.168.0.2:44365 ESTABLISHED
tcp 0 0 192.168.0.1:3306 192.168.0.2:44359 ESTABLISHED
tcp 0 0 192.168.0.1:3306 192.168.0.2:46406 ESTABLISHED
tcp 0 0 192.168.0.1:3306 192.168.0.2:44355 ESTABLISHED
tcp 0 0 192.168.0.1:3306 192.168.0.2:44352 ESTABLISHED
tcp 0 0 192.168.0.1:3306 192.168.0.2:48217 ESTABLISHED
tcp 0 0 192.168.0.1:3306 192.168.0.2:47208 ESTABLISHED
tcp 0 0 192.168.0.1:3306 192.168.0.2:46463 ESTABLISHED
tcp 0 0 192.168.0.1:3306 192.168.0.2:47229 TIME_WAIT
tcp 0 0 192.168.0.1:3306 192.168.0.2:46459 ESTABLISHED
tcp 0 0 192.168.0.1:3306 192.168.0.2:47987 ESTABLISHED
tcp 0 0 192.168.0.1:3306 192.168.0.2:46469 ESTABLISHED
tcp 0 0 192.168.0.1:3306 192.168.0.2:42371 ESTABLISHED
tcp 0 0 192.168.0.1:3306 192.168.0.2:47259 TIME_WAIT
tcp 0 0 192.168.0.1:3306 192.168.0.2:47252 ESTABLISHED
tcp 0 0 192.168.0.1:3306 192.168.0.2:46480 ESTABLISHED
tcp 0 0 192.168.0.1:3306 192.168.0.2:47275 ESTABLISHED
tcp 0 0 192.168.0.1:3306 192.168.0.2:47293 ESTABLISHED
tcp 0 0 192.168.0.1:3306 192.168.0.2:47291 TIME_WAIT
tcp 0 0 192.168.0.1:3306 192.168.0.2:47311 ESTABLISHED
tcp 0 0 192.168.0.1:3306 192.168.0.2:47304 ESTABLISHED
tcp 0 0 192.168.0.1:3306 192.168.0.2:47303 ESTABLISHED
tcp 0 0 192.168.0.1:3306 192.168.0.2:46530 ESTABLISHED
tcp 0 0 192.168.0.1:3306 192.168.0.2:49089 ESTABLISHED
tcp 0 100740 192.168.0.1:3306 192.168.0.2:47318 ESTABLISHED
tcp 0 0 192.168.0.1:3306 192.168.0.2:47315 ESTABLISHED
tcp 0 0 192.168.0.1:3306 192.168.0.2:47312 ESTABLISHED
[root@mysql ~]#
Do you see the high different number between connections !!
I am sorry for bad english but i am really get more pain daily with the high load
My server kernel
Linux httpd 2.6.18-8.1.8.el5 #1 SMP Tue Jul 10 06:50:22 EDT 2007 i686 i686 i386 GNU/Linux
I use CentOS 5 and httpd 1.3 and php 4.4.7
I try to upgrade them to httpd 2.0 and php 5.2.4 but most users can't browse the site so
i come back to 1.3
I have upgraded the kernel, I have optimized the my.cnf (mysql), the swap file is free.
The memory is not overloaded even then the I/O wait is too high, the top result is as below
The server become very very slow due to high I/O load, I am failed to dins out the reason. Please help me with the commands so I can sort it out
top - 06:09:17 up 13 min, 2 users, load average: 7.51, 8.26, 5.35
Tasks: 179 total, 1 running, 178 sleeping, 0 stopped, 0 zombie
Cpu(s): 2.7% us, 2.0% sy, 0.0% ni, 0.0% id, 95.0% wa, 0.3% hi, 0.0% si
Mem: 1027536k total, 1014232k used, 13304k free, 114232k buffers
Swap: 2040244k total, 0k used, 2040244k free, 242300k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
3474 apache 16 0 92232 54m 5780 D 0.7 5.4 0:04.01 httpd
2914 named 18 0 39448 4404 1964 S 0.3 0.4 0:01.44 named
3067 mysql 15 0 283m 42m 4288 S 0.3 4.3 0:03.87 mysqld
3826 popuser 15 0 34572 29m 2348 D 0.3 2.9 0:10.69 spamd
3876 apache 15 0 93716 55m 5512 S 0.3 5.5 0:03.41 httpd
7049 root 17 0 10508 2572 1996 S 0.3 0.3 0:00.05 sshd
7161 root 26 10 12712 5804 2656 S 0.3 0.6 0:00.37 mytop
7651 root 16 0 2784 1020 760 R 0.3 0.1 0:00.03 top
7688 popuser 16 0 6068 932 740 D 0.3 0.1 0:00.01 imapd
1 root 16 0 2588 552 472 S 0.0 0.1 0:00.72 init
2 root 34 19 0 0 0 S 0.0 0.0 0:00.00 ksoftirqd/0
3 root 5 -10 0 0 0 S 0.0 0.0 0:00.00 events/0
4 root 9 -10 0 0 0 S 0.0 0.0 0:00.00 khelper
5 root 15 -10 0 0 0 S 0.0 0.0 0:00.00 kacpid
19 root 5 -10 0 0 0 S 0.0 0.0 0:00.00 kblockd/0
20 root 15 0 0 0 0 S 0.0 0.0 0:00.00 khubd
37 root 20 0 0 0 0 S 0.0 0.0 0:00.00 pdflush
38 root 15 0 0 0 0 S 0.0 0.0 0:00.03 pdflush
39 root 15 0 0 0 0 S 0.0 0.0 0:00.01 kswapd0
40 root 11 -10 0 0 0 S 0.0 0.0 0:00.00 aio/0
186 root 25 0 0 0 0 S 0.0 0.0 0:00.00 kseriod
415 root 15 0 0 0 0 D 0.0 0.0 0:00.32 kjournald
1606 root 7 -10 0 0 0 S 0.0 0.0 0:00.00 ata/0
1607 root 7 -10 0 0 0 S 0.0 0.0 0:00.00 ata_aux
1617 root 6 -10 2044 448 380 S 0.0 0.0 0:00.01 udevd
1850 root 6 -10 0 0 0 S 0.0 0.0 0:00.00 kauditd
1915 root 19 0 0 0 0 S 0.0 0.0 0:00.00 kjournald
1916 root 19 0 0 0 0 S 0.0 0.0 0:00.00 kjournald
2698 root 15 0 3540 548 456 S 0.0 0.1 0:00.26 syslogd
2702 root 16 0 1564 384 316 S 0.0 0.0 0:00.00 klogd
2729 rpc 15 0 3560 548 452 S 0.0 0.1 0:00.00 portmap
2748 rpcuser 18 0 2348 724 620 S 0.0 0.1 0:00.00 rpc.statd
2774 root 16 0 5944 344 172 S 0.0 0.0 0:00.00 rpc.idmapd
2845 root 19 0 2568 472 264 S 0.0 0.0 0:00.00 smartd
2854 root 18 0 2928 444 368 S 0.0 0.0 0:00.00 acpid
2863 root 16 0 9548 2008 1456 S 0.0 0.2 0:00.02 cupsd
2957 root 16 0 5440 1132 832 S 0.0 0.1 0:00.04 sshd
eveyday i see my vps high load
1st problem <<<<
now i show this error for load in CPU/Memory/MySQL Usage
--------------------------------------------
/usr/sbin/mysqld --basedir/ --datadir/var/lib/mysql --usermysql --pid-file/var/lib/mysql/server.nogomhost.net.pid --skip-external-locking
---------------------------------------------
this " mysql " used 90% and 80 % from CPU
And all account used sql 0.0 , why load mysql ?
2nd problem <<<<
some times my vps is down , i don't why
3rd prblem <<<
my vps is not working to some clients , i make allow after user's sent to me ip's by apf program
i'm Disable Backup " Restore only "
top - 00:21:30 up 4 min, 1 user, load average: 20.30, 6.74, 2.42
Tasks: 221 total, 12 running, 209 sleeping, 0 stopped, 0 zombie
Cpu(s): 33.7% us, 4.4% sy, 0.0% ni, 0.0% id, 61.8% wa, 0.1% hi, 0.0% si
Mem: 1025804k total, 639076k used, 386728k free, 1296k buffers
Swap: 2031608k total, 22584k used, 2009024k free, 23804k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
3359 apache 16 0 30968 16m 5752 S 11.9 1.7 0:00.61 httpd
3065 apache 16 0 31092 16m 5776 S 5.0 1.7 0:01.38 httpd
2478 apache 16 0 29068 14m 5680 S 4.0 1.5 0:00.80 httpd
2822 apache 16 0 28420 14m 5756 D 4.0 1.4 0:00.59 httpd
2810 apache 16 0 31412 17m 5764 R 3.0 1.7 0:01.72 httpd
3111 apache 15 0 29312 14m 5756 D 3.0 1.5 0:00.76 httpd
3787 apache 16 0 29164 14m 5668 S 3.0 1.4 0:00.09 httpd
2816 apache 16 0 31556 17m 5776 S 2.6 1.7 0:01.20 httpd
3063 apache 16 0 29740 15m 5760 S 2.3 1.5 0:01.65 httpd
3226 apache 15 0 31132 16m 5772 D 2.3 1.7 0:01.62 httpd
3007 apache 16 0 29160 14m 5744 S 2.0 1.5 0:00.59 httpd
3058 apache 16 0 31612 17m 5764 S 2.0 1.7 0:00.92 httpd
3064 apache 15 0 30300 15m 5764 S 2.0 1.6 0:01.59 httpd
3481 apache 16 0 29032 14m 5752 S 2.0 1.5 0:00.15 httpd
3503 apache 16 0 29076 14m 5756 S 2.0 1.5 0:00.48 httpd
2589 apache 15 0 28980 14m 5760 S 1.7 1.4 0:00.94 httpd
3069 apache 15 0 30900 16m 5760 S 1.7 1.7 0:01.92 httpd
httpd.conf
Quote:
ServerType standalone
ServerRoot "/etc/httpd"
LockFile /var/run/httpd.lock
PidFile /var/run/httpd.pid
ScoreBoardFile logs/apache_runtime_status
ResourceConfig /dev/null
AccessConfig /dev/null
Timeout 30
KeepAlive Of
MaxKeepAliveRequests 100
KeepAliveTimeout 5
MinSpareServers 8
MaxSpareServers 18
StartServers 10
MaxClients 100
MaxRequestsPerChild 500
I am using rsync to transfer files (tar.gz) between servers. However, it makes server load increasing 3-4. Normally, server load can be around 1, but when doing the transfer, it can go up to 5+
Is there anyway to reduce the load when doing rsync?
