How To Reduce OpenVZ Memory Usage By 50%
Apr 18, 2009
Few months ago I bought new small VPS box (OpenVZ, 128 MB RAM) in order to place there a new monitoring node of my site monitoring system. Such small amount of RAM is a challenge for operating system optimisation techniques (OpenVZ doesn’t have “swap” as Xen does).
First of all I discovered that apache2-mpm-worker (Apache implementation that uses threads) consumes more memory (100MB) than the classic version that use separate processes (20MB). I had to switch to apache2-mpm-prefork version then.
Next unpleasant suprise: small Python app eats 100MB of virtual memory! I checked that virtual (not resident) memory is taken into account by VPS. I applied some tools to locate memory bottleneck, but without success. Next I added logs with current memory usage to track call that causes big memory consumption. I tracked the following line:
server = WSGIServer(app)
is guilty for high memory increase. After few minutes of googling I located problem: default stack size for a thread. Details:This line creates few threads to handle concurrent calls
Stack size is counted towards virtual memory
Default stack size is very high on Linux (8MB)
Every thread uses separate stack
=> multi threaded application will use at least number_of_threads * 8MB virtual memory!
First solution: use limits.conf file. I altered /etc/security/limits.conf file and changed default stack size. But I couldn’t make this change to alter Python scripts called from Apache (any suggestions why?).
Second (working) solution: lower default stack size using ulimit. For processes launched from Apache I altered /etc/init.d/apache2 script and added:
ulimit -s 256
Now every thread (in apache / Python application) will use only 128 kB of virtual memory (I lowered VSZ from 70 MB to 17 MB this way). Now I have additional space to enlarge MySQL buffers to make DB operations faster.
There’s even better place to inject ulimit system-wide: you can insert this call in:
/etc/init.d/rc
script. Then ulimit will be applied to all daemons (as Apache) and all login sessions. I reduced virtual memory usage by 50% this way.
Note: you may increase stack size on stack overflow errors. In my opinion 256 kb is safe option for most systems, you may increase if in doubt. Still memory savings are big.
View 4 Replies
ADVERTISEMENT
Mar 18, 2008
Last year my web host stated that my site was over utilizing allowed resources for my plan. Specifically, they state that I was overusing the CPU. At the time, I had to upgrade my plan in order to stay online. I would like to move to a new host, but the prospective hosts are all suggesting a dedicated server because of my CPU usage. I don't want to pay that kind of money, so I would really like to curb the CPU problem. Does anyone know how to reduce the CPU of a Wordpress blog? I tried posting this question over at Wordpress.org, but I haven't received a single reply.
View 11 Replies
View Related
Mar 18, 2008
My server details
Intel 2.4 Ghz P4 Celeron
os-redhat
RAM-2GB DDR
harddisk-160+50Gb
bandwith-3000Gb
now iam haveing more that 0.50-1.20 cpu useage,also cpu useage is also increased i hosted only 6 site out what only one site use MSQL all other site are plain download site,how to reduce the cpu load can u figure me out this issue also give me some tips to reduce the cpu usage
View 8 Replies
View Related
Oct 31, 2009
How I can see how much guaranteed memory I have ? And how I can see how much guaranteed memory I have used ?
Additional how I can see how much bustable memory I have used or how much total memory my VPS is using.
View 14 Replies
View Related
Apr 16, 2009
When my OpenVZ VPS is running with lighttpd, RAM usage is very low, but when I switch to Apache, RAM usage goes all the way up to the max. I've had this happen to two VPSs already and can't figure out why this happens.
I also have two other VPSs, one Xen and one Virtuozzo and have no troubles with Apache.
View 6 Replies
View Related
Dec 1, 2007
Let say your VPS has 128MB of memory. My understanding would be that if you had, say, another 128MB of 'burstable' memory, that if another guest on the system wasn't using all it's memory, or if there was some spare on the system, then your VPS could use that.
But, how much memory does your VPS really think it has available? and what happens if the other VPS (or the system) decides it wants it memory back?
Does OpenVZ just start killing off your processes until it free's up enough memory?
View 13 Replies
View Related
Oct 30, 2008
How to limit memory for VE on openvz
Boys how to limit the memory Guaranteed of one VE in MB example:
128MB
256MB
512MB
1024MB
2048MB
How to set this to the VE?
View 12 Replies
View Related
Jul 16, 2009
I just got a new server Dual E5520 with 6GB RAM, SAS 15k rpm raid10. It's running well. However, the memory usage is just around 2.5GB, even when I have more traffic. Here is the kernel info
Quote:
# uname -a
Linux server2.[url]2.6.18-128.1.10.el5 #1 SMP Thu May 7 10:35:59 EDT 2009 x86_64 x86_64 x86_64 GNU/Linux
Any idea that we can put more content into memory?
View 11 Replies
View Related
Nov 1, 2007
In the last two weeks I have noticed a major issue concerning memory usage. HyperVM and Top (via console) report two very different amounts of memory being used. On a fresh rebuild, my overall usage should be no more then 22mb. However, HyperVM reports 45mb whereas Top reports 11mb. Notice the huge gap?
I was told by my VPS host that OpenVZ / HyperVM is to blame. The overwhelming issue is: if I pay for 256mb of ram and I'm being cut short, then I'm obviously over paying. What's more: how can I tell whether or not I'm being cut short?
Has anyone run across these problems in the last two weeks?
View 4 Replies
View Related
Jun 5, 2009
We're in the process of setting up our new VPS Server, and we can create a VPS with 256MB memory and with 512MB memory fine, but when creating one with 1GB memory, we get the error:
Could Not Start Vps, Reason: Unable to fork: Cannot allocate memory: Not enough resources to start environment: Container start failed:
Even though the server has 4GB RAM and no other VPS's running. Any ideas?
Thanks.
[Edit]We now seem to get the problem for all our VPS's. I think it may be something to do with the Server not unallocating the memory, as we've provisioned and de-provisioned quite a few Servers
View 10 Replies
View Related
Nov 23, 2008
[openvz] WHM not show partition on Service Status and Disk usage
Hi, the VPS not show the partition on "Service Status" of WHM and in the "Show Current Disk Usage" see the Attach Files images...
How to fix/show this?
Attached Thumbnails
ÂÂ*
View 12 Replies
View Related
Dec 25, 2008
today i get a vps from lime, and i try to create a vps
but when i try to enable vps i get this message :
Could Not Start Vps, Reason: vzquota : (error) Quota getstat syscall for id 110: Inappropriate ioctl for device: vzquota init failed [3]:
and the disk usage not display properly:
View 3 Replies
View Related
Jun 23, 2009
It seems that a user may get more percentage of memory purchased for real use. I've got a xen VPS which has access to all 8 CPU cores. Guess this is a good thing to be able to burst CPU resources
[xwu@atom ~]$ cat /proc/cpuinfo | grep processor | awk '{a++} END {print a}'
8
But this requires lots of kthread running to be able to access all CPU resources, which in turn consumes quite some memory, a valuable, limited resource on a small VPS instance.
[xwu@atom ~]$ cat /proc/meminfo | grep Mem
MemTotal: 524288 kB
MemFree: 276128 kB
The output above is grathered when almost no other services are running except sshd.
While XEN VPS surely consumes more memory than OVZ VPS, I would suggest the Xen VPS can be built in such a way less memory is required to just do the housekeeping.
Of course, that would imply careful provisioning, maybe less "overselling" for the sake of lack of a term. The bottom line is how we can reduce the memory usage, while ensure individual VPS instance can still have fair share of CPU if needed.
Is there anyway in the VPS kernel config which can disable access to certain CPU core, thus reducing the number of kthreads and etc?
View 0 Replies
View Related
Dec 1, 2008
I do not know if i have problems with my vps but "top" output looks strange for me. It looks like apache processes have huge VIRT parameter and all processes have huge SWAP param.
My VPS 712 guaranteed and 1024 burstable. I'm running 10 virt hosts with very small traffic. Totally not more than 500 visits/day. Most of sites are static and only two are PHP.
Apache and PHP configuration are very standard.
Here is top output: ...
View 14 Replies
View Related
Jul 30, 2007
this is my machine's vmstat result
procs memory swap io system cpu
r b w swpd free buff cache si so bi bo in cs us sy id
1 1 0 1864 16352 34576 146252 0 3 541 106 146 142 6 23 71
I want to free some space
How can I do that?
View 3 Replies
View Related
Nov 1, 2007
how much adding php to apache will increase memory usage on a VPS? This would be php5.
I need it to use phpMyAdmin to manage my MySQL database (actual site is running off tomcat but jspmyadmin won't work for some reason).
Or can someone recommend a database design tool (I've used toad data modeler before) which I can use on my home pc to generate SQL statements for execution on the server (and please don't say notepad).
View 4 Replies
View Related
Mar 10, 2007
We have a server that is rebooting, we saw that free memory reaches almost 0 before the server reboot.
i´m running a cpanel server on P4 3.6HT / 1GB RAM / load always under 1.0:
Apache
46.6 to 80 requests/sec - 183.7 kB/second - 4034 B/request
top - 11:07:15 up 21 min, 1 user, load average: 0.29, 0.38, 0.46
Mem: 1026348k total, 529632k used, 496716k free, 31148k buffers
Most processes are:
12239 nobody 15 0 49436 7324 3116 S 1 0.7 0:00.25 /usr/local/apache/bin/httpd -DSSL
Is the time to increase RAM server or would be a hardware problem?
View 5 Replies
View Related
Aug 30, 2007
Those of you who work with shared hosting, how much memory per customer do you allow for PHP? What about for Ruby on Rails?
View 3 Replies
View Related
Jan 2, 2007
I am trying to run tomcat on my linux server and I am getting memory allocation error. When I see check memory usage it is full, but when I check the cpu usage it show as this:
load average: 0.00, 0.00, 0.00
When I run top command, I found tis.
16003 root 19 19 5492 5492 5040 D N 0.7 0.6 0:00 0 pkgacct - triwaste
1 root 8 0 476 432 412 S 0.0 0.0 0:35 0 init [3]
2 root 9 0 0 0 0 SW 0.0 0.0 0:00 0 keventd
3 root 19 19 0 0 0 SWN 0.0 0.0 0:00 0 ksoftirqd_CPU0
4 root 9 0 0 0 0 SW 0.0 0.0 12:09 0 kswapd
5 root 9 0 0 0 0 SW 0.0 0.0 0:00 0 bdflush
6 root 9 0 0 0 0 SW 0.0 0.0 4:16 0 kupdated
7 root 9 0 0 0 0 DW 0.0 0.0 40:29 0 kjournald
384 root 9 0 0 0 0 SW 0.0 0.0 0:00 0 kjournald
385 root 9 0 0 0 0 SW 0.0 0.0 8:05 0 kjournald
387 root 9 0 0 0 0 SW 0.0 0.0 2:45 0 loop0
642 root 8 0 800 752 692 S 0.0 0.0 0:02 0 xinetd -stayalive -pidfile /var/run/xinetd.pid
653 root 9 0 1324 1168 1128 S 0.0 0.1 0:44 0 /usr/sbin/sshd
920 named 9 0 4012 3488 2240 S 0.0 0.3 0:00 0 /usr/sbin/named -u named
921 named 9 0 4012 3488 2240 S 0.0 0.3 0:19 0 /usr/sbin/named -u named
922 named 9 0 4012 3488 2240 S 0.0 0.3 3:49 0 /usr/sbin/named -u named
923 named 9 0 4012 3488 2240 S 0.0 0.3 0:04 0 /usr/sbin/named -u named
924 named 9 0 4012 3488 2240 S 0.0 0.3 1:07 0 /usr/sbin/named -u named
1252 root 8 0 928 616 564 S 0.0 0.0 0:10 0 crond
1260 root 9 0 5172 1436 1408 S 0.0 0.1 0:59 0 /usr/local/apache/bin/httpd -DSSL
1346 xfs 9 0 2528 680 656 S 0.0 0.0 0:00 0 xfs -droppriv -daemon
1355 daemon 9 0 556 540 500 S 0.0 0.0 0:00 0 /usr/sbin/atd
1552 root 18 19 11844 8740 7968 S N 0.0 0.9 35:28 0 cpanellogd - setting up logs for detail
1599 root 9 0 1008 876 876 S 0.0 0.0 0:00 0 /bin/sh /usr/bin/mysqld_safe --datadir=/var/lib/mysql --pi
1630 mysql 9 0 70928 56M 53624 S 0.0 6.3 0:34 0 /usr/sbin/mysqld --basedir=/ --datadir=/var/lib/mysql
When the memory usage 6.3 is what is it mean? Is it using 6.3% of the total memory?
View 0 Replies
View Related
Mar 28, 2009
Am using Hypervm,my all vms are not using more than 512 MB memory but when i click on server as localhost the there is show maximum memory usage I have total 8 GB it always show 5-6 GB usage and never drop down, How can I fix this matters?
View 7 Replies
View Related
Dec 30, 2008
I was just wondering about DA memory load. Like CPANEL load around 300mb and LXADMIN about 20mb. I was going to get VPS with 256 only to host 40-50 church sites with just static html, not dynamic or anything. Greatly appreciated with your input. I'm still learning all of this
View 8 Replies
View Related
Mar 23, 2009
I have a VPS with 384 MB RAM, with free about 100-120 MB. I've upgraded to 512 MB (to have some other features...). I notice that the memory usage is always about 250-300 MB. For example, now:
Code:
[root@host ~]# free -m
total used free shared buffers cached
Mem: 512 311 200 0 0 0
-/+ buffers/cache: 311 200
Swap: 0 0 0
But PHP tells "out of memory" in some tasks
The current PHP config is memory limit 192 MB (it was 96 MB, then I tried to increase).
[url]
Code:
<b>Fatal error</b>: Out of memory (allocated 19660800) (tried to allocate 39 bytes)
in <b>##hidden##/includes/joomla.php</b> on line <b>3041</b><br />
View 9 Replies
View Related
Nov 6, 2009
Does anyone know if MySQL 5.1 or 5.0 uses less memory than 4.1 does?
View 3 Replies
View Related
Oct 20, 2009
I'm currently playing with my dedicated server, it isn't much but for learning purposes it's more than enough.
I have CentOS 5.3 installed on the server.
It's Intel Atom 330 with 2 GB RAM.
Now my question is:
When server is running nothing but basic install memory comsumption is aroun 500-600 MB.
Today I have rsynced 11 GB of data from one of my VPSs to the ded server and the memory comsumption on the server sky rocketed to 2 GB, leaving only 56 Mb free.
Strange.. (for me)
And there was almost no (110 Kb) swap usage.
Now the memory comsumption is ~ 1.2 GB.
View 6 Replies
View Related
Jun 10, 2009
Since a short while back my server memory usage is 100%. The amount of
visitors decreased so the memory should be lower in consumption than before.
I suspect a newly installed script could have bugs or misuse of the
server by hackers. I don't know how to see on the server what script or
what part makes the memory use so high. I see Apache is very high but
I'm on VPS.
Technical data........
View 4 Replies
View Related
Jul 13, 2009
My managed dedicated server at 1and 1 has very low load, but quite slow, I was trying to figure out the reason. The top and free command ( I run at midnight without traffic), here is the result. Can anybody tell me if the memory usage is normal, anything suspicious. Look like the memory usage is high even with no traffic, but 1and 1 support say that's because it's reserved for cache.
top - 02:01:38 up 31 days, 14:13, 0 users, load average: 0.00, 0.03, 0.07
Tasks: 6 total, 2 running, 4 sleeping, 0 stopped, 0 zombie
Cpu(s): 0.0%us, 0.0%sy, 0.0%ni,100.0%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 1017068k total, 972620k used, 44448k free, 169564k buffers
Swap: 514064k total, 26076k used, 487988k free, 509580k cached
total used free shared buffers cached
Mem: 1017068 972656 44412 0 169600 509612
-/+ buffers/cache: 293444 723624
Swap: 514064 26076 487988
View 1 Replies
View Related
Mar 23, 2009
So I just need some clarification:
Code:
-bash-3.2$ free -m
total used free shared buffers cached
Mem: 2000 1131 869 0 219 513
-/+ buffers/cache: 398 1602
Swap: 4094 0 4094
How much memory have I used?
View 7 Replies
View Related
Mar 16, 2009
I have a VPS w/ KnownHost on CPanel and 256mb of RAM (I know, bad mix). It's the newer CPanel that is VPS optimized.
There are 3 websites on it and get < 500 hits/day total on average.
Right now I am at 128mb used/127mb free. It seems higher than it should/needs to be.
View 7 Replies
View Related
Oct 11, 2009
I have a Drupal site with around 1000 visitors/day on a basic VPS. (HyperVM with lxadmin) Burstable RAM is 384MB and my site reachs it.
is this normal for a site like this?
anything that I can do to decrease the memory usage?
View 14 Replies
View Related
Nov 18, 2008
my grunted memory for apatchi is 51 meg
i want make him 256meg
because the vps its alwayes down
see this please
HTML Code:
29890 nobody 0
2.5
0.1 /usr/local/apache/bin/httpd -k start -DSSL
31854 nobody 0
2.3
0.1 /usr/local/apache/bin/httpd -k start -DSSL
31766 nobody 0
1.8
0.1 /usr/local/apache/bin/httpd -k start -DSSL
32043 nobody 0
1.7
0.1 /usr/local/apache/bin/httpd -k start -DSSL
25921 nobody 0
1.4
0.1 /usr/local/apache/bin/httpd -k start -DSSL
32014 nobody 0
1.3
0.1 /usr/local/apache/bin/httpd -k start -DSSL
25998 nobody 0
1.3
0.1 /usr/local/apache/bin/httpd -k start -DSSL
30388 nobody 0
1.0
0.1 /usr/local/apache/bin/httpd -k start -DSSL
View 3 Replies
View Related
Jul 21, 2008
I have a dedicated server with 2 GB of RAM. I am concerned with my server's memory usage when I am currently not running many applications.
[root@digm1 ~]# free -m
total used free shared buffers cached
Mem: 1947 1896 50 0 106 1579
-/+ buffers/cache: 210 1736
Swap: 2047 0 2047
It tells me that I only have 50 MB of memory left and it drops down to ~20 MB after Apache has been running for a while. Once it runs out of that 20 MB I will start swapping right? I have also run this command and do not see any process taking up anywhere close to what is being reported:
ps -eo pid,ppid,rss,vsize,pcpu,pmem,cmd -ww --sort=pid
No process is using more than 1.5% memory and only 3 use this much.
Is Linux caching memory which will be used after I run out?
View 2 Replies
View Related