Hitting Max Memory
May 5, 2009I have a major problem, I keep on hitting high memory usage and cant find what is causing this, i have no idea at all where to look .....
View 6 RepliesI have a major problem, I keep on hitting high memory usage and cant find what is causing this, i have no idea at all where to look .....
View 6 RepliesI have a question regarding something.
I have a live visitor tracking software so I see visitors online in my website
Some hour ago someone from AOL United States was on my contact page website.
Then after an hour i see the same user is still on the contact page but he is going from home domain.com to domain.com/contact.php
Then after 10 seconds he goes again to the homepage, 10 seconds later he goes again the contact page. So the counter shows 1000 pages this visitors is hitting all the same, forwards and backwards, to the homepage and back to the contact page, again and again in a loop for 10 seconds in one, 10 seconds in the other.
So I think this must some user that left his PC on and is going crazy in a loop, has a virus or something abnormal. The IP resolves to a AOL proxy cache using Internet Explorer with low resolution ,536 something.
So I go into the server restart apache, and think this is going to cut or break the connection. No, user is still there looping.
So I say, enough with this, this is not normal, I block the IP. Then voila the user changes IP but same browser from AOL. I say what? Block the new IP and this little devil changes IP again. So i think this must be someone trying to corrupt my webstats or is having fun on me, since a DDOS attack would not be so stupid to use only 1 IP. I block every IP and he keeps changing. So I block the full range from 205.188.116/***
I have a powerful 8 core 8gb ram web server with scsi raid drives running RedHat EL 4. This server handles 2,000 - 3,000 HTTP requests per second via Litespeed httpd without strain (over 60%+ CPU idle time during peak load, under 1% IO wait). As the traffic volume continues to increase I've encountered a strange problem, the symptoms of which are as follows:
- About 1/4 or 1/3 of new connections are not answered by the server - they time out.
- All connections that are answered have exactly 3 seconds added to the time it takes to establish connection with the server (can be seen as "Connecting to ..." phase in FireFox). HTTP response times were tested by Pingdom from multiple locations all over the world.
- The problem is either "on" or "off", it is not gradual.
- Server ping is unaffected during the problem - no delay and no packet drops.
- The problem does not happen during off-peak hours of the day.
If litespeed httpd settings are tweaked to keep as many connections as possible in keepalive state for as long as possible, the problem is avoided, while tens of thousands of connections are kept in keepalive state.
Possible causes that were tested and eliminated: PHP/MySQL load (problem applies to static files exactly the same), CPU / IO / RAM, network uplink, hardware firewall, DNS.
This makes me think that there is some kind of bottleneck of how many NEW connections per second the server can accept. By maxing out keepalive quantity and duration I'm reducing the number of new connections per second. This is a temporary fix that will only work up to a certain point.
After investigation, litespeed staff verified that my litespeed configuration was correct and after some testing said that nothing in litespeed was responsible for this limiting factor. Litespeed process uses relatively little CPU and can definitely handle more volume.
Following sysctl.conf values were increased substantially to see if that will make a difference: tcp_max_syn_backlog, tcp_max_tw_buckets, tcp_max_orphans, netdev_max_backlog, somaxconn, file-max. This didn't produce any results. Disabling syncookies didn't help either. dmesg doesn't have any notices of limits being hit or throttles being applied.
Litespeed staff suggests that likely some limit in linux kernel is being reached. The strange 3 second delay does seem like an "intelligent" DDOS protection strategy of some sort. Perhaps this is some kind of kernel level DDOS protection?
I have been using managed servers for all of my webhosting career. I just decided to try to do it all on my own and of course, here come the growing pains.
I went with Linode for my new hosting provider. I followed their guides to get the initial setup done, minus setting up MariaDB.
I then went ahead and installed Plesk 12. The install went off without a hitch. But, now that I try to hit my hostname:8443, I get a 404.
I have done the following in an attempt to resolve the issue:
- Restart the server
- Restart the sw-cp-server
- Remove the /etc/sw-cp-server/conf.d/agent.conf (which didn't exist)
I do have the following firewalld rules in place:
firewall-cmd --zone=public--add-port=8443/tcp --permanent
firewall-cmd --zone=public--add-port=8447/tcp --permanent
I have a VPS. And have had an issue both when it was 1Gig and now I recently downgraded it to 768m, because I am moving some sites to a dedicated.
However, the part I am having trouble grasping is that when I look at graphs from Munin, it will typically always show 200-400MB free memory (and free -m and top agrees with munin), but Munin shows 'committed' memory that is above the total Ram on the VPS and once the 'committed' ram exceeds the VPS limit, processes start failing.
So, why is 'committed' memory exceeding the RAM on my VPS, when Munin, free -m and top all show there is free memory available?
Code:
root@server [~]# free -m
total used free shared buffers cached
Mem: 768 449 318 0 0 0
-/+ buffers/cache: 449 318
Swap: 0 0 0
Here's a graph that munin produces that shows the 'committed' memory exceeding the total memory.
[url]
I just got a new server Dual E5520 with 6GB RAM, SAS 15k rpm raid10. It's running well. However, the memory usage is just around 2.5GB, even when I have more traffic. Here is the kernel info
Quote:
# uname -a
Linux server2.[url]2.6.18-128.1.10.el5 #1 SMP Thu May 7 10:35:59 EDT 2009 x86_64 x86_64 x86_64 GNU/Linux
Any idea that we can put more content into memory?
I just ordered a server from serverbeach that should have come with 2 GB but I see that this one comes with 8 GB
Unfortunately, I seem to be missing 7 GB of ram.
Installed Physical Memory: 8 GB
Total Physical Memory: 1 GB
Windows 2008 Server Web 32-bit
Now, being a 32-bit system, I should see 3-4 GB of ram right?
Any idea why only 1 GB is available for the OS?
[url]
I have a 512mb DV server with Mediatemple, which I am running 24 (ish) domains off (most of them static websites) and a teamspeak server. I would say MAX theres 10 users online at a time)
Now, I know its running out of memory because i get frequent QoS Alerts in plesk (kmemsize is apparently the memory size):
Oct 01, 2009 11:52:57 AMBlack zonekmemsize
I have attached my results (when I did top).
My questions are:
1. Should I be expecting to be out of memory running what I am?
2. Is there a way to see the problem domains (memory wise)?
3. Are there any ways I can reduce the memory? (I have followed this already:
[url]
4. Where is the memory usage coming from (I am finding it very hard to understand TOP)
I am hoping someone with experience of these things can comment on memory usage on my VPS partition. The master server on which my partition sits seems to be running at full memory usage and I'm getting lots of fork and mutex errors in apache causing apache to crash several times a day.
I'm running Invision Power Board on there with an average of 100 users in the last 15 mins during most of the day.
oomguarpages and privmpages are reported in 4KB blocks.
Hello everyone.i run LAMP on a dedicated server at theplanet.I have a small vbulletin forum.
I m planning to move to a new server.Just a quick question.for my new hardware,do i give more emphasis to ram or cpu...i will be getting 2 gb at the minimum.
SO,is LAMP dependant more on cpu resources or ram?
I previuosly have a forum hosted on a VPS with a 512 MB RAM (OpenVZ) and at that time it was only using 300MB of ram during peak time but the server was always down due to harware failures so I move to a new host this time Using Xen with a 768 RAM now it is using all the RAM available which is double the ram that it uses before. Is it really normal for a XEN vps to consume more memory than on a VPS using OpenVZ?
View 2 Replies View Relatedtoday I recieved an email from my server saying:
Drive Space Critical on server
Drive Critical: /dev/simfs (/) is 91% full
When i check the whm I see
cpsrvdfailed
exim (exim-4.68-1_cpanel_maildir)up
ftpdup
httpd (2.2.8 (Unix))up
imapup
mysql (4.1.22-standard)up
named (9.3.3rc2)up
popup
Server Load0.11 (2 cpus)
Memory Used38 %
Swap Used0.00 %
Disk /dev/simfs (/) 91 %
what i dont understand is where did it go. I dont really have much traffic and nothing was uploaded or downloaded. I dont have any automatic backups enabled. How do I get it back to the normal 40%
I do notice i have alot of cpu usage
Top Process%CPU 77.4gzip
Top Process%CPU 76.2gzip
Top Process%CPU 75.9gzip
Which is also confussing to me because I am the only user. I didnt do any backups didnt have any major traffic. And my disk space "memory used" didnt change.
How much memory would I need to run a couple of websites, with gallery,postgresql,wordpress,dotproject,spamassassin on top of usual apache, mysql, php etc?
Most of the cheap VPS starts from 196MB or 256MB. 512MB upgrades are expensive :p
How much extra memory do I need on a VPs to be safe ?
Do I need something like 20% more of what I actually use just to be safe?
I am trying to optimize my VPS setup and can't seem to get it to use all of the memory that I have. I have problems even getting it to use half of it. What kind of changes can I make so that it uses more memory while reducing load? My recent MySQL and Apache conf optimizations I have read about here and other sites have sent my loads above 1, but the memory usage is staying the same.
View 4 Replies View RelatedI've a question with XEN VPS. I rented vps with sweden provider and its 20 GB HD and 256MB memory. The setup isnt bad, done within 1 day. I check inside the vps and its XEN VPS.
I tried "top" command and wow, I am supprised !! here what I saw
Mem: 262320k total, 208708k used, 53612k free, 54680k buffers
isnt it funny ? 50MB++ left(not yet run anything, no panel running too). is it normal ?
I have other vps running inside virtuozzo, and got 192 MB inside. even its running so many process inside(about 15) that takes about 5-10MB each, its still have more left than XEN.
Mem: 196608k total, 82972k used, 113636k free, 0k buffers
100MB++ left,
I noticed that, VPS with Xen technology, are using up far more memory than others?
Lets say, I usually use about 300mb of ram in a VPS with openvz, but VPS with xen, with the same usage, is using about 820mb of ram.
Even without running anything...after a fresh install of centos 5, with only few OS processes, its using around 170mb of ram already.
Is this so with Xen? The expected ram usage with Xen? Or am I missing something?
I have this 512MB memory VPS plan from fdcservers.net and it kept running out of memory.
The memory went up and down like roller coaster every seconds although I switched off httpd. Anyone can tell me what RAM do they assign to my VPS? Here's the beancounter results: [Please find the result in the attachment] Dont know why webhostingtalk mess up the spaces between each texts.
We are running into yellow status often at our new VPS. We have been with the web host for almost 1 year and recently got moved to a new VPS. WHM often show a yellow status for Memory Used (80% or so). As per the web host, WHM shows RAM for the entire server and not just our VPS. So how can we determine how much RAM we are using so? And to determine if we are using more RAM than we should or if others on the server are the culprit?
never got this yellow status on the old VPS.
if someone here could offer their advice/expertise in this problem. I have a 256MB CPanel VPS. When Apache is restarted, memory is around 180MB which is perfect
However, before long, memory usage is at 240MB. Looking at top processes, this is the top 5 i get...
PID USER PR NI VERT RES SHR S %CPU %MEM TIME+ COMMAND
29833 nobody 15 0 27616 14m 3776 S 1 1.4 0:30.32 httpd
26432 nobody 15 0 29104 16m 3836 S 1 1.6 0:24.80 httpd
28398 nobody 15 0 26996 14m 3776 S 0 1.4 0:28.70 httpd
28645 nobody 15 0 31324 17m 3776 S 0 1.7 0:25.93 httpd
31981 nobody 15 0 32232 17m 3776 S 0 1.7 0:38.69 httpd
Anybody able to offer any advice? I see that all processes are httpd, is lighthttpd or lightspeed a solution?
The main site serves up php content (No mySQL) and a few images. It also has a LOT of image requests which are redirected by photobucket via .htaccess.
The secondary site on the server (not yet launched) is going to be an arcade site running gamescript. I have been hesitant to release this site untill these memory issues are sorted.
My VPS Service Status showing
Memory Used 70.4 %
is that normal? how I can less memory used.
----------------------------------------------
Second I just got following email from system
"The following list of files have FAILED the md5sum comparision test. This means that the file has been changed in some way. This could be a result of an OS update or application upgrade. If the change is unexpected it should be investigated:
/usr/bin/sa-learn: FAILED
/usr/bin/sa-update: FAILED
/usr/bin/spamassassin: FAILED
/usr/bin/spamc: FAILED
/usr/bin/spamd: FAILED"
any issue with server?
I have got a VPS with slhost but seems like I am hitting my memory limit when I check in VZPP.
Is there anyway I can find out which websites are causing high loads etc and get the limit back to normal?
is there a way to quickly check and see how much guaranteed ram my VPS has?
View 14 Replies View RelatedI just want to know that when I run the command free -m (/usr/bin/free -m) what exactly this output means:
Code:
total used free shared buffers cached
Mem: 3546 3395 151 0 261 2730
-/+ buffers/cache: 403 3143
I know that the values are in megabytes, but what scares me is the amount of megabytes left. Considering that I have 4gigs of space, does this mean that I only have 151 megs of RAM space left? Or is a large portion of that 4 gigs put aside for some reason (perhaps the cache).
If so, then why is this? Is the memory still practically free?
So my cPanel / WHM VPS (512MB RAM, 1024 burstable) is apparently using over 90% of its memory (according to the "service status" panel in WHM), and has been using 80% or more every time I've happened to log in over the past 2 weeks.
There ought to be literally nothing going on on the server right now (no email sent, received or relayed, nobody visiting the sites, no uploads, no downloads, no nothing). CPU load is very reasonable (0.11, 0.04, 0.0), and none of the processes appearing when I run "top" are using any memory worth mentioning.
What's the most likely explanation, and how concerned should I be about this (considering I'm anticipating a lot of traffic next week)? Would you recommend any specific further steps to investigate?
I have 512mb of memory on my new VPS.
I got it last night and i've been setting it up since. For some reason the memory usage is at 70 percent now.... how could this be? What happens when I open my site to the public and I get hammered with users? This was the whole point of getting a VPS!
When I run yum update I get:
memory alloc (XXXXX bytes) returned null
It's probably memory problem since my VPS config is really minimalistic... running updates one-by-one (yum update packagename) works ok, but it's pain in the a** to install 100+ updates like that, manually. It's apparently some kind memory leak in yum, does anybody know some way to prevent it? E.g. a script that would download list of needed updates, save it and then run it individually.
I recently upgraded my VPS account, specifically to get more memory. During testing, all my apps were consuming right around 400K, so I upgraded from 512K just to be safe.
At first I was glad I did be because I was routinely passing my previous limit of 512. I then started to approach my current limit and grew concerned. Then I noticed that my processes total memory did not match the amount of RAM the performance tab indicated (commit charge), actually it was almost double. Prior to the upgrade, these numbers matched consistently. I have investigated this for days and consulted my peers and the internet concerning this issue. I have concluded that these two numbers should match.
Hosting company said they shouldn't match and closed the issue.
Does anyone have any experience in this? I did run out of memory once when I was at 512, and it was ugly. Not sure why it didn't use VM. Which is set to 3gigs, seems really high, do VPS typically let you mange VM?
How I can see how much guaranteed memory I have ? And how I can see how much guaranteed memory I have used ?
Additional how I can see how much bustable memory I have used or how much total memory my VPS is using.
It seems that a user may get more percentage of memory purchased for real use. I've got a xen VPS which has access to all 8 CPU cores. Guess this is a good thing to be able to burst CPU resources
[xwu@atom ~]$ cat /proc/cpuinfo | grep processor | awk '{a++} END {print a}'
8
But this requires lots of kthread running to be able to access all CPU resources, which in turn consumes quite some memory, a valuable, limited resource on a small VPS instance.
[xwu@atom ~]$ cat /proc/meminfo | grep Mem
MemTotal: 524288 kB
MemFree: 276128 kB
The output above is grathered when almost no other services are running except sshd.
While XEN VPS surely consumes more memory than OVZ VPS, I would suggest the Xen VPS can be built in such a way less memory is required to just do the housekeeping.
Of course, that would imply careful provisioning, maybe less "overselling" for the sake of lack of a term. The bottom line is how we can reduce the memory usage, while ensure individual VPS instance can still have fair share of CPU if needed.
Is there anyway in the VPS kernel config which can disable access to certain CPU core, thus reducing the number of kthreads and etc?