Optimizing Dedicated Server With MYSQL And Busy Forum
May 11, 2009
Are there any services where an ADMIN can monitor DB usage on system and make some recommendations or even find SQL that is poorly written ...
I have a DUAL harpertown, 10GB RAM, and RAID
I have a typical, gallery, busy VB forum, and video script...
THe site traffic has not increased much but my Memory keeps getting chewed up... i already did some tuning that VBULLLETIN suggested... but the memory still goes... i need a tool or someone to just monitor the server for a day and grab as much diagnostic info as possible..
I suspect that its a single query giving problems cuz i have some custom coded pages...
I don't want to split the DB and HTTP request on diff servers cuz the traffic that i get shouldn't warrant it... for now...
it's getting to the point where I need to optimize MySQL to better handle a busy server.
These days it seems MySQL is using 30% - 60% CPU almost constantly. But, the good news is that I've got 4 gigs of ram on this box and their seems to be an access of 600mb free constantly throughout the day.
Is it possible to tweak MySQL to a little more RAM dependent and take some of the load off the CPU? It seems MySQL wont go over 300mb of ram at any given time.. I'm already working on optimizing the SQL Querys on the web page itself.
my.cnf (4.1.22-standard):
# Default to using old password format for compatibility with mysql 3.x # clients (those using the mysqlclient10 compatibility package). # old_passwords=1
What minimum VPS specs should I be looking for to support a PHPBB3 forum that uses 100GB/mth bandwidth and has 50 concurrent users at peak times (measured by PHPBB, so not real-time concurrent)?
And are there any suggestions for inexpensive ($30 or less) options that would be worth trying? Have never used a VPS before.
If not, are there any shared hosting providers that specialize in hosting message boards like PHPBB?
Are there some simple things that we can do or perhaps request our server management to do to optimize our server? Not sure where to start or what to ask so would like to learn some more before speaking with the server management company. Often times, you need to know the right questions to ask.
I am having problems with apache going down at least once a day. In Plesk there is a watchdog that monitors the service and then restarts it, but tries 5 times and fails, so apache will still be down and monitoring released. I really don't know what is causing this problem, maybe I could get some help? (Server specs at bottom of post, hope this is all you need)
error_log shows:
Code: [Thu Oct 04 12:05:43 2007] [notice] caught SIGTERM, shutting down [Thu Oct 04 12:05:48 2007] [notice] suEXEC mechanism enabled (wrapper: /usr/sbin/suexec) [Thu Oct 04 12:05:48 2007] [warn] RSA server certificate CommonName (CN) `plesk' does NOT match server name!? [Thu Oct 04 12:05:48 2007] [warn] RSA server certificate CommonName (CN) `plesk' does NOT match server name!? [Thu Oct 04 12:05:48 2007] [warn] RSA server certificate CommonName (CN) `plesk' does NOT match server name!? [Thu Oct 04 12:05:48 2007] [warn] RSA server certificate CommonName (CN) `plesk' does NOT match server name!? [Thu Oct 04 12:05:48 2007] [warn] RSA server certificate CommonName (CN) `plesk' does NOT match server name!? [Thu Oct 04 12:05:48 2007] [warn] RSA server certificate CommonName (CN) `plesk' does NOT match server name!? [Thu Oct 04 12:05:48 2007] [warn] RSA server certificate CommonName (CN) `plesk' does NOT match server name!? [Thu Oct 04 12:05:48 2007] [warn] RSA server certificate CommonName (CN) `plesk' does NOT match server name!? [Thu Oct 04 12:05:48 2007] [warn] RSA server certificate CommonName (CN) `plesk' does NOT match server name!? [Thu Oct 04 12:05:48 2007] [warn] RSA server certificate CommonName (CN) `plesk' does NOT match server name!? [Thu Oct 04 12:05:48 2007] [warn] Init: SSL server IP/port conflict: default-69-64-36-86:443 (/etc/httpd/conf.d/zz010_psa_httpd.conf:271) vs. webmail:443 (/etc/httpd/conf.d/zz010_psa_httpd.conf:344) [Thu Oct 04 12:05:48 2007] [warn] Init: SSL server IP/port conflict: default-69-64-37-16:443 (/etc/httpd/conf.d/zz010_psa_httpd.conf:111) vs. *****:443 (/var/www/vhosts/*****/conf/httpd.include:12) [Thu Oct 04 12:05:48 2007] [warn] Init: You should not use name-based virtual hosts in conjunction with SSL!! [Thu Oct 04 12:05:48 2007] [notice] Digest: generating secret for digest authentication ... [Thu Oct 04 12:05:48 2007] [notice] Digest: done [Thu Oct 04 12:05:48 2007] [notice] mod_python: Creating 4 session mutexes based on 512 max processes and 0 max threads. [Thu Oct 04 12:05:48 2007] [warn] RSA server certificate CommonName (CN) `plesk' does NOT match server name!? [Thu Oct 04 12:05:48 2007] [warn] RSA server certificate CommonName (CN) `plesk' does NOT match server name!? [Thu Oct 04 12:05:48 2007] [warn] RSA server certificate CommonName (CN) `plesk' does NOT match server name!? [Thu Oct 04 12:05:48 2007] [warn] RSA server certificate CommonName (CN) `plesk' does NOT match server name!? [Thu Oct 04 12:05:48 2007] [warn] RSA server certificate CommonName (CN) `plesk' does NOT match server name!? [Thu Oct 04 12:05:48 2007] [warn] RSA server certificate CommonName (CN) `plesk' does NOT match server name!? [Thu Oct 04 12:05:48 2007] [warn] RSA server certificate CommonName (CN) `plesk' does NOT match server name!? [Thu Oct 04 12:05:48 2007] [warn] RSA server certificate CommonName (CN) `plesk' does NOT match server name!? [Thu Oct 04 12:05:48 2007] [warn] RSA server certificate CommonName (CN) `plesk' does NOT match server name!? [Thu Oct 04 12:05:48 2007] [warn] RSA server certificate CommonName (CN) `plesk' does NOT match server name!? [Thu Oct 04 12:05:48 2007] [warn] Init: SSL server IP/port conflict: default-69-64-36-86:443 (/etc/httpd/conf.d/zz010_psa_httpd.conf:271) vs. webmail:443 (/etc/httpd/conf.d/zz010_psa_httpd.conf:344) [Thu Oct 04 12:05:48 2007] [warn] Init: SSL server IP/port conflict: default-69-64-37-16:443 (/etc/httpd/conf.d/zz010_psa_httpd.conf:111) vs. *****:443 (/var/www/vhosts/*****/conf/httpd.include:12) [Thu Oct 04 12:05:48 2007] [warn] Init: You should not use name-based virtual hosts in conjunction with SSL!! [Thu Oct 04 12:05:48 2007] [notice] Apache configured -- resuming normal operations [Thu Oct 04 12:06:40 2007] [warn] child process 25195 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25197 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25204 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25207 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25219 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25228 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25232 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25244 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25246 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25257 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25261 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25262 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25265 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25275 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25278 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25281 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25283 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25287 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25351 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25291 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25300 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25302 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25307 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25355 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25365 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25374 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25376 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25377 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25408 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25412 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25423 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25430 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25434 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25437 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25460 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25463 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25474 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25475 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25476 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25565 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25478 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25480 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25481 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25483 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25484 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25485 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25486 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25583 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25489 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25490 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25491 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25493 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25590 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:40 2007] [warn] child process 25591 still did not exit, sending a SIGTERM [Thu Oct 04 12:06:42 2007] [notice] caught SIGTERM, shutting down [Thu Oct 04 12:06:46 2007] [notice] suEXEC mechanism enabled (wrapper: /usr/sbin/suexec) [Thu Oct 04 12:06:46 2007] [warn] RSA server certificate CommonName (CN) `plesk' does NOT match server name!? [Thu Oct 04 12:06:46 2007] [warn] RSA server certificate CommonName (CN) `plesk' does NOT match server name!? [Thu Oct 04 12:06:46 2007] [warn] RSA server certificate CommonName (CN) `plesk' does NOT match server name!? [Thu Oct 04 12:06:46 2007] [warn] RSA server certificate CommonName (CN) `plesk' does NOT match server name!? [Thu Oct 04 12:06:46 2007] [warn] RSA server certificate CommonName (CN) `plesk' does NOT match server name!? [Thu Oct 04 12:06:46 2007] [warn] RSA server certificate CommonName (CN) `plesk' does NOT match server name!? [Thu Oct 04 12:06:46 2007] [warn] RSA server certificate CommonName (CN) `plesk' does NOT match server name!? [Thu Oct 04 12:06:46 2007] [warn] RSA server certificate CommonName (CN) `plesk' does NOT match server name!? [Thu Oct 04 12:06:46 2007] [warn] RSA server certificate CommonName (CN) `plesk' does NOT match server name!? [Thu Oct 04 12:06:46 2007] [warn] RSA server certificate CommonName (CN) `plesk' does NOT match server name!? [Thu Oct 04 12:06:46 2007] [warn] Init: SSL server IP/port conflict: default-69-64-36-86:443 (/etc/httpd/conf.d/zz010_psa_httpd.conf:272) vs. webmail:443 (/etc/httpd/conf.d/zz010_psa_httpd.conf:345)
The my sql seems to take much load in my VPs, configuration file is as follows
[mysqld]
set-variable=local-infile=0 datadir=/var/lib/mysql socket=/var/lib/mysql/mysql.sock user=mysql # Default to using old password format for compatibility with mysql 3.x # clients (those using the mysqlclient10 compatibility package). old_passwords=1
I optimized a mysql table of 2 million records and about 500MB.. it took about 15 minutes.. However, on the same DB now i have another huge table of 88 million records, it size is 2.2 GB and it has about 30 MB to optimize... my questions..
1.- How can I speed up the optimization process so it can take the less possible time? any tweaks to my.cnf?
2.- Should I repair it using phpmyadmin or just from the shell?
3.- Should I stop http traffic during this optimization?
This is a dedicated db mysql server that handles a large VB forum with 5-8 users online average:
What I did here was create /var/log/mysqld.slow.log for queries that are taking one second or longer. After around 36 hours, here is what I came up with. Since the file size of /var/log/mysqld.slow.log was 219KB, posting it in its entirety it not practical. Therefore, I used a program, the perl script known as mysql_slow_log_parser found on www.retards.org, to parse the mysqld.slow.log to make it easier to interpret and read. The result was that the original filesize of 219KB was converted to the smaller size of 14KB....
[info] server seems busy, (you may need to increase StartServers, or Min/MaxSpareServers), spawning 8 children, there are 6 idle, and 37 total children
Is there a way I can track the HTTP traffic to which domain is running with high traffic. Due to traffic load I/O wait is increasing. I want to suspend the domain that have the large traffic to avoid down time.
I have a friend which owns a 2k alexa rank forum using VB
The server hangs and he gets mysql connection error in logs
Quote:
Database error in vBulletin : mysql_connect() [<a href='function.mysql-connect'>function.mysql-connect</a>]: Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock'
The server is a dual Pentium D with 4GB RAM
currently 600 users online and 20% RAM used
in rush hours there are 2000 users online and 50% RAM used
We want to optimize mysql - this is the current my.cnf
I have a pages with high load - load avg is about 10-20.
and in the error_log of the apache message:
[Mon Mar 17 18:10:19 2008] [info] server seems busy, (you may need to increase StartServers, or Min/MaxSpareServers), spawning 8 children, there are 6 idle, and 32 total children
when i try to install the VB forum it's show me this warning Messege!
Code: Error description: mysql_connect() [function.mysql-connect]: Access denied for user 'user_db'@'localhost' (using password: YES) /home/*****/public_html/includes/class_core.php on line 274
The database has failed to connect because you do not have permission to connect to the server. Please confirm the values entered in the 'includes/config.php' file. how can i fix this problem in Mysql USER ?
i have a Pentium D 820, 2GB Ram at LT where i am hosting a few proxies. Using Centos and Directadmin.
It's realy fast and i am happy with it. The only problem i am facing is that load is jumping up to 60 sometimes but just for a few seconds. Especially when a lot of people are using the proxy and it slows down a bit. That affects only the proxified pages and not a few personal html sites i also host there.
At the moment i am seeing in top that the CPU usage varies from 0,2 to 8, 12, 21 etc but just for a second or two
telling me that mysql is hitting loads of 25, which he says is very high and i don't quite know what it means. He is strongly recommending that i shld get another dedicated server for mysql alone.
So can i get some advice on how I can assess the validity of his recommendations? I see that my CPU is load is hitting 125-150% daily. So i suppose there is some truth?
He is recommending that i get a raid-5 which is best. How can i know a suitable configuration of a new server to get? Of course, if i got all the money in the world i shld buy the best. But with constraints on budget, i want to get one (if i really need a new server) that is good for current loads with some projected margins for growth.
I've a huge site that runs on PHP and MYSQL, I'm going to get a dedicated server and make it for MYSQL so I need to know what server should I get for MYSQL ?
does it need to have lots of ram or should I get high CPU ?
I was trying to upgraded MySql on my godaddy V.dedicated server.. And basicly ive screwed it up somehow.
I need to get back up and running and could do with some help on the best way to do that..
Ive visited the MySql website.. ive been playing with the shell (a little too much thats why its screwed up) so i can access the server via that and the server is running
Operating System: Red Hat Fedora Core 2
Can anyone point me first of all to the right download. and maybe point me to a tutorial or give me some advice on installing.. if ive messed up mysql does this also have any impact on the php or anything else?
i am getting mysql down issues with my current dedicated server. I would like to move my database to a dedicated server where only mysql will be running. Just wondering if this will be faster than the localhost? I have planned to buy dedicated server from another hosting company so definitely there will be a good enough connectivity distance.
my current servers are part of this mess with Alphared: [url]
what I'm looking for:
static content main server: average cpu, average ram 15-20gb data tops, but could use a fast drive need about 6tb/m of higher quality bandwidth 2 machine cluster for forums
only thing on this will be vBulletin forums. current database is about 6gb (~7 million posts) averaging about 800 members active per 15 mins this isn't for a business, so it all comes out of my pocket. however, after the $#@! with Alphared I do recognize the importance of a good host and I am willing to put money toward that as needed. however, my goal is in the $600-$800/m range for everything. is that price range doable? if not, what is a reasonable price for what I'm asking? and can anyone recommend reliable hosts (especially one that can correctly setup the cluster for the forums).
