I been logging queries for a whole 3 days and my logs is huge and the problem seems to be my phpBB search table thats causing such problems for me heres what I logged
Code:
# Time: 070219 19:41:53
# User@Host: admin_db[admin_db] @ localhost []
# Query_time: 11 Lock_time: 0 Rows_sent: 0 Rows_examined: 13274745
SELECT word_id
FROM phpbb_search_wordmatch
GROUP BY word_id
HAVING COUNT(word_id) > 259756;
Everything from phpbb_search_wordmatch takes more then 11 sec Query time.
How can I optimze this and lower the Query time to something like 1 or 2.
Some adivce would be helpful me not that good with mysql.
I'm running a Xeon Quad Core 2.5GHz with 2GB RAM. Comments on my setup for shared hosting? (will upgrade ram if people believe that will help with increase page loadtimes.)
I run a small Fan community / forum that I am looking to move to a VPS server as these are a little cheaper than Dedicated
I have a couple of questions & wondered if anyone could assist?
I need a Control panel as I have had experience with Plesk & Cpanel & do not have any SSH experience whatsoever
I see Cpanel offered in some VPS offers, Would this include things like Fantastico etc?
Would I better suited to a Managed or Unmanaged account? I assume seeing I have no SSH knowledge Managed account would be better
I had looked at a site called nameway dot com & like the look of their VPS offer but would love to hear other peoples thoughts on them (I haven't posted enough to post a url so site is www dot nameway dot com/resellers-hosting.htm )
If I were to go unamanaged or part managed if there is such a thing, would this mean I would have to upload things like apache for php, mysql etc? or would this still be standard in an unmanaged account if a cpanel or control panel is offered?
Warning: mysql_connect() [function.mysql-connect]: Can't create a new thread (errno 11); if you are not out of available memory, you can consult the manual for a possible OS-dependent bug in /home/user/public_html/file.php on line 400 Can't create a new thread (errno 11); if you are not out of available memory, you can consult the manual for a possible OS-dependent bug
I have a feeling there's something not quite right with it
I ran DNSreport.com's query and it said there were a few problems which might cause slowdowns (Which is what i'm experiencing), but didn't go into any detail on how to fix it
They've now put in a fee for doing anymore dns checks, so i'm abit in the dark as to what to do?
currently im on a VPS server and things are fine normally. However whenever there are like 20 users on my site (browser based text game) things get ugly. The sql queries are all needed and don't think it can get much more effiecent.
Anyways my website is very dynamic all information is changing every second.
For example a user when every page they go to or refresh their account is being set to time() to show that they are online at that second. Processor load gets up to like 6 at times and that is when it is virtually impossible to connect to the site.
Is there anythign you recommend? mysql is the top then when i login via ssh and run 'top'
I have a large proxy, are getting ~3k pageviews/day.
I only got 128 MB RAM on my VPS, so no panels works on it (not even kloxo/lxa). I would guess apache wont do it in the long run either.
So I decided to go with nginx. But I feel it isn't quite good optimized, as it sometimes takes like 1 minute to load the page.
Here is my current config:
####################################################################### # # This is the main Nginx configuration file. # # More information about the configuration options is available on # * the English wiki - http://wiki.codemongers.com/Main # * the Russian documentation - http://sysoev.ru/nginx/ # #######################################################################
#---------------------------------------------------------------------- # Main Module - directives that cover basic functionality # # http://wiki.codemongers.com/NginxMainModule # #----------------------------------------------------------------------
I am facing problem regarding my site. I have dedicated server with WHM/cPanel, i have integrated tomcat with apache , the apache processes are too high aroung 1200-1400, So please guide me howto optimize my apache for better performance.
root@trick [/]# ps aux | grep -c httpd 1403 root@trick [/]# ps aux | grep -c mysql 3 root@trick [/l]# free -m total used free shared buffers cached Mem: 4053 3408 645 0 220 1890 -/+ buffers/cache: 1297 2756 Swap: 4094 0 4094
---------------------------------------------
KeepAlive On MaxKeepAliveRequests 100 KeepAliveTimeout 15
I'm looking to get some tips to optimize my Apache webservers. Now i have 2 apache servers with load balancer. If someone can guide me and bring some tips for this purpose is highly appreciated.
Also, i would like to know about disadvantages of enabling KeepAlive. Recently i have enabled it and found my site load much better. But the disadvantage (that i experienced personally) is after stop browsing for a while (about 40-60 minutes) i need to keep triggering the URL of site several times to get enter the website. If not i can't get into it and it likes the site giving no response at all.
right ive got a server thats getting battered at the moment by lots of apache processes, ive moved sql off to a seperate box (with private lan so thats fine) but now i need to optimize/replace apache with something less intensive on resources, only problem is im using plesk on this server so i am not sure if i can change the webserver app?
I am switching from shared hosting to managed VPS. I have minimal knowledge of UNIX/Apache, pretty good with PHP and programming in general.
So, what I have now is my VPS, with 512mb of ram, CentOS, cpanel and my two sites, not live yet, that is, I haven't changed dns records in the registrar.
I want to try to optimize the box or whatever is the correct name for it and understand the whole thing better. Mainly to learn more, I dot' think I'll be pressed for memory or bandwidth for now. Still, at least knowing things I can optimize for speed of space.
Few things that I assume should allow for some simplification and RAM savings(hopefully) is that:
a) Both sites are hobby sites, not very big load. Few thousand visitors a day. Traffic is around 10gb monthly combined.
b) Both sites are mine, nobody else on that box, so I don't have to worry about customers screwing things up and caging things internally.
Based on that, I don't really need email for the second site domain.
When I run top command I see 2 exim processes running. Is that normal, or is it because I have 2 domains registered there? And if yes can one be disabled?
Same applies to pop3-login and imap-login processes, 2 copies of each. Can I have just one of each, i.e. exim, pop3-login and imap-login?
Next, I selected not to run log analyzer cpanellogd for 21 hours, i.e. it'll run for 3 hours a day. I assume that should be sufficient for the site like mine?
I did read sticky about securing the site and quite a bit about Apache/mysql optimizations.
I've got a VPS server with a total process limit of 100 process.
I know this sounds like a newbie question, what numbers would you recommend for the Apache 2 Conf file to get it running as best as possible without it taking the server down?
i am having quite problem with my server i cant get it to optimize it. During peak times the load goes beyond 10 sometimes 20 to 50 sometimes its just under 1. I have my webserver running on P4 Core 2 6300, 1 GB ram, 250 HDD, on CentOS 4.4 (kernel 2.6.9-42.0.10) etc. It has cpanel/whm running Apache 1.3.7, php 4.4, mysql 4.1, mailscanner, eaccelerator, etc i dont know really what other info to show you.
I host about 200 accounts and there are 4 large php forums (not like WHT) running on it. Sometimes pages stop loading especially these forums have to refresh to get page load.
During day there are approx 700-900 connections.
Previously i had phpsuexec and the load never went beyond 4-5, i have removed it to install eaccelerator.
Am just about to emigrate to USA (yay) and I want to keep my xxxxxxxx.co.uk domain active so I can recieve emails etc. I would also like to register a yyyyyyyyy.com domain.
Can anyone advise me on this please?
Can I host a .co.uk in the US?
Can I host a different .com and .co.uk on the same servers?
Can anyone recommend a good reliable, cheapish ($10-$20per month) host that provide MSSQL and asp.net 2.0 support.
My troubles started about a month ago, on a Windows 2003 VPS (clean, no plesk/cpanel): Every ting worked fine until, for no obvious reason, IIS started to consume too much memory, I tried separating sites (two) in separate application pools, adjusting recycle triggers - nothing worked, sooner or later worker processes would use too much memory and fail, only way to fix the problem was to restart it.
At this point I would like to mention that: - MySQL is optimized for low memory usage (and task manager never said otherwise) - PHP is limited to 20MB RAM, only few modules were enabled - the only other application running is WinDNS, and it doesn't seam RAM hungry
So a few days ago I decided to kill IIS/app server role altogether and install apache, something I should have done long time ago. Everything went smooth, VPS performance dramatically increased, memory usage was negotiable... at first.
As time goes by, apache consumed more memory (httpd.exe comes to about 80MB in 12 hours), it doesn't seam to be dependant on site traffic, and it doesn't drop, server didn't fail once yet and I have apache on scheduled graceful restarts every 24hrs.
I didn't try setting a MaxRequestsPerChild value, I'll keep that as a last option because I really want to get to the bottom of this
So... I suspect it could be PHP, the only thing that's common in both scenarios. I did upgrade to the latest version during Apache installation though.
I have a dedicated server with the 'typical' 2 ips pointing to the same instance of BIND on it for its nameservers.
I would like to actually have an ns2 to remove this single point of failure. Even though my 'infrastructure,' such as it is, is only a single server; my research on here and elsewhere suggests that this separate DNS server will make my site appear to be non-responsive when the server is down rather than simply non-existent. This is the behavior I would like to have!
I am still left with questions on implementing this. I know I need either a small VPS account, or an account with a provider such as DNSMadeEasy.com. What is not clear to me is how I would set up such an arrangement with the separate DNS server.
Does anyone have a link to a resource that shows how to do this, or would be willing to do a quick run through here?
I am not technically incompetent but am unfamiliar with this procedure and cannot seem to find documentation.
I've got 18 domains parked on it, with only 4 of those having active websites. There are 3 mailman lists set up, and a further 10 or so email accounts with SpamAssassin active on them.
It also runs cPanel/WHM.
The server itself has 384Mb RAM, with 512Mb burst.
Am I putting too much strain on the VPS with the amount of domains/emails I run through it? Is cPanel/WHM the problem? Is the server config suspect? Are VPS accounts only good for 1 or 2 domains?
if using the Internap FCP technology to optimize the routing. I want a feedback on it, since I want to deploy this solution for have a better traffict routing.
Also, is anyone using avaya? i have looked in their website, but I have no information about their routing optimizer. Basically I want to go beyond of normal BGP since I will be deploying VoIP services soon.
just got a new server and got my site up and running on it perfectly but ive noticed its a bit slower than my old server and i think this is down to my incorrctly optimized mysql setup. ive used the my.cnf off my old server with some minor edits but im wondering what people can suggest i change for the following server spec
AMD Athlon 64 X2 4200+ 2GB DDR2 120gb Sata hd
currently my my.cnf is as follows
Quote:
# This is for a system with little memory (32M - 64M) where MySQL plays # an important part, or systems up to 128M where MySQL is used together with # other programs (such as a web server) # # You can copy this file to # /etc/my.cnf to set global options, # mysql-data-dir/my.cnf to set server-specific options (in this # installation this directory is /var/lib/mysql) or # ~/.my.cnf to set user-specific options. # # In this file, you can use all long options that a program supports. # If you want to know which options a program supports, run the program # with the "--help" option.
# The following options will be passed to all MySQL clients [client] #password = your_password port = 3306 socket = /var/lib/mysql/mysql.sock
according to mysql tuning primer it reports the following
Quote:
-- MYSQL PERFORMANCE TUNING PRIMER -- - By: Matthew Montgomery -
MySQL Version 4.1.20-log x86_64
Uptime = 0 days 17 hrs 52 min 44 sec Avg. qps = 15 Total Questions = 1028682 Threads Connected = 1
Warning: Server has not been running for at least 48hrs. It may not be safe to use these recommendations
To find out more information on how each of these runtime variables effects performance visit: [url] Visit [url] for info about MySQL's Enterprise Monitoring and Advisory Service
SLOW QUERIES Current long_query_time = 5 sec. You have 0 out of 1028694 that take longer than 5 sec. to complete The slow query log is NOT enabled. Your long_query_time seems to be fine
WORKER THREADS Current thread_cache_size = 256 Current threads_cached = 3 Current threads_per_sec = 0 Historic threads_per_sec = 0 Your thread_cache_size is fine
MAX CONNECTIONS Current max_connections = 1000 Current threads_connected = 1 Historic max_used_connections = 4 The number of used connections is 0% of the configured maximum. You are using less than 10% of your configured max_connections. Lowering max_connections could help to avoid an over-allocation of memory See "MEMORY USAGE" section to make sure you are not over-allocating
MEMORY USAGE Max Memory Ever Allocated : 243 M Configured Max Per-thread Buffers : 41 G Configured Max Global Buffers : 75 M Configured Max Memory Limit : 41 G Physical Memory : 1.90 G
Max memory limit exceeds 90% of physical memory
KEY BUFFER Current MyISAM index space = 12 M Current key_buffer_size = 1 M Key cache miss rate is 1 : 14581 Key buffer fill ratio = 44.00 % Your key_buffer_size seems to be too high. Perhaps you can use these resources elsewhere
QUERY CACHE Query cache is enabled Current query_cache_size = 64 M Current query_cache_used = 5 M Current query_cache_limit = 64 M Current Query cache Memory fill ratio = 8.42 % Current query_cache_min_res_unit = 4 K Query Cache is 15 % fragmented Run "FLUSH QUERY CACHE" periodically to defragment the query cache memory If you have many small queries lower 'query_cache_min_res_unit' to reduce fragmentation. Your query_cache_size seems to be too high. Perhaps you can use these resources elsewhere MySQL won't cache query results that are larger than query_cache_limit in size
SORT OPERATIONS Current sort_buffer_size = 32 M Current record/read_rnd_buffer_size = 1020 K Sort buffer seems to be fine
JOINS Current join_buffer_size = 3.00 M You have had 378 queries where a join could not use an index properly You should enable "log-queries-not-using-indexes" Then look for non indexed joins in the slow query log. If you are unable to optimize your queries you may want to increase your join_buffer_size to accommodate larger joins in one pass.
Note! This script will still suggest raising the join_buffer_size when ANY joins not using indexes are found.
OPEN FILES LIMIT Current open_files_limit = 50000 files The open_files_limit should typically be set to at least 2x-3x that of table_cache if you have heavy MyISAM usage. Your open_files_limit value seems to be fine
TABLE CACHE Current table_cache value = 2000 tables You have a total of 908 tables You have 102 open tables. The table_cache value seems to be fine
TEMP TABLES Current max_heap_table_size = 31 M Current tmp_table_size = 30 M Of 3666 temp tables, 0% were created on disk Created disk tmp tables ratio seems fine
TABLE SCANS Current read_buffer_size = 5 M Current table scan ratio = 1544 : 1 read_buffer_size seems to be fine
TABLE LOCKING Current Lock Wait ratio = 1 : 4664 You may benefit from selective use of InnoDB.
The servers load is vey bad, most of the time 7-8+ and the IO WAIT more than 60% which is decreasing server performace. Please help me to optimzie the MySQL specially. If you have the good my.cnf config please give me the complete config file.
[client] port = 3306 socket = /var/lib/mysql/mysql.sock
anyone have any tips on how to optimize WHM / cpanel to run at top performance on 256-512mb guaranteed VPS accounts?
I've had several VPS providers in the past, and each one of them run webpages and LAMP stuff fine, but as soon as I bring up cpanel /whm, it either crashes the VPS altogether, or cpanel and whm run very slow, choppy, pretty much bogging the whole VPS down, doesn't seem to matter if the VPS is running on 256 or 512, still same issues. I run on Virtuozzo, which I don't know if thats part of the problem, or not,
really all I use out of cpanel/ WHM is the standard things like
creating/deleting accounts RVSkin, Fantastico
basically what a reseller would use. the rest of the stuff I do not use, so I was just wondering if there was a tutorial on how to strip down WHM / cpanel somehow so it would run better on VPS accounts? or if someone could write one up perhaps?
I currently have my jimpix site hosted by a really good Canadian company called Alentus. BUT, they are based in Canada, and I'm based in the UK.
I am working on a site at the moment which will require a timetable / scheduling facility, so working in the 7 hour time difference between the UK and Canada is a pain.
The package I need is: ASP Hosting MySQL Hosting Use of ASPJPeg and ASPUpload Components
I've not been able to find a UK hosting firm offering these - or haven't spent hours looking for one, so wanted to check here if anyone could recommend a UK firm offering these - and a good one if possible! I have used other hosts before with other web clients, and some have been pretty ropey to say the least!
I hope some of you folks could give me some pointers here. I have a server that is used for a gaming clan's purposes. Nothing major as far as games go, but what I got I want running at peak efficiency.
The most important is the Counter-Strike source. I really need the kernel frequency to be tweaked for this. The number one question is can I merely modify the existing config file and recompile that or do I need to start all over? If I could do that is it something like make old or something to that matter?
I am running a couple other servers as well, but there is never a time where all the servers have anyone in them. I keep everything running. After installing some weird stuffs here and there I got the memory usage to go down. I think. Regarding a scenario of having more than one instance of a game, is there any way to share memory between them?
My Swap. Is there a way to force idling games to move to it instead of using physical memory?
The kernel is what I really need to take care of. I'm still somewhat of a n00b and have just switched from centos to debian to top it off. So any tips would make my day. Thanks for reading me.
Hi"Optimization of computing resources has long been an important management issue. One of its aspects concerns server scalability and the question of whether an organization should scale-up or scale out.Assume that the computing performance of the servers can be measured by variable 0 <=p, that their total cost is given by "c" and the relationship between server performance and cost is defined by c=αp^β"
a. What is the cost-performance elasticity(ђ), precisely?
b. What would be the range of values for ђ that would be expected by moore's law and what are its implications?
c. What would be the range of values for ђ that would lead managers to scale-out? Draw a graph and throughly explain the implications.
someone to look at my DB and optimize it as it is running ridiculously high loads of 25. It is vbulletin. I'm only looking for professional companies for this job.
Is it possible to call a cron job with a query string appended to the file. I have no problem setting up crons in the cron tab..but i'd like the cron to fetch a url that looks something like
/home/php/some-file.php?a=1
is this possible directly through the cron job? I guess an alternative is call some php file that uses curl but i was wondering if there 's a direct way.
I have a friend which owns a 2k alexa rank forum using VB
The server hangs and he gets mysql connection error in logs
Quote:
Database error in vBulletin : mysql_connect() [<a href='function.mysql-connect'>function.mysql-connect</a>]: Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock'
The server is a dual Pentium D with 4GB RAM
currently 600 users online and 20% RAM used
in rush hours there are 2000 users online and 50% RAM used
We want to optimize mysql - this is the current my.cnf
