Input Wanted: Optimizing SQL - For Millions Of Queries
Jul 7, 2008
I am running a SQL test server here that is piping HUGE amounts of data for a test project I am running.
Approximately 30 queries a second - constantly. That's over 2.5M queries a day -- so we are talking big (I think?)
I am currently running this test on a
AMD Phenom 9300, 4GB RAM - SATA 500GB HDD and I am running MySQL 5.0.51a i386 on CentOS
I have programmed a process control for our applications purpose - basically it controls the launching of our SQL intense applications, and stops launching when the Load is greater than 2.5
I have plans to optimize the number of queries (I will build in a cache to some of the applications - and run INSERT statements all together) however I am looking for SQL tweaks that will improve performance. Would running the 64bit version work better?
View 12 Replies
ADVERTISEMENT
Jun 14, 2008
What I did here was create /var/log/mysqld.slow.log for queries that are taking one second or longer. After around 36 hours, here is what I came up with. Since the file size of /var/log/mysqld.slow.log was 219KB, posting it in its entirety it not practical. Therefore, I used a program, the perl script known as mysql_slow_log_parser found on www.retards.org, to parse the mysqld.slow.log to make it easier to interpret and read. The result was that the original filesize of 219KB was converted to the smaller size of 14KB....
View 7 Replies
View Related
Jul 25, 2008
I have a website that offers web stats. It receives like 30 million hits per day (legitimate) in addition to a large number of invalid URL requests and DOS attacks that max at 50MB. I currently have a server at liquidweb who, after bearing too much with me, informed me that I might have to move away some day because the attacks are affecting their network. I have been with them for 4 years now.
We tried using a normal firewall but it couldn't handle the normal requests. I don't have a budget to afford an expensive one. Firewall tweaking is not easy because of the large number of legitimate requests.
So, my questions are:
1. What should I do? Is there a known, affordable firewall that can help (or any other setting)?
2. Which hosting company will take me and manage to make things work without getting their network affected?
View 10 Replies
View Related
Mar 14, 2008
Please post your preferred hosts here that allow dedicated server hosting with adult content.
I know Softlayer does, I need some cheaper alternatives.
View 14 Replies
View Related
Jun 17, 2009
I need 2U of colocation (I have 2 1U servers) I need to home in San Diego with 24/7 access.
I do not want to be in either I2B or AIS facilities.
View 14 Replies
View Related
Aug 30, 2009
I am leasing servers for about 2 years now, and now I wanted to start with colocation. I am selling VPS so I need VPS nodes. I would buy node with 32Gb RAM, latest Xeons, Hardware Raid 10, etc. so I figured that it is better to colocate in the long run.
Can you suggest me best colocation company in terms of quality of bandwidth and support.
I really need prompt support, ticket answered in 15 minutes, and only premium bandwidth.
Also, is there company in USA which assembles rack servers for a fee. I would like to pay them for the components I find on newegg and their fee, and that they order the components, assemble the hardware, test it, and send it to DC.
View 12 Replies
View Related
Mar 30, 2009
Alright, here's the deal--
I need a budget chicago server -- I know, very difficult to find (last company I went with was Singlehop, and they're great, but I can't afford it for what I'd wish to do.)
Anyways, here's what I need my server for --
Some personal, non busy websites(my webhost that I've been using is being let go by me :[ I need this server for it reliably.)
CentOS5 or RH4 is preferred.
cPanel is required
I intend to host a few websites, and TWO counter-strike 1.6 servers (not busy or CPU intense really)
So..
View 14 Replies
View Related
Jul 30, 2008
I purchased some services from hostfresh.com but after waiting 3 days for my hosting to be set up (just basic web host space) i decided to switch to wrzhost.com where i was ready to go within 10 min of buying the services. I sent a support ticked to hostfresh(before i asked for the refund) and a lady told me to contact sales , when i told her i was getting no reply she again told me to contact sales so i bought else where. I emailed sales and billing 2 times each and sent 2 support tickets to them over a week and a half but have gotten no reply at all and when i sent a ticket to the lady that was actually replying , she now wont reply to my tickets also.
Anyone else have a problem with them and how did you get your refund?
Paypal was used to pay
View 14 Replies
View Related
Jul 21, 2008
I've been with JaguarPc since 1999 and I just realized that through all my years here I never gave them a shout out. These guys are very helpful and it's amazing the type of service they offer for the money. I have 2 virtual private servers with them and absolutely no issues. They manage the entire server for me for $33.95 a month. So if anybody needs good hosting:
[url]
View 10 Replies
View Related
May 30, 2005
I need a company to register my domain, and then forward emails and urls to my actual site that is somewhere else. I don't need any actual web hosting or email pop (at the moment). My main requirement is reliability.
The company I currently use bounces some email to me and forwards other email to a black hole. They're also not replying to my mail, so it's time to leave. BTW, this is a company that has generally excellent reviews.
View 6 Replies
View Related
Mar 18, 2008
I've got a decent server, quad processor, 12GB ram, terabyte of hot swappable RAID 10 disk. Its at an Equinix site. They provide UPS, backup generators, etc and fiber to the usual major backbone folks.
But its a lights out facility. I want someone else to handle backups, rebooting when needed, etc.
I'd like to let someone else provide the service. Use my 2U server or I can rent yours.
Need MySql, Apache, Tomcat, SSL, Java, ssh access. I've got wildcard certs for SSL, domain registered, etc.
I'm guessing that I can get this for about $500 per month with low bandwidth (this is an IT application, not peer-to-peer or torrents.). Let me know if my budget is off base. I think one megabyte/second sustained over the month, 95% averaged is suffiicent. At least until the business grows, we can then talk about getting racks of blades at higher cost.
View 5 Replies
View Related
Apr 15, 2008
We use dedicated servers at several data centers.
We have used a particular host since 1999 (we were shared/resellers then) and have used dedicated with them since 2001.
For a particular set of development servers, moderate traffic e-commerce sites and testing we use them.
One particular server has been our workhorse and it basically had a ridiculously low grandfathered in price.
Unfortunately they moved us. That's not a problem. The problem is they moved our dedicated machine with 3 drives to a vps.
So instead of our own machine, we share a machine, and instead of 3 drives, we have 3 partitions on one drive.
(the drives were 1 for OS, 1 for websites, and 1 for backups)
This is a windows 2k3 machine
The did this without notice or warning.
We saw it, then they mentioned it in a support ticket, and now refuse to discuss it (no response to questions)
So, unfortunately we hate to move.
We use 3 provider, none of them have we been with less than 3 years. We are super loyal if you treat us right.
WE dedicate and not co-lo. Co-lo def would save us money, but we just prefer a dedicated environment.
What we are lookng for is an entry level server to begin a relationship with a new host
for this machine
need two small drives (35 GB or more)
half gig or more of memory
p4 or more processor
100mbps port preferred
win 2k3
if you want to throw in a control panel great
(sounds crappy doesnt it? but thats what we used for many years)
multiple IPs
of course, feel free to make it better
looking to pay less than $199/mo - no setup
less than 150 would be stupendous.
willing to sign a contract.
AM I asking too much? considering u could probably do the above with spare parts? I don't know
Prefer North American based machines.
We really don't have that much of a simultaneous strain on these, they are work horses really.
View 14 Replies
View Related
Apr 15, 2007
Preferably in the Irvine area.
Requirements are simple:
Two AC outlets
1U server
5 IPs
256kbps or 60GB transfer
No 24/7 support needed
No monitoring
Was paying $49/mo, but my rates were recently jacked up.
View 14 Replies
View Related
Feb 13, 2007
I have a 512mb cPanel VPS and would like to try and save a bit more ram, I have made the below changes to the httpd.conf and have also turned spamd, entropychat, melange, mailman, the only webstats I have is AWStats
Code:
MinSpareServers 2
MaxSpareServers 5
StartServers 3
Can anyone recommend any other changes to save some more ram ?
For anyone wanting to know, the VPS is being used to serve my websites
View 1 Replies
View Related
Feb 11, 2009
I have an Architecture/Interior Design firm and send lots of emails and CAD and photo files. I am designing a website and having it hosted for the first time. (I know...I know...I should have done it long ago..) I have read tons of articles on web hosting.
The website will be lots of photos (thumbnails to be enlarged possibly), text.
Has anyone heard of Inmotion? (web hosting company) They seem to have what I am looking for at a decent price and have gotten some good reviews (but I don't know if those reviews are sponsored by someone).
I work on a Macbook Pro and am looking into creating the website on iWeb....
View 7 Replies
View Related
Jul 24, 2008
I have gotten my server configured and running, and have been advised to look into creating virtual hosts for each site, I have found good information on setting virtual hosts within postfix, but does anyone have any good reading on configuring Apache2?
I only have one site I intend to host in the immediacy, but I'd like to host multiples eventually.
View 4 Replies
View Related
Jul 2, 2008
I'm thinking about colocating in Milwaukee, purchasing a rack over at the Cogent facility to resell and was faced with a problem. The problem is, to some people, a rather simple one. How can a reseller sell their servers when competition sells their services for unlimited space, bandwidth, domains, sub-domains and such for only $1/month?
I've done the math I could with the information provided to me but am not able to get around the above problem. I can see why some users go to this type of service though. A lot of websites don't even need more than what these sellers offer, and with good reason.
Usually that person only uses 10MB of space and 10GB of transfer.
To break even on hosting, I would have to be able to sell 12 servers at $169 each. Our hardware would be fairly new, capable of whatever you want it to do, short of cutting your lawn, clipping your toenails and what have you, all with 5mbps standard port connectivity inside a 1u case. Obviously you can upgrade the port speeds, drives or whatever else you need in it. This is to snag users into coming with us. Bigger guys charge much more per month for higher end hardware.
I guess what I'm trying to ask is simple. Is it even worth it? Are there users out there who are happy and able to put down $100+ a month for a dedicated server? I'm willing to expand our current services to this type of offering, but I need your input based on your experiences on what you think will end up happening.
View 8 Replies
View Related
Apr 14, 2009
I am wanting my VPS Optimize to run at it best
I am also wanting MySQL on the VPS to run at it best
Which company do you recommend for VPS and MySQL optimizing?
View 1 Replies
View Related
Jun 27, 2008
I have a server facing to 150+ requests/sec. Using apache 1.3.39. The current config here
Timeout 15
KeepAlive Off
MaxKeepAliveRequests 10
KeepAliveTimeout 5
MinSpareServers 15
MaxSpareServers 20
StartServers 15
MaxClients 400
MaxRequestsPerChild 100000
I wonder if I can change anything to make site is faster? Currently, it's very slow. It's one core2duo box with 2GB RAM
View 14 Replies
View Related
Sep 6, 2008
A friend of mine has a VPS server from godaddy, the site he is hosting on this VPS is quite slow and times out a lot.
What would be the best option? Move out of godaddy? Upgrade the plan? or hire someone to optimize the server (apache/mysql).
If you would recommend the third option, it would be great if you can let me know about companies that provide this service.
View 6 Replies
View Related
May 10, 2007
We host our DNS with DNSmadeeasy.com. We noticed that the number of DNS requests is too high. So we decided to contact their support and ask them for log file, so we can determine
what's going on.
Reply we got from them is the following:
We researched your queries and we found that many of them were coming from the SoftLayer resolving name servers. We phone their admins to report the abuse and they said that the queries were infact coming from your own server with them.
We will not charge for any overage on the queries this month so you can research what on your server is causing these queries. But we will provide you with logs of about 5% of our your traffic.
here is the example of the line from log file sent by them:
May 10 17:15:48 t145 named[29945]: client 66.228.118.72#52529: query: host-196.218.57.145.tedata.net.mydomain.com IN AAAA -E
May 10 17:15:48 t145 named[29945]: client 66.228.118.72#52529: query: afontenayssb-151-1-40-153.w83-114.abo.wanadoo.fr.mydomain.com IN AAAA -E
I changed the real domain name to "mydomain.com"
I checked the apache access log and found these hosts there in exact order as they are in log file sent by dnsmadeeasy.
What is strange is that why is my server making back these requests ? Also these requests are bad because these are not valid domain names:
e.g. should be "host-196.218.57.145.tedata.net" instead of "host-196.218.57.145.tedata.net.mydomain.com"
Seems that it includes ".mydomain.com" to the end of every request.
Is there a way to discover what is making those DNS queries?
View 11 Replies
View Related
Jan 19, 2007
how can i run queries in dnstuff.com
for examlpe we can run following query for DNS Lookup MX record
Code:
nslookup -q=MX www.webhostingtalk.com
ISP Cached DNS Lookup =?
E-mail Test = ?
ISP Cached DNS Lookup =?
View 3 Replies
View Related
Jun 13, 2007
I have 2000 domains set to
NS1.anydomain.com NS2 etc
Is it possible, through some script or otherwise, to send the traffic to certain/chosen domains to a completely different set of nameservers.? Preferably without having too much server load?
I already use a domain catchall, so no NS records are actually registered on the server.
View 2 Replies
View Related
Aug 12, 2007
i run a popular forum with at least 1000-1200 users online at any given time which reaches 2000-2500 at peak times...
i am using Invision Power Board.
Problem:
Server seems to lose connection with mysql server at peak loads with server load going upto 30.
The server is good enough for these type of loads...
Server Specs:
Code:
Dual AMD Opteron 248
4 GB RAM
CENTOS Enterprise 4.5 i686
Cpanel
The my.cnf file is as follows:
-----------------------------------
Code:
[mysqld]
datadir=/var/lib/mysql
socket=/var/lib/mysql/mysql.sock
skip-locking
skip-innodb
long_query_time=4
key_buffer_size = 64M
query_cache_limit=32M
query_cache_size=256M
query_cache_type=1
max_connections=1024
max_user_connections=1024
interactive_timeout=20
wait_timeout=20
connect_timeout=6
thread_cache_size=256
key_buffer_size=64M
log-queries-not-using-indexes
join_buffer=8M
low_priority_updates=1
max_allowed_packet=16M
table_cache=2048
record_buffer=8M
sort_buffer_size=16M
read_buffer_size=4M
max_connect_errors=10
# Try number of CPU's*2 for thread_concurrency
thread_concurrency=4
myisam_sort_buffer_size=64M
[mysql.server]
user=mysql
basedir=/var/lib
[safe_mysqld]
err-log=/var/log/mysqld.log
#pid-file=/var/lib/mysql/mysql.pid
open_files_limit=8192
[mysqldump]
quick
max_allowed_packet=16M
[mysql]
no-auto-rehash
#safe-updates
[isamchk]
key_buffer=128M
sort_buffer=128M
read_buffer=32M
write_buffer=32M
[myisamchk]
key_buffer=128M
sort_buffer=128M
read_buffer=32M
write_buffer=32M
[mysqlhotcopy]
interactive-timeout
----------------------------------------------
any changes that would bring down the server load?
Also, some entries from httpd.conf are as follows:
Code:
Timeout 30
KeepAlive Off
MinSpareServers 15
MaxSpareServers 40
StartServers 15
MaxClients 300
MaxRequestsPerChild 1000
View 14 Replies
View Related
Dec 29, 2014
I have been contracted to resolve an issue for a Plesk installation. This installation in particular is receiving the 'no input file specified' error when attempting to access Horde webmail, and I believe it is because:
IIS is in FastCGI mode (as expected) Permissions are not allowing php to execute out of the expected path.
PHP is working for all other domains (there are multiple) on this account, it is just the horde PHP that is not functional.
I have tried contacting Skype support but received no answer.
I have tried running the commands --fix-webmail that were suggested in other threads, but they have no effect.
View 2 Replies
View Related
Jul 14, 2008
I am checking DNS Report for a domain and in nameservers records I am getting following:
Recursive Queries
I could use the nameservers listed below to performe recursive queries. It may be that I am wrong but the chances of that are low. You should not have nameservers that allow recursive queries as this will allow almost anyone to use your nameservers and can cause problems. Problem record(s) are:
xxx.xxx.xxx.xxx
I am using Windows 2003 Standard and Microsoft DNS Server. Any ideas what is this all about and how to fix it?
View 2 Replies
View Related
Apr 14, 2009
I am wanting my VPS Optimize to run at it best
I am also wanting MySQL on the VPS to run at it best
Which company do you recommend for VPS and MySQL optimizing?
View 1 Replies
View Related
May 26, 2008
I remember seeing a website/forum where you couldn't post your server stats and httpd.conf settings and experts would give advice on settings you should use.
Does anyone know the url to this site, or site similar to it
View 14 Replies
View Related
Apr 7, 2008
I'm currently hosting all of my stuff with my own Wild West Reselling Account, i.e., InnoDomains.com.
Problem is I'm running multiple Wordpress Installations and a few websites that have some pretty intense MySQL work going on in the background, and I use about 250GB per month in bandwidth.
My Account gets the 503 downtime errors because according to Customer Service I cannot run more than 50 MySQL queries in one second. Well, that's not much of a challenge because a lengthy wordpress page runs about 90 queries and loads in 2-3 seconds. Time this by three including the other websites and a couple of shopping stores, and I'm easily doing more than 100-150 queries a second more than several times a day, thereby seeing that nasty, irritating error.
My other option is to split up all the websites over basic $ 3.95 per month accounts. I don't want to switch to a dedicated server yet because I'm not really making a whole lot of money (about $ 30 per month). Another thing I could do is move my MySQL testing to a local machine, and that may actually reduce the load on the damn server.
Are there any hosts out there that will allow me to do more than 100 MySQL queries per second? If so, are there any that are any good?
View 13 Replies
View Related
May 24, 2007
Are there some simple things that we can do or perhaps request our server management to do to optimize our server? Not sure where to start or what to ask so would like to learn some more before speaking with the server management company. Often times, you need to know the right questions to ask.
View 3 Replies
View Related
