DNS Hosting, Number Queries Versus Hardware Config
Jun 10, 2008
For those who run their own DNS servers I am interested in what DNS software your running on BSD or Linux platforms and on average how many DNS queries per second it serves on what hardware specification?
if anyone has insight or comments about Fusion-io's ioDRIVE versus their ioXtreme drive. If you do, I would appreciate reading your thoughts on this.
The ioDRIVE is their enterprise product while the ioXtreme drive is being marketed to the consumer market. Both seem to be extremely impressive products.
My main question is whether or not an ioXtreme is suitable for web server use. The ioDRIVE is made for server use and is much more expensive, so is not only a bit less attractive because of the cost but also a bit out of my reach, financially, at this point.
So, what do you think about the ioXtreme being used in a web server? Any reason that this might be a bad idea?
Would Intel's X25-E be a better solution than the ioXtreme? The ioXtreme is PCIe based & the X25-E is a SATA drive.
im running a few blogs on a shared hosting account (steadfast) and i noticed the 18 sql queries being generated by a fresh install of wordpress 2.7 are taking 0.246 seconds to execute. <!-- 18 queries. 0.246 seconds. -->
considering this is a shared hosting server with over 800+ more domains on it, is the performance better or worse when compared to other shared hosting providers ? archim3des
We also have the appropriate licenses for Windows and MSSQL (which is what we use).
I am currently on a shared host that we'd like to move away from. We would like to have the ability to run both a production and a development environment. We'd also like to be able to offer web-hosting to a couple of other small sites...
So what I'm wondering is whether it really makes sense to colo. Honestly, it seems like we'll get a lot more bang for our buck versus dedicated. Most dedicated servers that are under 200 could only be described as sad and pathetic. However, they may be enough for what we need....
Is there any hosting providers without file number limits? Or higher limits...
I've been using dreamhost, but found that they have a 500k file number limits. So now i'm using less than 2 gigs of disk and still have 370+ worthless free gigs of disk space
I have a custom made server side bulk email application. My current hosting service does allow unlimited emails (most restrict to around 3-500 per hour) but im having other problems with them.
As such I need a new host for this tool. I send around 45,000 emails as newsletters to my site members about 10 times a year.
I know that a dedicated server is a obvious solution but I dont want the management headaches and higher costs that go with it.
Has anyone got a shared hosting solution that doesn't restrict email numbers or atleast has much higher limits?
I am currently selling hosting from my reseller account. Planning to buy a dedicated server. I will be hosting around 250 hosting accounts with PHP and Mysql on a centos 5 OS with Cpanel. The 250 sites will be controlled by normal terms and conditions that comes with shared hosting. Now I am confused about the configuration to go for:
My Budget is around USD 200 per server.
Here is the config I thought to go for initially: Xeon 3060 Dual Core 2 x 250 GB SATA II HDD 4 GB RAM Cpanel/WHM 10 MBPS Port
Then I found this config for 20$ extra.XEON 3220 Dual Core 2 X 250 GB HDD 4 GB RAM CPanel 10 MBPS Port
will 3060 is a good config or do you think should go for the 3220. Or should I save that extra 20$ and use them to get a hardware RAID 1 for 3060 server...?
I'm new to Private Virtual Server and the package offered by different company are quite confusing.
I was on RackForce and their basis VPS package dds200-L can host 100 domain names on Plesk and unlimited domain names on WHM/Cpanel.
On 1and1 it didn't say if Plesk support 100 or unlimited domain names. My question is, do we always have the liberty to host unlimited domain names on our PVS?
We host our DNS with DNSmadeeasy.com. We noticed that the number of DNS requests is too high. So we decided to contact their support and ask them for log file, so we can determine
what's going on.
Reply we got from them is the following:
We researched your queries and we found that many of them were coming from the SoftLayer resolving name servers. We phone their admins to report the abuse and they said that the queries were infact coming from your own server with them.
We will not charge for any overage on the queries this month so you can research what on your server is causing these queries. But we will provide you with logs of about 5% of our your traffic.
here is the example of the line from log file sent by them:
May 10 17:15:48 t145 named[29945]: client 66.228.118.72#52529: query: host-196.218.57.145.tedata.net.mydomain.com IN AAAA -E May 10 17:15:48 t145 named[29945]: client 66.228.118.72#52529: query: afontenayssb-151-1-40-153.w83-114.abo.wanadoo.fr.mydomain.com IN AAAA -E
I changed the real domain name to "mydomain.com"
I checked the apache access log and found these hosts there in exact order as they are in log file sent by dnsmadeeasy.
What is strange is that why is my server making back these requests ? Also these requests are bad because these are not valid domain names:
e.g. should be "host-196.218.57.145.tedata.net" instead of "host-196.218.57.145.tedata.net.mydomain.com"
Seems that it includes ".mydomain.com" to the end of every request.
Is there a way to discover what is making those DNS queries?
Is it possible, through some script or otherwise, to send the traffic to certain/chosen domains to a completely different set of nameservers.? Preferably without having too much server load?
I already use a domain catchall, so no NS records are actually registered on the server.
I am checking DNS Report for a domain and in nameservers records I am getting following:
Recursive Queries
I could use the nameservers listed below to performe recursive queries. It may be that I am wrong but the chances of that are low. You should not have nameservers that allow recursive queries as this will allow almost anyone to use your nameservers and can cause problems. Problem record(s) are: xxx.xxx.xxx.xxx
I am using Windows 2003 Standard and Microsoft DNS Server. Any ideas what is this all about and how to fix it?
I'm currently hosting all of my stuff with my own Wild West Reselling Account, i.e., InnoDomains.com.
Problem is I'm running multiple Wordpress Installations and a few websites that have some pretty intense MySQL work going on in the background, and I use about 250GB per month in bandwidth.
My Account gets the 503 downtime errors because according to Customer Service I cannot run more than 50 MySQL queries in one second. Well, that's not much of a challenge because a lengthy wordpress page runs about 90 queries and loads in 2-3 seconds. Time this by three including the other websites and a couple of shopping stores, and I'm easily doing more than 100-150 queries a second more than several times a day, thereby seeing that nasty, irritating error.
My other option is to split up all the websites over basic $ 3.95 per month accounts. I don't want to switch to a dedicated server yet because I'm not really making a whole lot of money (about $ 30 per month). Another thing I could do is move my MySQL testing to a local machine, and that may actually reduce the load on the damn server.
Are there any hosts out there that will allow me to do more than 100 MySQL queries per second? If so, are there any that are any good?
I have just upgraded my website, and set 301 redirects for all old pages.
But on the old website I used a search engine, and in Google Webmaster there are loads of 404 pages with search queries. They look like this: [URL] ....
Simply redirecting search.php doesn't work, so I guess I need to use a wildcard?
This has happened twice now. I have my wait_timeout variable set to 60 seconds, but occasionally my database gets overloaded with "locked" queries. Here's an example of my processlist:
This continues on with locked queries all the way up to my limit of 450 connections, then the whole server goes down. Note the time spent processing these queries, 35483 seconds and counting! Surely the wait_timeout is supposed to prevent this from happening?!
Also, this appears to start with queries in the State "statistics". Then the State for the following queries becomes "locked". Does anyone know what these mean? Can I get them to timeout normally? Queries which never timeout are guaranteed to bring your server down eventually, surely this is not the desired behaviour.
I've been pondering something for a long time here, but never really knew the right question to ask, or how to word it... so I never even know what to search for. So I honestly have no idea what I'm asking or if this is even under the right topic. What I'm looking for is answers, links, tutorials, or just some words I can search for to help me do the following:
I have a MySQL database filled with accounts. People have to pay to get these accounts. All the accounts are set to expire on different days. I need to send an e-mail out to accounts, for example, to let them know they're expiring, say, a month before this will occur. Right now the only way I know to do this is to have MySQL queries on a PHP page that, every time the page is loaded, runs through all the accounts, checks their expirations, and sends emails to those that need it. I know there has to be a way to have this happen automatically without having to load a PHP page every day, for example.
I got a dedicated server which hosted 45 sites, one of those sites contains a vbulletin forum application since january 2007 , but from two weeks i found that there is a high amount of Queries from the this database which leads the server load to be always in RED and exceeds 200 or 300! and the memory is totally consumed!
i tried alot to solve this problem as : - reinstall the vb. - change the vb path to another ( considering it as attack) - installing BFD , APF , ( considering it as attack ) - upgrading to apache 2.2.6 , PHP 5.2.5 , MySQL 5.0.24 ( considering it as a bug)
this is the sample of queries.
Code: 46978hakawyc_SKJI8jjlocalhosthakawyc_froumvbSleep40 NULL46980hakawyc_SKJI8jjlocalhosthakawyc_froumvbSleep38 NULL46990hakawyc_SKJI8jjlocalhosthakawyc_froumvbSleep38 NULL47034hakawyc_SKJI8jjlocalhosthakawyc_froumvbSleep30 NULL47086hakawyc_SKJI8jjlocalhosthakawyc_froumvbSleep23 NULL47092hakawyc_SKJI8jjlocalhosthakawyc_froumvbSleep19 NULL47095hakawyc_SKJI8jjlocalhosthakawyc_froumvbSleep23 NULL47099hakawyc_SKJI8jjlocalhosthakawyc_froumvbSleep23 NULL47122hakawyc_SKJI8jjlocalhosthakawyc_froumvbSleep24 NULL47124hakawyc_SKJI8jjlocalhosthakawyc_froumvbSleep24 NULL47126hakawyc_SKJI8jjlocalhosthakawyc_froumvbSleep24 NULL47127hakawyc_SKJI8jjlocalhosthakawyc_froumvbSleep24 NULL47142hakawyc_SKJI8jjlocalhosthakawyc_froumvbQuery22Sending dataSELECT * FROM datastore WHERE title IN ('','options','bitfields','attachmentcache','forumcache47143hakawyc_SKJI8jjlocalhosthakawyc_froumvbQuery0Writing to netSELECT moderator.*, user.username, IF(user.displaygroupid = 0, user.usergroupid, user.displaygroup47144hakawyc_SKJI8jjlocalhosthakawyc_froumvbQuery22LockedSELECT * FROM datastore WHERE title IN ('','options','bitfields','attachmentcache','forumcache47145hakawyc_SKJI8jjlocalhosthakawyc_froumvbQuery22LockedSELECT * FROM datastore WHERE title IN ('','options','bitfields','attachmentcache','forumcache47147hakawyc_SKJI8jjlocalhosthakawyc_froumvbQuery22Writing to netSELECT * FROM datastore WHERE title IN ('','options','bitfields','attachmentcache','forumcache47151hakawyc_SKJI8jjlocalhosthakawyc_froumvbSleep16 NULL47159hakawyc_SKJI8jjlocalhosthakawyc_froumvbSleep17 NULL47166hakawyc_SKJI8jjlocalhosthakawyc_froumvbSleep15 NULL47177hakawyc_SKJI8jjlocalhosthakawyc_froumvbSleep0 NULL47180hakawyc_SKJI8jjlocalhosthakawyc_froumvbSleep16 NULL47211hakawyc_SKJI8jjlocalhosthakawyc_froumvbSleep10 NULL47251hakawyc_SKJI8jjlocalhosthakawyc_froumvbSleep0 NULL47283rootlocalhostNULLQuery0NULLSHOW PROCESSLIST Once i disabled the database the server load became normal again
another example for Queries :
Code: 117445 hakawyc_SKJI8jj localhost hakawyc_froumvb Sleep 49 NULL 117497 hakawyc_SKJI8jj localhost hakawyc_froumvb Sleep 42 NULL 117667 hakawyc_SKJI8jj localhost hakawyc_froumvb Query 24 NULL SELECT *ntttFROM datastorentttWHERE title IN ('','options','bitfields','attachmentcache','forumcache 117790 hakawyc_SKJI8jj localhost hakawyc_froumvb Sleep 7 NULL 117791 jarabhar_vb localhost jarabhar_vb Sleep 7 NULL 117793 hakawyc_SKJI8jj localhost hakawyc_froumvb Sleep 7 NULL 117795 hakawyc_SKJI8jj localhost hakawyc_froumvb Sleep 8 NULL 117798 hakawyc_SKJI8jj localhost hakawyc_froumvb Sleep 8 NULL 117799 hakawyc_SKJI8jj localhost hakawyc_froumvb Sleep 8 NULL 117802 unauthenticated user localhost NULL Connect NULL Reading from net NULL 117803 unauthenticated user localhost NULL Connect NULL Reading from net NULL 117804 unauthenticated user localhost NULL Connect NULL Reading from net NULL 117805 unauthenticated user localhost NULL Connect NULL Reading from net NULL 117806 unauthenticated user localhost NULL Connect NULL Reading from net NULL 117807 unauthenticated user localhost NULL Connect NULL Reading from net NULL 117808 hakawyc_SKJI8jj localhost hakawyc_froumvb Query 9 Sending data SELECT *ntttFROM datastorentttWHERE title IN ('','options','bitfields','attachmentcache','forumcache 117818 jarabhar_vb localhost jarabhar_vb Query 8 Sorting result SELECT post.postidntttFROM post AS postntttntttWHERE post.threadid = 52572nttttAND post.visible = 1n 117821 hakawyc_SKJI8jj localhost hakawyc_froumvb Query 8 Sending data SELECT *ntttFROM datastorentttWHERE title IN ('','options','bitfields','attachmentcache','forumcache 117829 jarabhar_vb localhost jarabhar_vb Query 8 Sending data SELECT *ntttFROM datastorentttWHERE title IN ('','options','bitfields','attachmentcache','forumcache 117832 hakawyc_SKJI8jj localhost hakawyc_froumvb Query 7 statistics SELECT post.*,ntttIF(visible = 2, 1, 0) AS isdeleted,ntttnnttteditlog.userid AS edit_userid, editlog 117833 jarabhar_vb localhost jarabhar_vb Query 7 statistics SELECT IF(visible = 2, 1, 0) AS isdeleted,ntttnntttNOT ISNULL(subscribethread.subscribethreadid) AS 117834 hakawyc_SKJI8jj localhost hakawyc_froumvb Query 7 statistics SELECT languageid,ntttphrasegroup_holiday AS phrasegroup_holiday,ntttphrasegroup_global AS phrasegro 117835 hakawyc_SKJI8jj localhost hakawyc_froumvb Query 7 Writing to net SELECT *ntttFROM datastorentttWHERE title IN ('','options','bitfields','attachmentcache','forumcache 117836 hakawyc_SKJI8jj localhost hakawyc_froumvb Query 7 Sending data SELECT *ntttFROM datastorentttWHERE title IN ('','options','bitfields','attachmentcache','forumcache 117840 hakawyc_SKJI8jj localhost hakawyc_froumvb Query 7 Sending data SELECT forum.forumid, lastpost, lastposter, lastthread, lastthreadid, lasticonid, threadcount, reply 117841 hakawyc_SKJI8jj localhost hakawyc_froumvb Query 7 Sending data SELECT *ntttFROM datastorentttWHERE title IN ('','options','bitfields','attachmentcache','forumcache 117842 hakawyc_SKJI8jj localhost hakawyc_froumvb Query 7 Sending data SELECT *ntttFROM datastorentttWHERE title IN ('','options','bitfields','attachmentcache','forumcache 117843 hakawyc_SKJI8jj localhost hakawyc_froumvb Query 7 Sending data SELECT *ntttFROM datastorentttWHERE title IN ('','options','bitfields','attachmentcache','forumcache 117845 hakawyc_SKJI8jj localhost hakawyc_froumvb Sleep 2 NULL 117846 hakawyc_SKJI8jj localhost hakawyc_froumvb Killed 0 NULL NULL 117847 unauthenticated user localhost NULL Connect NULL Reading from net NULL 117848 hakawyc_SKJI8jj localhost NULL Connect NULL Writing to net NULL 117849 unauthenticated user connecting host NULL Connect NULL login NULL 117850 unauthenticated user connecting host NULL Connect NULL login NULL 117851 unauthenticated user connecting host NULL Connect NULL login NULL 117852 unauthenticated user connecting host NULL Connect NULL login NULL 117853 unauthenticated user connecting host NULL Connect NULL login NULL 117854 unauthenticated user connecting host NULL Connect NULL login NULL 117855 unauthenticated user connecting host NULL Connect NULL login NULL 117856 unauthenticated user connecting host NULL Connect NULL login NULL 117857 unauthenticated user connecting host NULL Connect NULL login NULL
I know about the general log but want to just log queries of a specific user. Our database does 400 queries/s on a slow day, so I think it would be a pain to grep though a huge log like that. And, im not sure if it would cause any preformance issues.
I am running a SQL test server here that is piping HUGE amounts of data for a test project I am running.
Approximately 30 queries a second - constantly. That's over 2.5M queries a day -- so we are talking big (I think?)
I am currently running this test on a
AMD Phenom 9300, 4GB RAM - SATA 500GB HDD and I am running MySQL 5.0.51a i386 on CentOS
I have programmed a process control for our applications purpose - basically it controls the launching of our SQL intense applications, and stops launching when the Load is greater than 2.5
I have plans to optimize the number of queries (I will build in a cache to some of the applications - and run INSERT statements all together) however I am looking for SQL tweaks that will improve performance. Would running the 64bit version work better?
What I did here was create /var/log/mysqld.slow.log for queries that are taking one second or longer. After around 36 hours, here is what I came up with. Since the file size of /var/log/mysqld.slow.log was 219KB, posting it in its entirety it not practical. Therefore, I used a program, the perl script known as mysql_slow_log_parser found on www.retards.org, to parse the mysqld.slow.log to make it easier to interpret and read. The result was that the original filesize of 219KB was converted to the smaller size of 14KB....
I have fairly a large web site that has a forum and a torrent tracker.
Currently MySQL server is handling about 150 queries an avarage per second. Here is the server spec:
Core2Duo 2.66Ghz 4Gb RAM 320GB SATA 7200RPM (Server provider does not have 1.5K RPM nor 1.0k RPM) 100Mbit Connection (servers on the same switch and the switch does not have 1Gbit port) MySQL Version: 5.0.51a
I had Master-Master Replication setup with forum running on one and the tracker running on the other. Although this has been working for about few days, we started seeing lags in the replication process. After a week, there is a major lag and the changes made on one of the servers takes about 5 hours to appear on the another. So, this doesn't work.
What would be the other ways of splitting MySQL queries concerning the same database?
While I was researching, I read about MySQL Cluster with database storage engine being NDB.
But, let's say that there is a power failure on both the nodes at the same time, then I would lose the whole database as the database is stored on the memory correct? I would not like to take that chance either, but if this is faster then replication method then maybe I will concider.
I thought about editing the forum coding to make all queries that concerns the tracker to go in to, say server B (with forum's primary MySQL server being Server A), and make the tracker use server B as MySQL backend, but it seemed like a heavy work so that will be the last choice.
I am getting into the dedicated server market and have a question...
I would like to get access to an entire Class C so 111.111.111.xxx - is that standard or should I assume someone offering a dedicated server with 1 IP only is giving say 111.111.111.1 ?
What would be the cost of being able to allocate different sites on the same class C?
For a server with Xeon 3060 + 2 Gigs of RAM, which setup result would you choose to run at?
This is the normal load. At peak times, they would be more like:
Server Load: 0.07 / Memory Used 50% Server Load: 0.40 / Memory Used 30%
Would a slightly higher CPU load be a better choice than having 50% of RAM used? We can choose either scenario based on installing eAccelerator, a PHP cacher.
I visited the colo space (1 cabinet) we obtained through an Equinix reseller. There was some confusion as initially we were going into DC2, but they put us into DC3 as that's where they had the space (they have a lot of cages in both DCs).
In the past, I had visited DC2 and it's clear the facility was purpose-built for Equinix. You can tell just by looking at it from the outside, but also inside.
Driving up to DC3 (on Chillum Place), I was first surprised to notice glass windows on the outside of the building (they have the reinforced walls inside of that I was told).
Apparently, the building was some other company's datacenter or offices, which Equinix then refitted their standard-build datacenter inside the building. They also have different man-traps (like a rotating door) compared to DC2, raised flooring (which is not used I was told), and lower ceilings.
I drove around the DC3 building, and the other half of it appears to be some other company's datacenter (based on the generators on the roof). Any idea who that is?
Is DC3 the same quality as DC2? It didn't quite "feel" like the quailty of DC2, but that's just an impression and not based on any empirical evidence. It's also a bit further out there, while DC2 and its new "siblings" (DC4/5) are all adjacent to each other (on Filigree Court).
With the reseller we are using, most of their bandwidth in DC3 cross-connects to their network equipment in DC2, and that's where they peer. That's another thing that makes me feel like DC3 is quite secondary.
Are my feelings unfounded, or should I push our reseller to find a cabinet for us in DC2?
Does anyone have input on either of these VPS hosts? Their plans are similar and prices are nearly identical, and I'm trying to figure out whether I should just flip a coin, or whether one edges the other out.
How much faster is a Raptor 74GB 10,000rpm compared to a Seagate 250GB SATA-II 7200rpm? Both are priced the same. I'm comtemplating on which one to use for a database..go for more storage or a faster drive.