I have recently upgraded to a virtual private server. What is a safe speed for googlebot to crawl my website.
Can you please give me results in the format of:
xxx requests per second
xxx seconds between requests.
I have a 2.5ghz dualquad 5420 harpertown with a 160gb hdd. I was wondering if I upgraded my hdd to a 160gb scsi 10krpm with a Intel Xeon 5130 2.0 GHz Dual Core, would I get a performance increase or a performance decrease?
I have a server that does 20k visitors per day, large forums, over 10million file requests per day.
Current Server:
2.5ghz harpertown dualquad
4gb of ram
dual 160gb hdd's
Free offsite backup
Cpanal
4,000gigs in/out bandwidth
$355 per month
Looking At:
2x Xeon 5130 2.0 GHz Dual Core
4gb of ram
dual 300k 10krpm scsi
Cpanel
4000gigs bandwidth
$380 per month (with specials)
My host has an option to upgrade my hdd for 60 bucks to a 73gb scsci 10krpm drive.
Should I do that instead or go with the new host?
Anyone have an optimization tips for me instead if they think I can do that instead, but I done a ton of optimization via reputable admins including some on this forum. Mysql crashes 4+ times a day, that's why i'm wondering if a scsi hd would be better choice.
currently i am on OVH...and ovh's speeds are amazing when it comes to torrenting..and stuff..no problems whatsoever till now..but i am looking for a modest budget server than will give me good http speeds average 400-500KB/sec ...i dont care much abt the hard drive space..even a 40 geg hard drive will do..but all i need is a good RAM..i am expecting 300-400 max users to download from the server using http..concurrent connections may be not more than 150..so i definitely need a good RAM..3 gegs i presume? budget: preferably less than 100 dollars
View 2 Replies View RelatedUpon reviewing my modsecurity log today, I found an interesting hit from google.
-------------------
Requesting IP: 66.249.65.67 is http://ws.arin.net/cgi-bin/whois.pl?...t=66.249.65.67
Date: 2006-10-03
Time: 07:10:16
Handler: mod_gzip_handler
Get: /page/index/1&show=25,07,2005?php%20echo%20$bmc_vars%5B'site_url'%5D;%20?%3E/profile.php?id=1
Mod_Security-Message: Access denied with code 406. Pattern match "echo " at THE_REQUEST
Mod_Security-Action: 406
------------
The rule that set off this 406 response was:
SecFilterSelective THE_REQUEST "echo "
What I find interesting is that I do not have any such URL structure on this website that google requested.
I'm running a web server with mod_evasive and want to know how can I prevent mod_evasive from blocking the googlebot crawler ip address.
Is there a script out there that can detect this crawler and make sure its ip doesnt get blocked by iptables or mod_evasive?
I am just wondering whether my idea will work for the google search engine.
Basically, I have my official VPS root (home/admin/public_html/) and this is where my main website will be hosted. However, since my VPS will be used for additional website, I will direct additional domains to it.
My second site hosted on this VPS may have a document root of (home/admin/public_html/advertising/). And my domain will then be setup to have that as its document root.
However, when google searches for my second site (e.g. advertising.com) will it go 'below' the domain root? For example, will it also creep the files under /public_html/ for this domain, even though the domains root is /public_html/advertising/?
edit: Or do people host multiple sites differently? Is this an appropriate method?
I recently found out that the Google robot spidered my site and used up 5.74 GB in bandwidth! The hits were 4498 and I even have it scheduled to return every 2 weeks.
Now my site is down for the rest of the month unless I up my bandwidth. This is the second time this has happened to me in the past year. What is going on?
Googlebot has been absolutely ripping through my bandwidth. This has been on going for many months now, but each month the damage has gotten worse and worse. I have posted about this problem here but with no luck:
http://www.webmastertrader.com/showthread.php?t=389
To demonstrate the problem, I have decided to show you all my server stats for one of my websites.
I have no choice but to ban googlebot from my site and follow this action with a letter to google!
1) Aug: http://www.webmastertrader.com/attac...0&d=1159816704
2) Sep: http://www.webmastertrader.com/attac...1&d=1159816714
3) Oct: http://www.webmastertrader.com/attac...2&d=1159816723
We're only a day and a half into this month and Google's robots have already consumed over 1gig of bandwidth!
Yes, it’s quite true. DreamHost representatives are asking their clients to block GoogleBot trough the .htaccess file, because their websites were “hammered by GoogleBot”.
Dreamhost representatives are also guiding their clients to make all their websites “unsearchable and uncrawlable by search engine robots”, because they cause “high memory usage and load on the server”.
PS: This is NOT a rumor. Multiple people are already complaining about Dreamhost asking clients to block search engine spiders. A post in QuickOnlineTips confirms this too.
Initial news bit via Zoso.
If your server is blocking googlebot from finding your robots.txt file, how do you configure your firewall to unblock it?
I've searched through Google and I've seen may people just say your firewall is blocking it, but none mention how to really stop it from doing that. Like does Google have an IP it uses, and if so, what is the IP you should whitelist for your server?
As I keep getting that message: Network unreachable: robots.txt unreachable
and I'm sure it's due to a firewall issue, just have no idea how to fix that.
One of my customers uses Webmasters Tools from google , looking at what pages he have indexed by Googlebot, found that 180 pages are giving a "DNS lookup timeout" error, tried searching for help on google and the only thing that i found is " We received a timeout on DNS lookup."
DNS are ok, same as the zone file, everything is responding OK, I dont know what can be the issue.. ? any ideas ?
Im using Ensim Pro and RHES 4.
I'd like to start an ongoing thread here listing the 'Good Hosters with Good TELEPHONE tech support'. In other words, out of the 1,000s of host companies, this may cut it down to less than a dozen.
( And for all you Hosters out there who really want your company to grow, and want to know how, - it's easy: just read here.)
Good telephone support is the #1 ultimate requirement, because:
-It's a lot faster and easier for both the user and the host company, because you can state and answer all questions and clarifications on the spot, you don't need to continually pass new emails with new questions and clarifications, back and forth for days on end, until the issue is solved. It saves tech time and user's time. And saves a lot of nerves.
- It's the best way to sort the good guys from the bad. A bad company isn't going to bother to answer the phone, - or will make you wait way too long, - because they are likely getting endless complaints. The good guys are always ready to answer the phones, with a friendly voice, - because they really WANT to please the customer.
- If a company can't be bothered to pick up the phone, we can't be bothered to even consider them. They're a joke, and so won't be listed here on this thread. (So, before adding or listing any Hosters here, please verfify that they do have Good, quick, friendly, telephone support,; ideally 24/7, but 9am to 10pm might be acceptable, if it was supplemented by some emergency contact.
AND:
- Hoster ALSO needs good EMAIL support (and preferably, Chat online, extended hour availability). (I spend a lot of time overseas). It sems all emails should get a non-automated response within about an hour, - and then support should jump on fixing any problem.
I only need support a few times a year. To answer some questions, or fix a problem, or do an install. That's lesss than 1 hour total, so any company paying maybe $18/hour tech support should be able to handle this. It IS reasonable to charge a custm for extended calls, beyond say, 90minutes a year, IF you don't count the 80%? Of times an issue is the Hoster;s fault of stmg gone wrong, and don't count the 'hold' times.
ALSO IMPORTANT:
- Uptime
- site Speeds
- Monthly plans, no contract (Only a dishonest host will try to force you into a contract, where they can then ignore you.)
- Reasonable price. (? Maybe $12 to $18/month for a basic business site. We don't need massive bandwitdths, - we all know that's an overselling scam, and can't ever be delivered.)
- a good upgrade plan of bigger options. Maybe even VPS.
- Dedicated IP, and availbility of SSL
-PHP 5, mysql, phpMyAdmin, etc
- cPanel ( Some Hosts are using problematic panels, like Hsphere, which are slow to load, slow in operation, require many more clicks, have too many options, spread apart on many separate pages. Time is money, and this really slows down the ability of a small business to manage his own site in effective time. For example, one WHT user wrote somewhere: "I don't feel that HSphere's interface is nice at all, although I have worked with cPanel and DA all my life... I just found it to include un-necessary features or split features up in to different hard to find pages, such as backups - mysql backups you had to find on a completely different page than file backups, and then there were options to have it in the home directory or server-end backup, in which then you had to wait a good 10 minutes before it was ready. cPanel, just hit backup and hit download and instantly it does everything you need...".
I have used several hosters. Currently on Aplus.net and Godad, which have phone support, and mediocre service.
My LIST So Far:
- Liquidweb: a very impressive company with good, 24 hour support. But to get dedicated IP, you need to go with their $25/month plan. Yikes!
- NewIdeaHosting.com. A very small company. My call was returned, and the owner chatted with me for an hour on the phone! Plans have small bandwidth, but promises No overselling, and personalized attention. Extra $5 for dedi IP. He specializes in Small business sites, and small eCommerce sites. He has only 250 accounts, on 3 servers. He rents servers from the Equinox data center of Chicago. Seems exceptionaly honest.
- MegaHosters. Excellent phone support and WHT reviews. But company was taken over by another company, and so may well go downhill in future. Another problem: uses Hsphere.
- Steadfast. Has a good rep on WHT, and seems impressive. Tech answered the phone immediately, but they say they prefer emails. Sales phone has limited hours. Good price on $20 SSL. But, uses Hshhere.
- JodoHost 24 hour phone. But, uses Hsphere. An Indian company with office in Florida, and good rep. I like the idea of outsourcing phone support, if it makes it more available and affordable. But, the accent on the phone was very hard for me to understand, so maybe this might not work.....
- Hostgator. Yes, it's a big overseller, but seems to get good reviews/results anyway, and good phone support.
- ? ThePrimeHost ?? Mostly good WHT reviews; some dissenters. Site says 24hour phone, but when I called on several nights, no one ever answered...
- Can anyone add to this list? Please list only hosts that meet the above minimum requirements of phone support, etc. Especially useful is hosters you've tried.
TO AVOID:
- Avoid Arvixe. I had a horrid experience with them, here: [WHT forum]:/showthread.php?p=5097822#post5097822
- Avoid WebHostingBuzz. This company never returned my phone msessage inquiries.
I am having some serious speed issues with my 1Gbit server at FDC. After opening a ticket, they've simply dismissed it as a server configuration problem. However I am convinced it isn't because certain ISP's (usually universities) get good speeds, usually 700kb/sec but the vast majority of my users get between 20-50 kb/sec and it's causing a lot of complaints.
Furthermore I have other servers with FDC which are 100mbit which perform better than my 1 Gbit one. There are no server bottlenecks (CPU/RAM/HDD), since I've closely monitored them (PRTG) and they aren't even heavily utilised. So the problem is with the network at some point.
Speed Test : [url]
where abouts you are downloading from, your ISP and net connection. Wget's from servers are also welcome as are traceroutes.
My .NET software requires version 3.5 of the framework. But the ISAPI module is 2.0 and I'm wondering how I can upgrade it to 3.5. Windows hosting is not my field so I am a bit lost here.
Anyone have pointers? So far I've been looking for an ISAPI module but haven't found any. The 3.5 framework is installed but I don't know where the .dll file is (if there is any for IIS).
Is there a way to update php from 5.0.4 to 5.1.4 quickly without using yum or up2date?
Can this be done with RPM? Or where can I find instructions on doing this?
I am currently upgrading my PHP on my unmanaged VPS. From PHP4 to PHP 5. I have been following the following website tutorial at nix101.com/2007/09/22/setting-up-a-secure-and-fast-php-build-for-litespeed/ on how to do it for the litespeed server of which I have got installed.
But now I have come to the stage where it says Make, Make Install. And I keep on getting the following error messages coming up
Make: *** No targets specified and no makefile found. Stop.
Make Install: *** No rule to make target `install'. Stop.
I have got running on it Centos 4 and I have just installed Yum to see if that sorts out the problem. But it don't.
So any suggestions on how to sort out the make, and make install so that I can finish configing PHP.
to upgrade my server to PHP 5 from PHP 4.3.9
My server specs are;
Centos 4.2
Plesk 8.3.0
PHP 4.3.9-3.12.1.swsoft
Apache 2.0.52-28.ent.centos4.1.swsoft
MySQL 4.1.20-3.RHEL4.1.el4_6.1
I also have access to root SSH.
will "yum update php" do the trick? If so will I also keep the GD Library support?
this may seem like a strange question but what happens to your and other VPS accounts when someone upgrades part of their account? This doesn't make much sense so I'll give you an example...
Your VPS host has a nice big server with 8Gb of RAM. Currently there are 16 users on the server each with 512Mb RAM (for simplicity) therefore all RAM is currently used. Now, say I decide to upgrade my RAM to 1Gb, what happens? Do they move me to a new server? Do they move someone else to a new server? Is there any down time during this move? Would I be notified of this move?
This question is more out of curiosity than anything else and I know that the above example is somewhat unrealistic as most servers which were hosting VPS would probably have some spare RAM but eventually it has to run out.
I'm debating whether I should try upgrading php myself or if I should just pay someone to do it.
I know very little about server stuff. I'm more of an SEO guy who can write a few php scripts.
Currently we are running Plesk 7.5.4 on our server with PHP version 4.3.2. I want to install the latest version of vBulletin on the server, but it requires at least 4.3.3.
Unless there are some unforseen issues, I'd be happy to upgrade to the latest version, PHP 5.2.1.
Is this a super easy type of deal that even a server retard (myself) could handle or is it something that only an experienced server dude / chick should mess with.
If it is a good idea to pay someone, what is a fair rate?
Is there a guide available on how to upgrade to gcc 4.2.0 on Mac OS X 10.4.9?
View 8 Replies View RelatedI've traditionally used shared hosting to cover all my needs however as my sites have grown in popularity my host has suggested I should really upgrade to a VPS before he pulls the plug.
However as I've always been within a shared environment, I've absolutely no idea what sort of resources I will require. Bandwidth and disk space I can manage, but how does one work out the RAM requirements of a piece of software without prior access to a Dedicated or VP server?
Basically I need to run a Joomla install (with a forum integrated), two more standalone forums, a MediaWiki site, the Roundcube mail system and a few static websites. Can anyone point me to a resource that would allow me to work out a rough requirements estimate for that?
Luckily the host I'm considering offers an off-server Control Panel (HSPcomplete, never heard of it mind) but would I be right in thinking I'd still require a fairly sizeable machine?
Any experience with Good Avocado and their reseller plan?
What about Thinkhost, good avocado is partnering with?
Wind and solar energy, it sounds all good, the reseller plan is awesome.
Any real life experience?
We have 2 servers with old Dual Opteron 285's and would like preform an upgrade. I'm not sure where to start, these servers are for webhosting and load is pretty much around 3~5 during peak times.
We have the following choices:
Single Q9550 (Will it preform better than my current CPUs? Are they suitable for server use?)
Dual E5405's (Slowest Harpertown, is it worth it?)
I currently have a basic level VPS and was wondering if it is wise to upgrade apache from 1.3 to 2.2 and php to 5?
I am not quite sure why do I want to upgrade when everything is already running smoothly but it's just if something better exist then why not take advantage of that?
Anyone who can advise if this is going to a be a wise move? I have quite a few sites running on php so might have issues with newer version.
Has anyone tried it yet?
Yum update =
=============================================================================
Install 11 Package(s)
Update 285 Package(s)
Remove 2 Package(s)
Total download size: 659 M
I have done a clean install but a local upgrade hosed grub. I am hesitant
to try it remotely.
After the vBulletin's latest version i had to upgrade my mysql server from 4 to 5
searched a little bit found out that it can be done through tweak settings ,, select 5 and click save then do the server software update link .
i did that
after that i checked one of the websites that uses vB
found this database error:
<!--
Database error in vBulletin :
mysql_connect() [<a href='function.mysql-connect'>function.mysql-connect</a>]: Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (2)
/home/xxx/public_html/vb/includes/class_core.php on line 274
MySQL Error :
Error Number :
Date : Sunday, May 4th 2008 @ 01:05:15 PM
Script : [url]
Referrer :
IP Address : 212.102.30.3
Username :
Classname : vB_
i went to the shell and wrote (mysql) i received this error:
[root@server tmp]# mysql
ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (2)
googled alot searching for a solution but i found millions of problems with different specifications so i didn't want to mess it up more!
most of them talked about the file (/var/lib/mysql/mysql.sock) and the configurations in the file (my.cnf)
i've been through my.cnf and couldn't find anything about /var/lib/mysql/mysql.sock
my server is centOs 5 32 bit intel xeon
my php version is 5.2.5
i've reset the root password to mysql to blank again through WHM
i really hope that you can provide me with a solution ASAP as my clients are starting to warm up to beat me
if anyone of you needs to know anything else about my server just shoot and i'll be here to answer
By the way
the file mysql.sock doesn't seem to be there on the server.
How many people have upgraded existing servers from PHP4 to PHP5?
Or are you not bothering at all?
We tried it on one server and 90% of PHP scripts stopped working! Some needed only minor changes; many needed more serious changes.
Has anyone seen any docs on upgrading phpMyAdmin? And does it need to be done via SSH?
I'm on a MediaTemple (gs)...
When I asked my hosting company to upgrade my cPanel version they replied with the following:
"This is not recommended. A lot of problems have been reported and I'm suggesting you hold on with this upgrade until cPanel Tech Support has ironed out all the bugs. Please request this again in 1-2 months.
should I upgrade now or wait?
I've been trying to move this one website to a VPS for a few days now. Everything was easy enough until it comes to restoring the wordpress blog. The problem is that the VPS that I'm transferring to has mysql 3.23. Since wordpress requires 4.0+ mysql I've been trying to upgrade but I keep running into problems.
The OS is centos 3.8 and I've been using RPMs to install mysql. First I uninstalled the old mysql using "rpm -qa | grep mysql" and then moving the packs. Then I find mysql 4.1.22 centos. I installed them using rpm -ivh blahblah.
After that I restart mysql and apache. When I start apache I get this error "Cannot load /etc/httpd/modules/mod_auth_mysql.so into server: libmysqlclient.so.10: cannot open shared object file: No such file or directory"
Well I commented that part from httpd.conf and was able to restart apache no problem.
The problem is after I restart apache, php is unable to connect to mysql. In other words, wordpress isn't working (got the "Your PHP installation appears to be missing the MySQL which is required for WordPress" error). Now I don't think its that line since I'm not requiring any authencation. It seems to be what comes with the old mysql 3.23
My problem is how do I get pass this error? I've even tried compiling php from source with --mysql switch and it still doesn't connect.
I've noticed that if I just installed the new mysql, wordpress actually works but obviously when apache restarts, it wouldn't work.
Could it be that apache is somehow requiring the authencation? but since I've disabled that line, I don't know why it needs that.
way to upgrade postgresql 7.4 to 8.1, i heard that V8 is less consuming
View 6 Replies View Related