Keeping Mirror/Mirroring Backups...anything Better Than Rsync?
Dec 17, 2008
Keeping mirrored backups...anything better than rsync?
I'm keeping mirrored backups of my servers. Does anyone know of any solution better than rsync to update the files on the backup server?
I've noticed that when running rsync it can cause a lot of disk i/o, which can slow down a running server.
Does anyone have any suggestions on how to decrease disk i/o or another solution to keeping mirrored backups on a secondary server?
View 13 Replies
ADVERTISEMENT
Jan 29, 2009
A great insight to alot of my research and thank you in advance for any advice given.
I have a server based in HK(with WHMCS) and host several websites. The speed and availability serves the Asia Pacific market/viewers well; but we have several new websites that also targets the European and North American viewers.
I have been researching on getting a dedicated server based in US to mirror our server. Therefore allowing the US/European market to access the website faster. Although we have a few problems (and very little budget to solve it too ;p)
1. We need to sync the two servers in real time ; rsync seems to be the best but is there any other reccomendations?
2. We will make the IP address in each servers the same, so our clients need not change their dns. Do we need IPcast/anycast?
3. Is there anything else that I may have oversight?
View 4 Replies
View Related
Oct 29, 2007
My company requires a Mirrored Server setup. I hope someone can direct me to the right solution which guarantees the least downtime.
- We have 20+ php/mysql websites.
- We need two dedicated servers hosted in 2 different datacentres.
- Users are directed to the first server.
- If the first server is down the users are automatically directed to the 2nd server @ the 2nd datacentre.
- The software/hardware which redirects the users need to be fail proof or have an instant backup which takes over incase that goes down too.
- Data (databases and files) needs to be synced correctly to avoid data not being mirrored correctly.
I've done some reading and there is alot of mention of the DNS round and load balancers.
However, it seems these two options are also not fail proof.
Would appreciate if someone could simply outlining what system would be best for us for 100% uptime incase of server failure.
View 3 Replies
View Related
Dec 18, 2005
i am new to this and am in need of some help.. i have vbulletin 3.5.0 installed with photopost gallery and phpprobid auction...
I am hosted with fasthosts on a linux dedicated server, it is crap! it has been down 3 times in 1 month, the support is terrrible.. I have already movedit from pipex hosting due to lack of support for mysql. i canot keep moving my site, my brain will melt out of my ears ...
Can i link to my original install.. so if the fasthost server goes down,, could i have it directed to the old server? and can i keep the 2 databases current?
Hope i have explained it well enough... basically need a backup server setup for my vbulletin so, i dont lose potential new members..
View 9 Replies
View Related
Apr 14, 2008
2 servers in 2 different continent. One will be primary and the other is redundant. It will be controlled by DNS fail over service.
Question:
1. What is the things that i need to consider before setting it up?
2. What is the best way to sync the data and databases?
View 2 Replies
View Related
Jan 10, 2008
I have a DB server, running mysql 64bit. I would like to add another server to the mix to build some kind of redundancy if the 1st one were to go down.
View 7 Replies
View Related
Sep 12, 2007
I have two dedicated servers on two different countries. My idea is having one of them fully active and the other as a backup server so that in case the first crashes or something I only have to redirect the domains to the second server.
Can you help me on how this can be done?
View 3 Replies
View Related
Dec 20, 2005
There are some Download Manager Programs that have a option like Find alternate URLs through mirror list file when giving a file for downloading. Where can I insert such a file in my site so that download programs can add other mirrors to it from my list of mirrors?
View 0 Replies
View Related
Mar 28, 2009
Does anyone run a setup where 2 or more cPanel servers (perhaps in a shared hosting environment) are dynamically mirrored for high availability?
How have you configured this? Does cPanel play nicely?
View 14 Replies
View Related
Feb 24, 2009
I was wondering if anyone knows of any provider that provides RAID VPS Mirrored Hosting.
So if one drive goes down, the site will immediately switch over to the next one in the cluster.
View 14 Replies
View Related
Nov 16, 2006
We are expanding our photo sharing business and are revising our Unix-based server architecture. We're looking to develop a standard server configuration so that we can easily add servers when necessary.
Our ISP has recommended a configuration with mirrored web servers and mirrored RAID5 NAS boxes. I've read about Google's server architecture which consists of identical mirrored servers; when a drive or part from one of those servers goes down, data is served from the mirrored servers and the bad machine is repaired or replaced.
Comparing the two architectures with similar storage sizes, the overall cost of the hardware itself is about the same, with the identical mirrored machines being slightly cheaper. The monthly co-location fees (rack, power, etc.) are higher for the NAS solution.
I'm interested to hear your thoughts and experiences with similar solutions. I know the web/NAS solution is popular, and it's probably the one we'll go with, initially at least. Has anyone here implemented a Google-like identical mirrored server solution?
View 14 Replies
View Related
Aug 10, 2005
I currently have a mirror site set-up on a seperate server (with a seperate web hosting company) for risk management purposes.
For zero downtime dependability, a load balancer cluster checking both servers in real time, and directing traffic at only servers that were online has been suggested.
However this option is rather expensive. Does anyone know of any other options?
View 2 Replies
View Related
May 20, 2009
I was asked earlier today by one of the tech people at the university that I go to if I knew of any hosts that would offer some space/bw/access for a website that already exists. From what I was told, the host would not be the primary server for the website, so it would not require very much bandwidth, and the entirety of the website is only 300MB, so space isn't really an issue either (As most hosts now a days offer 1GB+). The catch is that they were planning on using rsync to update the mirror host, with the latest content from the live website, every 3 hours or so. Preferably, they want to spend as little money as possible on this and not buy a dedicated server or VPS somewhere, as that would be very costly.
So, does anyone here know of a host that would offer such a thing and allow SSH access to setup the rsync?
View 9 Replies
View Related
Mar 19, 2008
I am trying to find a piece of software that will allow me to mirror the online files of my companies domain. There are a number of contributers to the domain, so files are not stored offline in one location. I want to create an exact mirror of the contents that perhaps I schedule to mirror once every week.
I cant seem to find anything that would allow me to do this.... can anyone point me in the right direction?
View 5 Replies
View Related
Jul 7, 2009
I have a LAMP server running and would like to have the exact mirror running on another location. I would like to sync the web files and database in either real time (upon any update) or in delayed mode (x minutes after the update).
For MySQL, I believe replication can do the job unless anybody has better recommendation. What would you guys suggest for web files? Can I use different Linux flavor but maintain back the same LAMP version?
Is there any "online" 3rd party load balancing service that I could use to load balance the traffic to both servers?
View 14 Replies
View Related
Apr 2, 2009
On a CentOS5 VPS I have access to "yum update" barely working due to the base mirror "styx.biochem.wfubmc.edu" being tremendously slow.
I'm trying to find out how to disable that mirror possibly via a mirror exclude setting in yum.conf or some other way. I've been searching but I've not found any documentation on this so hopefully somebody out there will know how to make this change.
View 5 Replies
View Related
Jan 29, 2009
I'm having an issue with a client site and I am not sure what to do at this point. Conversations with the host (GoDaddy) haven't led to a solution and to be honest, I'm not sure it's their issue to handle although I will be firing off an email to their domain dispute department shortly. I spoke with a couple of supervisors there and they were as baffled as I am.
Here's the situation:
When people Google the name of the client's business, it returns their site but on a different domain. The entire site is there, nothing is changed but the URL. It's like having an unintentional mirror site except that none of the forms work which is what tipped off the users that something was wrong but of course, they don't notice that they're not actually on 'www.clientsite.com' so they think it's just a form error when in actuality, they're not even at the right domain.
There is really no way for this other domain to profit from mirroring the client's site; it's just a business profile type of thing with a few forms for contact, employment applications and vendor applications. No secure info is transmitted other than perhaps the occasional email address but we're not talking a heavy volume site, it's a niche market and really not something that would be a typical target. There's no eCommerce, no subscriptions, no financial info.
I'm at a total loss. Could this happen if this other site is hosted on the same server as my client's site? Could it be an actual error of some sort or would it have to be intentional?
The whois for this bogus site leads to DomainsbyProxy.com and I'll be sending them a letter as well but I'd really appreciate any input you all might have on HOW this could happen. Should I also contact Google?
View 5 Replies
View Related
Jan 8, 2007
We damaged a file on a windows server 2003 system which caused us to get a grey screen where the login windows should be (it was setup as a domain controller)
We tried booting it in safe mode and all the other modes etc etc.... but to no avail... we couldn't get it to work.
So we wanted to replace the file manually using another pc (by inserting one of the harddrives into the pc, and copying the file to it).
We used a windows XP machine.... imported the harddrive using disk management..... we had to un mirror the drive to be able to access it.
Once the mirror was broken i gave it a drive letter, copied the the new file to it, and, removed the drive letter i assigned it, and tried booting with *just* that drive in the windows 2003 server.
Now it wont boot, it just reboots everytime i tries to start up, probably because we broke the mirror on a different machine.
It still boots from the other untouched drive... that was in the mirror, but we have no way to edit the files on there.
So is there any way to actually get this, once mirrored drive, to boot now its a single disc?
View 9 Replies
View Related
Mar 10, 2005
If you receive the following errors while trying to install a Perl Module through the WHM ...
View 1 Replies
View Related
Nov 5, 2009
We recently began to mirror a large number of open source projects with a dedicated mirror server on our network and I was surprised not only with how popular the mirror server has become, is, but also of the ability of the hardware we're using to keep up with the load.
At an given time, the mirror seems to be pushing at least 50 Megabits of trafficthe server is also an IRC server (irc.igsobe.com) for customers and internal staff communications.
The hardware is a low end Dell Pentium 4 @ 2.66 GHZ server, running with 512MB of RAM and a 400 GB ATA hard drive. CentOS v5.3 is the operating system.
If you're interested, you can view the HTML logfile analysis here but that doesn't tell the full story as FTP users make up a good portion of the traffic. We've received over a quarter million hits in the first few days of November alone.
18:14:15 up 65 days, 9:04, 5 users, load average: 0.31, 0.69, 0.56
The only change that I made to the default configuration was lowering the maximum number of Apache servers to 128.
Just thought I'd share this information as I wouldn't have thought a server with such a small amount of RAM would be able to serve up so much data, even though we are talking strictly static HTML files.
I'll definitely keep this in mind when clients ask me for those "what type of dedicated server should I use for XXX" type discussions that are had all too often with clients.
View 0 Replies
View Related
Oct 28, 2008
FTP backups, doing RSYNC what is needed?
I have a linux box with pure-ftpd as FTP backup server. However, we want to explore/expand to RSYNC now.
Is there a package that allows RSYNC to be used for FTP users?
This is basically like what do FTP services like BQbackup use to allow RSYNC, etc.
View 3 Replies
View Related
Oct 11, 2006
Rsync seems to be popular as a backup solution, so I thought I give it a look myself. However, after looking for a while I think it is lacking in either (1) usability or (2) security for backups.
Lets use a backup of /home for example:
(1) To make the transfer secure I'd use rsync over ssh. Backup works great - untill you have to restore. Restore works only partially, because all the files now have the user/group id of the user on the backup server (even if the restore is run as root). You'd have to chown all the individual users dirs, permission files....error prone and a lot of manual work --> not good.
(2) Running rsync in daemon mode on the remote server preserves uid/gid and permissions. Restoring works like a charm when run as root. But, hey, now every 13 year old with some knowledge and a packet sniffer can write down your data unencrypted. They just need to look for -lets say- db-info in php files etc and suddenly have access to your customer base or whatever you store.... Even worse if you transfer db dumps or other sensitive data. So it is not safe to use --> not good.
Is there a way to secure the transfer or keep uid/gid info intact?
And how do all the backup providers handle the issue? (This one here claims rsync is secure.)
Or is there another way to fix the problem - restoring uid/gid and secure transfer for backups.
View 9 Replies
View Related
Jun 3, 2009
I'm currently using (amongst other backup systems) rsync to an offsite space (am using BQBackup at the moment)
I'm just wondering - apart from backing up all of /home/, /var/lib/mysql/ and the important config files (httpd.conf, php.conf, etc etc) is there anything else that *needs* to be backed up?
Obviously in a worst case scenario, a new machine would be deployed with a fresh OS install (and a fresh WHM/cPanel install) so I wouldn't worry about backing up OS files or cPanel core files, although I'm wondering if there's anything apart from the /home/ directory and the MySQL databases which would be lost (and so need backing up) in the event of a crash?
View 10 Replies
View Related
Mar 5, 2007
script that will backup full cpanel backups remotely. Can anyone recommend a decent script that will make daily/weekly backups using rsync to do remote full cpanel backups?
The script should set up rsync so that doing a restore is very simple with WHM restore backup option.
View 1 Replies
View Related
Oct 28, 2009
I was doing a search on google and retrieved some files on it with some sites that should not be available to the public. I investigated the site a little bit and it looked like they are running ASP. I know with Linux servers you can place a .htaccess file which can restrict bots from accessing certain directories, but how can you do it with a windows server running IIS? I would like to get in contact with these companies and let them know about the issues I ran into with their site.
View 4 Replies
View Related
Oct 21, 2009
We have a few single CPU (54xx quad core)systems running Hyper-V and looking at the Hyper-V Logical Processer Total value in Perfmon its staying pretty much from 85% to 100% all day long. Perfomance is mostly ok with an occasional hesitation, but the biggest reason is we are trying to avoid doubling the cost of SPLA license by not adding the second CPU. Most motherboards we have only hold 16 gig to 24 gig memory and by adding a second CPU both will probably be less then 40% or 50%
Any problems keeping a 54xx or any CPU for that matter running flat out as long as its cooled OK?
View 3 Replies
View Related
Aug 11, 2008
We are in the process of replacing our site & hardware (all co-located servers) and moving to a five server config with 2 Apache servers, 2 MySQL servers and a stage server (where pages are prepared). The Apache servers utilise mod_proxy_balancer and a PHP/MySQL script to connect to either of the MySQL servers which replicate with each other.
The bit I am a bit stuck on is keeping both the Apache servers in sync with eachother in terms of files (pages & images) - has anyone got any suggestions that could help with this?
Ideally, the images would be placed on the stage server and automatically copied to the 2 Apache servers. I did have one idea which was to put the images on one of the MySQL servers and use that as a file store but then if that goes down, we are in the poo so to speak.
View 7 Replies
View Related
Jan 1, 2009
I am using a email list manager to keep contact of our client and I need to send few thousand emails to my members occationally. Now I have noticed that gmail, hotmail and others consider you as a spammer if you send too many email.
But my contacts are legitemate. How Can it manage this list fairly?
View 5 Replies
View Related
Apr 22, 2007
what's the most practical way to move ALL the content from one domain to another in terms of keeping decent search ranking as well as forwarding to the new domain.
So like say the current URL is:
[url]
And I want it to be:
[url]
So if you went to the example.com version it'd automatically forward to the example.org version and then the search engines would pick up on that and update the URL.
I've got full control over all the DNS zones, nameservers, etc etc...so whatever is the best option I can do it. I just don't know what that best option is.
View 1 Replies
View Related
Apr 21, 2007
what's the most practical way to move ALL the content from one domain to another in terms of keeping decent search ranking as well as forwarding to the new domain.
So like say the current URL is:
[url
And I want it to be:
[url]
So if you went to the example.com version it'd automatically forward to the example.org version and then the search engines would pick up on that and update the URL.
I've got full control over all the DNS zones, nameservers, etc etc...so whatever is the best option I can do it. I just don't know what that best option is.
View 1 Replies
View Related
