FTP backups, doing RSYNC what is needed?
I have a linux box with pure-ftpd as FTP backup server. However, we want to explore/expand to RSYNC now.
Is there a package that allows RSYNC to be used for FTP users?
This is basically like what do FTP services like BQbackup use to allow RSYNC, etc.
Rsync seems to be popular as a backup solution, so I thought I give it a look myself. However, after looking for a while I think it is lacking in either (1) usability or (2) security for backups.
Lets use a backup of /home for example:
(1) To make the transfer secure I'd use rsync over ssh. Backup works great - untill you have to restore. Restore works only partially, because all the files now have the user/group id of the user on the backup server (even if the restore is run as root). You'd have to chown all the individual users dirs, permission files....error prone and a lot of manual work --> not good.
(2) Running rsync in daemon mode on the remote server preserves uid/gid and permissions. Restoring works like a charm when run as root. But, hey, now every 13 year old with some knowledge and a packet sniffer can write down your data unencrypted. They just need to look for -lets say- db-info in php files etc and suddenly have access to your customer base or whatever you store.... Even worse if you transfer db dumps or other sensitive data. So it is not safe to use --> not good.
Is there a way to secure the transfer or keep uid/gid info intact?
And how do all the backup providers handle the issue? (This one here claims rsync is secure.)
Or is there another way to fix the problem - restoring uid/gid and secure transfer for backups.
Keeping mirrored backups...anything better than rsync?
I'm keeping mirrored backups of my servers. Does anyone know of any solution better than rsync to update the files on the backup server?
I've noticed that when running rsync it can cause a lot of disk i/o, which can slow down a running server.
Does anyone have any suggestions on how to decrease disk i/o or another solution to keeping mirrored backups on a secondary server?
I'm currently using (amongst other backup systems) rsync to an offsite space (am using BQBackup at the moment)
I'm just wondering - apart from backing up all of /home/, /var/lib/mysql/ and the important config files (httpd.conf, php.conf, etc etc) is there anything else that *needs* to be backed up?
Obviously in a worst case scenario, a new machine would be deployed with a fresh OS install (and a fresh WHM/cPanel install) so I wouldn't worry about backing up OS files or cPanel core files, although I'm wondering if there's anything apart from the /home/ directory and the MySQL databases which would be lost (and so need backing up) in the event of a crash?
script that will backup full cpanel backups remotely. Can anyone recommend a decent script that will make daily/weekly backups using rsync to do remote full cpanel backups?
The script should set up rsync so that doing a restore is very simple with WHM restore backup option.
I made some data backup on one of the backup servers using rsync. How can I restore it to the new server now?
My account is ready on new vps and all I need is pull the data back from backup server to new vps account.
I used this command previously
Quote:
rsync -avz -e ssh /home/user1 backupuser@backup.server.com:user1
i have two srevers one is Dedicated Server and the secound is for backup .
well , i login to the backup server and creat ftp account .
i wanna make the server save the weekly backup .
the backup path is /backup
the copmany of the backup server said "
To RSync your data to your backup server, type:
"rsync -av --progress -e ssh @"
this will put all the files in your home
directory..."
i dont know how to use this command on the Dedicated Server .
Is there anything better then rsync to replicate files (twice a day) on servers located in seperate datacenters?
Looking for more of a free to cheap solution though will also be interested in the higher end solutions later on.
I search over the forum as many members recommend rsync over the backup option builit in cPanel/WHM. May I know why cPanel/WHM's is not recommended?
View 4 Replies View RelatedDoes rsync required to be installed on both servers for it to work? Can rsync work with ftp only on the remote server?
Can you guys list some typical rsync shell command to help me get started...
I am using BQbackup to auto backup my CPanel VPS and was wondering whether it is best to use CPanel's own backup service which automatically backs-up the vps daily or should I use the rsync script that bqbackup provides?
Which is easier to restore and more reliable?
Looking for an RSYNC tutorial, something that focuses on backing http data, exporting the databases then transferring offsite to a receiving rsync server once a week.
Something that's understandable and logical would be great, happy to work through over the next week and continue more in depth with it.
I have been trying to setup rsync on my server and following these instructions
http://www.bqbackup.com/setup.html
The problem is I keep getting errors.
On this step,
ssh-keygen -t rsa -N
I edited it and did ssh-keygen -t rsa --N becauseI got an error saying it need the '--' before the N.
So after getting through that part, I got these questions asked
Enter passphrase (empty for no passphrase):
Enter same passphrase again:
Your identification has been saved in /root/.ssh/id_rsa.
Your public key has been saved in /root/.ssh/id_rsa.pub.
The key fingerprint is:
I left the passphrase empty, and then when it asked where to save to, I just typed in 'rsa'. Then it gave me some fingerprint.
Then I get to the step,
# scp ~/.ssh/id_rsa.pub yourusername@yourusername.bqbackup.com:keys/server1
# ssh yourusername@yourusername.bqbackup.com mergekeys
But I get errors saying
-bash: cat~/.ssh/id_rsa.pub: No such file or directory
I dont get what I'm doing wrong. If somebody doesnt mind, can you please re-write the steps on getting this working, or maybe tell me where I am going wrong if the tutorial is correct?
Current, 2.6.3 came with my centos 4.4 cpanel server, I tried updating it to latest 2.6.9. However, when I type "rsync" it's pointing to 2.6.3 How can I remove the old version or reinstall over it?
View 8 Replies View Relatedone day later, if I run the following command again, the command is same as the one run by the first time.
rsync -avz username@IP:/home/asite/public_html/ /home/asite/public_html/
does it mean rsync will just check and copy the newer folders and files from the last copy?
I have a bit of a strange problem, I have an rsync command setup in the servers crontab and from the cron log it show it ran the command but the files don't copy to the backup server. If I take the rsync syntax and run it manually all the files copy across with no errors, but I can't figure out why the cronjob doesn't work properly.
View 8 Replies View RelatedI'm trying to configure rsync to backup my vps data to an rsync backup provider.
The problem that I am having is that each time I try to run rsync it prompts for the passphrase.
I did some reading and it seems (and maybe this is not correct), that in order to do unattended rsync (e.g. using cron), that you need to use a key that doesn't have a passphrase generated.
If this is the case, is it true that it's not a good idea to use a key that doesn't have a passphrase?
I got one of those cheap $10 servers from hostmds to use to backup my vps.
Know I just need to know how do I setup rsync to backup my vps nightly? Any links to good guides to do this would be great. I looked on google, but am hoping someobody knows a guide that is simple to follow.
I am in the process of setting up a cronjob so I can run rsync automatically every day.
But I want to know is it ok to exclude the following folders?
/home/.cpcpan/
/home/cpeasyapache/
/home/src/ <!--- This folder I made to put files in before I install
/home/MySQL-install/
/home/.cpan/
As from what I understand cPanel/WHM makes these folders, and there no user data in these folders
I have wrote a small script which copies file names which has name as *default* from backup to users main folder. It works fine with one folder but doesn't copy files from sub-folders.
it works with all the sub-folders as well?
HTML Code:
#!/bin/bash
for i in $(ls /var/cpanel/users)
do
rsync -vrplogDtH /backup/cpbackup/weekly/$i/homedir/public_html/*default* /home/$i/public_html
chown -R $i.$i /home/$i/public_html/*default*
done
i have two differnt server at two differnt datacenters,with same contant,runing under subdomain eg main domain is domain.com and subdomain is sub.domain.com both are same site,i used this to reduce server load and share request,but the problem iam haveing when update any stuff i need to update on both server it bit diffcult any way to update contant via rsync between the two servers?
View 6 Replies View RelatedI have two folders:
/misc
/misc-backup
how do I go about making /misc-backup a mirror of /misc correctly?
I just signed up with Rsync Palace for remote backups 2 days ago. Otto and Darin at Rsync Palace gladly helped me out and actually ended up setting me up for free. It's really an inexpensive price to pay for a little additional piece of mind to have a remote backup.
I have a VPS with cPanel that has NAS on a private network. The way they set it up was for Cpanel cron job to create backups of my VPS and place the backups in a /backup folder off root; Daily, Weekly and Monthly.
Then they have Rsync via cron set up to take those backups to the remote Rsync Palace server daily.
I still want to maintain backups on my NAS in the datacenter. (cPanel will only backup remotely or locally, but not both.)
In addition to Rsync securely transferring my data to Rsync Palace for offsite backups... How can I set up Rsync to ftp the same /backup data across the private network to the NAS? (Only ftp is available via the NAS.)
I use bqbackup.com in addition to ServInt's backup. The ServInt backup is inaccessible to me and can be restored only by their NoC.
Is there a way for me to download the backup files from bqbackup.com to my PC? I am using Win XP Pro. I backup the entire VPS, but I want to be downloading only the changes made each day after the initial download to my PC.
I'm running rsync in cron jobs. is there a way to be notified via email when the job is done plus the log? I'd really like to know how long it's taking to complete and whether it's running properly or not.
View 12 Replies View RelatedI am trying to recover some backups on the server by rsync the home dir from BQbackup to my server. I deleted 1 file to see whether it actually works. I executing this command on the server:
rsync -avz -e ssh username@username.bqbackup.com:path.to.home.dir /home
I saw that it downloaded the file I deleted, however after checking on FTP if the file was recovered it actually wasn't. Is there something wrong in the command I used as it seems that it is not recovering any files.
I type rsync and after the man page, it says
Code:
rsync error: syntax or usage error (code 1) at main.c(1073)
I am setting up a mirror server to kick on in the event my main server fails and I need some help with syncing the two.
It is my understanding I can use rsync to mirror the two. But, will that cover everything (ie. database, mail, etc) or only files?
im trying to setup rsync to mirror my FreeBSD box to my CentOS box.
I have rsync moving everything in /etc/, /usr/, /home/. The rsync daemon is hard to get running on CentOS (need to make startup scripts and all) so I was wondering if I can just make a user on the centOS box for rsync:rsync and transfer it as root fromt he freeBSD box to the centOS box using ssh keys. Can I do this?
Someone said this won't be possible because rsync:rsync will not be able to read the files owned by root:wheel. Is this true?
I am using rsync to database and i found out it corrupted my database. I should have used mysql dump before backing up the data..The problem with taking mysql dump each is that it takes a long time and resources as database is around 10 GB
if i want to take backups every 4 hour, whats the best way as mysql dump causes server load problem
I am wanting to setup rsync to always login, so I don't want to use keys. Is it possible to put the password in the rsync command leave.
If so how do I do this?
Or do I have to use: --password-file=/path/to/password/file