Incremental Rsync
Jan 17, 2008I have two folders:
/misc
/misc-backup
how do I go about making /misc-backup a mirror of /misc correctly?
I have two folders:
/misc
/misc-backup
how do I go about making /misc-backup a mirror of /misc correctly?
Does anyone have experience in backing up mysql incrementally? From what I've read in the docs it's possible using the binary logs but I haven't been able to find a good resource on how to make this work.
I have a database that is over 5GB. There are a few Myisam tables that are insert/select only and one innodb table that receives updates/deletes/selects/inserts.
Ideally I wouldn't have to backup the 5GB every night, I'd prefer to only get the items that have changed. If I could make this work, then I could also get backups more often rather than once a night.
I was wondering if I would be better to use incremental backup in cpanel instead of disabling the incremental feature and having tar.gz backup.
Im doing ssh overnigth on an offsite server.
Gzip is -rsync tagged when activated, as per this ccron command:
Quote:
0 1 * * * export GZIP="--rsyncable" ; /scripts/cpbackup
so they should be rsync friendly?
Whats your tougth on this?
do incremental backup on my local hard disk but i would use backup compression, is there any way to tar each account and use incremental system? i have read something on GZIP --rsyncable
View 1 Replies View RelatedI was wondering which of the backup method has the fastest restoration time - is it incremental uncompressed backup or compressed backup?
I am making 2 daily backup which is both uncompressed and compressed. However in case my server broke down, I want to choose which one is the fastest?
We have incremental backups running in our server. We want to move the cPanel accounts to a new cPanel server and restore in that server. The Backup Restore option in WHM will recognize only compressed backups (like .tar.gz) when it is placed in the /home directory. So how do I do about restoring a incremental backup through the WHM of the new server?
View 4 Replies View RelatedWhat type of backup do you use with your host? (daily, nightly, incremental, etc)
View 10 Replies View RelatedI want to back-up accounts managed by cPanel/WebHostManager to a remote server. I want to be able to restore to any of the last 7 days. I believe doing an incremental back-up each night can accomplish this best, saving both bandwidth and disk space on the remote server.
Using the back-up functionality built into WHM is appealing because WHM knows what files need to be backed up to do a full restore. However, WHM can't do exactly what I'm looking for either. I've been looking into using rsync as described in this document:
[url]
It looks becaue of the "hard link" capabilities of linux, rsync can be used to create what functions like a full back-up every night but requires a full backup the first day and then each day after that only the incremental changes have to be transfered. However, because I don't know what directories need to be backed up, I'm not sure how to implement an rsyc solution either. (BTW, I want to back-up everything necessary to be able to restore each account except the log files. So, that means MySQL, mail, config info, and whatever the user has uploaded)
I current do some rsync backups with a command like so every day
rsync -az -e ssh --stats --delete --exclude "stuff" / user@server:/home/user/
What I want to do is have some incremental backups in there in subdirectories. So, for example, something like this on the remote server
/home/user/something.tuesday
/home/user/something.friday
I thought the --backup --backup-dir Switches were used to store just the files that had changed in seperate directories, am I wrong on that?
I've read everything I could find, including the big rsnapshot scripts, but I'm not able to do what I want, it seems so simple but something's not right, am I wrong that subdirs should have just files that are new or have changed. I tried various things like this, but had no luck
rsync -az -e ssh --stats --delete --backup --backup-dir=/home.Thursday --exclude "stuff" / user@server:/home/user/
I made some data backup on one of the backup servers using rsync. How can I restore it to the new server now?
My account is ready on new vps and all I need is pull the data back from backup server to new vps account.
I used this command previously
Quote:
rsync -avz -e ssh /home/user1 backupuser@backup.server.com:user1
i have two srevers one is Dedicated Server and the secound is for backup .
well , i login to the backup server and creat ftp account .
i wanna make the server save the weekly backup .
the backup path is /backup
the copmany of the backup server said "
To RSync your data to your backup server, type:
"rsync -av --progress -e ssh @"
this will put all the files in your home
directory..."
i dont know how to use this command on the Dedicated Server .
Is there anything better then rsync to replicate files (twice a day) on servers located in seperate datacenters?
Looking for more of a free to cheap solution though will also be interested in the higher end solutions later on.
I search over the forum as many members recommend rsync over the backup option builit in cPanel/WHM. May I know why cPanel/WHM's is not recommended?
View 4 Replies View RelatedDoes rsync required to be installed on both servers for it to work? Can rsync work with ftp only on the remote server?
Can you guys list some typical rsync shell command to help me get started...
I am using BQbackup to auto backup my CPanel VPS and was wondering whether it is best to use CPanel's own backup service which automatically backs-up the vps daily or should I use the rsync script that bqbackup provides?
Which is easier to restore and more reliable?
Looking for an RSYNC tutorial, something that focuses on backing http data, exporting the databases then transferring offsite to a receiving rsync server once a week.
Something that's understandable and logical would be great, happy to work through over the next week and continue more in depth with it.
I have been trying to setup rsync on my server and following these instructions
http://www.bqbackup.com/setup.html
The problem is I keep getting errors.
On this step,
ssh-keygen -t rsa -N
I edited it and did ssh-keygen -t rsa --N becauseI got an error saying it need the '--' before the N.
So after getting through that part, I got these questions asked
Enter passphrase (empty for no passphrase):
Enter same passphrase again:
Your identification has been saved in /root/.ssh/id_rsa.
Your public key has been saved in /root/.ssh/id_rsa.pub.
The key fingerprint is:
I left the passphrase empty, and then when it asked where to save to, I just typed in 'rsa'. Then it gave me some fingerprint.
Then I get to the step,
# scp ~/.ssh/id_rsa.pub yourusername@yourusername.bqbackup.com:keys/server1
# ssh yourusername@yourusername.bqbackup.com mergekeys
But I get errors saying
-bash: cat~/.ssh/id_rsa.pub: No such file or directory
I dont get what I'm doing wrong. If somebody doesnt mind, can you please re-write the steps on getting this working, or maybe tell me where I am going wrong if the tutorial is correct?
Current, 2.6.3 came with my centos 4.4 cpanel server, I tried updating it to latest 2.6.9. However, when I type "rsync" it's pointing to 2.6.3 How can I remove the old version or reinstall over it?
View 8 Replies View Relatedone day later, if I run the following command again, the command is same as the one run by the first time.
rsync -avz username@IP:/home/asite/public_html/ /home/asite/public_html/
does it mean rsync will just check and copy the newer folders and files from the last copy?
I have a bit of a strange problem, I have an rsync command setup in the servers crontab and from the cron log it show it ran the command but the files don't copy to the backup server. If I take the rsync syntax and run it manually all the files copy across with no errors, but I can't figure out why the cronjob doesn't work properly.
View 8 Replies View RelatedI'm trying to configure rsync to backup my vps data to an rsync backup provider.
The problem that I am having is that each time I try to run rsync it prompts for the passphrase.
I did some reading and it seems (and maybe this is not correct), that in order to do unattended rsync (e.g. using cron), that you need to use a key that doesn't have a passphrase generated.
If this is the case, is it true that it's not a good idea to use a key that doesn't have a passphrase?
I got one of those cheap $10 servers from hostmds to use to backup my vps.
Know I just need to know how do I setup rsync to backup my vps nightly? Any links to good guides to do this would be great. I looked on google, but am hoping someobody knows a guide that is simple to follow.
I am in the process of setting up a cronjob so I can run rsync automatically every day.
But I want to know is it ok to exclude the following folders?
/home/.cpcpan/
/home/cpeasyapache/
/home/src/ <!--- This folder I made to put files in before I install
/home/MySQL-install/
/home/.cpan/
As from what I understand cPanel/WHM makes these folders, and there no user data in these folders
I have wrote a small script which copies file names which has name as *default* from backup to users main folder. It works fine with one folder but doesn't copy files from sub-folders.
it works with all the sub-folders as well?
HTML Code:
#!/bin/bash
for i in $(ls /var/cpanel/users)
do
rsync -vrplogDtH /backup/cpbackup/weekly/$i/homedir/public_html/*default* /home/$i/public_html
chown -R $i.$i /home/$i/public_html/*default*
done