Offsite Backups (via Rsync) - What Files/folders To Backup
I'm currently using (amongst other backup systems) rsync to an offsite space (am using BQBackup at the moment)
I'm just wondering - apart from backing up all of /home/, /var/lib/mysql/ and the important config files (httpd.conf, php.conf, etc etc) is there anything else that *needs* to be backed up?
Obviously in a worst case scenario, a new machine would be deployed with a fresh OS install (and a fresh WHM/cPanel install) so I wouldn't worry about backing up OS files or cPanel core files, although I'm wondering if there's anything apart from the /home/ directory and the MySQL databases which would be lost (and so need backing up) in the event of a crash?
View Complete Thread with Replies
Sponsored Links:
Related Forum Messages:
SSH, Rsync And Offsite Backup
I have a VPS with remote backup that I dod every night with rsync. Now, for further SEO testing, Im looking into a reseller account. Some reseller plan do offer access via SSH. Im not familiar with this ssh access for a reseller. Would I still be able to program a cpanel backup and then rsync all my cpanel backup ?
View Replies!
View Related
Backup: Offsite, Cross VPS, Security Of Backups
I have two VPS's, VPS1 has one vbulletin community. VPS2 has about 10 cpanel accounts, mostly email, a blog site, etc. Both VPS's well under 10 gig in size not including any backups stored on the VPS. For the more important VPS, VPS1, I am packaging the cpanel account (50mb) and SCPing it to VPS2. I am also running pckgacct on the cpanel accounts on VPS2 (about 2 gig total, 1 tar.gz is 1.5gb, three others around 250mb, others smaller) and storing them on VPS2. I then have WS_FTP scheduled to download the cpanel tar.gz files each night to a local machine. I also have WHM setup to do daily incremental backups, but am not moving any of these offsite. So, it seems I have three options: Keep doing what I am doing. Keep moving VPS1 tar.gz files to VPS2, but also start moving VPS2 tar.gz files to VPS1. Start moving tar.gz files (or raw files with rsync) to offsite storage. I'm curious on some feedback about the three options. These are personal sites, I am not reselling any sites/packages. It seems like from a data security standpoint (email and stuff), the more 'locations' introduced into the loop, the less security there will be. Does anyone get concerned about moving their email and other data to offsite storage services? As I said, I have a technical solution currently working, but I am wondering about the theory/data protection aspects of the various options for going forward.
View Replies!
View Related
Daily Backup + Rsync Ssh + Large Number Of Files
i just wana know is it safe to do remote daily backup for about 70,000 files? file sizes is about 200kb and every day i have about 1000 new file, so rsync first should check old files becouse i am deleting about 30-50 of them daily and them backup new 1000 files , so how much it will take every time to compare that 70,000 files? i have 2 option now: 1-using second hdd and raid 1 2-using rsync and backuping to my second server , so i can save about $70 each month.
View Replies!
View Related
Rsync Backups And Security
Rsync seems to be popular as a backup solution, so I thought I give it a look myself. However, after looking for a while I think it is lacking in either (1) usability or (2) security for backups. Lets use a backup of /home for example: (1) To make the transfer secure I'd use rsync over ssh. Backup works great - untill you have to restore. Restore works only partially, because all the files now have the user/group id of the user on the backup server (even if the restore is run as root). You'd have to chown all the individual users dirs, permission files....error prone and a lot of manual work --> not good. (2) Running rsync in daemon mode on the remote server preserves uid/gid and permissions. Restoring works like a charm when run as root. But, hey, now every 13 year old with some knowledge and a packet sniffer can write down your data unencrypted. They just need to look for -lets say- db-info in php files etc and suddenly have access to your customer base or whatever you store.... Even worse if you transfer db dumps or other sensitive data. So it is not safe to use --> not good. Is there a way to secure the transfer or keep uid/gid info intact? And how do all the backup providers handle the issue? (This one here claims rsync is secure.) Or is there another way to fix the problem - restoring uid/gid and secure transfer for backups.
View Replies!
View Related
FTP Backups, Doing RSYNC
FTP backups, doing RSYNC what is needed? I have a linux box with pure-ftpd as FTP backup server. However, we want to explore/expand to RSYNC now. Is there a package that allows RSYNC to be used for FTP users? This is basically like what do FTP services like BQbackup use to allow RSYNC, etc.
View Replies!
View Related
Offsite Backup Service
Razorservers.com provide offsite backup service that can be used for not only servers but also PCs, Mac, linux, Windows, Solaris, etc. Think that must be useful for many web masters. Does your host provide the same?
View Replies!
View Related
Offsite Backup Services?
leave LayeredTech completely, including Dynavol. My new host I've chosen doesn't have backup services, but no big deal. I'd like to know what people out there use (Company and Specific Services) for off site backup of their servers. I can either do push or pull. I liked how Dynavol worked. I guess if that's the best option I could keep LT strictly for Dynavol, but looking to see what others think.
View Replies!
View Related
Offsite Backup Server
running my own servers but i have been hosting websites for a years now using a dedi server in the USA through c-Panel, now i am looking to offer my clients offsite backup to a local server at my end, offering small to large packages of bandwidth and storage. Anyway i have all that sorted the thing is i had a webpage developer create the pages for me and configure it to my ip address (as im not using a domain name for this server) the problem im having is hosting these pages on my centOS 5 server setting up apache, ftp, etc. i require a username and password for each of my clients and when they log in they will be displayed with there file inventory including the files they have uploaded, where that is the other problem i am having creating username and passwords for each of my clients what would be the best software that could do this? remember these backups are via ftp and a web based interface for files up to 500mb but to use a ftp program i will still need to create a username and password for each of my clients
View Replies!
View Related
Keeping Mirror/Mirroring Backups...anything Better Than Rsync?
Keeping mirrored backups...anything better than rsync? I'm keeping mirrored backups of my servers. Does anyone know of any solution better than rsync to update the files on the backup server? I've noticed that when running rsync it can cause a lot of disk i/o, which can slow down a running server. Does anyone have any suggestions on how to decrease disk i/o or another solution to keeping mirrored backups on a secondary server?
View Replies!
View Related
UK To USA Offsite Backup, To Slow
I have a server in UK and i want to make daily offsite backups to a remote location using rsync or other similar software. My idea is to buy a backup server in USA, but i dont know if is going to work well/fast because of the long distance between UK and USA (latency). So any experiences making backups from UK > USA? What do you think, can i buy a backup server in USA or if i want to have fast/reliable backups i have to buy a server also in uk because of the distance?
View Replies!
View Related
Offsite Backup Of Dedicated Server
I have a managed dedicated server at a co-location. While the service I pay for runs the Cpanel backup function, I feel I need to provide a better service to my customers by creating an exact duplicate(image) of the drive itself. I don’t want my customers to lose their databases and web site information. I need help with creating a Plan B. The plan I thought might work, would be to get a workstation, download Acronis and make an image of my dedicated server on a scheduled basis. The reasons I thought this was a good idea: 1) I would have the image in my hands(my control), should something happen to my main hosting server. 2) It would create a complete off-site back-up. 3) It seemed cost effective. What if Scenario: So my main hosting server gets taken away in a hurricane and the data center will not be up and running for 3 months. I have an image of the hard disk, now what do I do with it?
View Replies!
View Related
Weekly Offsite CPanel Backup Process Crashing Apache/bind
Right now I am using the built-in cpanel backup feature to backup all the accounts on my server to an offsite FTP backup account I have on a weekly basis. The problem I am having is that everytime the backup runs, the load (thats what I'm guessing is the cause) is crashing apache/bind, causing sites to be unreachable until I can restart the services. What options do I have to resolve this issue? Currently I already have spri installed, and it does help out a bit, but its still not enough.
View Replies!
View Related
Removing Large Files Or Folders CentOS
Something weird happening here. I have tried every string possible... There are a number of folders I want to remove off my server, tried the good old and simple... rm -r /folder/ And then went and ended up with a string as long as my screen. No matter what I do, as it goes recursive in to the directory it asks me if I want to remove each file individually. No matter what string or action I take it insists on asking me as it goes to delete each file. Could this be a configuration option in CentOS?
View Replies!
View Related
Simple Script To Find Suspected Files And Folders
Try this useful script to find all 777 permission files and folders in /home directory also it can find all names of suspected folders and files you want and then you can take the required action to install this follow the steps login as root Code: cd /root Code: pico checkpandnscript.sh Enter this code and in the 5th line from the end change email@email.com to your email Code: # This file will help you to find suspected folders and files in /home directory # Coded and desgined by Alrutani Web Hosting www.alrutani.com , for more informations please contact us. #!/bin/sh echo " " > /root/perdfmbc echo "################# Folders with 777 permission #################" >> /root/perdfmbc echo " " >> /root/perdfmbc find /home -type d -perm 777 |egrep -v "./cpapachebuild|./.cpan|./src" >> /root/perdfmbc echo " " >> /root/perdfmbc echo "################## Files with 777 permission ##################" >> /root/perdfmbc echo " " >> /root/perdfmbc find /home -type f -perm 777 >> /root/perdfmbc echo " " >> /root/perdfmbc echo "############### Folders & files must be checked ###############" >> /root/perdfmbc echo " " >> /root/perdfmbc find /home -name forum >> /root/perdfmbc find /home -name upload >> /root/perdfmbc find /home -name 4images >> /root/perdfmbc find /home -name gallery >> /root/perdfmbc find /home -name uploader >> /root/perdfmbc find /home -name up >> /root/perdfmbc find /home -name r57shell >> /root/perdfmbc find /home -name r57shell.php >> /root/perdfmbc find /home -name r57.php >> /root/perdfmbc find /home -name c99shell >> /root/perdfmbc find /home -name c99shell.php >> /root/perdfmbc find /home -name c99.php >> /root/perdfmbc find /home -name shell.php >> /root/perdfmbc echo " " >> /root/perdfmbc echo "###############################################################" >> /root/perdfmbc echo "Developed by Alrutani Web Hosting http://www.alrutani.com" >> /root/perdfmbc echo "For more informations please contact us." >> /root/perdfmbc echo " " >> /root/perdfmbc cat /root/perdfmbc | mail -s "Suspected files & folders in your server" email@email.com cd /root rm -rf perdfmbc # This file will help you to find suspected folders and files in /home directory # Coded and desgined by Alrutani Web Hosting www.alrutani.com , for more informations please contact us. To add more files and folders that you want the system to list fine Code: find /home -name upload >> /root/perdfmbc after it add Code: find /home -name xxxxxx >> /root/perdfmbc where xxxxx is the name of the file or the folder you want Save file Ctrl X select yes then click enter Code: chmod 755 checkpandnscript.sh To make the script works daily Code: crontab -e At the end enter Code: * 3 * * * sh /root/checkpandnscript.sh save and exit done !! now to test the script Code: cd /root Code: sh checkpandnscript.sh you will receive email from the server
View Replies!
View Related
Disk Quota Issue - Locating The Folders With The Highest Number Of Files
we've been having issues with reaching or exceeding our disk quotas. I've checked carefully, and while I've cleared our mail queue's, I don't think that's the issue. So what I'm really looking for is a way to figure out why we have so many files (our quota is 220000, and I'm pretty confident that we aren't intentionally doing anything to create so many files). There's lots of information on finding the folders with the largest file sizes, but locating the folders with the greatest number of files isn't quite so simple--or at least, it doesn't seem very clear to me. Does anyone know a way via the command line to figure out this information, short of going through every single folder and figuring out how many files are in the specific folder?
View Replies!
View Related
Atomated Backups Of Files And Db
free system or script for automatically generating file and database backups on my server and emailing me a notification when the yare ready. I want it to be able to schedule itself so that it can take care of all my backups.
View Replies!
View Related
Rsync Doesn't Want To Transfer Files
i have a client machine which requires backing up, and the server. For some reason, rsync doesn't want to transfer files... i've already set up keys, it logs in fine without asking for password. server config: max connections = 2 log file = /var/log/rsync.log timeout = 300 [backup] comment = Rsync backups path = /secondary/client read only = no list = yes uid = nobody gid = nobody auth users = root client command: rsync -vz --recursive --progress --stats -e "ssh -i /root/.ssh/rsynckey" root@server.com:/backup/ /home/usertobackup it keeps saying cannot find the backup folder, even thouhg it does exist on the server and is what is specified in the path above?
View Replies!
View Related
How To Backup To Your PC Using Rsync
I use bqbackup.com in addition to ServInt's backup. The ServInt backup is inaccessible to me and can be restored only by their NoC. Is there a way for me to download the backup files from bqbackup.com to my PC? I am using Win XP Pro. I backup the entire VPS, but I want to be downloading only the changes made each day after the initial download to my PC.
View Replies!
View Related
Rsync / Backup
I am setting up a mirror server to kick on in the event my main server fails and I need some help with syncing the two. It is my understanding I can use rsync to mirror the two. But, will that cover everything (ie. database, mail, etc) or only files?
View Replies!
View Related
Rsync Backup
I am using rsync to database and i found out it corrupted my database. I should have used mysql dump before backing up the data..The problem with taking mysql dump each is that it takes a long time and resources as database is around 10 GB if i want to take backups every 4 hour, whats the best way as mysql dump causes server load problem
View Replies!
View Related
Large Media Files & Backups
I've been using Lypha for the past 4 years, but they've taken the last straw (gigabytes of backups went missing and they wont reply to emails as to why). Looking for a web hosting package for under $10/month that has large enough disk-space/bandwidth to allow me to backup large audio / video files to it, as well as the normal site operation (I use it for portfolio website, as well as hosting additional domains)
View Replies!
View Related
So I Do An RSync Backup - How Do I Restore It?
Backing up a server is obviously very important. Lets say I do a daily rSync backup and eventually my server HDD crashes, I know it isn't just a 'one click' job to restore my backup but what is it necessary to do in order to carry out a complete and effective restore back to how it was? A step-by-step 'tutorial' on restoring an rSync backup would be helpful not just to me but to many 'would-be' server administrators.
View Replies!
View Related
Databases Backup ? (Rsync)
I am using bqinternet.com to backup (Rsync) some accounts. I sent them a ticket before 2 days and didn't get any reply. I used this command to schedule a remote backup for specific accounts: Code: echo "30 6 * * * root rsync -avz -e ssh ~account1 ~account2 ~account3 myuser@myuser.bqbackup.comerver" >> /etc/crontab But, I found this command will backup only files. How can I backup also databases?
View Replies!
View Related
Rsync Backup Related
Currently I am using rsync to backup directory and mysqldump sql file on both external and internal backup drive Now the directory has around 100,000 files that hardly change. Only thing that happens in that directory is either the old files are deleted or new files are added. All of them image Due to some reason when i rsync using any of the two commands below, it transfer each and every file again rather then transferring the new or updated files. Here is what i am currently using rsync -avH /old/path /destination/path (this is for internal backup drive) or rsync -avz -e ssh /old/path username@username.remoteaddress:/destination/path why all my files in the directory all uploaded again
View Replies!
View Related
Any Daily Moving Files Soloution (Rsync)
I have move all my vBulletin images to a separate server .. to decrease the load in the main server.. but i am still having a problem .. I have a 3 directors updated daily with new images they are /home/mark/public_html/vb/customavatars /home/mark/public_html/vb/customprofilepics /home/mark/public_html/vb/signaturepics/ I am searching for a way to move only the new files uploaded to this there directory's to the other server in this way /home/mark/public_html/vb/customavatars (new files) ===> /home/mark/public_html/images/customavatars /home/mark/public_html/vb/customprofilepics (new files) ===> /home/mark/public_html/images/customprofilepics /home/mark/public_html/vb/signaturepics/(new files) ===> /home/mark/public_html/images/signaturepics I have tried to use Rsync in this way as i have a internal connection between my server but it's not work rsync -a rsync://192.168.0.2/vb/customprofilepics/ /home/mark/public_html/images/customprofilepics rsync -a rsync://192.168.0.2/vb/customavatars/ /home/mark/public_html/images/customavatars rsync -a rsync://192.168.0.2/vb/signaturepics/ /home/mark/public_html/images/signaturepics with daily corn ..
View Replies!
View Related
Rsync Some Files From Windows To A Linux Server
At work, we have a windows 2003 server. We have a set of files that get modified from day to day. Since they know I own a dedicated server (Linux) they ask me if it would be possible to have an offsite backup on my server of the set of files on the windows 2003 server. Also, I dont want to have the whole files set to be uploaded everyday. I am aware of rsync on *nix system, but do you have any suggestions on how to proceed with a windows 2003 server to a unix server?
View Replies!
View Related
Using Rsync To Backup An Entire Server
The backup program (cpbackup) that comes with WHM/Cpanel is not ideal for our current situation. We have lots of third party applications installed on our server along with many customized configuration files. We need a solution that will backup everything and allow for fairly simple restoration. How viable is rsync for full server backups? Can it handle 100 GB of data? More importantly, how would you restore the backup to a new server? If the new server already has an OS the restored files would break the system, right?
View Replies!
View Related
Rsync Backup - User Permissions
I have a problem with my rsync backup First of all my setup is thus: I have a Linux box at the office which has an rsync cron on it which pulls from my web server as a backup. It pulls websites, mysql, conf files etc. My web server is running debian etch LAMP etc. When I originally set it up I used root user to log into the web server, and setup keys to authenticate, this worked perfectly. I then decided that having direct root access to the web server was a bad thing so I have turned off root login (PermitRootLogin no in sshd_config) I then setup a backup user which works fine for the website files but fails on permissions for the mysql data files (/var/lib/mysql) How can I get over this without granting root access to the backup user which would defeat the object of not allowing root access. I have been told about host authentication based on ip address but I have dynamic address at the office so that would be no good
View Replies!
View Related
Rsync Backup To NAS Via FTP
I just signed up with Rsync Palace for remote backups 2 days ago. Otto and Darin at Rsync Palace gladly helped me out and actually ended up setting me up for free. It's really an inexpensive price to pay for a little additional piece of mind to have a remote backup. I have a VPS with cPanel that has NAS on a private network. The way they set it up was for Cpanel cron job to create backups of my VPS and place the backups in a /backup folder off root; Daily, Weekly and Monthly. Then they have Rsync via cron set up to take those backups to the remote Rsync Palace server daily. I still want to maintain backups on my NAS in the datacenter. (cPanel will only backup remotely or locally, but not both.) In addition to Rsync securely transferring my data to Rsync Palace for offsite backups... How can I set up Rsync to ftp the same /backup data across the private network to the NAS? (Only ftp is available via the NAS.)
View Replies!
View Related
Backups: Managed Backup Company, Or DIY With Dedicated Server
We have 2 servers which run our website. One for data (about 50gb) and one for databases (about 5gb) We currently perform offsite backups but we want to improve upon these. Our main objectives are: 1) Be able to recover as much info as possible in the event of a disaster 2) Be able to rollback to a previous version should we not notice a problem until later (ie 30 day history?) 3) Be able to restore as quickly as possible 4) Be able to afford it! The options we seem to have are: A) Use a service such as backupdirect.net which specialise in offsite backup and have specialised software to handle this. Obviously we get support, the backups are encrypted, etc and probably will end up with a much more robust backup solution. However, it will take time to restore, if our server goes down we still have to get that working then perform the restore B) Buy another dedicated server, which we can run everything on (albeit slowly!) and keep a 'live backup' on this server. This means we could switch to it should our main servers die for any reason with minimal downtime. Downsites would mean we have less support, would have to be careful with encryption of the data flowing from one server to another and we would have a less formal backup solution (eg harder to restore back to a point in time)
View Replies!
View Related
How To Delete Backup Files
I have files on offsite backup from a previous server - I can login via putty ot winscp. Putty login shows: Quote: FreeBSD 6.1-RELEASE-p3 (BACKUP3) i want to delete them all - how can I do this in the most secure manner with the access I have?
View Replies!
View Related
How To Easiest Do Backup And Transfer Of Mysql Files
I have following problem-i have over 20 sites on server and each site has own database.Is there a way to speed up backup and transfer or other server? Method which i use right now it's following:first i archive entire directory using command tar -pczf name.tar.gz public_html,and then repeat with each directory.But i think i could simply archive all requied directories,but that will took toomuch time,so if i drop connection during archiving it wont be archived at all then.So i think best solution will be to create some kind of batch command which can load in background,so that means command wont stop if client lost connection. So let's say i have 2 sites and two directories located and different places. One is at home/site1 and other at home/site2 So i think i would need to put command into batch file tar -pczf site.tar.gz. /home/site1 and tar -pczf site2.tar.gz /home/site2 Will that work? Also second part,mysql databases,i founded if i login into phpmyadmin as root i can see all databases.I managed to export all databases,but question will import again to phpmyadmin work.I think phpmyadmin create command for each database "if there is no db sitename_mysqlbase,create it",but howmuch i know phpmyadmin have limit with importing size of mysql database.Could that be done with import/export mysql command?
View Replies!
View Related
Automatically Purge Backup Files Off Thumb Drive
we have a thumb drive attached to a CentOS (linux) box and mysql backups are automatically saved to the thumb drive. Is there a way an HOW to automatically purge backup files if they are older than say 15 days? I suppose I would need to write a script for this and place it in the cron scheduler. The format of the mysql dump files are: Backup_20070420_0015.sql
View Replies!
View Related
Cron Job That Deletes Backup Files Older Than 5 Days
This is on a RHEL 4 Box. I want to create a cron job that deletes backup files that are older than 5 days. I have created a shell script (/usr/local/src/runjob.sh) that runs successfully from the SSH command line: Code: #pwd /usr/local/src #./runjob.sh Here is the script: Code: #!/bin/sh # # find /usr/local/apache/sites/*/BACKUPS/ -maxdepth 1 -atime +5 -iname 'test*.txt' -exec rm {} ; Script has 777 permissions and is owned by root. I have the following entry in crontab: Code: 10 12 * * * /bin/sh /usr/local/src/runjob.sh >/dev/null 2>&1 As shown in the cron log, the job does run, but it does not delete the files. And there are files older than 5 days in the directory that meet the find criteria.
View Replies!
View Related
Offsite Secondary DNS
would it be possible to have my main box running apache, a second box for dns/other and an offsite secondary dns such as DNS1.PUBLIC-DNS.NET? Is it possible to authenticate the primary and offsite secondary nameserver so the zone is transferred to the secondary? Would i need to pay for a special service, or do free ones exist? Are there any security implications with zone files being transferred out over the public internet, would a vpn need to be configured or can the process be encrypted via the transfer procedure? Finally, how would this affect the way the entire virtual hosting works? I know when the nameserver on the host machine serves resolves a name request for a computer trying to browse the site in question, but when the actual http request goes to the web server does it incldue the domain it is looking at also?
View Replies!
View Related
Offsite NAS For Co-located Servers
I've just co-located a few servers and I need to get some offsite NAS, based in the UK so we can start taking regular backups. Wondering if anyone could give me some recommendations of good but reasonably cheap companies to use for this?
View Replies!
View Related
|
TRACKER
