Rsync Backups And Security
Rsync seems to be popular as a backup solution, so I thought I give it a look myself. However, after looking for a while I think it is lacking in either (1) usability or (2) security for backups.
Lets use a backup of /home for example:
(1) To make the transfer secure I'd use rsync over ssh. Backup works great - untill you have to restore. Restore works only partially, because all the files now have the user/group id of the user on the backup server (even if the restore is run as root). You'd have to chown all the individual users dirs, permission files....error prone and a lot of manual work --> not good.
(2) Running rsync in daemon mode on the remote server preserves uid/gid and permissions. Restoring works like a charm when run as root. But, hey, now every 13 year old with some knowledge and a packet sniffer can write down your data unencrypted. They just need to look for -lets say- db-info in php files etc and suddenly have access to your customer base or whatever you store.... Even worse if you transfer db dumps or other sensitive data. So it is not safe to use --> not good.
Is there a way to secure the transfer or keep uid/gid info intact?
And how do all the backup providers handle the issue? (This one here claims rsync is secure.)
Or is there another way to fix the problem - restoring uid/gid and secure transfer for backups.
View Complete Thread with Replies
Sponsored Links:
Related Forum Messages:
FTP Backups, Doing RSYNC
FTP backups, doing RSYNC what is needed? I have a linux box with pure-ftpd as FTP backup server. However, we want to explore/expand to RSYNC now. Is there a package that allows RSYNC to be used for FTP users? This is basically like what do FTP services like BQbackup use to allow RSYNC, etc.
View Replies!
View Related
Keeping Mirror/Mirroring Backups...anything Better Than Rsync?
Keeping mirrored backups...anything better than rsync? I'm keeping mirrored backups of my servers. Does anyone know of any solution better than rsync to update the files on the backup server? I've noticed that when running rsync it can cause a lot of disk i/o, which can slow down a running server. Does anyone have any suggestions on how to decrease disk i/o or another solution to keeping mirrored backups on a secondary server?
View Replies!
View Related
Offsite Backups (via Rsync) - What Files/folders To Backup
I'm currently using (amongst other backup systems) rsync to an offsite space (am using BQBackup at the moment) I'm just wondering - apart from backing up all of /home/, /var/lib/mysql/ and the important config files (httpd.conf, php.conf, etc etc) is there anything else that *needs* to be backed up? Obviously in a worst case scenario, a new machine would be deployed with a fresh OS install (and a fresh WHM/cPanel install) so I wouldn't worry about backing up OS files or cPanel core files, although I'm wondering if there's anything apart from the /home/ directory and the MySQL databases which would be lost (and so need backing up) in the event of a crash?
View Replies!
View Related
Backup: Offsite, Cross VPS, Security Of Backups
I have two VPS's, VPS1 has one vbulletin community. VPS2 has about 10 cpanel accounts, mostly email, a blog site, etc. Both VPS's well under 10 gig in size not including any backups stored on the VPS. For the more important VPS, VPS1, I am packaging the cpanel account (50mb) and SCPing it to VPS2. I am also running pckgacct on the cpanel accounts on VPS2 (about 2 gig total, 1 tar.gz is 1.5gb, three others around 250mb, others smaller) and storing them on VPS2. I then have WS_FTP scheduled to download the cpanel tar.gz files each night to a local machine. I also have WHM setup to do daily incremental backups, but am not moving any of these offsite. So, it seems I have three options: Keep doing what I am doing. Keep moving VPS1 tar.gz files to VPS2, but also start moving VPS2 tar.gz files to VPS1. Start moving tar.gz files (or raw files with rsync) to offsite storage. I'm curious on some feedback about the three options. These are personal sites, I am not reselling any sites/packages. It seems like from a data security standpoint (email and stuff), the more 'locations' introduced into the loop, the less security there will be. Does anyone get concerned about moving their email and other data to offsite storage services? As I said, I have a technical solution currently working, but I am wondering about the theory/data protection aspects of the various options for going forward.
View Replies!
View Related
Joomla Security / Linux Security
I run a web hosting company and one of my servers is a LAMP server running CentOs 5. A user of mine has a Joomla installation running to manage his website and he has run into the following problem that I am puzzled by. When Joomla adds a component or module to itself, or when a user uses the Joomla upload functionality, Joomla will add the new files under the user name "apache". This makes sense as it is the apache service running PHP that is actually creating the files. However, when he FTP's into the account to modify these files, he doesn't have the appropriate permissions to do so as he doesn't have a root level login, just permissions on his home directory which is the site. Any help would be much appreciated. Also, does anyone know how to change the owner/group of a directory and all of its sub directories in Linux without changing the actual permissions? I.e. some of the files in the folder have different permissions (0644 as apposed to 0755) than its parent but if I do a top down user/group change on the folder it will change everything in that folder to 0755.
View Replies!
View Related
Backups.
I've got a VPS with SLHost and have setup a remote backup account with RVPalace The VPS is running WHM/Cpanel I'm running a fairly busy forum and host a few friends sites on the server to. (CMS systems etc) What's the best way to go about backing up the data to this remote host? Would you say WHM's backup system is sufficient? I don't feel comfortable with one backup every 24 hours, so i'm wondering if there's anyway to reduce that to every 6 hours? Or would you guys recommend RSync instead? I do have a question regarding RSync...something that worries me If it's set to backup the sites every 6 hours and only backs up when something changes (Files/databases) If, god forbid, a site gets hacked, but isn't noticed and Rsync kicks in and backs up the hacked site, there'd be no way to go back to a previous backup, would there?
View Replies!
View Related
Backups
what I want to do is a backup every night of the files on my servers from the Data Centre to a server in our local office. What would be the best program to do this? The OS would be Windows Server 2003.
View Replies!
View Related
Automated Backups
I have a dedicated server that only has around 3-4gb of data on it. I would like to do automated nightly backups for as cheap as possible. I don't want to pay to have my server managed just to be able to have automated backups, so what other solutions do I have? I know I can get really cheap storage from Amazon or Mosso, but is there a way to automate this?
View Replies!
View Related
Cpanel Backups
I would like to know what is the difference in cpanel between a full backup and a daily or weekly backup, and how they work together. I was under the impression that a daily backup was a backup of all the files at the end of the day but apparently according to my host this is not so, and Im a bit confused as to what is the purpose of the daily and weekly backup.
View Replies!
View Related
WHM Backups
In WHM I set my backups to go to the / directory in a flder called backup. This filled up rather quick and that partiton is now full! I was going to change the location to /home as i have over 400GB of space here but it says: Setting this to /home is a very bad idea.)
View Replies!
View Related
Restore A Backups
I have dedicated server and I have daily,weekly and monthly backups located in: root: /backup/cpbackup (my secondary drive) each account's backup locate in specific directory like: the backup of account website1.com will be located in: root: /backup/cpbackup/website1 all backups are not compressed file So, How can I restore one or more backup?
View Replies!
View Related
Colocation For Backups
if anyone knows about cheaper and reliable colocation services in East/ Central. I don’t need premium bandwidth (Internap, Level 3, etc). I need to colocate ½ rack to host my Backups, Bandwidth needed is 5 MB since I use Rsync at different hours, so I don’t need to push more than that. I try to look for colocation services here in Colorado, but all companies quote me $50 to $70 for each server and $130 per MB.
View Replies!
View Related
Dreamhost Backups User!
Check this out... I was just diggin around in my Dreamhost panel and discovered something new that I've not even seen announced anywhere... Dreamhost is giving a BACKUPS user on each account, totally separately from the web user. You are allowed... well, I'll just copy / paste straight from the panel: At DreamHost, you may only keep website-related content on your regular users. You do, however, get one user per account where anything legal may be stored; your Backups User. This user cannot have any websites pointed to it, nor may you share files via it... it is only to be used as an off-site backup for your personal files. As such, we keep no backups of files on this account. These are already supposed to be your backups... not your only copy! (Of course, you should always keep your own copies of all data stored with us.. we make no guarantees!) Every full DreamHost Hosting plan includes 50GB of backups space! (Additional usage will be charged at the rate of 10 cents / GB a month: the best backup deal on the net!) Pretty interesting... they didn't HAVE to do that, it's just another one of those things that they give in order to be even MORE awesome, evidently.
View Replies!
View Related
Creating Daily Backups
I want to set up my server (a linux dedicated server) to automatically create daily backups of the pop3, mysql, & webfiles. I want it to go to a server which i have purchased with the exact same specifications. I am not very good at unix command line/scripting. So what I need is for someone to help me define the backup strategy, select the scripts, and tell me of how to make sure backup server is secure.
View Replies!
View Related
CPanel Remote Backups
We all know about backups, and compressing files, etc etc... so, what do you guys do in this situation? I have a quad core, 4gb ram, 250gb disk, when I run cpanel backups to my remote server, the server loads go up to 3. Is there any way I can control this and lets say... dont let it go bellow 2? Improved Backup Performance — Speed is safe. cPanel’s backup facilities in 11.24 have seen significant speed increases. In previous versions, load averages while backups were running could be as high as 3. With our reworked and enhanced backup system, load averages tend to stay around 1.2 when backups run on servers with many accounts. This is an extremely substantial performance increase that you and your customers will notice right away. With our new backup system, there is no reason not to keep your data safe."
View Replies!
View Related
Best Reliable Method For Backups?
which is the best reliable method for backups? i own dedicated server along with cpanel and i want to make weekly backups of about 20 domains in the server. I have NAS but all files got corrupted (with theplanet) and so i cant rely on it. Please suggest me a inexpensive solution.
View Replies!
View Related
Mysql Automated Backups
some software that can be ran on a desktop that will allow me to download and backup my databases from my Cpanel server. I have a remote backup server that once the databases are backed up can be uploaded to this location. Im not too sure if im going around things in a long winded fashion, but ideally i need a solution that can take management of my database backups. The cpanel dedi im using at the moment is currently utilising the Backup feature, so this is a secondary backup. At the same time i would like to select which databases are backed up too. Realistically im looking for your expert advice here, im a novice when it comes to server admin etc so your expert help to guide me would be fantastic. Im not to sure whether i would need a desktop tool to back these databases up, or whether it can be done at a server level? Dare i say it im just used to using GUI's and not so familiar with command lines etc.
View Replies!
View Related
Automatic Site Backups
I've been searching for a tool to automate website backups for me, that is to keep regular copies of files and databases in case of unexpected data loss. So far I found Site Vault that handles both FTP and MySQL backups at the same time. Does anyone know good alternatives to consider?
View Replies!
View Related
Backups Through FTP Or SSH
How many would you guys recommend me? Currently I make backups on my own server and one at offsite. And what's the diffrence making backups trough ssh ot ftp? Because right now I work with ftp because I don't understand ssh.
View Replies!
View Related
MySQL Nightly Backups
I am starting a software as a service company and have a dedicated MySQL server running on Linux. It has RAID mirroring but I need to take nightly backups as well and store them either remotely or on a locally connected drive. There will be 100, and hopefully eventually 1000’s of databases. I am thinking of using the built in MySQL tools backup script in the GUI tools, which seems to work well. But I have also read about rsync and other disk mirroring backups. What do you guys recommend? Also, do you guys think a simple external USB connected drive 500GB to the MySQl server is good idea, or is it worth the money to look at TAPE or remote backup on a geographically different location? What exactly is the benefit of TAPE anyway? Seems to me like TAPE is so freaking old, and expensive, I don’t understand why anybody would use it over a simple USB external drive.
View Replies!
View Related
FTP Backups And NAS
I have a VPS and an NAS in same data center that are connected via a private network within the datacenter. I can access the datacenter's private network and both servers via VPN. I can access VPS via SSH. How do I FTP the data on the VPS to the NAS without downloading to my desktop and re-uploading?
View Replies!
View Related
Atomated Backups Of Files And Db
free system or script for automatically generating file and database backups on my server and emailing me a notification when the yare ready. I want it to be able to schedule itself so that it can take care of all my backups.
View Replies!
View Related
Backups Are Killng My Server
Opt 248 3gb ram 250gb sata II My server runs great 95% of the time. Loads average under 1. However backups have become a server killer. I use cpanel scheduled backup at early morning hours. The reason backups kill my server is that I have 300,000+ (and counting) images in a directory. They are all small pngs generated by LaTeX. It takes my server several hours to backup the images. I usually even have to stop apache to free up some power. This problem is only going to get worse as I get more images. Maybe I could upgrade proc or upgrade to faster HD? That would be costly, hopefully not. Should I hire a professional backup service? Costly, and would that help? Or is there a way of storing the images or doing the cpbackup I am doing wrong?
View Replies!
View Related
How To Do Redundent Backups With Different Hosts
This is something I've been thinking about a lot lately, and I'd like to hear what others have to say. I'd like to keep one copy of each website on a different server - far away from each other, maybe different hosting providers, and be able to use managed DNS to switch between the two in case of an outage. The sites could easily be backed up daily to the other host, but for databases that get updated frequently (like forums), what is the solution to this?
View Replies!
View Related
Backups Killing My Server
Opt 248 3gb ram 250gb sata II I have a fairly unique problem. My server runs great 95% of the time. Loads average under 1. However backups have become a server killer. I use cpanel scheduled backup at early morning hours. The reason backups kill my server is that I have 300,000+ (and counting) images in a directory. They are all small pngs generated by LaTeX. It takes my server several hours to backup the images. I usually even have to stop apache to free up some power. This problem is only going to get worse as I get more images. Maybe I could upgrade proc or upgrade to faster HD? That would be costly, hopefully not. Should I hire a professional backup service? Costly, and would that help? Or is there a way of storing the images or doing the cpbackup I am doing wrong?
View Replies!
View Related
RAID-1 Vs. Daily Backups
I just had a quick question about backup solutions. What advantage would I have by setting up 2 HD's in a RAID-1 array as opposed to just doing daily automated backups on one of the drives. The way I see it, if I have automated backups, HD use for that backup drive is limited to say 20 minutes a day. In a RAID-1 array however, both drives are used at the same rate. Wouldn't this provide better life expectancy for the backup drive, granted it is at the expense of having a guaranteed instant replacement for that original drive? Reason I'm asking is because I'm setting up a Mac Mini for a friend as a web server and he would like to have data backups. The only way to add space is to intall an external hard drive so my options are a bit limited.
View Replies!
View Related
RSync
I made some data backup on one of the backup servers using rsync. How can I restore it to the new server now? My account is ready on new vps and all I need is pull the data back from backup server to new vps account. I used this command previously Quote: rsync -avz -e ssh /home/user1 backupuser@backup.server.com:user1
View Replies!
View Related
Anything Better Then Rsync
Is there anything better then rsync to replicate files (twice a day) on servers located in seperate datacenters? Looking for more of a free to cheap solution though will also be interested in the higher end solutions later on.
View Replies!
View Related
I Need One Like Hostgator But With Reliable Auto-backups
I'm a happy hostgator user. I just don't like their lack of a good backup system. They just say they're doing weekly backups that you can ask for a fee. I'd like an hosting exactly like hostgator (well, similar) but with daily and weekly auto-backups on a secure storage (like read-only tapes etc.). Do you know some? I've heard about a backups system by R1soft and that some hosting companies use it, but those that I'm finding on Google I've never heard of them. One is HawkHost that seems good but I'm not sure about their choice of using LiteSpeed webserver instead of Apache.. They say it's a faster web server.. but of course the server won't run faster, they would just fill in more clients on every server..
View Replies!
View Related
MediaTemple Down For 2 Days And They Have No Backups Or Ideas
This is so unimaginably frustrating. I have a website, fightgame.com, with MediaTemple for about 7 months? I don't know how long it's been, but WAY TOO LONG! If they aren't just flat out down, they are constantly having problems. I don't know why I've stayed with them this long, but I guess I've learned my lesson. For several weeks my stock vbulletin site has sporadically been down due to database access errors. MediaTemple staff is pretty clueless and just couldn't figure it out. After telling them I had no choice but to leave, they agreed to put me on their MySQL container service for free to see if that solves the problems. They didn't tell me when they were going to move my MySQL database, they just did. That's fine, but shortly afterwards all my tables disappeared. Frantically, I opened tickets, called, etc. It's been 2 days and NOBODY is responding to me whatsoever!!! I would think MediaTemple is out of business or something, what the heck is going on?? No information about what's going on, no plans, no hints as to when they might look into this, absolutely nothing. Well I shouldn't say absolutely nothing. Yesterday I got a response to 1 of my tickets saying they know there's a problem and have escalated the issue for someone to review... Unfortunately yesterday was a huge day for my site because of the Antonio Margarito vs Shane Mosley megafight. This is when I get all the traffic and new users. But I was down all day long . REALLY unfortunately, my latest backup is somewhat old . I don't have all my recent posts and users... And I have a bad feeling that MediaTemple doesn't take backups of their servers. So what do I do? I've been involved in the hosting industry in one way or another for many years being a technologist and have never seen such extremely poor service. I don't understand, doesn't MediaTemple host some big sites like TechCrunch?? I guess they don't care at all about their smaller customers. Should I have my lawyer send them a letter or begin a lawsuit to get my data? I would normally assume a hosting company has backups, but MediaTemple is no ordinary hosting company.. If they do have backups, I so desperately want them. FightGame has grown very well and was very exciting for me, without those backups I don't know what's going to happen. After not hearing from them (aside from escalating the issue for review) for 2 days, I've threatened posting my support tickets on WHT and now have threatened a letter from my lawyer. Do you guys want to see how ridiculous my support tickets are?
View Replies!
View Related
Automated Backups And Disaster Recovery
I'm used to operating dedicated servers. This year I want to venture into getting a reseller account and / or media temple account. With my dedicated servers, I do automated mysql dumps and I do nightly rsyncs of all my /home /etc and other important data so disaster recovery is possible. My question is, how do you do the same thing? Sleep well at night? with these regular web hosting accounts? I see most newbie people who pay for web hosting do not bother to backup their data. Ignorance is bliss until disaster strikes. How do you automatically backup your data (mysql and directories) in your multiple web hosting accounts like reseller or grid service media temple?
View Replies!
View Related
Windows Software For Full Backups
I have 2 Windows VPS (the provider name does not matter) and as you may know most VPS providers recommed to backup on your side, because they don't take responsabilities on your data and their backup systems. So my question is what backup software/procedure, would you recommend? My VPS include IIS files and MySQL/SQL server database software/data, and I am not using any control panel.
View Replies!
View Related
Host That Lets Me Do My Own MSSQL Backups
I'm currently with HostNexus and I've been told by their tech support that I need to submit a ticket every time I want one of my databases backed up. This is not going to work anymore and I need to find a new host that will allow me to create and FTP the backups to my home server. My requirements: At least 1GB disk space Bandwidth won't matter as much right now Allow me to have at least 15-20 domains on my account, I run a few different sites Allow me to create a decent number of MSSQL databases (more than 5) No MSSQL size quote (just let it subtract from the overall disk space) A few MySQL databases Both ASP.NET 2.0 and PHP 5 I need to be able to run that MSSQL backup via a Scheduled Task or something I pay $20 but could go up to $30 if it has all the features + more space. DiscountASP.net seemed to have it all but I could only host one site per account and that just won't work. I did LOVE the thought of having a web service I could use to back up the DBs,
View Replies!
View Related
Corrupted MySQL Backups CPanel
Just a warning to all other hosts out there using cPanel it currently generates corrupted mysql backups due to a bug in their pkgacct script which has been like this for over 6 days now. [url] So for anyone out there it's an easy fix. Of course not every host is doing it so the fun of helping a customer migrate data and explain to them that their hosts backups being made are all corrupted is lots of fun. Sort of sad but I've been told this isn't a critical enough issue to even push it out to all versions. Right now it makes a great lock in so customers cannot switch providers without a lot more work.
View Replies!
View Related
Make Backups Of HyperVM Databases
I have one server with 500GB disks. The server is running HyperVM. My secundary backup disk is mounted /backup. In the main node I installed ProFTPd and I'm already making backups of cPanel coming trough a VPS hosted on that server. And I would like that all backups made by users or Automated Backups made by HyperVM would go to /backup, so I done this: 1) I would like to make backups of HyperVM databases. I done this: [url] Is this correct? 2) I went to Home/Central BackupServers and added: [url] Is this correct? 3) Then I went to Servers/localhost/Central Backup Config and selected 127.0.0.1 from the list. [url] Is this correct? Is only this I need to do to make my backups? Is there anything left? If disk one fails will I be able to restore the server after reinstalling HyperVM?
View Replies!
View Related
A Free Solution To VPS Backups
I have completed a complex set of scripts which backup your entire system with small managable backups. One script is for the homedir of the accounts that you choose to backup and another is for backuping up every single mysql database (mysqlhotcopy) on your server. The best thing is that hosting the backups is free because i have managed to have all the encrypted+compressed backup files uploaded on a free rapidshare collectors account. If for some reason something does go wrong, you can buy a temporary premium account. Backups stay on the rapidshare server for 90 days. On my machine, I have set the cron to daily. Now I have made many scripts before but this is the first one I want to commercialize. Does anyone want to buy a licence to use it? I'm now in the process of building a web UI and a solution to rapid restore of an account through it.
View Replies!
View Related
Will RAM Lower Load During Backups
On a Cpanel server, lightly loaded, but some fairly large sites (~3GB stored) loads get pretty high during CP backups (D/W/M to secondary drive, compression on). It looks like RAM is showing mostly used during this time (977,555 out of 1,026,348), and iowait is ~50, sometimes quite a bit higher at ~80 on the larger accounts. Not pegged at that amount, but fairly steady. This box only has 1GB RAM, so I'm thinking adding another Gig would alleviate this issue. OS: CentOS 4.x Hardware: Intel P4 3.6HT/1024MB/2x160GB
View Replies!
View Related
Cpanel Or Rsync?
I am using BQbackup to auto backup my CPanel VPS and was wondering whether it is best to use CPanel's own backup service which automatically backs-up the vps daily or should I use the rsync script that bqbackup provides? Which is easier to restore and more reliable?
View Replies!
View Related
RSYNC Tutorials?
Looking for an RSYNC tutorial, something that focuses on backing http data, exporting the databases then transferring offsite to a receiving rsync server once a week. Something that's understandable and logical would be great, happy to work through over the next week and continue more in depth with it.
View Replies!
View Related
Rsync Instructions
I have been trying to setup rsync on my server and following these instructions http://www.bqbackup.com/setup.html The problem is I keep getting errors. On this step, ssh-keygen -t rsa -N I edited it and did ssh-keygen -t rsa --N becauseI got an error saying it need the '--' before the N. So after getting through that part, I got these questions asked Enter passphrase (empty for no passphrase): Enter same passphrase again: Your identification has been saved in /root/.ssh/id_rsa. Your public key has been saved in /root/.ssh/id_rsa.pub. The key fingerprint is: I left the passphrase empty, and then when it asked where to save to, I just typed in 'rsa'. Then it gave me some fingerprint. Then I get to the step, # scp ~/.ssh/id_rsa.pub yourusername@yourusername.bqbackup.com:keys/server1 # ssh yourusername@yourusername.bqbackup.com mergekeys But I get errors saying -bash: cat~/.ssh/id_rsa.pub: No such file or directory I dont get what I'm doing wrong. If somebody doesnt mind, can you please re-write the steps on getting this working, or maybe tell me where I am going wrong if the tutorial is correct?
View Replies!
View Related
Update Rsync
Current, 2.6.3 came with my centos 4.4 cpanel server, I tried updating it to latest 2.6.9. However, when I type "rsync" it's pointing to 2.6.3 How can I remove the old version or reinstall over it?
View Replies!
View Related
|
TRACKER
