Rsync Backup Related
Apr 16, 2007
Currently I am using rsync to backup directory and mysqldump sql file on both external and internal backup drive
Now the directory has around 100,000 files that hardly change. Only thing that happens in that directory is either the old files are deleted or new files are added. All of them image
Due to some reason when i rsync using any of the two commands below, it transfer each and every file again rather then transferring the new or updated files.
Here is what i am currently using
rsync -avH /old/path /destination/path (this is for internal backup drive)
or
rsync -avz -e ssh /old/path username@username.remoteaddress:/destination/path
why all my files in the directory all uploaded again
View 4 Replies
ADVERTISEMENT
Apr 7, 2008
I just signed up with Rsync Palace for remote backups 2 days ago. Otto and Darin at Rsync Palace gladly helped me out and actually ended up setting me up for free. It's really an inexpensive price to pay for a little additional piece of mind to have a remote backup.
I have a VPS with cPanel that has NAS on a private network. The way they set it up was for Cpanel cron job to create backups of my VPS and place the backups in a /backup folder off root; Daily, Weekly and Monthly.
Then they have Rsync via cron set up to take those backups to the remote Rsync Palace server daily.
I still want to maintain backups on my NAS in the datacenter. (cPanel will only backup remotely or locally, but not both.)
In addition to Rsync securely transferring my data to Rsync Palace for offsite backups... How can I set up Rsync to ftp the same /backup data across the private network to the NAS? (Only ftp is available via the NAS.)
View 2 Replies
View Related
Jul 28, 2008
I use bqbackup.com in addition to ServInt's backup. The ServInt backup is inaccessible to me and can be restored only by their NoC.
Is there a way for me to download the backup files from bqbackup.com to my PC? I am using Win XP Pro. I backup the entire VPS, but I want to be downloading only the changes made each day after the initial download to my PC.
View 2 Replies
View Related
Nov 10, 2007
I am setting up a mirror server to kick on in the event my main server fails and I need some help with syncing the two.
It is my understanding I can use rsync to mirror the two. But, will that cover everything (ie. database, mail, etc) or only files?
View 5 Replies
View Related
Apr 13, 2007
I am using rsync to database and i found out it corrupted my database. I should have used mysql dump before backing up the data..The problem with taking mysql dump each is that it takes a long time and resources as database is around 10 GB
if i want to take backups every 4 hour, whats the best way as mysql dump causes server load problem
View 14 Replies
View Related
May 3, 2008
Backing up a server is obviously very important. Lets say I do a daily rSync backup and eventually my server HDD crashes, I know it isn't just a 'one click' job to restore my backup but what is it necessary to do in order to carry out a complete and effective restore back to how it was?
A step-by-step 'tutorial' on restoring an rSync backup would be helpful not just to me but to many 'would-be' server administrators.
View 4 Replies
View Related
Apr 23, 2009
Does anyone have a good link that explains the basics of setting up rsync for going from one host to another host?
View 5 Replies
View Related
Jun 3, 2008
I have a VPS with remote backup that I dod every night with rsync.
Now, for further SEO testing, Im looking into a reseller account.
Some reseller plan do offer access via SSH. Im not familiar with this ssh access for a reseller. Would I still be able to program a cpanel backup and then rsync all my cpanel backup ?
View 5 Replies
View Related
Nov 3, 2008
I am using bqinternet.com to backup (Rsync) some accounts.
I sent them a ticket before 2 days and didn't get any reply.
I used this command to schedule a remote backup for specific accounts:
Code:
echo "30 6 * * * root rsync -avz -e ssh ~account1 ~account2 ~account3 myuser@myuser.bqbackup.comerver" >> /etc/crontab
But, I found this command will backup only files.
How can I backup also databases?
View 11 Replies
View Related
Mar 12, 2007
The backup program (cpbackup) that comes with WHM/Cpanel is not ideal for our current situation. We have lots of third party applications installed on our server along with many customized configuration files. We need a solution that will backup everything and allow for fairly simple restoration.
How viable is rsync for full server backups? Can it handle 100 GB of data?
More importantly, how would you restore the backup to a new server? If the new server already has an OS the restored files would break the system, right?
View 2 Replies
View Related
Mar 27, 2009
We want to backup the contents of our public_html dir to another server we sue for backups. What is the proper rsnyc command to use. I am currently in the source server and want to send it to a specific user account on the destination server.
View 2 Replies
View Related
Apr 16, 2008
I'm looking for a new rsync backup solution. I've googled around and have seen a few but wanted to get the opinion of the community.
Any recommendations? All I know about is bqbackup.com and rsync.net. Any other ones?
View 14 Replies
View Related
Jan 18, 2009
I have a problem with my rsync backup
First of all my setup is thus:
I have a Linux box at the office which has an rsync cron on it which pulls from my web server as a backup. It pulls websites, mysql, conf files etc.
My web server is running debian etch LAMP etc.
When I originally set it up I used root user to log into the web server, and setup keys to authenticate, this worked perfectly.
I then decided that having direct root access to the web server was a bad thing so I have turned off root login (PermitRootLogin no in sshd_config)
I then setup a backup user which works fine for the website files but fails on permissions for the mysql data files (/var/lib/mysql)
How can I get over this without granting root access to the backup user which would defeat the object of not allowing root access.
I have been told about host authentication based on ip address but I have dynamic address at the office so that would be no good
View 2 Replies
View Related
Oct 31, 2008
Want to start my own RSYNC/FTP backup service... whats needed?
Besides the physical server and lots of GB's what software packages are needed, any tips on how to tie them together?
Do you create linux users, and then assign those users to an FTP account to a home folder?
View 10 Replies
View Related
Nov 5, 2008
What is the best way to get backup from linux server to windows same as rsync
i need to take offside backup from my linux server to windows server,before i used rsync to take backup,now i need to make backup in windows server with help of any software which work same as rsync or any software which must have good feature.
View 2 Replies
View Related
May 1, 2008
I have two vps's. VPS1 is for hosting my sites, VPS to I purchashed to backup to.
I know I can use rsync but i'm confused at how to do this exactly.
Backup to remote server every other day.
Only do incremental backups.
Backup cpanel accounts
View 1 Replies
View Related
Nov 10, 2008
I am going to backup the whole server. (Rsync)
I understood it is not efficient to backup the local "backup" folder to avoid duplicated backups.
1. Should I exclude additional folders from the backup process?
2. I noticed it is familiar to exclude the "proc" folder also ... Why?
View 5 Replies
View Related
Oct 29, 2006
i just wana know is it safe to do remote daily backup for about 70,000 files?
file sizes is about 200kb and every day i have about 1000 new file, so rsync first should check old files becouse i am deleting about 30-50 of them daily and them backup new 1000 files ,
so how much it will take every time to compare that 70,000 files?
i have 2 option now:
1-using second hdd and raid 1
2-using rsync and backuping to my second server , so i can save about $70 each month.
View 9 Replies
View Related
Jun 3, 2009
I'm currently using (amongst other backup systems) rsync to an offsite space (am using BQBackup at the moment)
I'm just wondering - apart from backing up all of /home/, /var/lib/mysql/ and the important config files (httpd.conf, php.conf, etc etc) is there anything else that *needs* to be backed up?
Obviously in a worst case scenario, a new machine would be deployed with a fresh OS install (and a fresh WHM/cPanel install) so I wouldn't worry about backing up OS files or cPanel core files, although I'm wondering if there's anything apart from the /home/ directory and the MySQL databases which would be lost (and so need backing up) in the event of a crash?
View 10 Replies
View Related
Jun 28, 2009
Can a domain have two set of users.... let me explain the situation.
mydomain.com has a set of users which have admins etc etc.
can i have sub.mydomain.com with the same set of users, with different admin and restricted access to certain level.
View 5 Replies
View Related
Sep 25, 2008
1- What means that the site has an IP?, what will differ if the site has an IP?
2- What is the importance of IPs for every site?, I mean now I'm running a shared hosting, Should each site has it's dedicated IP? and is it dangerous to make all clients has same IP?
3- I got 5 IPs with my server, how can I assign a DEDICATED IP for my main site, and then assign the 2nd 2 IPs for my main site Name servers & Finally assign the rest IPs for Resellers?
4- In the domaintools whois Service, Under Server Data category, sometimes I found :
Dedicated Hosting: domain.com is hosted on a dedicated server.
what this means, and how can I make my domain looks like this , cause it's already hosted on a dedicated server.
5- When I asked my Server Co. about extra IPs, they told me:
" for smaller allocations its $1 per ip, we also require full ARIN IP justification." so, what's ARIN IP justification?
View 4 Replies
View Related
Jun 8, 2009
I'm interested in making a site which would stream video game (RPG) audio to users through flash. I have long searched for a service that I could use to listen to that odd track from final fantasy 8 for example (and not some cheap midi) without going through hundreds of links etc. So I'm thinking of making one myself.
I know there are sites that host mass video game mp3s (gh.ffshrine.org) and also remix and host video game music (ocremix.org) but I don't know if what they are doing is OK by normal hosting standards.
if it is, <snipped>.
View 8 Replies
View Related
Apr 23, 2008
I have a question regarding, hard drives and performance etc... I only use it for forums and currently is only one site (hopefully couple more in no time)
Currently I have 2x36gb SAS in raid 1 obviously containing everything including dbs and /home. and a third 250gb drive for backups only ^^ Ronny did an excelent job setting this up.
Any ways, my problem is that I wan't to allow some attachments on my forums, and this would take a significant ammount of space over 1gb no problem and then keep increasing (that's gonna sux for bandwidth). I know it will fit in the SAS drives no problems, dbs are rather small at the time (2.5gb in total) but logs are quite big 5-10gbs in total.
I thought it might be a good idea to purchase another drive. This 4th drive would be 750 and backups would move there , and use the 250 for the /home directory. This would give a lot of room for uploads, and backups accordingly and keep the fast ones for OS and dbs
I was told, however, and understandebly, that a lot of performance would be lost by moving /home to a SATA drive I know SATAS are no way as fast, but then vbulletin can't upload attach files to a folder outside its hirachy (without complicated modifications).
(Note: i didn't specify my resons for wanting such set up)
So I'm in a bit of a pickle. Having the bigger drive would allow me to have the attachments, and should eventually result on more traffic etc to my site. /home currently is only 150mbs big... but then performance is also an issue pitty i couldn't afford the bigger drices at the time [sees the point of renting over buydowns now]
is there a way that /var/log/httpd saves those massive logs on another drive? it would free up 5-10gbs
in shortIs moving /home to a SATA drive from Raid 1 SAS a bad idea? (considering space and purpose)
Could httpd logs or /var/log in general be moved to the backup/another drive?
View 7 Replies
View Related
Aug 19, 2007
I have a Cpanel box, in WHM I used the "PHP Configuration Editor" and changed the php execution time (minor change). After clicking save I now get the following error on any php using sessions:
Warning: session_start() [function.session-start]: open(/tmp /sess_1d374c43a0f726cd43776f9f92485bec, O_RDWR) failed: No such file or directory (2) in /home/continou/public_html/control/index.php on line 4
One thing I noticed it did was turn on PHPSuexec which generally causes problems for me. I turned that off and the error response changed slightly (to above) but the problem is not solved.
I tried rebooting the server. /tmp does exist, I am now rebuilding apache in hopes that corrects the problem.
View 3 Replies
View Related
Apr 11, 2009
I've got a vps running centos 5.3 on an openvz platform. I've been using a simple set of iptables rules but recently the host moved me to a new server and I'm having issues with my firewall. I'm pretty sure it's the firewall since if I stop iptables or flush the rules everything works properly.
my rules:
Code:
!/usr/bin/env iptables-restore
*filter
:FORWARD DROP [0:0]
:INPUT DROP [0:0]
:OUTPUT ACCEPT [0:0]
-A INPUT -m state --state RELATED,ESTABLISHED -j ACCEPT
-A INPUT -i lo -j ACCEPT
-A INPUT -p tcp --dport ssh -j ACCEPT
The last rule continues with all the other used protocols (pop3/dns/http/etc)
The problem is incoming connections with should be allowed from by the related,established rule aren't permitted. If I use wget,ftp,ping, or dig from my shell they all report a time out. For example dig w3.org gives no server reachable. If I capture all dns requestes with tcpdump I see the outgoing request to dns and I see the incoming data but dig still reports a timeout. Since tcpdump sits before iptables and I have no output filtering it seems that my input filter isn't seeing the related/established state of dig and allowing the results in.
But, what's the solution? Do I need to ask the vps provider for something specific? If so what?
Or is there a better way to write my iptables rules to compensate for this problem?
View 5 Replies
View Related
Jul 8, 2008
I have read about addon domains but I have still one doubt regarding same. Suppose I have buy two domains which have no any relationship with each other like one is of my family (viralshah3112andfamily.com) and one is for my uncle's business site (xyz.com) . Now if I host them in one account as addon domain, both will have different identity? Means both will have different URL like xyz.com and viralshah3112andfamily.com. Is it so?
View 8 Replies
View Related
Jan 13, 2007
I'm using .htaccess file and mod_auth_mysql for protection of a site, where the old users are in flat passwd file and the new ones are in DB, so i need both the standart .htpasswd check and if the user is not there check in the mysql DB
well here is how currently my htaccess file looks:
------------------------
AuthName "Password Protected Pages"
AuthType Basic
AuthUserFile /home/edited/.htpasswd
<limit GET POST PUT>
require valid-user
</limit>
AuthMySQLAuthoritative Off
AuthName "Members Only"
AuthType Basic
AuthGroupFile /dev/null
AuthMySQLHost domain-removed.com
AuthMySQLDB username-removed
AuthMySQLUser user-removed
AuthMySQLPassword edited
AuthMySQLUserTable members
AuthMySQLNameField username
AuthMySQLPasswordField password
AuthMySQLPwEncryption none
AuthMySQLUserCondition "status=1 AND siteid=2"
require valid-user
----------------
but the site doesn't accept neither the flat passwd file users, neither the ones from the nats DB, it just pop-ups the password dialog box again, whicih means that the password is not accepted
For the users i tested with i double checked that they DO exist in the htpasswd file or in the DB, so its not that
also, cause the site and the DB are on different servers, i have authorised the first one to query the mysql db at the second, so its not from that as well
i have removed the sensitive information (domains, users and passwords from the sample code i pasted here)
so...i'm totally lost here and any directions or ideas will be highly apprecicated
View 0 Replies
View Related
Jan 26, 2009
I am working on a survey about top hosting news website.
View 10 Replies
View Related
Feb 10, 2007
good server setup review sites, such as most optimal setups for mysql driven sites, best value setups and so on.
View 1 Replies
View Related