Daily Backup + Rsync Ssh + Large Number Of Files

Oct 29, 2006

i just wana know is it safe to do remote daily backup for about 70,000 files?

file sizes is about 200kb and every day i have about 1000 new file, so rsync first should check old files becouse i am deleting about 30-50 of them daily and them backup new 1000 files ,
so how much it will take every time to compare that 70,000 files?

i have 2 option now:

1-using second hdd and raid 1
2-using rsync and backuping to my second server , so i can save about $70 each month.

View 9 Replies


ADVERTISEMENT

Any Daily Moving Files Soloution (Rsync)

Mar 5, 2008

I have move all my vBulletin images to a separate server .. to decrease the load in the main server.. but i am still having a problem .. I have a 3 directors updated daily with new images they are

/home/mark/public_html/vb/customavatars
/home/mark/public_html/vb/customprofilepics
/home/mark/public_html/vb/signaturepics/

I am searching for a way to move only the new files uploaded to this there directory's to the other server in this way
/home/mark/public_html/vb/customavatars (new files) ===> /home/mark/public_html/images/customavatars

/home/mark/public_html/vb/customprofilepics (new files) ===> /home/mark/public_html/images/customprofilepics

/home/mark/public_html/vb/signaturepics/(new files) ===> /home/mark/public_html/images/signaturepics

I have tried to use Rsync in this way as i have a internal connection between my server but it's not work
rsync -a rsync://192.168.0.2/vb/customprofilepics/ /home/mark/public_html/images/customprofilepics
rsync -a rsync://192.168.0.2/vb/customavatars/ /home/mark/public_html/images/customavatars
rsync -a rsync://192.168.0.2/vb/signaturepics/ /home/mark/public_html/images/signaturepics

with daily corn ..

View 4 Replies View Related

Plesk 12.x / Linux :: 413 Request Entity Too Large - Can't Upload Backup Files With Backup Manager

Sep 17, 2014

I have a 6GB backup file created with another Plesk Backup Manager, now I trying to upload this backup file to my Plesk Backup Manager but after upload 3% I am getting "413 Request Entity Too Large" error, I tried with disable NGINX but still getting this error.

how can I resolve this error or is their any other way to upload my file on backup manager?

I see that Backup Manager have a file size restriction of 2GB how can I increase this?

View 2 Replies View Related

Plesk 12.x / Linux :: Cannot Limit Number Of Backup Files

Oct 30, 2014

I'm running Plesk v12.0.18 #22 on Ubuntu 12.04.

In the plesk backup-settings I've set the max. number of backup-files to 5.

Actually Plesk doesn't limit the number of backups stored in the local repository.

So unfortunately the partition is running out of space.

What can be done to solve that problem?

View 1 Replies View Related

Offsite Backups (via Rsync) - What Files/folders To Backup

Jun 3, 2009

I'm currently using (amongst other backup systems) rsync to an offsite space (am using BQBackup at the moment)

I'm just wondering - apart from backing up all of /home/, /var/lib/mysql/ and the important config files (httpd.conf, php.conf, etc etc) is there anything else that *needs* to be backed up?

Obviously in a worst case scenario, a new machine would be deployed with a fresh OS install (and a fresh WHM/cPanel install) so I wouldn't worry about backing up OS files or cPanel core files, although I'm wondering if there's anything apart from the /home/ directory and the MySQL databases which would be lost (and so need backing up) in the event of a crash?

View 10 Replies View Related

Ban A Large Number Of IPs

May 30, 2007

I'm currently using iptables to ban IP addresses from the servers, like:

Code:
iptables -A INPUT -s xxx.xxx.xxx.xxx -j DROP
I ran a "spam trap" for the last few months and now I have over 11000 IP addresses who were trying to spam on my website (guestbooks, phpBB and forms) and I want to ban them all (pretty sure bots run from them).

My question - is iptables the way to do it? I mean does banning such a large number of addresses have any significant performance or other issues I should be aware of (except of the fact I may be banning some legitimate traffic)? Is the -A INPUT the way to ban them all or is there a more appropriate way of baning such a number of addresses?

I'm on CentOS 4.5 i686, Apache/1.3.37, Pentium D 930, 2GB RAM.

View 11 Replies View Related

Server For Send Large Number Of Emails Per Day?

Jun 7, 2009

server for send large number of emails per day?

What would be the best solution for that?

VPS ? Dedicated ? and Do I need to have Cpanel too?

View 6 Replies View Related

Plesk: Large Number Of Spam Emails: DNSBL

Oct 23, 2009

running Plesk qmail server. My local mail queue is growing rapidly and very slow dlivery m gettings too many spam emails from outbound. I am using DNSBL server sbl.spamhaus.org maped but it is out of control. how to protect my box from SPAM.

View 3 Replies View Related

How Do You Detect And Block Ddos Or Large Number Of Connection

Nov 7, 2008

sometimes, some people may try to guess the password of ssh,whm,ftp,...etc,

or any ddos attack,

do you only use iptables to place this problem?

or do you install any other scripts to secure your server?

my serve is centso.

View 6 Replies View Related

Plesk 11.x / Windows :: Large Number Of Domains - Change Vhost Manually

Jul 9, 2014

I have somewhere at 2000 domains.

I need to change path to vhost from W:host to D:vhost

I copied all files from W to D drive and created symbollinks. Now all files stored in D:vhost and symbollincs pointing to W:vhost.

If I will use reconfigurator, will it recopy existing files or just will skip them? Because I have millions files in my vhost dir

Also i thought about change drive letter in windows OS. It wil be enough to just stop IIS service and plesk services for switching disk letter?

Can i just some how say plesk that he should search all vhost files in D:vhost? With out process of copying files,becouse thay already exist there are.

View 2 Replies View Related

Plesk 12.x / Linux :: Backup And Quota - Limit Number Of Cores Backup Zipping Tool Uses?

Aug 15, 2014

I have 2 problems:

Firstly I wonder if there is any possibility to limit the number of cores the plesk backup zipping tool uses? This pigz takes up all my CPU. Is there any way I can reduce the amount of cores it uses because all my websites are down every time a backup takes place for around 3 minutes.

Secondly I get the following in my syslog:

1 baby plesk sendmail[20189]: Error during 'check-quota' handler

I don't know what is wrong. I think it's since the upgrade to Plesk 12. I now have 12.0.18 Update #13.

View 9 Replies View Related

Backup Daily Contrab

Jun 2, 2007

i want to run /scripts/cpbackup every day begain with 12:00 AM and i put this line in /tmp/crontab.XXXXwuxGUI File

0 0 * * * /scripts/cpbackup

but the backup didn't work and do the job

View 8 Replies View Related

CPanel Daily Backup: Load

May 5, 2008

I have my WHM/cPanel installation configured with daily and weekly backups. I checked at what time of the day the server load was at the minimum and configured the cPanel backup cron to run then.

The problem now is: Backing up a few hundred accounts results in a high server load. My server configuration:

Dual Processor Quad Core Xeon 5335 2.0GHz with 4GB RAM and 2 x 250GB SATA HDD hosted at SoftLayer.

The accounts are located on the first HDD and the backup archives are placed on the second HDD.

What can I do about this? I'd like to take daily backups of all accounts but not if my server load increases up to 10... That kind of renders the cPanel backup feature useless if it doesn't even work on a powerful server like this one...

Would it help if I use an application such as Auto Nice Daemon to give the backup process a lower priority? But then again that won't work on the MySQL dumps? And I think it's not a CPU problem but an I/O wait problem? Other processes have to wait for disk access because the disk-intensive backup process is running?

View 9 Replies View Related

Daily Full Backup On Cpanel

Apr 6, 2007

I have seen resellerzoom provides daily full backup to their customer. How should i configure my WHM so that it create daily backup and delete old backup.

View 4 Replies View Related

Daily Backup From Linux To Windows

Apr 5, 2007

I want to know how can backup my linux server data's to windows server? due high number of files and daily updates i cant use FTP

View 3 Replies View Related

Very High Load When Daily Backup Started

Jul 9, 2008

to decrease the load in server when daily backup start ,, the load in server before backup start from 0.80 to 1.20 after daily backup started i see very high load from 16.00 to 32 and 40

any solve for decrease load when backup start from 3 to 7 alot

View 7 Replies View Related

Backup Type :: Daily, Nightly, Incremental?

May 13, 2008

What type of backup do you use with your host? (daily, nightly, incremental, etc)

View 10 Replies View Related

Rsync Doesn't Want To Transfer Files

May 16, 2008

i have a client machine which requires backing up, and the server. For some reason, rsync doesn't want to transfer files...

i've already set up keys, it logs in fine without asking for password.

server config:

max connections = 2
log file = /var/log/rsync.log
timeout = 300

[backup]
comment = Rsync backups
path = /secondary/client
read only = no
list = yes
uid = nobody
gid = nobody
auth users = root

client command:
rsync -vz --recursive --progress --stats -e "ssh -i /root/.ssh/rsynckey" root@server.com:/backup/ /home/usertobackup

it keeps saying cannot find the backup folder, even thouhg it does exist on the server and is what is specified in the path above?

View 7 Replies View Related

Is It Possible To Create A Cron To Backup Mysql Data Daily

May 15, 2009

Is there any way to create a cron to backup mysql data daily ( or weekly )? I mean an "auto script" to run this command daily

mysqldump -u usernam -p password dataname > file.sql

View 11 Replies View Related

Rsync Some Files From Windows To A Linux Server

Mar 28, 2007

At work, we have a windows 2003 server.

We have a set of files that get modified from day to day.

Since they know I own a dedicated server (Linux) they ask me if it would be possible to have an offsite backup on my server of the set of files on the windows 2003 server.

Also, I dont want to have the whole files set to be uploaded everyday.

I am aware of rsync on *nix system, but do you have any suggestions on how to proceed with a windows 2003 server to a unix server?

View 3 Replies View Related

Mod_Security Log Files Too Large

Nov 7, 2008

Linux Fedora 6, Apache 2 with Mod Security, MySQL.

Our mod_sec logs get incredibly large very quickly. In the configuration for mod_security, we have specified logging options as
SecAuditEngine RelevantOnly
SecAuditLogRelevantStatus "^[45]"

but the mod_sec.log gets to almost 10 GB (in a matter of 5-6 days) before it is truncated to mod_sec.log.1 and a new one is created.

Is there a way we can specify that a max size of one log file is 1 GB, for example?
Or another question, how come it gets so huge so quickly? We thought that logging "RelevantOnly" will only display errors / requests that are deemed security risks.

View 2 Replies View Related

Hosting Large Flv Files

Oct 6, 2008

I have a customer who wants to sell access to videos of conferences he runs.

Each flv vid is approx 1 - 1 1/2 hors long approx 380MB each and there will be about 12 videos per conference.

approx 4 - 8 conferences per year.

My customer suggests 10 - 20 people will buy access to watch each video.

Access to watch the videos will be through a password protected webpage.

issue - the current site hosting company only allow uploads up to 150MB per file.

Can I host the flash videos elsewhere and deliver them through the password protected web page without anyone else being able to see them via server they are hosted on?

This would also reduce the bandwidth going through his current site server.

View 14 Replies View Related

Locate Large Files

Jul 7, 2008

I am trying to locate what large file are filling up the / on the server but I am having trouble using the find command to do this.

View 1 Replies View Related

RSYNC / Windows 2003 & Vista / Open Files

Jun 28, 2007

Does anybody know how I can force RSYNC to backup open files on Windows 2003 Standard and Vista Ultimate?

View 4 Replies View Related







Copyrights 2005-15 www.BigResource.com, All rights reserved