Transfer Large Data Files

Jun 15, 2008

I have a debian box, and have archived a gallery in to a .tar file, 5.77gb.

I have a centOS box, and have used wget to bring the data file over to the new server.

However upon doing so it only detects it as 1.8gb when it starts downloading.

I have terminal access to both servers, just trying to bring my files over from one server to another.

View 4 Replies


ADVERTISEMENT

Transfer Large Many Files From Server To Server

Oct 23, 2009

In reference to my previous post, i want to tranfer accross 7GB of data, approximatly 80,000 files i believe it is (due to a gallery script).

It's currently on another host (on a webhosting account) which uses their own control panel which has no options but to manage databases, the only way i can see to do this is via FTP but it'll take me days. I've tried using compressing and backup scripts, but the damn execution time on the hosts server is too low to allow the files to be zipped. Are there any ways? Can i login to my VPS via SSH and anyhow pull off the files from the other hosts server?

View 6 Replies View Related

How To Transfer A Large File

Mar 28, 2008

I have a situation here.

I wanted to transfer a file (about 10GB) from one server to another server. Both server are on the same LAN.

Inside server1, I zipped a folder as file.tar.gz

From server2, I uses wget http://server1.com/file.tar.gz and it says "404 Not Found"

I suspect it won't allow me to download because the file is too big.

View 7 Replies View Related

To Transfer A Large DB To Another Server

Jan 31, 2007

to transfer a MySQL database with way over 1 million rows to a different server.

What is the best way to do this without losing any data? I've tried using the export feature in phpMyAdmin but it doesn't seem to handle it very well.

There has to be a feature in WHM or cPanel,

View 2 Replies View Related

Transfer Large Sites To New Host

Mar 5, 2007

Compared to others my sites may not be that big but I have one site that is 5 gigs and another that is about 9 gigs. I was wonder what is the best or most recommend way to transfer these sites to a new host.

I tried downloading the whole site using FireFtp but always seem to get about 3rd of the way done and something messes up the conection. Are there any better tools or methods to do this.

I also have pretty large Dbs that I'll need to transfer as well.

View 11 Replies View Related

Share A Good Transnational Software For Large File Transfer

Jun 10, 2008

Knowing Qoodaa was quite by chance.

A few days ago, my friends studying in America recommended me a new popular transfer tool—Qoodaa. And he told me that it was a quite good software to download files and movies. At first,I was skeptical, but after using it, I found it’s a good choice to choose Qoodaa. And I have summarized the some features of Qoodaa:

1.Its speed is faster than any other softwares I used before to upload movies.

2.It can download files quickly through downloading links, in a word, it is time-saver and with high efficiency.

3.No limit of space.No matter where you are, it can download fast.

4. Qoodaa is a green software with high security and easy use.

It really can give you unexpected surprise.

I am a person who would like to share with others, and if you have sth good pls share with me

View 0 Replies View Related

Mod_Security Log Files Too Large

Nov 7, 2008

Linux Fedora 6, Apache 2 with Mod Security, MySQL.

Our mod_sec logs get incredibly large very quickly. In the configuration for mod_security, we have specified logging options as
SecAuditEngine RelevantOnly
SecAuditLogRelevantStatus "^[45]"

but the mod_sec.log gets to almost 10 GB (in a matter of 5-6 days) before it is truncated to mod_sec.log.1 and a new one is created.

Is there a way we can specify that a max size of one log file is 1 GB, for example?
Or another question, how come it gets so huge so quickly? We thought that logging "RelevantOnly" will only display errors / requests that are deemed security risks.

View 2 Replies View Related

Hosting Large Flv Files

Oct 6, 2008

I have a customer who wants to sell access to videos of conferences he runs.

Each flv vid is approx 1 - 1 1/2 hors long approx 380MB each and there will be about 12 videos per conference.

approx 4 - 8 conferences per year.

My customer suggests 10 - 20 people will buy access to watch each video.

Access to watch the videos will be through a password protected webpage.

issue - the current site hosting company only allow uploads up to 150MB per file.

Can I host the flash videos elsewhere and deliver them through the password protected web page without anyone else being able to see them via server they are hosted on?

This would also reduce the bandwidth going through his current site server.

View 14 Replies View Related

Locate Large Files

Jul 7, 2008

I am trying to locate what large file are filling up the / on the server but I am having trouble using the find command to do this.

View 1 Replies View Related

How To Find The Data Transfer Data In The Server

Feb 20, 2007

How can I find the data transfer rate on the server. I have done ifconfig -a , it
display the amout of data has been received and transfered. I want to see the live data transfer date. Can I able to check it?

View 6 Replies View Related

Speed Up Serving Large Files

Nov 9, 2009

I'm working on a web site which will basically be a flash games portal. I have a dedicated server running Apache 2 on a 100mbit dedicated line but my download speed for large files (flash files of over 5mbs) is really slow. I am thinking this is because of Apache but I don't know much about this. I've read that I should change for a lighter http server for serving static files. The way my server is set up is I have 2 virtual machines running, one doing the PHP processing and the other serving static files, both running Apache, so if I have to change HTTP server for the static files it would be very easy. Although I am not sure if this is necessary or if I can tune Apache to push files faster than this.

View 8 Replies View Related

FTP :: Stop Uploading Large Files

Jul 17, 2008

I'm facing a very strange FTP issue with one of my shared-hosting accounts, while all of my other servers are having no problems but only this one, when I try to upload a file (whatever file) larger than 500kb from my local PCs, in most cases, the file would stop uploading during the process and hang there until it times out.

There are 2 interesting things though:
The file transmission typically hangs when approximately 248kb of the file have been transferred, pls see the attached screenshot for example.

If you look at the attached screenshot, you will notice that the uploading transmission hangs when 248kb of the file have been transferred. This is very strange and what I mean is that for example, I randomly pick up a file, and attempt to upload it onto my host for 10 times, now see, 5 times it will hang when 248kb of the total size have been transferred, 3 times it will hang at other points *near* 248kb (224kb or 280kb typically), 1 time it will hang at another random point, and 1 time it might be uploaded successfully (yes, there is still a tiny chance for the file to be uploaded successfully).

My default internet uploading speed is 80kb/s-100kb/s, lately I found that, when I limit the uploading speed on my FTP client (e.g. max. 30kb/s), everything WILL WORK without any problem! No hangs, no interrupt.. Whereas when I free up the uploading speed limitation and let it upload with my regular speed, the problem appears again.

It seems to me that the FTP hangs only when the uploading speed is higher than 60kb/s. However my host provider told me that they have customers uploading without any problem at over 400kb/s, and they said "there's no problem or limitations on the server at all".

Up until now, I have done following things to troubleshoot the issue but with no luck:

Contacted my host.
Disabled/Enabled the PASV mode on my FTP client.
Tried different FTP clients on different computers (FlashFXP and Filezilla).
Rebooted my router and reseted everything with the factory default settings.
Contacted my ISP for the issue, they "did something" but nothing were helpful.
Rebooted all my PCs.
Disabled both firewalls on my PC and on the router.

Furthermore, I have asked another friend of mine in another city with another ISP to test the FTP uploading, but unfortunately he got the exact same problem. And I've done some search on the internet for hours but no one seemed to have the same problem..

View 12 Replies View Related

VPS :: Large Files And Taking Too Much Space?

Nov 22, 2008

I just logged into my VPS and was astonished by how much space I have in use.
8.09GB... but I can't figure out what's using up so much space!?

How can I find out were large files are located ? Since it's increasing daily

I use LXAdmin with HyperVM Control Panel

View 10 Replies View Related

Multiple Large Core Files

May 20, 2007

Just noticed quite a few large Core. files within one of our websites (within a sub folder of public_html). Anyone knwo what these are and how they got there?

View 3 Replies View Related

Large Media Files & Backups

Jul 16, 2008

I've been using Lypha for the past 4 years, but they've taken the last straw (gigabytes of backups went missing and they wont reply to emails as to why).

Looking for a web hosting package for under $10/month that has large enough disk-space/bandwidth to allow me to backup large audio / video files to it, as well as the normal site operation (I use it for portfolio website, as well as hosting additional domains)

View 17 Replies View Related

Large Video Files Need To Be Streamed

Mar 30, 2007

I am developing a web application for a private investigative firm. They do surveillance work and therefore have surveillance videos. I would like the capabilities of uploading the videos online and allowing the client to login and view their surveillance video online.

Currently, we get the video from the PI, put it on a DVD and then mail it to the client.

This takes too long. We want the client to be able to view the video online.

Some of these videos can be up to 2 hours long.

First, is this even possible?

Second,
- how much bandwidth would a website like this take?
- Is there a host that can hold hundreds of GB of video?

I want to convert it to flash to save file size and also so I can stream it.

View 3 Replies View Related

How To Move Large Files To New Host

Mar 21, 2007

I have some 100's of MB's to move and I'm definitely not doing it by transferring it via my PC / FTP.

I seen all the tutorials on how to move your MySQL databases, but what about full folders etc, how do I move those (putty?)?

View 1 Replies View Related

Optimizing Lighttpd For Large Files (180mb Avg)

May 9, 2008

I have four servers with a quad xeon, 4gb ram, and 2x300GB SAS 15K RAID0 harddrives, pushing a total of 1.6gbits. It serves a lot of zip files with an average flesize of 180mb. My question is, how can I optimize lighttpd 1.4.19 to push its max with very low IO-wait. I've looked up some stuff and only found options that deal with lighttpd 1.5 and use Linux-AIO for the backend network. Currently I use writev with 16 workers and an read/write idle timeout of 10s. Logging is off, too.

View 14 Replies View Related

Removing Large Files Or Folders CentOS

Jul 13, 2008

Something weird happening here. I have tried every string possible...

There are a number of folders I want to remove off my server, tried the good old and simple...

rm -r /folder/

And then went and ended up with a string as long as my screen. No matter what I do, as it goes recursive in to the directory it asks me if I want to remove each file individually. No matter what string or action I take it insists on asking me as it goes to delete each file.

Could this be a configuration option in CentOS?

View 3 Replies View Related

Daily Backup + Rsync Ssh + Large Number Of Files

Oct 29, 2006

i just wana know is it safe to do remote daily backup for about 70,000 files?

file sizes is about 200kb and every day i have about 1000 new file, so rsync first should check old files becouse i am deleting about 30-50 of them daily and them backup new 1000 files ,
so how much it will take every time to compare that 70,000 files?

i have 2 option now:

1-using second hdd and raid 1
2-using rsync and backuping to my second server , so i can save about $70 each month.

View 9 Replies View Related

Writing Large Files - Risk Of Damaging Filesystem

Jan 19, 2008

Does writing large files (ie, 10GB backups in one archive) cause any risk of damaging a linux filesystem?

View 1 Replies View Related

How Do You Host Large Video Files And Support The Bandwidth

Feb 8, 2007

I've got a client who wants to host audio files... Here are the sizes:

50 x 75MBs
300 x 10MBs
400 x 5MBs

That totals 8750MBs or 8.75GBs... If he gets hundreds of visitors, it could end up being 1000's of GBBs or bandwidth.

I don't know what to look for to support so much bandwidth... Do you buy bandwidth? Are their special companies out their that host it for you?

View 6 Replies View Related

Large Data Storage And Bandwidth

Jun 5, 2009

Our congregation needs webspace to archive mp3 and mp4 files of the weekly messages. Low mp3 is about 3 MB size. High mp3 is about 20 MB size. mp4 video is about 325 MB size. We would provide links to the files so they could be downloaded - no online streaming is needed. Also no normal website stuff - just file storage space and ability to download by anyone who has the URL links to the files.

1and1.com has 250 GB storage with 2.5 TB/mo bandwidth usage for $10/mo. Their phone rep said this type of use of their web space is OK. I wouldn't even look any further except I've read a lot of bad reviews about them.

View 10 Replies View Related

Moving Large Amounts Of Data From One Datacenter To Another

Jul 22, 2008

Scenario: Our website has 3 terabytes of data (photos, database files, etc).

1. How does one move all of this data from one hosting company to another?

2. How does this typically work? Does it involve buying the actual disks?

3. Does this need to be specified in a contract that's signed with the hosting company?

Copying it over the Internet (ftp, sftp, or http) is not an option.

View 14 Replies View Related

Transfer Files At 40 Kb / S

Jul 8, 2008

I know which is the transfer speed of my hosting? I have hired a plan with bluehost and I can only transfer files at 40 kb/s

View 14 Replies View Related

Files Transfer

Jul 23, 2007

i have a backup file about 2 giga in my linux server and i want to move it to windows server what is the best and quick way?

View 3 Replies View Related







Copyrights 2005-15 www.BigResource.com, All rights reserved