to move a site to another server at another datacentre that have approx 100 GB of media files.
Typically for small sites i am able to use server to server ftp to move files.
However, when moving large site like this, ftp might be disconnected and lost track of which files are not transferred.
How can i transfer/move the files (server to server) and resume if disconnected?
I couldn't find a suitable category for this topic, please feel free to move if I made a mistake.
I have a big website.
MySQL Size: 1 GB
Diskspace: 2 GB
It's over loading the server, so I am moving it to a dedicated server.
In the past, basically I would pause the live website (e.g. turn off forum). Move the data, turn everything back on in the new server and then change the nameservers.
But for this website, I don't want to pause the website nor I wish to loose any posts because of DNS propagation. (e.g. user might post data, which is stored in the current server. But then after propagation, the user won't see his post)
I have to move some large websites from one host to another. The websites contain data about 1 - 3 GB, and my internet connection here is not that fast, so that downloading and uploading would take many hours. Unfortunately I have no SSH-Access to both accounts (old and new one), so I have to make it by FTP.
So I tried to make a tar file and moved it from the old to the new host. I made a tar archive of the whole webfolder (I used php to execute the shell commmands) and moved it by ftp to the new host. But now I´ve got troubles when extracting the archive on the new host: the extracted files are obviously created by the wrong user, so I can´t delete or access them by ftp.
So I´m trying to find other solutions to fix these problems. Maybe someone else had the same problems and could give me advice how to move large sites? Or do you know php-applications that can directly connect one host accout to another via ftp?
Scenario: Our website has 3 terabytes of data (photos, database files, etc).
1. How does one move all of this data from one hosting company to another?
2. How does this typically work? Does it involve buying the actual disks?
3. Does this need to be specified in a contract that's signed with the hosting company?
Copying it over the Internet (ftp, sftp, or http) is not an option.
I'm moving a large, 4 gig site between 2 servers (both have cpanel... if that's an option). Is there a way to do it quickly and correctly? How would I transfer such a large site?
View 3 Replies View RelatedI'm currently running on a VPS. My site allows for large file uploads and downloads, with files over 600mb in size.
The server has issues when the site gets three or more requests for large file downloads. I'm trying to grow this site to thousands of users and it is hard to do when the site can't handle even three.
I've been told by my host that I need to upgrade to dedicated. My VPS only has 512mb RAM and one large file download is eating up that RAM. This is causing the issue.
I'm a newbie and while I knew I was risking a bit by going with VPS I do find it a bit annoying that these guys advertise 1TB of bandwidth per month but I can't even support downloading 1GB at the same time....maybe it's just me...
Anyway, I am now looking into moving the large files and the upload/download over to Amazon S3. If I do this I am expecting my RAM usage on the VPS to greatly decrease. Is this correct? If my PHP code is running on the VPS, but the actual file download via HTTP is coming from S3, that should not be a heavy load on my box, correct?
any opinions on S3?
I'm currently building a large guitar lesson website that will launch around the end of the year or so. Basically there will be multiple instructors on the site who submit video files from 10mb to 20mb in size each. There will eventually be a couple thousand videos on the site, so around 30gb of disk space right there give or take. So I need plenty of disk space.
I'm on a shared hosting account right now with iPowerweb, and that of course won't do me much good once the site's up and running. Plus they have a 12mb upload limit, but the instructors need to upload videos larger than that. And I'm aware that with a VPS I'd be able to set my own upload file size limit.
Anyway, this server stuff gives me a headache and I feel totally clueless. I've always loved the basic shared account because I don't have to do anything to keep the server in tact. But from what I've read, a VPS or dedicated server would take a lot of work on my part. So for that reason, I'm guessing I would need a managed VPS or managed dedicated server. I don't totally know what "managed" means, but hopefully to where I wouldn't have to do any upkeep. I need to focus my time on a bazillion other things besides the server, so it'd be nice to find a plan where I wouldn't have to worry about server security updates, software updates, and any other server maintenance etc.
I need tons of bandwidth. It's going to be a membership site with hundreds and eventually thousands of members who all watch the lesson videos. So that's a ton of bandwidth. I'll be the only one on my server though, I'm not going to also host clients or anything.
I'll of course need super reliability. With eventually having thousands of members, my site needs to be totally professional with near flawless uptime.
So I'm thinking I'd want to start off with AT LEAST 40gb of disk space, but 60gb might be better. At least 1000gb transfer, but again, maybe more? And I guess a lot of ram, although I admit I hardly know what ram is haha, does that have to do with the speed of the site? And what's burstable ram? But yes, I'd need to have a server that can handle all the many files and users, with great uptime and great speed.
Budget-wise, I'd like to keep it under $70 or $80 a month if possible. If absolutely necessary, maybe a little more.
Anyway, if you guys were in my shoes, what would you do. Assuming you're clueless about VPS, and have the needs mentioned above. Any host recommendations or advice?
Price-wise and size-wise, Start Logic looks pretty good, but I think their VPSs are all unmanaged. Ive looked at a lot of other companies, but it's hard to find the right plan.
I run a large adult vBulletin community with 70,000 members, 1/2 million posts, 186,000 attachments (a lot video), and closing in on 100 million downloads since our start some odd years ago. I've been battling keeping the site up for quite some time, and I am starting to wonder whether we shot too low on the server setup. I figure I would ask the pros here at WHT for some advice.
This is our current setup:
Site server:
Quote:
CPU: Intel(R) Core(TM)2 Duo CPU E4500 @ 2.20GHz
4 Gig ram
250 Gig sata harddrive
Unix FreeBSD 6.2
Apache
MySQL server:
Quote:
CPU: Pentium III/Pentium III Xeon/Celeron (2666.62-MHz 686-class CPU)
Cores per package: 4
4 Gig ram
750 Gig SATA harddrive
Unix FreeBSD 6.4
Apache
Do you think the site would perform better under one server and maybe a more powerful processor? What should I be looking at exactly as far as hardware goes for this type of site. I should note we push about 2.5TB of bandwidth monthly.
I got a new server for a site that contains 5 GB of data. I'm wondering how can I move it? I have root access to both servers.
View 5 Replies View RelatedWe are in the process of changing web hosting companies and I am having difficulty in moving all the directories. We are a membership based company with over 8,900 members. The original web site (called Site a) has over 26,700 individual directories along with many tutorials in video format. The entire site is approximately 80 GB in size.
When I had the second web hosting company try to move the site via tar they indicated that the tar would abort at about 4 GB every time.
Is there any other way to move this site or get a complete backup of the site. I have no problem moving the MySQL databases.
to move one of my sites from 1-st dedicated server to 2-nd dedicated server.
Of course i have shell access on both servers. As site is huge one (60gb space and 99% of files in one folder) going to tar -czvf this folder and move it.
or may be mput all files.
the only problem that i have ... is, that i need SSH commands advice.
if i type [mput *] i must keep window opened. but as u understand 60gb is can be transferred during ~10-15 hours. that's why need to know, is there any command that i must type (with mput *) and close window. So, don't be online all this time and/or keep shell window opened during this tranfer.
I want to move a Sharepoint site (WSS 3.0) to another server. Now my question is how?
I've only found a way by using frontpage 2003 but I don't want/can't do this. I need another way.
The site name will remain the same and everything, but I don't know how to export everything and import on this new server.
My company is going to launch four online retail site and in need for a dedicated server service provider that can provide us with room to grow from minimal traffic to possibly 2-5k traffic an hour.
View 14 Replies View RelatedI have a customer who would like me to move his site from a linux box to windows. As we are all linux I'm not sure of any major implications this would have.
He wants to move as he is starting some .NET dev and wants to keep it all on the same server.
The linux box has a forum/blog type application (customer written). It was done in PHP and using MySQL.
The windows server is a Windows 2003 server.
As far as I know I'll have to install the entire windows OS, install all SP and updates. I will install IIS, .NET.
The MySQL installation is pretty simple and the PHP will be run as a CGI under IIS.
I am thinking of installing an anti virus/trjoan scanner but as there will be no mail server there I'm guessing it's not necessary.
I'm pretty sure I will need a firewall as there is no iptables equivalent for windoes (is there??). Any suggestions on something cheap / fast / stable and good.
If someobody can see anything I missed here PLEASE let me as it will be most appreciated.
is the 4GB + problem still around with a windows server 32bit ? The box will have exactly 4GB of memory.
how do you move a site from a reseller account to a VPS if I do not know the site password. I believe the user changed the Cpanel password.
View 6 Replies View RelatedI have what I think is kind of a unique situation with a site move and Google is not turning up an answer that seems to work.
My site is currently in this format:
www.mydomain.com/site/file.html
And I am "moving" it but also switching from html to php, so the same file would be found at:
site.mydomain.com/file.php
I want to redirect users going to the old pages to their equivalent on the new site, however this is a little bit of a problem because this is a normal subdomain - it is the same directory as before but now there are php versions of the html files.
Right now I have all of the http files redirecting to their php equivilents, but I don't believe this is a desirable solution. Also it creates a problem when people go to www.mydomain.com/site (not indicating a specific file; just the subdir root) because I have www.mydomain.com/site/index.html redirecting to www.mydomain.com/site/index.php.
Quite a mess.
My first option is to put the redirects in the htaccess file on the "old" site. But is this a problem because there are over 500 pages on the site? Does it create a heavy server load because any requests force the server to serve a huge htaccess file?
The next alternative seems the most preferable although I'm not sure how to do it. It seems it could use wildcards so that anyone going to *.html gets directed to *.php or something like that. The only problem is that there are a small number of files that were removed completely and do not have php equivilants (about 5 or 6) and would need to redirect to the index.php in the root
Attached is a (badly) drawn diagram of two sites, connected by a vpn.
The site to the left, is network 10.0.0.0/24 which runs a linux server as the router for the network.
The site to the right, is network 10.1.0.0/24 which runs a windows 2003 server as the router for the network.
Now, my problem is, the clients behind the windows 2003 server can ping any machine on the first network because i setup a static route to route all traffic to 10.0.0.0/24 over the vpn interface.
now, my problem is, only the linux server can ping any machine on the windows 2003 network, any client behind the linux server cant seem to route over the interface.
I have the following route on the linux server: .....
Starting point: a working site using a shared IPv4, dedicated IPv6, and SSL. HTTP and HTTPS work, the latter only using SNI of course.
The good news: If I simply allocate an IP resource of 1 to a subscription it is pulled from the pool, assigned to the service node, assigned to the web site, DNS is updated, and the site is automatically changed to using a Dedicated IPv4 and Dedicated IPv6.
The bad news: visitors land on the default web site of the service node, with the default SSL certificate.
Other info: I can't ping the new IP, even though it shows in "ip a l" and /etc/sysconfig/network-scripts/ifcfg-eth0:0. [edited]
After the IP assignment, it is still installed, and /etc/httpd/conf/plesk.conf.d/ip_default/domainname.conf shows the new certificate is being used.
However, a second set of VirtualHost entries is created in server.conf for this IP for ports 80 and 443, with NameVirtualHost enabled on the new IP. The port 443 entry uses the default certificate. Apache's setup this default VirtualHost entry will override the web site configuration because Apache is listening on port 443 with the wrong cert.
If I go to "Change webspace settings" and toggle to Shared IPv4, Dedicated IPv6 the site works again via HTTPS, and Dedicated IPv4 and Dedicated IPv6 breaks it again. Setting the SSL cert to None and back again does not work.
Setting the SSL cert to None, changing to a dedicated IP, and enabling SSL results in the server being inexplicably inaccessible...browsers no longer connect to either the default site or the correct site, and I don't see any entries in the vhosts's logs.
is there anyone knows for a good hosting located in uk,which is allowed : adult site and casino betting online site ?
im looking for vps and dedicated server.
please help me i really need as soon as possible.thx
I run basicly run two main site.
1.Forum big one .
2.File and image sharing site.
(image sharing site generates thumbnails which produces lots of hits)
In these conditions how much difference can lighttpd can do as compared to apache for keeping my 600 MB Ram VPS host constant.
I'm having a lengthy issue where my databases are to large to import in phpmyadmin using plesk. Unfortunately I dont have direct access to phpmyadmin and can only access it by DB user through plesk.
I have tried to edit php.ini in the following locations:
upload_max_filesize = changed this to 64M
post_max_size = changed this to 32M
maximum_execution_time = changed this to 300
maximum_input_time = changed this to 300
Why am I still not able to import my DB's which are about 8MB each?
what type of hosting do use big sites like Deviantart, or any kind of site with a lot of Gb or Tb. and how much it costs?
View 7 Replies View RelatedI have a website which has about 20K users, and now I am using VPS plan at LunarPages.
However, I have encountered a trouble of out-of-memory. Although I have configured my Apache and MySQL carefully, the 512M memory is not enough. Therefore, the users' expirence is not good these days because my site is very unstable.
I contacted Lunarpages, asking them whether I can upgrade my VPS to bigger RAM, but they said the ONLY way to get a RAM bigger than 512M is to upgrade to dedicated hosting plan.
The following are some stats of my website:
Total Members: 20k
Online at the same time: max 600, average 300
The Lunarpages VPS plan:
www[dot]lunarpages[dot]com/virtual-private-server/
disk space: 20G
RAM: 512M
price: $42 / mo
Now I am not sure whether to migrate to didicated hosting plan, because currently, the main problem is just the size of RAM. Other resources e.g (CPU, network etc. ) are not my bottleneck. So I think it seems not worthwhile for me to migrate to the dedicated hosting plan with a doubled price (even more, almost 3x if I need 1G RAM), just for a larger size of RAM.
Can you guys give some suggestions to choose a VPS provider for my site?
The factors taken into my consideration include:
* RAM size: at least (1G for peak, 768M garantee). The bigger, the better. Nice if can choose larger size when needed.
* price
* bandwidth: 1T/mon?
* easy to upgrade to dedicated host: just in case that one day I will have to use dedicated.
* whether there are coupons for a lower price.
I've been with zone.net for a couple months now, and I have a guaranteed 512MB of memory, which I seem to constantly be hitting, which seems to result in processes being killed and http access vanishing. Growing quite annoying.
I'm looking into moving onto a new provider that can provide more guaranteed RAM for about the same price.
Space isn't a huge deal, I'd do fine with a meager 5GB. Bandwidth I need at least 200GB, but wouldn't mind more.
I'd like to stay managed if possible, as I'm not as well versed in server workings as I should be. Also am in need of cPanel, which I know is a spendy sucker.
My budget is something around $70 a month, and I don't really want to go much higher than that. Still a poor college boy :/
Can anyone suggest such a provider? I've browsed around a lot of the VPS hosts but can't seem to find one that has as much RAM as I need for a decent price. All the ones that seem to have 512MB+ are pretty expensive, and offer a lot more other stuff (space/bandwidth) than I need.
As a final note, the line speed isn't that big of a deal. I'm currently on a 3mbit and am surviving, but going back to a higher speed line would be great
Just had a quick question about backing up a large MySQL DB. I have a database that is 50gb with about half a billion entries in it. One table itself is about 40gb, the other 10gb consists of smaller tables.
The problem is, I want to back the database up and be able to keep it LIVE at the same time (as it will fall behind quickly if it's pulled for more than a few hours, as there are somewhere in the area of a million entries an hour, plus other deletions and queries).
I'm currently using iptables to ban IP addresses from the servers, like:
Code:
iptables -A INPUT -s xxx.xxx.xxx.xxx -j DROP
I ran a "spam trap" for the last few months and now I have over 11000 IP addresses who were trying to spam on my website (guestbooks, phpBB and forms) and I want to ban them all (pretty sure bots run from them).
My question - is iptables the way to do it? I mean does banning such a large number of addresses have any significant performance or other issues I should be aware of (except of the fact I may be banning some legitimate traffic)? Is the -A INPUT the way to ban them all or is there a more appropriate way of baning such a number of addresses?
I'm on CentOS 4.5 i686, Apache/1.3.37, Pentium D 930, 2GB RAM.
I wasn't sure where to post this so here goes, I need to migrate a MySQL DB, in the past I have just created an SQL file and used that method (sometimes having to split the SQL file up) but now the DB is about 50 meg and 733,233 records.
Is there an easier way to migrate the Database from one server to another?
I'm trying to find a server that can offer about 7-8 TB with 6-8 GB of ram. Does anyone know a good provider?
View 14 Replies View Relatedany recommendation for a good e-mail service (IMAP) for large accounts? between 5 and 10GB each?
View 13 Replies View RelatedI'm selling downloads of music files. The zip files are quite large. I've had several people complain that they get a message that the server resets their connection before the download finishes.
What can I do to allow these large downloads?
I'm on IIS.
I have a large directory which I want to copy to another account on the same server. Its 1 folder which contains 20000+ files and its around 2GB in size.
I used:
Quote:
cp -r /home/useraccount/public_html/foldername /home/useraccount2/public_html
It worked but some of the files didn't transfer correctly,