on good hosting setups for getting large amounts of disk space.
I would like to be able to offer up to 2Gb storage space for 100s, maybe up to a few 1000 users - any solution should scale well. The files would be static files that might be up to 400Mb in size.
It would be nice to be able to give users FTP access to their disk space, although it's not a core requirement.
I'm currently running on a VPS. My site allows for large file uploads and downloads, with files over 600mb in size.
The server has issues when the site gets three or more requests for large file downloads. I'm trying to grow this site to thousands of users and it is hard to do when the site can't handle even three.
I've been told by my host that I need to upgrade to dedicated. My VPS only has 512mb RAM and one large file download is eating up that RAM. This is causing the issue.
I'm a newbie and while I knew I was risking a bit by going with VPS I do find it a bit annoying that these guys advertise 1TB of bandwidth per month but I can't even support downloading 1GB at the same time....maybe it's just me...
Anyway, I am now looking into moving the large files and the upload/download over to Amazon S3. If I do this I am expecting my RAM usage on the VPS to greatly decrease. Is this correct? If my PHP code is running on the VPS, but the actual file download via HTTP is coming from S3, that should not be a heavy load on my box, correct?
any opinions on S3?
I've been with zone.net for a couple months now, and I have a guaranteed 512MB of memory, which I seem to constantly be hitting, which seems to result in processes being killed and http access vanishing. Growing quite annoying.
I'm looking into moving onto a new provider that can provide more guaranteed RAM for about the same price.
Space isn't a huge deal, I'd do fine with a meager 5GB. Bandwidth I need at least 200GB, but wouldn't mind more.
I'd like to stay managed if possible, as I'm not as well versed in server workings as I should be. Also am in need of cPanel, which I know is a spendy sucker.
My budget is something around $70 a month, and I don't really want to go much higher than that. Still a poor college boy :/
Can anyone suggest such a provider? I've browsed around a lot of the VPS hosts but can't seem to find one that has as much RAM as I need for a decent price. All the ones that seem to have 512MB+ are pretty expensive, and offer a lot more other stuff (space/bandwidth) than I need.
As a final note, the line speed isn't that big of a deal. I'm currently on a 3mbit and am surviving, but going back to a higher speed line would be great
I started tracking and collecting information about every page load on my site, which made the DB grow very fast. In 24 hours I had over 1.4 million INSERTs, so the DB will grow by over 170MB/day. The inserts so far didnt affect the performance of the server (dual clovertown, 4gb ram, SCSI HD), but at this rate the DB will grow by over 5GB per month. Is it a good idea to let the DB grow to those sizes? Would it affect performance if a table had several 10s of millions of rows? Public doesnt run any SELECT/UPDATE queries on that table, only admin does (me).
View 14 Replies View RelatedI wasn't sure if this would be better posted in the resellers forum, but that seemed to generally be reviews of companies.
Anyway, I work for a company who is trying to move a large amount of sites from one server to a new one. I was looking for the best way to handle this, since you run into issues with mySQL databases, file permission getting lost in ftp, ect.
Just got a letter from InMotion. They don't like I uploaded my backup files to them, which makes their hosting benefits totally pointless to me and I will be moving to some other cheaper hosting since I basically only use email.
So I need some place to store my backups... I need only about 5 Gb, and I don't care about bandwidth, as I don't plan to download them unless all my HDDs will burn or get stolen or something so I don't need bandwidth. And it should be no more than few bucks/mo.
For those host which are not overselling, they have obviously the space for file storage. But should they allow file storage on their shared hosting account, if they aren't overselling, and the files are legal?
Well, this can also be counted as a survey I need
It would be best if you provide a reason if your vote is no.
I have a website that is approx 50GB, that I essentially would like to take offline for a while. Obviously, while the site is offline, I don't want to be paying for my server.
Can anyone let me know of some options to "store" this mammoth of a site. Downloading it locally is not an option, so it needs to stay in the cloud for the lowest possible price.
Our congregation needs webspace to archive mp3 and mp4 files of the weekly messages. Low mp3 is about 3 MB size. High mp3 is about 20 MB size. mp4 video is about 325 MB size. We would provide links to the files so they could be downloaded - no online streaming is needed. Also no normal website stuff - just file storage space and ability to download by anyone who has the URL links to the files.
1and1.com has 250 GB storage with 2.5 TB/mo bandwidth usage for $10/mo. Their phone rep said this type of use of their web space is OK. I wouldn't even look any further except I've read a lot of bad reviews about them.
I have found SL can offer you 12*1 TB drive based systems, after RAID-5 and Win 2003 install you get just over 10 TB of storage. The monthly price works out to $1000/Month.
I know some time ago LeaseWeb offered these type of storages....any one else know of any others ?
Amazon S3 works out to about $1500 for 10 TB
Network File Storage (NFS), does anyone use it or find it useful?
From what I see are advantages:
- Raid redundant
- Good backup
- Cheap extra space
Cons:
- slower speeds read/write speeds?
Looking for someone to add on and change my point of view on NFS. Also if you like NFS what is a good model for us to get. We are currently looking at the the Dell PowerVaults...
I run several sites and all of them are hosted at invision. The main reason for having my sites hosted there is that my sites are "forum centered" and I'm very happy with the service that I have got over the last few years from them, so I don't want to change that.
However, I now wish to expand and provide my users with a file repository. The problem is, whilst hosting my sites at invision is fine, hosting my files there would be quite expensive...
Thus, I'm now looking for a host to host my files and nothing else. (I run chess sites, so I'll be providing my users with files and possibly a gallery. All legal material, of course).
I don't need any download manager or anything of the kind. Invision forums actually has its own download manager, and I can have my files hosted externally (i.e. other than on my site).
Thus, I'm looking for a host that offers specific packages for what I am looking for - I would not need scripting or any 'fancy' features, just file storage with FTP access.
How much space? around 1 GB, possibly 2 in the future, maybe 3 or 4 if I add the gallery one day.
And bandwidth, as people will be downloading files from my site.
I've been looking around, but it's just so difficult: they all offer webhosting services for people who need to have their sites hosted, etc. and that's not what I need.
Any recommendations?
I don't have any fixed budgets, my focus will be on price, speed and reliability. Preferably a hosting company which has been around for a while and has good reviews.
is there any web hosting that can be used as file storage (>10G) and cheap? I have some huge files, but many web hostings can not accept non-web-content files.
View 10 Replies View RelatedI run a large adult vBulletin community with 70,000 members, 1/2 million posts, 186,000 attachments (a lot video), and closing in on 100 million downloads since our start some odd years ago. I've been battling keeping the site up for quite some time, and I am starting to wonder whether we shot too low on the server setup. I figure I would ask the pros here at WHT for some advice.
This is our current setup:
Site server:
Quote:
CPU: Intel(R) Core(TM)2 Duo CPU E4500 @ 2.20GHz
4 Gig ram
250 Gig sata harddrive
Unix FreeBSD 6.2
Apache
MySQL server:
Quote:
CPU: Pentium III/Pentium III Xeon/Celeron (2666.62-MHz 686-class CPU)
Cores per package: 4
4 Gig ram
750 Gig SATA harddrive
Unix FreeBSD 6.4
Apache
Do you think the site would perform better under one server and maybe a more powerful processor? What should I be looking at exactly as far as hardware goes for this type of site. I should note we push about 2.5TB of bandwidth monthly.
What's the best setup for me to have for a machine which will host web files that other servers have to read and serve to end users on the web?
For example, I have servers Web1 and Web2 serving the same content from Files1.
I assume it's best just to go with RAID 10 and be safe or?
More importantly for me, what's the best way for these systems to communicate? I.e.
what protocol should be used for the web servers to read the files from the file server?
I once used SSHFS for serving the same static files on a couple of machines from one location... but that's presumabely very slow (at the time wasn't a problem).
All systems will be running CentOS Linux.
is there a low end server just designed for receiving and sending large audio and media files?
like CPU should be minimal, as long as it can send and receive large files to and from a main server which has apache + php + mysql running in it...
would this be cost effective?
file storage service that can be used for backups and allows FTP access.
Do you know of any reliable service that also offers a free account?
on the optimal setup for a new clients project. We currently host with eUKhost and have been very happy with them in terms of support. They offer a range of hi-end dedi servers but as with everything in life, cost is an issue.
The 3 servers I am looking at are:
Quad Core Intel Xeon X3360, 2GB Ram, 250Gb Sata, 100Mbit - £170 pm
Quad Core Intel Xeon X3353, 8GB Ram, 2x500Gb Sata, 100Mbit - £260 pm
Dual Quad Core Intel Xeon X5420, 12GB Ram, 2x500Gb Sata, 100Mbit - £419 pm
I know that obviously if money was not an issue, the last server would be the best, but I wonder if this is absolutely necessary for the website. Here are the anticipated site specs....
Portal site with anticipated traffic of around 5,000 visitors online at any one time, searching around 1,000,000 business listings and around 500,000 classifieds ads. Most listings or ads would have multiple pictures on their pages and there will be a reasonable amount of advertising on each page.
My question is whether the system will function adequately with a lesser processor and more Ram, or whether its the processor that gets the database searching speedily.
My client's website needs to hold files that are around 60 or 70 MB. The host only allows files up to 10 MB. Is that typical?
Right now I'm linking to a file storage but would rather make the files available from my site without going to a 3rd Party Site. He doesn't want to zip his files either - just to be a straight download.
I have a situation here.
I wanted to transfer a file (about 10GB) from one server to another server. Both server are on the same LAN.
Inside server1, I zipped a folder as file.tar.gz
From server2, I uses wget http://server1.com/file.tar.gz and it says "404 Not Found"
I suspect it won't allow me to download because the file is too big.
how to handle the file storage of a youtube clone?
Is it just a matter of getting more servers with a few hdds or are there specialized companies that one can upload files over a distributed file streaming network?
The reason I ask is because I have thousands of gigabytes of videos and it appears to be impossible to upload it on 1 dedicated server or even a few.
So I've recently ordered a Supermicro 4U server with 24x1TB HDs, 64GB RAM and put it in RAID 10. I'm running Debian 5.0 and have installed lighttpd. All the content I serve are video files (AVi, MP4, MKV, OGM) and each file is about 100-500mb in size. I'm wondering how can I optimize lighttpd to get the best performance out of it. I look forward to your replies.
View 14 Replies View RelatedCan anyone tell me the format of SCP command for transfering an 18gig TAR.GZ file from one srever to another
say im logged in to the old host via SSH and the backup is located at /home/public_html/cpbackup/blahblah.tar.gz
what command would i put down to transfer to the new server
I have been trying quite unsuccessfully to import a large sql db file via phpMyAdmin for one of my clients. Since the db file is about 250mb I get a server timeout error.how I can do this via SSH...I have a CentOS server 6.5, 64 bit that runs Plesk v 12.0.18
View 4 Replies View RelatedKnowing Qoodaa was quite by chance.
A few days ago, my friends studying in America recommended me a new popular transfer toolQoodaa. And he told me that it was a quite good software to download files and movies. At first,I was skeptical, but after using it, I found its a good choice to choose Qoodaa. And I have summarized the some features of Qoodaa:
1.Its speed is faster than any other softwares I used before to upload movies.
2.It can download files quickly through downloading links, in a word, it is time-saver and with high efficiency.
3.No limit of space.No matter where you are, it can download fast.
4. Qoodaa is a green software with high security and easy use.
It really can give you unexpected surprise.
I am a person who would like to share with others, and if you have sth good pls share with me
I need a hosting with 5-10 GB Hard-drive Space and about 500 GB of bandwidth (maybe a bit less). Without any features (apache, php, etc). I need only Ftp to upload and share video files.But not very expensive, not more than $10-$20.
View 12 Replies View RelatedI need to put a proposal for a client who has 20 TB data storage (files/images).
Will propose PHP/mysql - mysql for meta data of files and other authentication etc. Application/mysql could just be ~10 MB.
The storage would increase (incrementally) ~ 1 TB per year.
And data needs stored at a different place for Disaster Recovery point of view.
Need to figure storage costing.
Please give me some pointers:
a) How to find high storage hosting provider?
b) Has any one experimented with Cloud Computing, and if so any ball park potential costing? I attempt S3 and could not figure costing.
c) or any other suggestion.
how come the difference between shared and resellers storage is so different? If you buy shared, you can get stupid amounts of storage like 250 gigs or even unlimited for $5 a month. Yet the same company sells a reseller account for $30 and you only get 20 gigs.
Assuming you are going to split that up and sell that 20 gigs in 1 gig blocks to try and make money, why wouldn't your potential customer buy the shared account instead, and get way more space? It seems backwards to me. Shared $5 should be 20 gigs, and resellers $30 should be 250 gigs. I'm talking about big name trusted sites, not fly-by-nights who have unlimited everything.
I've gone Geek! I just switched to GeekStorage hosting a little less than a month ago, because my previous host was just ridiculous. I won't get into it because I could go on for days about my old host, it was just plain horrible. I'm not really one to mudsling or drag people's livelihoods down, so I'll just let them remain anonymous. Alot of the problems probably weren't in their control but they were numerous. That's enough of that though, because I've packed my bags for greener pastures and don't even want to look back.
Anyways, so I've been at Geek Storage for about a month now, on a shared hosting plan.
In this time I must say that I have been quite impressed with them. I've been through a number of hosts throughout the years, and have been studying the hosting game for years now. So since I know what to look for, I shopped around here at WHT for a couple of months and was drawn to Geekstorage. It was not an easy decision to make, finding a host, I'm very very picky.
First of all, I've fallen in love with the Litespeed http server. I still have all the benefits of apache, such as mod_rewrite, and any other apache modules. With Litespeed, PHP code executes blazingly fast. When I first benchmarked a Zend framework bootstrap on the servers, I fell in love. And once it was cached in memory... well let's just say it was like the time when Bruce Willis was dead at the end of the Sixth Sense. This is coming from a HUGE performance stickler... I am rarely impressed by these kinds of things. Some bigger MySQL queries that took ~0.148s to execute on my old host don't even have a benchmark reading on these servers (they round off to 0.00001s). I don't know why there was such a remarkable difference, perhaps just more memory available on the server compared to my last host.
The servers have Ruby/RoR installed, as well as Python. I am a really big fan of Python, in fact I believe it will take over the scripting world in the coming years, becoming more popular than PHP and Perl. So this was a selling point to me, since I want to get into Django development more.
Another selling point to me was PostgreSQL databases. Though I am using MySQL for all my current projects, the scope of some bigger projects I am looking into getting off the ground in the future (when I can only find the time...), require a more robust database system. What's funny is when I first signed up for GeekStorage the PostgreSQL database connection settings weren't working correctly, and PhpPgAdmin (the postgreSQL phpmyadmin equivalent) was not working. I sent in a support ticket and the problem was solved almost immediately. I think I may be the first client to use the pgsql databases!
I guess I should probably put a link to one of my sites here. This one's kinda greyhat, in fact I wouldn't even reccomend going to it because I've shoved an barrage of ads onto the page. The myspace crowd seems to love them. Here's the URL anyways:
[url]. Coming soon: Popups and peel away ads,
I haven't experienced any downtime, any slow page loads, or any other problems of that nature. I hope it continues to be that way, and as for now I am very happy with my decision. The best part to me, is it seems I have found people just as geeky about technology as me. Everything is the current version, Ruby, pgsql, mysql, PHP, etc. All up to date and ready to go. I love staying current on technology, and the Geeks really seem to know their stuff.
And before you ask I'll be sure to give the 3-month, 6-month, and 1-year reviews in due time Geek Storage Web Hosting