File Storage For Multiple Web Servers
Nov 5, 2009
What's the best setup for me to have for a machine which will host web files that other servers have to read and serve to end users on the web?
For example, I have servers Web1 and Web2 serving the same content from Files1.
I assume it's best just to go with RAID 10 and be safe or?
More importantly for me, what's the best way for these systems to communicate? I.e.
what protocol should be used for the web servers to read the files from the file server?
I once used SSHFS for serving the same static files on a couple of machines from one location... but that's presumabely very slow (at the time wasn't a problem).
All systems will be running CentOS Linux.
View 6 Replies
ADVERTISEMENT
Nov 26, 2008
is there a low end server just designed for receiving and sending large audio and media files?
like CPU should be minimal, as long as it can send and receive large files to and from a main server which has apache + php + mysql running in it...
would this be cost effective?
View 8 Replies
View Related
Aug 16, 2009
Network File Storage (NFS), does anyone use it or find it useful?
From what I see are advantages:
- Raid redundant
- Good backup
- Cheap extra space
Cons:
- slower speeds read/write speeds?
Looking for someone to add on and change my point of view on NFS. Also if you like NFS what is a good model for us to get. We are currently looking at the the Dell PowerVaults...
View 8 Replies
View Related
May 19, 2009
I run several sites and all of them are hosted at invision. The main reason for having my sites hosted there is that my sites are "forum centered" and I'm very happy with the service that I have got over the last few years from them, so I don't want to change that.
However, I now wish to expand and provide my users with a file repository. The problem is, whilst hosting my sites at invision is fine, hosting my files there would be quite expensive...
Thus, I'm now looking for a host to host my files and nothing else. (I run chess sites, so I'll be providing my users with files and possibly a gallery. All legal material, of course).
I don't need any download manager or anything of the kind. Invision forums actually has its own download manager, and I can have my files hosted externally (i.e. other than on my site).
Thus, I'm looking for a host that offers specific packages for what I am looking for - I would not need scripting or any 'fancy' features, just file storage with FTP access.
How much space? around 1 GB, possibly 2 in the future, maybe 3 or 4 if I add the gallery one day.
And bandwidth, as people will be downloading files from my site.
I've been looking around, but it's just so difficult: they all offer webhosting services for people who need to have their sites hosted, etc. and that's not what I need.
Any recommendations?
I don't have any fixed budgets, my focus will be on price, speed and reliability. Preferably a hosting company which has been around for a while and has good reviews.
View 14 Replies
View Related
Oct 8, 2008
is there any web hosting that can be used as file storage (>10G) and cheap? I have some huge files, but many web hostings can not accept non-web-content files.
View 10 Replies
View Related
May 28, 2009
Does anyone know of a .RU host/provider that offers large scale storage servers? looking for something with a 8 or more drive configuration...
Russian speaking only would be fine also.
View 3 Replies
View Related
Mar 19, 2009
file storage service that can be used for backups and allows FTP access.
Do you know of any reliable service that also offers a free account?
View 6 Replies
View Related
Jul 18, 2008
Just got a letter from InMotion. They don't like I uploaded my backup files to them, which makes their hosting benefits totally pointless to me and I will be moving to some other cheaper hosting since I basically only use email.
So I need some place to store my backups... I need only about 5 Gb, and I don't care about bandwidth, as I don't plan to download them unless all my HDDs will burn or get stolen or something so I don't need bandwidth. And it should be no more than few bucks/mo.
View 8 Replies
View Related
Oct 26, 2008
For those host which are not overselling, they have obviously the space for file storage. But should they allow file storage on their shared hosting account, if they aren't overselling, and the files are legal?
Well, this can also be counted as a survey I need
It would be best if you provide a reason if your vote is no.
View 14 Replies
View Related
May 29, 2008
I am trying to find out how many 3 minute videos can be stored on a dedicated server that holds 500GB of Disk Space and how many videos can be viewed at the same time if it has 1500GB of Bandwidth.
We are starting a user-generated site that will potentially receive a lot of videos and someone is trying to persuade us to use a media platform that charges based on views instead of a dedicated server. They are saying the server will not hold many videos nor will large amounts of videos be able to be viewed at the same time.
View 7 Replies
View Related
Sep 11, 2007
We're currently serving approx. 150mbit of traffic (mainly video files) via 2 round robin'ed front-end servers. The front-end servers are NFS mounting the content blades so we can access all content via dedicated links to each blade, A,B,C like:
mainsite.com/A/files.wmv (blade A)
mainsite.com/B/files.wmv (blade B)
mainsite.com/C/files.wmv (blade C)
We're fed up with this way of structuring our content because of space issues and because we need to go to blade A to get file X.wmv and to blade C for Y.wmv
We're looking for a better solution and we need your help, I have looked at the producs from Coraid, e.g:
[url] look for "Bundle - CLN21 + SR1521"
Would this be a way to do it? it will give us plenty of storage space and if we could buy 2 sets, we could mirror the sets and mount a set to each front end server to have some failover protection? and we could remove the A,B,C areas and have it all under:
projectABC/
X.wmv
Y.wmv (not so important just an easier way for us to keep track of it)
But is Coraid even used for this kinda task or is it a LAN product? Can it keep up with the 150mbit of file requests, 20-400mbit a piece.
Another idea was to simply build 2 sets of raid boxed with a 16channel raid card some some disks and it would give us something similar to the coraid?
View 7 Replies
View Related
Nov 18, 2007
how to handle the file storage of a youtube clone?
Is it just a matter of getting more servers with a few hdds or are there specialized companies that one can upload files over a distributed file streaming network?
The reason I ask is because I have thousands of gigabytes of videos and it appears to be impossible to upload it on 1 dedicated server or even a few.
View 6 Replies
View Related
Aug 21, 2007
on good hosting setups for getting large amounts of disk space.
I would like to be able to offer up to 2Gb storage space for 100s, maybe up to a few 1000 users - any solution should scale well. The files would be static files that might be up to 400Mb in size.
It would be nice to be able to give users FTP access to their disk space, although it's not a core requirement.
View 4 Replies
View Related
Jul 24, 2007
I'm currently running on a VPS. My site allows for large file uploads and downloads, with files over 600mb in size.
The server has issues when the site gets three or more requests for large file downloads. I'm trying to grow this site to thousands of users and it is hard to do when the site can't handle even three.
I've been told by my host that I need to upgrade to dedicated. My VPS only has 512mb RAM and one large file download is eating up that RAM. This is causing the issue.
I'm a newbie and while I knew I was risking a bit by going with VPS I do find it a bit annoying that these guys advertise 1TB of bandwidth per month but I can't even support downloading 1GB at the same time....maybe it's just me...
Anyway, I am now looking into moving the large files and the upload/download over to Amazon S3. If I do this I am expecting my RAM usage on the VPS to greatly decrease. Is this correct? If my PHP code is running on the VPS, but the actual file download via HTTP is coming from S3, that should not be a heavy load on my box, correct?
any opinions on S3?
View 2 Replies
View Related
Jan 20, 2007
I have a lot of questions here so if you can't answer them all I understand. even pointing me somewhere where I could get the answers would be appreciated; hardware sites focusing on server hardware, forums focusing on such, etc.
we plan to have three different types of servers:
- db server (self explanatory. mysql. for forums, mysql driven sites.)
- file server (lots of files around ~2-10MB, consistant 70mbps right now, but we want more room for upgrades. needs a LOT of storage room.)
- web server (lots of php files, but also static things like plain html, images, etc. also includes all misc services for the setup-- dns, etc.)
could I be given a rundown for which hardware each of the three should have? I don't need specifics, even just knowing that more ram is important here while cpu doesn't matter as much, or that the fastest disks available are a must, etc would all be valuable info for me. despite that, I certainly wouldn't mind specific hypothetical hardware configs.
for the database server I'm assuming the more ram the better. not entirely sure about the cpu? also not positive on disks...
for the fileserver, how much ram would be practical or useful? disk io will be an issue I'm because plenty of people will be pulling files at once so the disk needs to read from multiple places. scsi (and even raptors) are not an option as we need 750GB+ of space on a reasonable budget. more ram will take some load of of the disks, but how much is neccessary / reasonable?
for the web server I'm assuming cpu first, then ram, but it'll likely need less ram than the db server?
I'm more lost on the disks than anything. scsi on the fileserver is not an option under any circumstances due to $/GB. for the db & web server I'm willing to pay for scsi if the performance increase really does warrant the extra money, but I'd like to be convinced before shelling it out. if you have benchmarks geared at server hardware when it comes to disks I'd really appreciate it.
also, what's the best way to network these together when colocated? each one with a dual gigabit ethernet port and then the communications go to and from the router?
View 7 Replies
View Related
May 19, 2009
I currently have 2 web servers both running the cPanel Control Panel.
Out of the two servers only one is used and the other is just used currently to test scripts. It has come to a stage with the website capacity that I now require both servers to run in con-junction with each other to spread the load.
Questions:
1) There is a file upload service, How would you go about networking both the servers to allow remote removal / uploading of files to different servers. Eg, If user is on server 1 and files are stored on server 2. Also deletion of files etc - The website is programmed mainly in PHP.
2) File updating - The website is constantly being updated and therefore both servers will need the PHP files to be in sync. How would you go about doing this?
Both servers are at the same Data Center location.
View 3 Replies
View Related
Mar 9, 2008
We are looking for KVM/IP solution for multiple server. Where we can add the users remotely and give temporary access to the server owners. Once they are done we remove them from access list. So it can be used by someone else.
Anyone know for KVM/IP solution with kvm switch which can solve our purpose of KVM.
View 5 Replies
View Related
Jun 17, 2008
I currently have two servers, one is rhel 5 with cpanel, the other is windows 2003 with plesk 8.4
Each server wants you to setup a Hostname... one that is FQDN but not being hosted on that server so I setup a generic dns domain as follows...
SERVERCODNS.COM
Now for the hostname I setup both servers to be use this domain but different prefix... so...
SERVER1.SERVERCODNS.COM
SERVER2.SERVERCODNS.COM
Is this ok? Will I have problems?
My cpanel continues sending me emails nightly that my DNS is routing to another ip?
which bring sup my next question...
Is is ok to NS1.SERVERCODNS.COM, NS2.SERVERCODNS.COM for say the RHEL server and then DNS1.SERVERCODNS.COM and DNS2.SERVERCODNS.COM for say the windows? Is this going to cause problems?
Whats the difference or proper procedure for setting up DNS with my registrar (*ENOM) vs in the control panels they have Nameserver tools?
View 5 Replies
View Related
Aug 25, 2008
if it is possible to use more than 2 regular DNS entries across 2 hosts? So if a site goes down the other host picks it up?
View 12 Replies
View Related
Dec 3, 2008
I have a website.
I have it on 2 different servers.
This is because if the first server goes down for whatever reason, i dont want the site to go down.
To get this to work, is it just a case of adding more nameservers to the domain?...
becuase this doesnt seem to be working... the domain seems to always resolve to the server that is listed last in the list of nameservers...
View 6 Replies
View Related
Jan 31, 2008
Has anyway come up with a way to have several servers connected to one external CD-ROM on a USB Hub/network? This could allow a few external CD-DRIVES to handle a whole rack and the possibility of setting the bios via KVM/IP on a server to boot from CD, then it would boot from the CD tied in on the USB "network". Maybe using a USB hub? Or would this cause possible security issues having multiple servers tied in via USB ports?
I would love to have the ability to have maybe 3 or 4 CD-ROMs tied into multiple servers for OS installs remotely without having to actually go into the DC for this. You could put the CD-ROMs on your APC reboot and just turn on the one you need and set the bios to boot from CD (ie: one drive could have CentOS, one could have Windows, etc)
I'd be interested in some ways people have done this or what they use.
View 2 Replies
View Related
Mar 9, 2007
I have a firebox firewall and two servers. I don't one machine to see the other one the network. The servers are for two different clients. However I would like to be able to access a backup folder on Server 2 from Server 1. What is the best setup for this?
View 0 Replies
View Related
Mar 9, 2007
I have a firebox firewall and two servers. I don't one machine to see the other one the network. The servers are for two different clients. However I would like to be able to access a backup folder on Server 2 from Server 1. What is the best setup for this?
View 0 Replies
View Related
Sep 20, 2007
I'm completely torn on going the absolute budget route vs spending more for something that'll allow easy upgradeability in the future. I basically need lots of space but file sending-- media like mp3s, video, etc.
it'll be raid 5 and I'll need at least 2-3TB initially but the ability to expand would be nice.
option 1:
nice chassis with plenty of hotswap bays with sas expanders
expensive sas raid card
option 2:
cheap chassis to serve "immediate" needs and go with more later.
not sure what I'd use as a card? maybe even onboard?
regarding reliability: I once saw a database of failure rates of different models. raptor was the most reliable of the "desktop" drives. anyone have the link? I'm wondering of the seagate ES drives are worth the extra money vs the non-ES drives. they're supposedely more reliable and the "server versions" of sata drives.
View 3 Replies
View Related
Oct 24, 2007
Does anyone know how I can run multiple servers. But still use the same Domain name.
Such as server one with ip 547.547.547.547 uses domain www,m1.domain.com
and server two has ip 547.548.548.548 but uses domain www,m2.domain.com
View 5 Replies
View Related
Jun 13, 2009
What is the best way to run one command on multiple servers. Security isnt too much of an issue as I'll be doing a master/slave type setup, with the master being a system in the office with no ext access.
I'm thinking pssh is going to be quick and easy, what do you use?
View 8 Replies
View Related
Jul 16, 2009
I have 2x servers with the following os/control panels:
1x Windows Server 2008 running Plesk 9.2
1x Centos 5.3 running cPanel/WHM
What I wish to do is to point all of my domains to the nameservers:
ns1.domain.com
ns2.domain.com
But, the domains hosted could be on either of the boxes above (because some sites are ASP.NET and others PHP).
Each of the above machines are running BIND and I have not yet setup nameservers on either of them. How should I proceed with this?
In addition (for arguments sake), if I then add additional servers how would I then achieve the same?
If there's already stuff around on the forum (I've done a search but found nothing specified to my issue of running a windows and linux box with completely different control panels) please point me in the right direction.
View 9 Replies
View Related
Jun 4, 2009
A website I am involved with may soon hit a problem due image uploading being stored on only one server. We are unable to find a realistic solution which would allow us to upload images from 1 central location.
The website is programmed in PHP and is on a standalone web-server - currently the images are uploaded to the same directory as the website however we are looking to move the images to another server for scalability.
Is it possible at all to upload using a directory link of some kind, eg, the directory would be /serverip/path/to/images which you would upload to? Or any other realistic approaches that you know off.
View 8 Replies
View Related
Nov 1, 2009
Is it possible to combine multiple servers via "Configure Cluster"? Will the hosting domains use same ns1.mydomain and ns2.mydomain.com if one server is located in UK and second is in USA Datacenter. Can somebody provide me information with explanation?
View 3 Replies
View Related
Feb 5, 2008
I run a vbulletin based web forum ([url] and everything is going quite smoothly. We are currently in the process of getting a partnership with a supplement store.
Basically, our goal is to have our own store for Lean Bulk, but it will be run by a different company, and will be on their server.
Soo, the store database and custom script will be staying on their server, but my forums will be staying on my server. What I want is for the store to be located at [url]or [url]
Either one works for me. However, the tech guy that runs all the stuff for the store, is trying to tell me that this is "impossible." While it might be somewhat difficult, I have a hard time believing anything is really impossible.
The tech says the only thing we can do is have the store located at:
[url]
Personally, I think this looks unprofessional, and would rather stay away from this solution.
View 11 Replies
View Related
Nov 11, 2008
I purchased a domain, domain.com, from GoDaddy.
I have 5 servers, 2 running CentOS and Apache, 3 running Windows Server 2003 and IIS. Each server has it's own dedicated IP address, so I can access each site by going to [url]
Would I would like to be able to do is set each of these servers up with a subdomain on my domain.com. So I would have [url]going to one server, [url]going to another server, etc.
I logged into GoDaddy's Domain Manager. However, it appears that the only form of subdomains they have is redirection. So while I can create server1.domain.com, it merely redirects to [url]
I can mask the forward, but this creates problems with the login on the servers because they use cookies. In addition, the address always appears as [url], it doesn't have the "index.html" or "/login/login.aspx" when
I click links. The actual links appear as "[url] and not "[url]
Is there anything I can do? I want the subdomains to point to a particular IP address, not redirect.
View 4 Replies
View Related
