Storage, Raid, Front-end Servers/ Coraid
Sep 11, 2007
We're currently serving approx. 150mbit of traffic (mainly video files) via 2 round robin'ed front-end servers. The front-end servers are NFS mounting the content blades so we can access all content via dedicated links to each blade, A,B,C like:
mainsite.com/A/files.wmv (blade A)
mainsite.com/B/files.wmv (blade B)
mainsite.com/C/files.wmv (blade C)
We're fed up with this way of structuring our content because of space issues and because we need to go to blade A to get file X.wmv and to blade C for Y.wmv
We're looking for a better solution and we need your help, I have looked at the producs from Coraid, e.g:
[url] look for "Bundle - CLN21 + SR1521"
Would this be a way to do it? it will give us plenty of storage space and if we could buy 2 sets, we could mirror the sets and mount a set to each front end server to have some failover protection? and we could remove the A,B,C areas and have it all under:
projectABC/
X.wmv
Y.wmv (not so important just an easier way for us to keep track of it)
But is Coraid even used for this kinda task or is it a LAN product? Can it keep up with the 150mbit of file requests, 20-400mbit a piece.
Another idea was to simply build 2 sets of raid boxed with a 16channel raid card some some disks and it would give us something similar to the coraid?
View 7 Replies
ADVERTISEMENT
Sep 20, 2007
I'm completely torn on going the absolute budget route vs spending more for something that'll allow easy upgradeability in the future. I basically need lots of space but file sending-- media like mp3s, video, etc.
it'll be raid 5 and I'll need at least 2-3TB initially but the ability to expand would be nice.
option 1:
nice chassis with plenty of hotswap bays with sas expanders
expensive sas raid card
option 2:
cheap chassis to serve "immediate" needs and go with more later.
not sure what I'd use as a card? maybe even onboard?
regarding reliability: I once saw a database of failure rates of different models. raptor was the most reliable of the "desktop" drives. anyone have the link? I'm wondering of the seagate ES drives are worth the extra money vs the non-ES drives. they're supposedely more reliable and the "server versions" of sata drives.
View 3 Replies
View Related
Apr 25, 2007
I have a problem with my new server's setup. It's using a big RAID storage mounted to the main system. When it comes to shell everything is fine, I have access to the disk and files. Problems rise when I try to access the storage content from my php scripts (running on apache) - "Permission Denied" ...
Anyone knows where might be the problem?
I suppose it's because of using RAID but I'm sure it's doable.. somehow..
When I tried to use CLI mode it looks fine - PHP script can access RAID'ed folders when running like :
php /var/www/html/filetest.php
View 2 Replies
View Related
Nov 5, 2009
What's the best setup for me to have for a machine which will host web files that other servers have to read and serve to end users on the web?
For example, I have servers Web1 and Web2 serving the same content from Files1.
I assume it's best just to go with RAID 10 and be safe or?
More importantly for me, what's the best way for these systems to communicate? I.e.
what protocol should be used for the web servers to read the files from the file server?
I once used SSHFS for serving the same static files on a couple of machines from one location... but that's presumabely very slow (at the time wasn't a problem).
All systems will be running CentOS Linux.
View 6 Replies
View Related
May 28, 2009
Does anyone know of a .RU host/provider that offers large scale storage servers? looking for something with a 8 or more drive configuration...
Russian speaking only would be fine also.
View 3 Replies
View Related
Nov 26, 2008
is there a low end server just designed for receiving and sending large audio and media files?
like CPU should be minimal, as long as it can send and receive large files to and from a main server which has apache + php + mysql running in it...
would this be cost effective?
View 8 Replies
View Related
May 29, 2008
I am trying to find out how many 3 minute videos can be stored on a dedicated server that holds 500GB of Disk Space and how many videos can be viewed at the same time if it has 1500GB of Bandwidth.
We are starting a user-generated site that will potentially receive a lot of videos and someone is trying to persuade us to use a media platform that charges based on views instead of a dedicated server. They are saying the server will not hold many videos nor will large amounts of videos be able to be viewed at the same time.
View 7 Replies
View Related
Oct 22, 2008
What configuration would be best for a backup server:
2 x 1000gb SATA II RAID 1 - $150
3 x 500gb SATA II RAID 5 - $110
4 x 500gb SATA II RAID 10 - $140
Reliability and performance wise, which would be more suitable for a R1Soft backup server? Best bang for the buck?
I didn't find this being discussed so I thought I should ask, since hardware gurus would know better than me.
View 14 Replies
View Related
Mar 7, 2007
Quote:
Today we are going to conduct a detailed study of RAIDability of contemporary 400GB hard drives on a new level. We will take two "professional" drives from Seagate and Western Digital and four ordinary "desktop" drives for our investigation. The detailed performance analysis and some useful hints on building RAID arrays are in our new detailed article.
[url]
View 0 Replies
View Related
Apr 4, 2009
We are interested to know how many VPS providers.. ( not resellers ) have hardware firewalls in front of their VPS hardware nodes?
If so, Do you find this impacts customer vps's?
What kind of hardware firewall do you use?
If not, how do you protect your hardware nodes from attack?
After some research I seem to find most providers do not in fact have any hardware firewalls in front of their VPS hardware nodes. Mostly they say it causes too many problems and tickets due to port blocking, etc... and customers complain about being restricted..
View 4 Replies
View Related
May 19, 2007
Forbidden You don't have permission to access /_vti_bin/_vti_aut/author.exe on this server. Additionally, a 404 Not Found error was encountered while trying to use an ErrorDocument to handle the request.
I have done the following: uninstalled /re installed extensions via whm (same error)
.htaccess is default frontpage's code only, nothing else
/scripts/chownpublichtmls
dns zone propagated fully, correct (today)
.htaccess file:
Code:
# -FrontPage-
IndexIgnore .htaccess */.??* *~ *# */HEADER* */README* */_vti*
<Limit GET POST>
order deny,allow
deny from all
allow from all
</Limit>
<Limit PUT DELETE>
order deny,allow
deny from all
</Limit>
AuthName www.domain.com
AuthUserFile /home/user/public_html/_vti_pvt/service.pwd
AuthGroupFile /home/user/public_html/_vti_pvt/service.grp
View 0 Replies
View Related
Apr 15, 2008
Initially I'm planning on interfacing with GMail as well as providing a downloadable plugging.
I'm planning on coloing @ 151 Front Street since Google peers at torix and the majority of my data transfer will be to them.
My concern is dealing with DOS attacks, since in the past some anti-spam companies have been subject to DOS attacks. Are there any providers at 151 front who specialize in high-risk hosting?
View 9 Replies
View Related
Dec 13, 2008
Why Wndows 2008 standard shows its IIS front page only
I am using windows 2008 standard version 64 bits
I am using an external DNS service and using none of Windows roles
I disabled the firewall completely
When I run IIS i can access to its front page from another machine but when I run jboss the browser can't get access to my web site front page! They both use port 80
Does ISS has some sorts of hidden privileges in Micorosoft which is not surprising
I am about to revert back to Windows 2003 if I can't find a solution to this problem. Or do I have use a certain role for remote access?
View 0 Replies
View Related
Mar 24, 2008
Is Motherboard RAID as good as a dedicated PCI-E card? I am guessing a dedicated card is the best option, though costs more.
We are looking at buying a barebones server from Supermicro. It features an onboard RAID controller which supports RAID 0, 1, 5 & 10 - but for some strange reason it will only support RAID 5 if you use Windows. Here is a link to the page detailing the RAID features.
[url]
We are going to be running Linux, CentOS 5.1, so we will only have the choice of RAID 0, 1 or 10. This isn't an issue, as having RAID 10 on 4x SAS (15k) drives will be fine for speed and stability. What is an issue is would this RAID controller be as fast or reliable compared to a dedicated PCI-E card? If it can only use RAID 5 in windows, does that suggest this controller is too reliant on software? It would be a nightmare to suffer downtime and data loss because the controller couldn't hack it during a drive failure, or one day it decided to bugger up the array when rebooting.
So that leads me to looking at this card, this looks very good for what we need. Are adaptec a reliable brand? I've seen it advertised for £200, which is a good price.
[url]
This card features RAID 5 and 6, would RAID 6 be better than RAID 10 for redundancy, or is it too slow to bother with? Also it seems to have a battery module available for it, what does this achieve? Cos surely if the power dies the hard drives and motherboard can't run off this little battery, or does it just help the controller stay alive long enough with some hard drive information in its memory if the power goes out during a rebuild?
View 14 Replies
View Related
Sep 17, 2009
I could try the Software-RAID 5 of the EQ9 Server of Hetzner.
Does anyone here has experiences, how fast a hardware raid 5 compared against the software-Raid 5 is?
The i7-975 should have enough power to compute the redundnacy on the fly, so there would be a minimal impact on performance. But I have no idea.
I want to run the server under ubuntu 8.04 LTS x64.
On it a vitualisation like VMware the IO-Load could get really high.
View 14 Replies
View Related
Jan 14, 2008
So I've just got a server with 2xSATA raid 1 (OS, cpanel and everything in here) and 4xSCSI raid 10 (clean).
Which one do you guys think will give the best performance:
1. Move mysql only to 4xSCSI raid 10
2. Move mysql and home folder to 4xSCSI raid 10
View 0 Replies
View Related
Jul 8, 2007
I am in a somewhat complicated situation... I wanted to order a custom server with hardware 3Ware RAID controller but after over a month of waiting I was told the HW RAID controller, as well as any other 3Ware controller they tried, does not work with the motherboard used in the server from Fujitsu-Siemens and that they simply got a reply from FS that the controller is not certified to work with their motherboard.
So although I'd prefer a HW raid, I am forced to either choose a different webhost or setup a software RAID. The problem is, I haven't done that before and am somewhat moderately...scared
I have read a lot of the info about SW RAID on Linux that I could find through Google but there are some questions unanswered still. So I thought that perhaps some of the more knowledgeable WHT members could help me with this problem...
The server specs will be:
Core2Duo E6600 (2.4Ghz), 2GB RAM, 6-8x* 250GB SATA II HDDs, CentOS 4.4 or SuSe, DirectAdmin
* I prefer 8 HDDs (or actually 9) over 6 but I am not sure if their server chassis can hold that many HDDs, I am awaiting answer from them. They don't have any other drives beside the 250GB ones so I am limited to those.
The preferred SW RAID setup is to have everything in RAID 10, except for the /boot partition which has to be on RAID-1 or no RAID I believe, plus one drive as hot spare (that would be the 9th drive). I am quite sure they will not do the setup for me but will give me access to KVM over IP and a Linux image preinstalled on the first HDD so that I'll have a functional system that needs to be upgraded to RAID-10.
How do I do that? The big problem I see is that LILO or GRUB can't boot from a software RAID-5/10 so I will have to mount the /boot partition elsewhere. It's probably terribly simple...if you have done it before which I have not. I have read some articles on how to setup a RAID-5/10 with mdadm (e.g. [url] ) but they usually do not talk about how to setup the boot partition. Should it be setup as a small sized (100-200MB) RAID-1 partition spread over all of the drives in the otherwise RAID-10 array?
What about swap? Should I create a 4-8GB (I plan to upgrade the server RAM to 4GB in near future) RAID-1 swap partition on each of the disks or swap to a file on the main RAID-10 partitions. The second sounds simpler but what about performance? Is swapping to a file on RAID-10 array a bad idea, performance wise?
Is it possible to grow a RAID-10 array in a way similar to growing a RAID-5 array with mdadm (using two extra drives instead of one of course)? mdadm doesn't actually even mention RAID-10 despite it does support it without having to create RAID-0 on top of RAID-1 pairs if the support is in kernel, from what I know.
View 8 Replies
View Related
Feb 25, 2009
How often do RAID arrays break? Is it worth having RAID if a servers hard drive goes down? I was thinking it may just be a better option to just have a backup drive mounted to my system and in the even of a system failure just pop in a new hard drive, reload the OS, and then reload all my backups?
View 14 Replies
View Related
May 20, 2009
I have a new server and it is rather slow during raid 1 recovery after system installed
CPU: Intel Core2Duo E5200 Dual Core, 2.5Ghz, 2MB Cache, 800Mhz FSB
Memory: 4GB DDR RAM
Hard Disk 1: 500GB SATA-2 16MB Cache
Hard Disk 2: 500GB SATA-2 16MB Cache
root@server [~]# cat /proc/mdstat
Personalities : [raid1]
md0 : active raid1 sdb1[1] sda1[0]
256896 blocks [2/2] [UU]
md1 : active raid1 sdb2[1] sda2[0]
2096384 blocks [2/2] [UU]
md2 : active raid1 sdb4[2] sda4[0]
480608448 blocks [2/1] [U_]
[=======>.............] recovery = 36.7% (176477376/480608448) finish=1437.6min speed=3445K/sec
the sync speed is just 3.4Mb/second and the total hours needs to be more than 40 hours
Also the server load is very high (nobody uses it)
root@server [~]# top
top - 07:00:14 up 16:55, 1 user, load average: 1.88, 1.41, 1.34
Tasks: 120 total, 1 running, 119 sleeping, 0 stopped, 0 zombie
Cpu(s): 0.0%us, 0.2%sy, 0.0%ni, 99.7%id, 0.0%wa, 0.0%hi, 0.2%si, 0.0%st
Mem: 4148632k total, 747768k used, 3400864k free, 17508k buffers
Swap: 5421928k total, 0k used, 5421928k free, 569252k cached
View 8 Replies
View Related
Oct 22, 2009
I am in the process of restructuring the infrastructure on our servers. I am thinking of using either RAID 5 (1 hot spare) vs RAID 10 as my 1U server has 4 HDD tray.
RAID 5 would have better capacity but RAID 10 has better overall performance. Which one do you guys go for a shared hosting server?
View 14 Replies
View Related
Dec 23, 2008
Is it possible to turn a non raided setup into Linux software raid, while it is live, and if it's the OS drive? Can you even software raid the OS drive remotely? I've been thinking about doing it for the redundancy (and possible slight performance boost for reads, but doing it more for redundancy). I'm using CentOS.
View 12 Replies
View Related
May 22, 2008
I want to take some data from a raid-disk (taken from a raid-1 sstem). Put it into a new system already, but this system doesn't have any raid.
When viewing "fdisk -l", it said /dev/sdb doesn't contain valid partition. Is there anyway I can mount it now? I am on CentOS 4 box
View 2 Replies
View Related
Mar 24, 2009
MY server configure our drives with RAID-1.
How can I check it my server configure with 3ware or software raid ?
Also please advise me how can I monitor raid configuration that my raid is working fine or no ?
View 8 Replies
View Related
Jul 11, 2008
I've been talking to the Planet about trading in my four and a half year old "SuperCeleron" (from the old ServerMatrix days) Celeron 2.4 GHz system for something new. As part of their current promotions, I've configured a system that looks decent:
Xeon 3040, 1 gig of RAM, 2x250GB hard disks, RHEL 5, cPanel+Fantastico, and 10 ips for $162.
Not too bad. I could bump up the ram to 2 gb for, I think, $12 more, which I'm thinking about and wouldn't mind some thoughts on. But, the thing that has me really confused is RAID. I like the idea of doing a RAID 1 setup with those two hard disks. But, the Planet wants $40/month for a RAID controller to do it. I really don't want to go over $200 a month!
Any thoughts on alternative redundancy strategies that might avoid that cost? Software RAID does not seem to be offered by the Planet, unless I can figure out how to do it after installation (is that possible?) Better ideas in general on the server?
View 14 Replies
View Related
May 23, 2007
Just curious what your thoughts are on performance:
2 SCSI Drives 10k w/RAID 1
or
4 SATA 10k w/RAID 10
Prices are not too different with 4 drives just being a tad more.
View 5 Replies
View Related
Jun 5, 2007
how well software raid can perform and how it compares to hardware raid. How does software raid actually work and is it worth it?
How should I look at be setting up software raid if I was going to? Would you recommend just to use hardware raid instead?
View 2 Replies
View Related
Dec 10, 2007
Which do you guys recommend of the following?
4x 73GB 15,000rpm SAS drives in a RAID 10
or
4x 73GB 15,000rpm SAS drives in a RAID 5 w/ online backup
View 9 Replies
View Related
Jul 17, 2008
I received an unusual question from a friend earlier tonight, and I couldn't figure out the answer to his problem, so I thought I would post it here and see if anyone has a solution.
How to configure your server to automatically add "www." in front of domain names?
For example, someone--let's say Bob--typed in [url] in his URL blank on his browser window, how can I make it so that my server automatically changes it to [url]?
I have noticed a number of major web hosts have the www automatically added in front--including webhostingtalk.com and google.com.
View 1 Replies
View Related