how to handle the file storage of a youtube clone?
Is it just a matter of getting more servers with a few hdds or are there specialized companies that one can upload files over a distributed file streaming network?
The reason I ask is because I have thousands of gigabytes of videos and it appears to be impossible to upload it on 1 dedicated server or even a few.
I'm starting a youtube clone / streaming video site and I need some info on hosting and bandwidth.
1.) Does anyone have any information, or can provide me with a link to information, about the costs required?
2.) I know bandwidth is the biggest cost. Does anyone know what kind of prices I will be paying per gigabyte? I heard its 5 - 15 cents per gigabyte (and dropping) - is this accurate, and where can i get the best rate while still having a reliable host that can handle a lot of traffic? Is there any kind of a list out there?
3.) Besides bandwith, what other costs are involved - for example, is storage space expensive? Will I need a dedicated server, and how much does this run? Other costs?
The database has been changed. Some of the data has been altered
The tilte has been change to: Hacked By Genc_Rapci
i have found a nice script "phpmotion.com" and itīs freeee and i need help to upgrade the software of my vps.
i have a linux vps cpanel/whm
512ram guaranteed
30GB space
450GB bandwith...
how can i upgrade the gd library to higher version(captcha code not working on my sites)
and what is the command line to write on ssh console for this software:
- FFMpeg
- LAME MP3 Encoder
- Libogg + Libvorbis
- Mencoder and also Mplayer
- FFMpeg-PHP
- Be able to run background processes
to install in my VPS the vShare script and I have a headache with this issue, and I decide to contract an installation service. HostOnNet offers this service by $25.
I want to know if you meet this company or other that offers the same. I don't matter the price, if they are good.
I'm planning to buy a share hosting support media streaming, encoding and decode the video file like youtube, likeclub.com. or others
View 3 Replies View RelatedI am trying to figure out what file system to use for my server. It has 24 hard drives, 2 run the OS in RAID 1, and the other 22 are in RAID 10. When I was installing the OS (Ubuntu 8), I kept on getting problems when I tried to partition and format the second drive (the one with the 22 disks in RAID 10) and it keeps failing on me. I then changed the file system type from ext3 to XFS and it worked fine. I also gave it another try and did not partition/format the second drive and decided to do it manually once the OS was installed. When I did it it told me that the file system was too large for ext3. So my guess is that ext3 has a limit on the size of the file system it is being installed on.
Anyway, so I am wondering, is there any other file system that will get me the best performance, mainly I/O performance, that I can install? I would like to stick with Ubuntu OS. This server will mainly serve large files for download over HTTP.
Network File Storage (NFS), does anyone use it or find it useful?
From what I see are advantages:
- Raid redundant
- Good backup
- Cheap extra space
Cons:
- slower speeds read/write speeds?
Looking for someone to add on and change my point of view on NFS. Also if you like NFS what is a good model for us to get. We are currently looking at the the Dell PowerVaults...
I run several sites and all of them are hosted at invision. The main reason for having my sites hosted there is that my sites are "forum centered" and I'm very happy with the service that I have got over the last few years from them, so I don't want to change that.
However, I now wish to expand and provide my users with a file repository. The problem is, whilst hosting my sites at invision is fine, hosting my files there would be quite expensive...
Thus, I'm now looking for a host to host my files and nothing else. (I run chess sites, so I'll be providing my users with files and possibly a gallery. All legal material, of course).
I don't need any download manager or anything of the kind. Invision forums actually has its own download manager, and I can have my files hosted externally (i.e. other than on my site).
Thus, I'm looking for a host that offers specific packages for what I am looking for - I would not need scripting or any 'fancy' features, just file storage with FTP access.
How much space? around 1 GB, possibly 2 in the future, maybe 3 or 4 if I add the gallery one day.
And bandwidth, as people will be downloading files from my site.
I've been looking around, but it's just so difficult: they all offer webhosting services for people who need to have their sites hosted, etc. and that's not what I need.
Any recommendations?
I don't have any fixed budgets, my focus will be on price, speed and reliability. Preferably a hosting company which has been around for a while and has good reviews.
is there any web hosting that can be used as file storage (>10G) and cheap? I have some huge files, but many web hostings can not accept non-web-content files.
View 10 Replies View RelatedWhat's the best setup for me to have for a machine which will host web files that other servers have to read and serve to end users on the web?
For example, I have servers Web1 and Web2 serving the same content from Files1.
I assume it's best just to go with RAID 10 and be safe or?
More importantly for me, what's the best way for these systems to communicate? I.e.
what protocol should be used for the web servers to read the files from the file server?
I once used SSHFS for serving the same static files on a couple of machines from one location... but that's presumabely very slow (at the time wasn't a problem).
All systems will be running CentOS Linux.
is there a low end server just designed for receiving and sending large audio and media files?
like CPU should be minimal, as long as it can send and receive large files to and from a main server which has apache + php + mysql running in it...
would this be cost effective?
file storage service that can be used for backups and allows FTP access.
Do you know of any reliable service that also offers a free account?
Just got a letter from InMotion. They don't like I uploaded my backup files to them, which makes their hosting benefits totally pointless to me and I will be moving to some other cheaper hosting since I basically only use email.
So I need some place to store my backups... I need only about 5 Gb, and I don't care about bandwidth, as I don't plan to download them unless all my HDDs will burn or get stolen or something so I don't need bandwidth. And it should be no more than few bucks/mo.
For those host which are not overselling, they have obviously the space for file storage. But should they allow file storage on their shared hosting account, if they aren't overselling, and the files are legal?
Well, this can also be counted as a survey I need
It would be best if you provide a reason if your vote is no.
on good hosting setups for getting large amounts of disk space.
I would like to be able to offer up to 2Gb storage space for 100s, maybe up to a few 1000 users - any solution should scale well. The files would be static files that might be up to 400Mb in size.
It would be nice to be able to give users FTP access to their disk space, although it's not a core requirement.
I'm currently running on a VPS. My site allows for large file uploads and downloads, with files over 600mb in size.
The server has issues when the site gets three or more requests for large file downloads. I'm trying to grow this site to thousands of users and it is hard to do when the site can't handle even three.
I've been told by my host that I need to upgrade to dedicated. My VPS only has 512mb RAM and one large file download is eating up that RAM. This is causing the issue.
I'm a newbie and while I knew I was risking a bit by going with VPS I do find it a bit annoying that these guys advertise 1TB of bandwidth per month but I can't even support downloading 1GB at the same time....maybe it's just me...
Anyway, I am now looking into moving the large files and the upload/download over to Amazon S3. If I do this I am expecting my RAM usage on the VPS to greatly decrease. Is this correct? If my PHP code is running on the VPS, but the actual file download via HTTP is coming from S3, that should not be a heavy load on my box, correct?
any opinions on S3?
I'm completely torn on going the absolute budget route vs spending more for something that'll allow easy upgradeability in the future. I basically need lots of space but file sending-- media like mp3s, video, etc.
it'll be raid 5 and I'll need at least 2-3TB initially but the ability to expand would be nice.
option 1:
nice chassis with plenty of hotswap bays with sas expanders
expensive sas raid card
option 2:
cheap chassis to serve "immediate" needs and go with more later.
not sure what I'd use as a card? maybe even onboard?
regarding reliability: I once saw a database of failure rates of different models. raptor was the most reliable of the "desktop" drives. anyone have the link? I'm wondering of the seagate ES drives are worth the extra money vs the non-ES drives. they're supposedely more reliable and the "server versions" of sata drives.
One of my apps is based on querying Youtube API. My response times are badly slow: something like 2 to 3 seconds. The guys on YouTube APIs Developer Forum suggested that the response time should be more like <.5 seconds.
Would you guys do me a favor and post your results for this command:
curl -w "
Total: %{time_total}
" -o /dev/null http://gdata.youtube.com/feeds/api/videos?vq=dog
It basically queries the API and tells you how much time it took API to return the data.
Please post your result and the NOC/hosting company you use. I am now considering moving to another hoster.
I have a client who wants me to develop a youtube style website. The development i have no issues with, it's the hosting/hardware aspect with which i have no experience. I imagine if there are only 20 people on the site trying to encode videos that memory on a normal server could become an issue. I'd google for some answers but im not even sure what i would google for.
View 12 Replies View RelatedI have a problem with a customer. For the last 48 hours he has been receiving a massive DDoS at his server. I tried blocking the darn IPs but they keep coming and with several hundreds of connections each:
104 78.157.168.98
125 83.226.157.91
126 89.103.109.65
131 89.12.150.23
135 84.251.196.78
135 86.122.0.135
135 91.127.235.86
154 84.24.14.41
160 193.216.140.101
331 89.151.8.78
419 78.0.103.64
Apache has over 14000 connections. I tried using mod_evasive but didn't do anything and the server has been out without httpd for hours now. Any advices? This is a Hsphere server (I hate it personally) with 4GB RAM and a dual optero 246. I have the mexclients setting at 550.
Which VPS providers have the ability to clone an existing VPS?
Once I build my server, I don't want to have to do it again.
It seems like most providers don't offer this feature. What makes it so difficult?
How can I better monitor and trace down I/O spikes? I've noticed the wait hit 60% every now and again... could someone be running a rapidleech script and if so, how can i find it?
View 2 Replies View RelatedCan anyone with previous exp. in Video Hosting/Streaming provide me some info on THE CONFIG AND BANDWIDTH REQUIREMENTS FOR ffmpeg hosting for youtube like site?
Here are the basic things-to-know & Server(s) Funtions:
1. Do Video Conversions from AVI, MKV, etc to FLV/MP4
2. Stream out these videos for viewers.
3. Expected Traffic: Quite High (1 Million Visitors/mo)
So can anyone suggest me the most suitable Server Config, Bandwidth (I'd prefer dedicated-unmetered b.w) and Host for this?
Also can anyone provide me info on the amount of video conversions and traffic a single server (with your recommended config) can handle?
what VPS server will I be able to hear music or watch a trailer or youtube?cause my does not have a soundcard on it.
View 14 Replies View Relatedim not sure if "clone" is suitable for this meaning.
i know DRBD can let two server to do backup like raid1 does,
but DRBD is for linux only.
i want to ask for windows system,
are there any software or technology can do the same thing as DRBD does?
I want to prepare myself for getting dugg and whatnot, so I want to mirror my site ahead of tiem. The problem is that it's very db-intensive so there's a db that all mirrors would have to query. What's the best way to deal with multiple dedicated servers in order to spread traffic load and not crash my site?
View 3 Replies View RelatedI have a need to create about 50 clones of a user account. Obviously, they would each have thier own url and username.
I have WHM and root access to my server.
The reason I want to clone is because it will save massive time versus doing each one individually because the sites are exactly the same. My client is basically just using a parking page script.
I just purchased a 500GB ATA hard drive (meant to get SATA but must have misordered, but I don't think it makes that much difference) to replace a 80GB SATA hard drive on a Windows Server 2003 server. There are two partitions on the 80GB drive, and rather than add the new HD as a third partition, I would like to clone the data on the 80GB drive to the 500GB drive, then increase the partition sizes and remove the 80GB completely. Is there a specific method or software I can use to accomplish this?
View 4 Replies View Relatedto clone a scsi 73 GB into a 126 GB scsi hard drive do you know a software that can doit at OS level (windows 2003)
View 3 Replies View RelatedI have a dedicated windows server. I have it protected to the best of my ability (disabling administrative shares, anti-virus, anti-spyware, disabled remoted desktop, firewall, etc.). The purpose for the server is to host game servers. Over the past month, ive noticed massive amounts of bandwidth being used. For example Windows reports the bandwidth usage at a little over 2 GB in 1 day, yet on my control panel which reads the traffic from the switch, it shows that 9 GB have been transferred. I asked the colo what's happening and they said that traffic that is blocked by the firewall is still counted toward my monthly limit. But how can there be 7 GB of blocked traffic, keeping in mind i never had this problem months ago. As a test, last night i disabled all game servers and applications that use bandwidth. In the past day over 9GB has been transferred, despite the fact that i have nothing running that takes more then 50KB of bandwidth.
Aside from these bandwidth issues, everything is running fine, my passwords are still the same, etc. Is there anyway detect security holes, so that i may patch them when i reinstall the OS? I asked my colo for a security audit.
My question is, do you think my server has been compromised?