I have been reading about Amazon S3's service at [url] and I was wondering if it would be wise to use their service for a file host (like rapidshare..) I may be starting?
How good is their bandwidth and what is their policy on copyrighted material?
Or should I buy my own servers from an unmetered provider, such as alphared?
What's the best way to set up an automatic file backup to Amazon's S3 service? I have a Linux cpanel VPS. I have minimal VPS administration knowledge but at least the VPS is managed by a good team
Is there any way to do incremental backups to save on the bandwidth charges?
(a full backup for me would be about 15 gigs each time)
I'm building a kind of a file sharing site also with video conversions ( convert a full DVD to flash and stream) and if i can find more ideas, even more features. It won't be free (i'm not sure which way to go though, subscription-based or pay per bandwidth + storage) and it will support download managers. I'm not sure which way to go : Joyent or dedicated servers with RAIDs. If i distribute files over servers, and a users wants the files to be converted to flv etc., it will increase the server load, ( and if i put a lot of users in 1 server it will increase the load even more) so it won't be very good.
So i thought SAN for this, but couldn't find any hosts serving it ( especially for a reasonable price ). Joyent is close enough (Amazon S3 is very very expensive), but although bandwidth and storage prices seem good, server power is low ( and very expensive if higher ) Which way should i go?
I'm currently running on a VPS. My site allows for large file uploads and downloads, with files over 600mb in size.
The server has issues when the site gets three or more requests for large file downloads. I'm trying to grow this site to thousands of users and it is hard to do when the site can't handle even three.
I've been told by my host that I need to upgrade to dedicated. My VPS only has 512mb RAM and one large file download is eating up that RAM. This is causing the issue.
I'm a newbie and while I knew I was risking a bit by going with VPS I do find it a bit annoying that these guys advertise 1TB of bandwidth per month but I can't even support downloading 1GB at the same time....maybe it's just me...
Anyway, I am now looking into moving the large files and the upload/download over to Amazon S3. If I do this I am expecting my RAM usage on the VPS to greatly decrease. Is this correct? If my PHP code is running on the VPS, but the actual file download via HTTP is coming from S3, that should not be a heavy load on my box, correct?
any opinions on S3?
I have a site going that requires quite a large space/bandwidth host which allows hotlinking/streaming. Currently it's sucking up around 1.3gb space and 50gb/mo, maybe a tad less than that. My budget is low, I've currently been working off free hosts which has been a huge pain.
So basically I need a cheap host with moderate allowances, uptime with a decent speed. But because technically it's just a filehost which allows hotlinking/streaming (maybe even hotlinking protection), I don't need the other jazz to be working.
I saw Brinkster (which doesn't allow streaming, so good thing I didn't buy that) and webhostingpad, which both seem to get terrible reviews here.
I have a dedicated server for most of my sites and scripts
I'm starting a site (kind of like rapidshare, not really the same but for the purpose of this example, it might as well be rapidshare/megaupload/etc)
I want to run the main site off my dedicated server, but for the hosting of files, I want hosting that will offer good speeds/bandwidth/space
I'm not sure if I should get multiple 10mbit/sec lines, or one 100mbit/sec line, or what I should really do
I'm thinking about moving an account with one main domain and a bunch of addons from one cpanel host to another, using a whole site backup .tar.gz file. SSH does not appear to be an option at this point.
I just extracted the tar.gz to a local pc to get a look at what's in it. It has these 12 folders: bandwidth, cp, cron, dnszones, logs, meta, mysql, resellerconfig, userdata, va, vad, vf. Below these folders are also 14 unfoldered files, ranging from "addons" to "version."
So, will this work?
1. Does this mean the domains and all the addons will be set up with their original user names, passwords, and email accounts with all the same passwords, if I move everything to the right location? Will all the email accounts I've set up in my email client software work just as they do now with the current host?
2. How can I know where all these uploaded folders and files have to be moved once they're there?
3. Can I just upload the extracted contents to one location, or do I have to upload the unextracted tar.gz to a server, extract there, then move the contents wherever they need to be moved (but I don't know where things need to be moved now)?
I recently opened a shared hosting account with a new host.
Can someone advise on file/folder permissions I can set which will keep my shared host neighbors out?
While accessing my account via FTP I noticed I could freely view and download files from other users folders - their PHP, HTML, images, you name it!
I would like to be more private with my files which include PHP scripts, images, etc.
I already contacted the help desk with my host and the tech said shared access between accounts is normal (even FTP) and if I restricted permissions then my PHP wouldn't work for Internet users.
I'm not buying it. I should be able to set the permissions such that Internet users can execute the PHP and view images, without my account neighbors using FTP to download my files.
i want to build a fileshering web site, i know from the start that trafic to my site will be high becouse it is not a regular file host site and i belive that i will have a lot of downloads as service will be mostly free of charge.
from what i understand i will need massive servers or at least good servers with high data transfer speed , reliable up time , very big storage space and massive bandwith.
i understand that budget should be high for this and i am not cutting on budget, i thought on first starting low and then upgrading but the low point of this poject will still need to have the best i can find both in speed ,storage and bandwith.
can you reccomend what service or way i can use for this project?
what servers rapidshare use? megaupload? i know i am still at start but i want a clean start.
I am planning on starting a file/image uploading website using a custom script I wrote.
I was wondering if anyone who has had experience with these kinds of sites before could give me some info on the bandwidth usage, disk space, ect. And what kind of package I would need. I was thinking of a VPS?
version: Parallels Plesk Panel v11.5.30_build115130819.13
os: centos 6.5 (final)
I recently received this messsage from in my mailbox "Unable to generate the web server configuration file on the host <nsxxxxxxx.ovh.net>" which is coming now every hour for 4 days now.
I first tried to regenerate an apache conf file with the magic on my Centos 6:
# /usr/local/psa/admin/sbin/httpdmng --reconfigure-all
but it gives me this output:
Execution failed.
Command: httpdmng
Arguments: Array
(
[0] => --reconfigure-server
[1] => -no-restart
[Code] .....
At line 10 in my server.conf file I have a bunch of ipv6 address that looks like this:
NameVirtualHost xx.xx.x.xx:80
NameVirtualHost [xxxx:xxxx:8:5b11::1000]:80
NameVirtualHost [xxxx:xxxx:8:5b11::1001]:80
NameVirtualHost [xxxx:xxxx:8:5b11::1002]:80
[Code] ....
After the last update, I get this error:
Unable to generate the web server configuration file on the host <xxx.de> because of the following errors:
Template_Exception: nginx: [emerg] PEM_read_bio_X509_AUX("/usr/local/psa/var/certificates/certRHXRsQy") failed (SSL: error:0906D064EM routinesEM_read_bio:bad base64 decode)
nginx: configuration file /etc/nginx/nginx.conf test failed
file: /usr/local/psa/admin/plib/Template/Writer/Webserver/Abstract.php
line: 75
code: 0
Please resolve the errors in web server configuration templates and generate the file again.
the websites of my customer are not reachable now....
I'm trying to configure Apache logs to split logs files for every virtual host on the server
for example: {site1 .com} => copy access_log to /home/site1/public_html/logs {site2 .com} => copy access_log to /home/site2/public_html/logs .. {site3 .com} => copy access_log to /home/site3/public_html/logs
i want to also to make sure is the logs files updated in the real time
operating system is CentOs6, with Apache and cPanel
I'm build Plesk Panel for Linux and Presence Builder, I don't want my user can upload their website to hosting via File Manager. How can I do it...
View 2 Replies View RelatedAnyone ever use this service? I had an issue with tons of spam being sent to my mail servers from amazon, so I placed an IP ban on the entire Amazon network until the issue was fixed. They replied and said that it was coming from an Amazon EC2 client and that it was handled...made me kind of curious about it.
View 7 Replies View RelatedMy services/sites approached the state when DS becomes a must. Currently I have a DS with Server Logix (and am quite satisfied with it, to add), but I suppose I'll need another DS in the foreseeable future, to transfer most active sites there.
Amazon EC2 service offers several types of 'elastic' servers. The smallest one, citing the product page::
1.7 GB of memory, 1 EC2 Compute Unit (equals 1.0-1.2 GHz 2007 Opteron or 2007 Xeon processor), 160 GB of instance storage, 32-bit platform
If run for a month, this instance would cost me 72$. Traffic (bandwidth) is paid for separately; I estimate I'd pay approx $20 monthly for traffic consumed.
The question: are there DS plans matching the EC2 Small instance (i.e., 100$ monthly for the server of similar configuration, with 120Gb of traffic included)?
I have tried the EC2 hosting, to test its efficiency and availability. I should decide, whether to switch entirely to cloud providers, or there are traditional DS hosting that could beat EC2 prices and offer good reliability?
All the comments on EC2 experience and DS providers would be very welcome.
I am interested in USA or Europe-based DS hosting providers, if any. I'd need a server in approx 3-4 months.
Signed up but never really had chance to play with Amazon's EC2. This looks interesting though - non-persistent storage was one of the major downside's of EC2 -
--------
Many Amazon EC2 customers have been requesting that we let them know ahead of time about features that are currently under development so that they can better plan for how that functionality might integrate with their applications. To that end, we would like to share some details about a major upcoming feature that many of you have requested - persistent storage for EC2.
This new feature provides reliable, persistent storage volumes, for use with Amazon EC2 instances. These volumes exist independently from any Amazon EC2 instances, and will behave like raw, unformatted hard drives or block devices, which may then be formatted and configured based on the needs of your application. The volumes will be significantly more durable than the local disks within an Amazon EC2 instance. Additionally, our persistent storage feature will enable you to automatically create snapshots of your volumes and back them up to Amazon S3 for even greater reliability.
You will be able to create volumes ranging in size from 1 GB to 1 TB, and will be able to attach multiple volumes to a single instance. Volumes are designed for high throughput, low latency access from Amazon EC2, and can be attached to any running EC2 instance where they will show up as a device inside of the instance. This feature will make it even easier to run everything from relational databases to distributed file systems to Hadoop processing clusters using Amazon EC2.
When persistent storage is launched, Amazon EC2 will be adding several new APIs to support the persistent storage feature. Included will be calls to manage your volume (CreateVolume, DeleteVolume), mount your volume to your instance (AttachVolume, DetachVolume) and save snapshots to Amazon S3 (CreateSnapshot, DeleteSnapshot).
Are the amazon's EC2/S3 solutions a viable alternative to dedicated hosting? The thought of capacity/bandwidth/computing power on demand sounds great in theory. Could it host a basic LAMP setup?
If you've done any research in this area i'd love to hear your thoughts. Are they apples and oranges?
I need a very short term solution.....1 - 2 months max
Both boxes ideally would be dual-quad proc minim.
Box 1 not alot of storage needed. Web and DB server running Oracle
Box 1 - storagewise, would be 4 tery requirement.
LOTS of bw inbound and possibly outbound as well.
Has anyone used Amazons EC2 service ?
Inbound & Outbound traffic will be stateside and internaional sources.
I have a new comparison shopping site. The challenge I currently have is that I have a dedicated server on Hostgator ($374 per month). But, I am in the middle of changing programmers after initial problems. While we are working through issues, I would like to bring down costs (there is very little traffic on the site right now).
Does a service such as Amazon EC2 make sense? It is not that I am unhappy with Hostgator. I just want to reduce cost while we fix the site (could take several months), and, position the site for easy growth (which is why I am considering Cloud Computing).
Comparison shopping is a large database intensive effort, so I do not think that a simple "shared" service makes sense.
I've visited their web site (aws.amazon.com), but it seems kind of vague to me. Is AWS the same as S3? (which one does web hosting?) You can host web sites on Amazon's service, right? Do you get the usual stuff? (mySQL, PHP, etc) Do they offer SFTP? Shell access?
Man, I feel like they need a FAQ or a list of features. How come none of these things are mentioned on their site?
Has anyone looked into hosting on Amazon Web Services EC2? It seems to me that a Elastic Compute Cloud node would be a far better solution than a VPS or a dedicated server.
View 14 Replies View Relatedwe recently launched a site that has a you-tubeish clone to it, none the less the media progressive download bottlenecks the the rest of the sites functions beyond video...
I've been looking into solutions with moving the files elsewhere.
I was looking at Lime Light Networks but they were $1/gig, granted i'm sure their service is great but we're currently moving 3tb and have been going up around 500gb every month. So we really can't afford that.
I just stumbled on Amazon S3 and that looks real attractive, has anybody used their services or know of a site that does that I could test it out.
And the last stupid question, I'm trying to figure out how it works, they make it sound like all you have to do is put a CNAME in your zone, but I need the video clips to be put there as they're uploaded...
I am launching my site with Amazon EC2, which is a social network (webcams, videos, albums, etc)in PhP, Linux; and I am going to need someone who can do the virtual hands for me, site administration.
View 11 Replies View RelatedI did not put this under the tutorial section because it is not comprehensive enough. Its just a simple rant.
Those of you shopping for a host come to this forum, and are often given the advice to ask for a "test file" to download.
1) Hosts who offer test files will most likely put the file on their fastest server, not the server where your site will actually be hosted.
2) If they have servers in multiple data centers, they will use the one that is the most well-connected, not necessarily the one where your site is going to be.
3) Even if your account is assigned to the same server as the test file, what does your ability to download a static file actually prove? A test file does not show how well a server is going to perform, which is usually the biggest factor in page load times.
4) Barring all the above, and assuming your site is going to consist only of static files, most web site visitors are not all in the same area, so your results may differ from the rest of the people visiting your web site.
A test file can be helpful in rare circumstances, but as a potential customer you would have no way to really know whether your download is a true test of what you can expect, so it is best not to rely on something like that unless you are downloading it from your own hosting account with that host.
The only way to really know how a host is going to perform is to try it out. This is why hosts offer full money-back guarantees and free trials.
I am thinking of running my main MySQL 5 database from Amazon Elastic Cloud Computing (EC2)....
View 5 Replies View RelatedJust curious if anyone has some case studies/feedback regarding using Amazon S3 (or similar) services as a way to offset hosting needs and costs.
By that I mean being able to use a lower config server or less bandwidth because media/content is hosted on Amazon servers.