I'm working on a new project that involves some heavy data processing in the preparation stage. As an example, one of the setup jobs is now running on a P4-3.0HT desktop at 100% CPU and I estimate it'll be finished in just under a week! Memory and i/o usage are minimal but it's extremely CPU-hungry.
There are other similar jobs to follow and some correlation between the number of cpu cycles and the quality of results so I foresee an ongoing need for computing power for at least a few months.
Viable options are to continue running my own hardware (probably supplementing the P4 with something a bit newer), Amazon EC2 or a cheap dedicated server - I can get a good handle on the cost and performance of each of these.
But I wonder if I'd get more bang per buck from a few VPSs? Some of the VPS benchmark results are spectacular so I suspect the answer could be yes, in the short term anyway. But I don't want to hog the host-node's CPU to the point where it degrades other users' performance or gets my account shut down... Then again, judging by the performance of the VPSs I've used for hosting the node seems to have a lot of spare CPU available...
So (finally) to the questions: Am I crazy to even consider this? If not, which technology would be most suitable? (I'm thinking Xen because of its reputation for better isolation.) Has anyone else done anything similar?
I have two VPS's which run a single MySQL intensive site. The first VPS runs cPanel and has about 50 databases, 200mb each. Second has another 30 databases, of the same size.
What would be the best method to backup this website daily?
At Current; I use automysqlbackup to backup all the databases at midnight (this crashes the VPS's for about 10 minutes each night). This dumps each one into a zipped file.
Then the rsync copies the changed files (forum attachmenets, cpanel changes etc(whole server)) to an off site location.
Are there any easier ways to do this? The databases are most important!
Calling on all hosting and server experts here. (If you're not an expert, still feel free to take an educated stab at this. But please leave out total made up answers or foolish answers like "Have LittleJoeShmoe Hosting services do it all for $9.99/month".)
Scenario: If you knew or were planning on developing a site that you knew would generate millions to tens of millions of page views a day, how would you go about supporting a site of such traffic? The site would not serve up videos, but the average page size would contain up to 75-100kB. It would incorporate databases (user logins, accounts, user submitted content, server side scripting, CMS, etc.)
Don't assume anything. Don't assume you have too little or too much money. Just, what would you plan out to accomodate such a scenario?
What hosting companies would you use? Would you do it in-house and build your own datacenter? Farm out the server management? How much would it cost to implement your plan? What platform would you recommend for a site to handle this much traffic?
we are try SuPhp on Cpanel server but seem that is use a lot of resource, on 2 X quad core server we can't add more than 300 domains for server, whic configuration do u use? any alternative solution?
how do we know if our blog spent alot of resource on server (shared hosting)? can we monitor it, so if i knew i spent alot of resource i can move to another webhost (maybe VPS) before they suspend my blog?
My system usage is at 98.5% and the numproc out of 400 allowed 392 is in use It wasn't like this before and i have used up only 38% of the space alloted and cpu load is also at just 19%.
Could anyone explain me whats actually the problem of high system usage?
I own a dedicated server and have 3 cpanel for each of my 3 sites in my WHM, I was wondering how much resource would each cpanel account use?
Reason I'm asking is because I have a couple of other sites i'd like to add to this server but I'm not sure if I should simply add them as domain add-on's in one of my current cpanel accounts or if it's ok to create another for each site without using up my server's resources.
I am running a youtube clone on a VPS with 512mb ram at Lunarpages.
Whenever I log into Plesk, I find that my system usage is extremely high. 90%++ even up to 100%. However my CPU usage is often less than 5%.
This problem often occurs when there is slightly more visitors on my site. I am talking about only 30++ visitors and this problem will occur and my site slows to a crawl and I have to restart the VPS.
I am wondering if simultaneous downloads could take up a lot of CPU/Ram usage? Could a celeron server with 512MB handle simultaneous downloads and how many users can it support simultaneously? The server will be serving as a pure download, no database, no php, no cgi, no nothing. And what is the highest mbps this server could potentially reach?
i have one Question regarding MX-Records, i cant solve myself. Why is an MX-Record not allowed to contain an Ip or a CNAME-Record? As far as i know, the Record has always to point to an A-record which includes the Ip. Anyone here, who can explain why thats the case? Is there any RFC Dokument where this is explained?
I've been running website for several years, however, there's one thing that I've never quite figured, most likely because I haven't gone over to dedicated/vps yet.
How much memory would a static 10kb HTML use or for that matter a PHP page (static)?
I know it's quite a broad question, but I'm asking this as I might start a project and this one page may receive many hits. Oh and, would the memory usage go up if I have embedded objects from an outside source (e.g. embedded Youtube videos)?
I have seen posts that some hosts suspend a user after they so many seconds of high server resource usage... I was wondering how this is done so that I can do this on my dedicated server.
Time: Sun Sep 28 12:16:06 2008 +0200 Account: dbus Resource: Process Time Exceeded: 134303 > 1800 (seconds) Executable: /bin/dbus-daemon The file system shows that this executable file that the process is running has been deleted. This typically happens if the original file has been replaced by a new file when the application is updated. To prevent this being reported again, restart the process that runs this excecutable file. Command Line: dbus-daemon --system PID: 2015 Killed: No
How can I find which process runs this excecutable file ?
I recently migrated a load of domains from a pleks 8.? install to a plesk 12 one. As part of the migration a new reseller was created but all the resellers domains got "lost". They were all there and working but not appearing in the interface.
I did some googleing and fixed this problem and can now see all the domains and when I look at the reseller plesk tells me it has 0 own customers, 0 own plans and 0 own subscriptions. However, if I look at the resources tab it tells me that 7 domains out of unlimited are being used.I just wondered where plesk get's that info from and if it is safe to delete that reseller without risking the domains getting deleted too.
Is there any way to do resource throttling by subscription?What I would like to do is limit the CPU resources to all of the subscriptions equally, as some subscriptions are eating away the CPU all the time.
Version Parallels Plesk v12.0.18_build1200140606.15 os_Debian 7.0 OS Debian 7.7
I upgraded my hosting to DreamHost PS (http://www.dreamhost.com/hosting-vps.html) about 7 days ago, and after 3 days of evaluation i find no interest about it and decided to downgrade. But they rejected my request saying that the resource is too high, then came the long negotiation. My question now is, would domains parked(not hosted) at dreamhost ate up memory of my PS? Phase 1: Why didn't anyone warn me before the upgrade?
I wrote:
I found a few unreasonable facts about your statement of rejecting my downgrading request: 1. Dreamhost tempted me to upgrade when I was doing fine with share hosting;
2. Dreamhost didn't warn me with any condition or term of any kind, including downgrading would be rejected if memory reach a certain degree;
3. from the facts stated above, this upgrading thing is a total scam.
##comment: The upgrade took only a click of the button.
And their answer:
I'm sorry to hear you feel this way Ruiz. However, your accounts resource usage is above what will work on shared hosting. If we were to move you back, one of two things would begin to happen:
1 - your domains would affect the stability of the web server, slowing down other customers sites, or taking them down completely
2 - your own sites would begin to fail due to the high resource usage.
As such, we can not move you back until you've brought that usage down. However, I can understand why you would feel the way you do. As such, I'm willing to add a $15/mo subsidy to your PS service. What this means, is that the basic 150MB/MHz you have to pay for will be free, all you will need to pay for would be any resources you allocate beyond the first 150MB. If this is alright, let me know and I'll go ahead and add the subsidy to your account.Phase 2: Why my hosting suddenly ate up so much memory?
I said:
I haven't recieved any email mentioning that my domains are using too much resource BEFORE THE UPGRADE for almost ONE WHOLE YEAR, how come suddenly they are? Is it some kind of malfunction or misconfiguration of your PS that causes the problem? If it is, why should I pay for it?
They answered:
It isn't a "sudden" issue. Your sites have been using whatever resources they need for as long as you've been on the PS. It appears you've had spikes as high as 600MB of memory in your usage, and if you look at your graph over the last month: ...