How do I setup a site to use two servers? One as a mysql server and the other as a web server.
At the moment I have the site on one server. When I get the second server what steps do I need to take to make this possible?
How do I secure the mysql server to only allow the web server to connect to it?
Do I need a control panel (i.e. cPanel) software on the mysql server?
Here is what I am trying to do, to set up a WordPress powered site to be run across two servers for load balancing. The two servers are dedicated and I have the load balancing software installed and set up. I need to set up the site so that both of them are accessed, but to also have the same content. The main concern is for the same content.
WordPress uses a MySQL database to place all of the content there, so the main thing I would need is to set up the databases so they are synched on both servers, so that the same content is showing up on both of the servers, and so I don't have to manually upload data to the database every few hours, that would suck. I have already found a script to connect to a remote mysql server, it is called HyperDB, but I was wondering if there are any better ways.
I was wondering if it is possible to cluster 2 web servers and 2 mysql servers with only one server working as load balancer.
I am planning to use LVS (ldirectord and heartbeat).
Let's say I have 3 IPs allocated to the load balancing server.
111.222.111.222 (Main IP)
111.222.111.223 (Web Load Balancing IP)
111.222.111.224 (MySQL Load Balancing IP)
If a connection is made to .223 it would pass the request to one of the web nodes.
If a connection is made to .224 it would pass the request to one of the MySQL nodes.
Is it possible to do this?
If not, can I run, for example, nginx on 223 IP address to provide forward proxy? (Then it would not be able to HA but the main point is to load balance so)
Also, what would be the best way to keep the data same on both web servers? This is a web cluster for a very high traffic forum with a lot of uploads every hour so it has to do real time synchronization. I heard that DRDB is only one way and not two way so I'm not going to be able to use this.
Calling on all hosting and server experts here. (If you're not an expert, still feel free to take an educated stab at this. But please leave out total made up answers or foolish answers like "Have LittleJoeShmoe Hosting services do it all for $9.99/month".)
Scenario:
If you knew or were planning on developing a site that you knew would generate millions to tens of millions of page views a day, how would you go about supporting a site of such traffic? The site would not serve up videos, but the average page size would contain up to 75-100kB. It would incorporate databases (user logins, accounts, user submitted content, server side scripting, CMS, etc.)
Don't assume anything. Don't assume you have too little or too much money. Just, what would you plan out to accomodate such a scenario?
What hosting companies would you use? Would you do it in-house and build your own datacenter? Farm out the server management? How much would it cost to implement your plan? What platform would you recommend for a site to handle this much traffic?
I plan on purchasing a dedicated server to run a few proxy sites. However, i don't have a lot of Linux skills to administrate my own server. But i've always been able to figure stuff out so i feel pretty confident that i can get it going on my own. Anyways, My original idea was to use cPanel to run the web server for the proxy sites however i feel that using cpanel is not a great idea since i also wanted to maximize my servers performance and i hear cPanel can take heavy resources. So anyways, I just wanted to know what some other people here might think and if possible any recommended guides on setting up a linux webserver would also be appreciated as well.
View 4 Replies View RelatedI know this is kids stuff to you guys but i wanna verify how to that correctly.
I have a dedicated server with cpanel. So i setup nameservers there. like ns1.ABC.com and ns2.ABC.com
So now i wanna host ABC.com in that server. My registrar is Godaddy.
So how to setup at godaddy? can anyone guide me.
Is it like make hosts like ns1 and ns2 and put the IPs from the server in the fileds?
Then i have to put the nameservers fileds also ns1.abc.com and ns2.abc.com too. Or just making ns1 and ns2 hosts enough?
I run a large adult vBulletin community with 70,000 members, 1/2 million posts, 186,000 attachments (a lot video), and closing in on 100 million downloads since our start some odd years ago. I've been battling keeping the site up for quite some time, and I am starting to wonder whether we shot too low on the server setup. I figure I would ask the pros here at WHT for some advice.
This is our current setup:
Site server:
Quote:
CPU: Intel(R) Core(TM)2 Duo CPU E4500 @ 2.20GHz
4 Gig ram
250 Gig sata harddrive
Unix FreeBSD 6.2
Apache
MySQL server:
Quote:
CPU: Pentium III/Pentium III Xeon/Celeron (2666.62-MHz 686-class CPU)
Cores per package: 4
4 Gig ram
750 Gig SATA harddrive
Unix FreeBSD 6.4
Apache
Do you think the site would perform better under one server and maybe a more powerful processor? What should I be looking at exactly as far as hardware goes for this type of site. I should note we push about 2.5TB of bandwidth monthly.
I am currently moving from my current dedicated servers because they simply cannot handle the load. I have a site which frequently makes it onto radio, digg and other similar sites.
I need a dedicated server that can take a beating from Digg and offline Media. For most of the month the server load is really low, the site hardly uses up anything. However, when it hits those sites, it suffers.
I am OK with using Shell, just basic tars/logs/sqldumping/httpd.conf editing/rebooting etc.. anything beyond that like installing and configuring software I cant really do.
I guess I am looking at a dedicated option (linux based) with a host that'll setup software/modules modules for me when I ask, but doesn't really need to hold my hand all the time.
How are ThePlanet.com's servers? Do they manage the servers?
I have 2 servers. How do I setup the DSN for these 2 servers with my domain? For example, I have domain "mydomain.com" and server1 and server2. I want
ns1.mydomain.com, ns2.mydomain.com --> server1
ns3.mydomain.com, ns4.mydomain.com --> server2
Both server installed cPanel/WHM.
We are currently looking into getting a new setup to serve our online store, and I would be thankful for feedback as to which servers to choose.
Today almost the entire store is on a single three year old dual proc/dual core server (4 gb ram, RAID5) that is beginning to get overloaded. (There is also a simpler secondary server that serves some static content and does some cron jobs.)
The system is a in-house developed LAMP (where the P is mod_perl/Mason). The database is rather large, two tables with 2-6 million rows are hit multiple times on most public pages - these grow with ~10% per year. Several other often-used tables are in the few-hundred thousand to a million rows, also continuously growing.
We anticipate rapid sales/visit growth over the next couple of years (a good day today is 6000-8000 visits), so I'm thinking of separating the database and web server. The most likely hosting candidate right now is Softlayer's WDC data center (we are located in Europe).
With that background, does this sound like an adequate setup:
Database server
Dual Xeon 5430 - 2.66GHz
8GB ram
RAIDed 3x73GB (or possibly 147GB) (15k rpm). I'm thinking RAID1? The big tables are not written to too much during the day, so read performance is more important than writing.
Web server
This (these) would be serving the Apache/mod_perl part of the system. Some static content (images and some PDFs) unless we put them on a separate server (all static content are placed in a single folder so it would be easy to do a mod_rewrite to an image server).
Dual Xeon 5050 or 7320
4GB ram
2x73GB (SCSI 10k rpm) RAID1
I don't think we need to load balance between two web servers from the beginning but that is something we will keep in mind (and hopefully have to do at some point). Are the two configurations sane (or is one overkill compared to the other)? Generally, how many web servers can a single database server serve? Email is handled separately (Google Apps). I estimate our budget to not more than $1000-1500 a month (if we go with Softlayer we will most likely use some other services such as firewalls, SAN and so on).
We currently use Suse, I have previously used RedHat on personal servers at ThePlanet. Is RedHat 4 32-bit a sensible choice? I have some experience with CPanel so we would most likely use that.
I've taken the scalable approach when it comes to servers for my various sites. With shared servers, I never really worried about backup or even hard drives going down. Same goes for VPS. For some reason, when I moved to dedicated servers, I outfitted them with 74GB SATA drives in a RAID setup. My understanding is that it protects me if one drive happens to fail. I've been lucky and haven't had that problem.
I'm at the point now where I'm looking to upgrade from a VPS paying around $75 per month to a dedicated server. I can stand to be down a day if a hard drive goes, if it means $75 a month in savings. My biggest concern would be suggestions on the best way to protect myself in the event of a catastrophe.
Contacted SoftLayer about possibly adding a second server for me and honoring the price I'm paying on my old server.
Finally, both the old and new site are seeing roughly 3,000 visits per day. The server I'm considering is a Clovertown 5320 1.86 dual quadcore, 4GB RAM, RAID, 2 74GB Cheetah drives,100mbps, 2000GB bandwidth. Is this overkill or the right server for the job?
We're building a bunch of new servers (as I mentioned in another thread). What do you guys think is the best drive layout? Traditionally we just have the entire 4-6 drives in a RAID 5, but now I'm wondering if it makes sense to have a separate OS drive, and then the rest in a raid 5?
On a side note, we need a giant ~2TB-3TB partition on these boxes, that's why we go with the multi-drive raid setup. Thoughts? I know it was customary to have a separate OS drive back in the day (I remember having WD raptor's for that), but now when the WD Black-edition (which we'll be using for the raid setup) are as fast as the raptor's, is it even worth it?
I have a server at volumedrive it has cpanel and whm installed etc I am trying to setup the name servers but everytime it fails is there something that I might be missing?
View 4 Replies View Relatedsome setup recommendations as I feel I have outgrown my current server.
I have two websites:
#1 is a busy vBulletin based forum with 42,000 members.
#2 is a website with Wordpress and Vbulletin installed (though the forum is nowhere near as busy as the first site) and gets roughly 2000 uniques a day.
When site #2 gets a good surge of visitors from offline media or a large site, site #1 will die first with the "mysql error: too many connections" error and site #2 will take a very very long time to load.
For every other day, the load is quite low, nearly always under 1.50.
The current server that both sites reside on has the following specs:
Quote:
processor : 0
vendor_id : GenuineIntel
cpu family : 15
model : 2
model name : Intel(R) Pentium(R) 4 CPU 2.66GHz
stepping : 9
cpu MHz : 2667.540
cache size : 512 KB
fdiv_bug : no
hlt_bug : no
f00f_bug : no
coma_bug : no
fpu : yes
fpu_exception : yes
cpuid level : 2
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe cid xtpr
bogomips : 5339.18
total used free shared buffers cached
Mem: 1003 484 519 0 3 192
-/+ buffers/cache: 288 715
Swap: 2047 25 2022
What sort of setup would be best for me?
A files server and a sql server?
A server for site #1 and another for site #2?
A single, more powerful server?
Or something else you recommend?
Also, for the setup you do recommend, can you recommend a hosting company that is reliable and can do it for a good price?
The data centre which I use, is moving all collacated servers to a brand new data centre next week, which will mean a two hour downtime for each of my servers and customer websites.
At the moment my servers utilise two nameservers on seperate servers and when the move happens all websites will be offline with an ugly error message to any visitors.
Does anyone know a good way to setup a page which would be displayed if the web server was down? I am using MS DNS.
My thoughts so far is
1. Setup a 3rd nameserver which is off site from the data centre.
2. Purcahse web hosting / vps for a month on a seperate hosting company
3. Set it up so that it accepts * to a specific IP address in IIS or apache
4. I create an index.php script which gets the host header value sent i.e. [url]and the page then displays a nice maintenace i.e
"We are sorry joeblogs.com is currently down for maintenace, we will be back online shortly".
I think my main question is do I need to setup a 2nd www record in DNS for each site and how do I ensure the 2nd dns (backup record) only gets used when the first website / server is down.
what is the setup time of leaseweb servers after payment?
View 4 Replies View RelatedI've just initiated myself to splitting the load between servers... in this case, one server delivers all the html/php/mysql/emails, another serves all the images... its an auction site so there are loads of images.
Just did some testing using Firebug, with 20 5-10kb thumbnails loaded from the image server, everything else from the original server... the results speak for themselves:
no browse cache:
current - 11.7 seconds
test - 5.6 seconds
refresh (checks modified date on some/all files I believe):
current - 8.6 seconds
test - 4.1 seconds
I'm not testing scientifically or anything but these times were fairly consistent over a few dozen trials. Obviously also there are other factors with network connections, server loads etc. From my primitive knowledge I figure that if you fork the requests down 2 or more paths, instead of just 1, then you are virtually doubling the amount of requests that are taking place, hence the page loads faster.
Is this consistent with what others have found? In this case I figure the images are the common denominator so having them on the 2nd server makes sense. I also understand that databases, emailing and other processes can be split onto a separate server...
On a final note, can I get a recommendation...
#server 1:
hosts html, css, javascript, PHP, MySQL databases, and sends emails... php 5 is required and security is very important
#server 2:
hosts images and will possibly stream videos... basically just a file system we can access from another site
What would be the advisable server specs and operating systems for each? They would not be under a heavy load for some time, but the idea is that they could be further expanded if necessary. I understand that lighthttpd is good for serving images?
and finally, I also require:
- a good host
- a backup solution
if anyone could recommend anything to me at this point that would be great!
P.S. don't worry, i'm not setting the servers up myself - but i'm kindof in the position where I have to make the decisions!
Off Topic:
woohoo! 1,000 posts!
We have two in-house servers, one is hosting our public web server. The other one was just purchased to host a mirror of the production server (as a backup). The site is protected by an SSL cert... my question is how do i set up the server(s) so if/when the backup server needs to be switched into produciton, the SSL cert will transition flawlessly?
They are both apache 2 servers.
I run a website that gets a huge spike in traffic approx. once a month for 24 hrs.
Can you mirror one site on two separate servers and add load balance via the DNS records on godaddy.
exmp.
ns1.siteone.com
ns2.siteone.com
ns1.sitetwo.com
ns2.sitetwo.com
Is this possible? If one server goes down will I loose 50% of visitors or will it all forward to the up server.
if you have MySQL replication setup, and DNS failover switches over to the MySQL Slave server in case of an outage...
Is that gonna work? Will the Slave suddenly just work as a regular non-slave DB?
Then when the primary server comes back up, how do I sync my changes back to the master db?
Would it be possible to split website components transparently across 2 servers and make it look like a single site? For example: run a forum on ServerA and a wiki on ServerB, but with the same base URL? Doing this will allow me to buy smaller servers instead of a single huge server.
View 9 Replies View RelatedLet's say I want to host DOMAIN.COM on one server, and FORUMS.DOMAIN.COM on another server.
View 3 Replies View RelatedIs it possible to resell servers belonging to some other site and yet not letting the customers come to know who exactly is the owner of the server?
Something like adding personal name servers to a reseller?
I would just like to no how you would load balance 2 sites. Would this be done via dns settings. EG
instead of seting the domain to something like
ns1.server1.com ns2.server1.com
would it be?
n1.server1.com ns2.server2.com
if I could get some input on this. Currently I'm running an Opteron 246, 2GB RAM with 2TB bandwidth/mo. I run a single site which is currently 99% HTML, along with an invision forum which is fairly popular. I get about 300-400k pageviews per day.
Right now the server is able to handle this stuff without much of a problem, and the average CPU load is between .5 and 3 (after a TON of tweaking!) - the only exception is when the forum db is being backed up/optimized, which isn't a huge problem since it happens during the off hours.
The problem is that I'm running out of bandwidth quickly, and need to come up with some kind of solution soon. My current provider offers bandwidth at $1/GB, which to me seems crazy compared to other providers, so that's not really an option.
I was thinking about switching to a more affordable provider and upgrading hardware, but I'm not sure what the best approach would be. I'm in the process of moving my HTML content over to a PHP-powered CMS, so I need to make sure whatever I do can handle that... What might be a decent setup for a site like mine which consumes a lot of bandwidth and will probably need more CPU power in the near future for PHP/MySQL stuff?
I have fairly a large web site that has a forum and a torrent tracker.
Currently MySQL server is handling about 150 queries an avarage per second.
Here is the server spec:
Core2Duo 2.66Ghz
4Gb RAM
320GB SATA 7200RPM (Server provider does not have 1.5K RPM nor 1.0k RPM)
100Mbit Connection (servers on the same switch and the switch does not have 1Gbit port)
MySQL Version: 5.0.51a
I had Master-Master Replication setup with forum running on one and the tracker running on the other.
Although this has been working for about few days, we started seeing lags in the replication process.
After a week, there is a major lag and the changes made on one of the servers takes about 5 hours to appear on the another.
So, this doesn't work.
What would be the other ways of splitting MySQL queries concerning the same database?
While I was researching, I read about MySQL Cluster with database storage engine being NDB.
But, let's say that there is a power failure on both the nodes at the same time, then I would lose the whole database as the database is stored on the memory correct?
I would not like to take that chance either, but if this is faster then replication method then maybe I will concider.
I thought about editing the forum coding to make all queries that concerns the tracker to go in to, say server B (with forum's primary MySQL server being Server A), and make the tracker use server B as MySQL backend, but it seemed like a heavy work so that will be the last choice.
I finally broke down and just got a cPanel license to fix my multiple account problems, and had it installed... But now I have a problem that I can't seem to fix - MySql won't update to 4.1.21, its stuck at 4.1.18 which means I can't use PHP 5+... I can't update to MySQL 5.0+ because my databases (Which I have yet to move over) are 4.1 and should probably stay 4.1 until I know for sure it won't break anything.
Does anyone know whats going on and how I can fix this? I've tried "/scripts/mysqlup" and "/scripts/upcp --force", as well as Apache update in WHM, and manual cPanel update in WHM.
Heres what it says when I use mysqlup:
Quote:
MySQL Setup Script Version 7.0
This is the MySQL installer for OS FreeBSD
mysql-client-4.1 (4.1.18_1) is already installed.
mysql-server-4.1 (4.1.18_2) is already installed.
Install Complete
My forum is becoming more and more active and i would like to know how to setup a website on two servers. Ive seen many sites using www0.example.com and www1.example.com. Is this difficult to do?
View 5 Replies View RelatedWe are developing a new web site that will be collecting private information (no credit cards - only names, phones, email addresses and potentialy addresses etc).
Our company will be based in the EU and the target audience will largely be located in the EU.
We were thinking of using some of the very respected US companies like theplanet or softlayer that have very good prices for a quality service instead of the more expensive and less flexible EU based solutions.
But I was wondering whether this would violate the EU privaxy regulations (not sure if softlayer or theplanet are part of the US Safe Harbor) or whether there would be a way to cover ourselves (e.g. special contractual binds with the provider (which i am hoping would be part of their standard SLA/T&C) or by mentioning in the Terms & conditions of our site that data will be stored in the US.