Synchronizing And Balancing 2 Geo-separate Servers
Jul 16, 2008
I know this is not an awesome idea, but I'd like to try it. A friend and I want to share (home) servers. We both have fairly decent upload and we both have nice (dual core, 1GB RAM+) servers, so that's good. Another thing I'd like is failover for when one of our servers go down (I've got that part covered with my own DynDNS client). We're both running Windows servers.
Since I cant really use a load balancer in this situation, we'll be using round robin DNS. Now here's the questions:
How do we keep our MySQL servers synced?
Should I use rsync or something else for files?
How do we handle PHP sessions across servers?
If you don't think the load balancing thing will work out, I'd still like to do synchronization and failover. My friend is in another state by the way, we're not neighbors or anything so we can't just run some cables from one house to the other.
Here is what I am trying to do, to set up a WordPress powered site to be run across two servers for load balancing. The two servers are dedicated and I have the load balancing software installed and set up. I need to set up the site so that both of them are accessed, but to also have the same content. The main concern is for the same content.
WordPress uses a MySQL database to place all of the content there, so the main thing I would need is to set up the databases so they are synched on both servers, so that the same content is showing up on both of the servers, and so I don't have to manually upload data to the database every few hours, that would suck. I have already found a script to connect to a remote mysql server, it is called HyperDB, but I was wondering if there are any better ways.
I was wondering if it is possible to cluster 2 web servers and 2 mysql servers with only one server working as load balancer.
I am planning to use LVS (ldirectord and heartbeat).
Let's say I have 3 IPs allocated to the load balancing server.
111.222.111.222 (Main IP) 111.222.111.223 (Web Load Balancing IP) 111.222.111.224 (MySQL Load Balancing IP) If a connection is made to .223 it would pass the request to one of the web nodes. If a connection is made to .224 it would pass the request to one of the MySQL nodes.
Is it possible to do this?
If not, can I run, for example, nginx on 223 IP address to provide forward proxy? (Then it would not be able to HA but the main point is to load balance so)
Also, what would be the best way to keep the data same on both web servers? This is a web cluster for a very high traffic forum with a lot of uploads every hour so it has to do real time synchronization. I heard that DRDB is only one way and not two way so I'm not going to be able to use this.
I'm more of an application programming guy than network/internet guy so excuse any ignorance on my part.
I am currently using shared hosting on an IIS server.
I running SMF Forums and a business on the IIS server. I have a payment system that I've programmed tied into the MySQL SMF database. This payment system uses ASP.net. I'm a .Net programmer. SMF is also being currently ran on the IIS server, and it does ok.
I'm really wanting to start running my forums on a separate Unix Server.
So my question is, can i run my ASP.net scripts on my IIS server that access the MySQL database on a separate Apache server? The Apache server and IIS server would have different domains (I'm guessing that'd be required).
I think this is possible, but wondering what others think. All I should need to do is change some connection strings on my Web.config on my IIS server to point to the new SQL databases.
I've setup two servers with Webmin on them. One is a master nameserver, and the other is a secondary nameserver.
I've setup a third server with DirectAdmin, and ofcourse, DA installs everything for you. When I add a domain on DA.. it asks me to do all the DNS stuff there too.
Now, from what I understand, if I add a domain to a server, I host its DNS on that server too. Correct?
But then again, I've also seen many installations where the DNS servers are two completely different, even geographically, servers. And the main http/mail/db server(s) are different too.
here's my current setup has my stuff running on 2 separate "self contained" servers (eg; each runs their own apache/php/mysql):
Main site/server: content: mostly static content (no mysql, very little php). currently has about 4tb/m traffic. in the summer it could push up to 6tb/m hardware: P4 2.8ghz. 1gb ram. this server has no problem handling the load. only problem is bandwidth (i have to get it off the current host)
Forums site/server: content: running vBulletin. currently 400-500 peak (probably jump to 800 peak this summer) users active per 15 mins. hardware: 64bit dual Opteron 242. 4gb ram. it's absolutely griding that to a halt at peak times. it acts like 4gb memery isn't enough (it will run fine then eat through most of the 4gb. grind to a halt, then recover) personally i think it was setup/configured wrong but i've had multiple people look at it and nobody can find anything wrong in the apache/mysql settings.
What I want to know: what type of server setup should I start migrating to? should I keep both parts of the site separate? eg; main site on one server, forums on another server(s)?
what i've sorta been looking into is 3-server setup. (server1) main apache/php server. probably on unmetered (honestly don't think i'll find anything else that offers high enough traffic). run the main site and the vB php from here (server2) dedicated mysql 'read only' server (server3) dedicated mysql 'write only' server.
and have mysql read/write synced and have all 3 servers networked directly together. i have a friend running a single mysql driven site using this setup and it works really well for him.
is this overkill for me? should the current dual Opteron be able to handle the forums and i just need to hire someone smarter, or is there some other setup that would work better for me? i'm tight so i want to go cheap as possible, but I also realize i need room for summer traffic expansion that always hits us.
A couple days ago I bought 3 Dell Precision Desktop 360s for the purpose of Load balancing for a web server supporting Apache/php/mysql.
The Dells have: Code: Win XP Pro, 1 gb 3200 ram - can support up to 4, p4 2.4 ghz, 2 scsi raid 36 gb hdd How can I create Load balancing between 3 identical* web servers: by SCSI, network, or something else?
* Bought them all used. Quality tested the hardware, all of it identical.
is there any way to do this? I know the clustering system built into whm is only for DNS, not for actually serving websites. What I would like is that visitors to a site could be directed to one of two servers, transparently (no www.server1.site.com, www.server2.site.com, it looks idential but are just directed to different ips).
1. Is it possible to get a server in US and a server in Europe and load balance the two servers so that it would detect where the user is from and based on the users location, it would send the traffic to the right server? is this something a load balancer can do or does this have to be done on the php end to detect and send to the right server?
2. is there a way to sync the two servers meaning, we upload the files to one server and the other server automatically gets updated or synced with the original server?
There's something I've been desperately trying to resolve, but failed, and the question is can load balancing solution be applied to a shared hosting plan, will I need two plans in this case? Or is it only possible for dedicated servers?
Does any host provide load balancing (round robin will be the most frequently used type, I guess)? Questions to those using Serverpoint.com and Hostgator.com do these hosts offer load balancing?
I'm looking for a reliable hosting provider with a well-connected network and a responsive customer support team. I like my current provider, but they can't handle DB clustering, SANs, etc.
Details are below. I would provide all of my own OS and DB software. Suggestions based on first-hand experience would be appreciated ......
Hello, we have a few web servers that run Windows 2003 Server and IIS for web page hosting. We develop custom applications and don't do "web hosting" per se.
What is the best way to do this in a load balanced environment? We have a Cisco load balancer out in front of these servers, but I'm curious about the following:
1) Is there a way to replicate IIS entries instead of having to configure the site on each server?
2) How does everyone handle file replication (hopefully in real time) across all servers?
I have a small dns cluster with 4 servers, the problem is that when i want to update a dns registry one of them doesnt sync, i have to try like 6 or 8 times to get that server to sync with all the others, and im concern because the one who gets trouble to sync is my secondary dns server
I have been running 1 site on my VPS for some time, but there is still a lot of things I don't understand 100%. Now I want to add another site to the VPS, but keep the sites as separate as possible, and I have no idea how to accomplish this.
Lets say my first domain is football.com. This means I have these settings:
I got 3 IP's: x.x.x.1, x.x.x.2 and a new one x.x.x.9
My hostname is host.football.com (x.x.x.1) My site is www(dot)football.com (x.x.x.1) Nameserver NS1.football.com (x.x.x.1) Nameserver NS2.football.com (x.x.x.2) Reverse DNS on x.x.x.1 to host.football.com Exim running on x.x.x.1
Lets say my second domain is water.com. It's no problem using WHM and run this site on x.x.x.9, but there is a lot of references to football.com (nameservers, hostname and probably emails).
Is there anyway to keep the sites separate? I'm thinking that I need to request 2 new IP's, run NS1.water.com and NS2.water.com on these. I don't know if I can get a host.water.com with reverse DNS, and I guess emails will still be from x.x.x.1.
I have a server with lots of sites and about a hundred MySQl apps. All of them are configured to talk to localhost and work fine. But I'm trying to move the MySQL off to a separate box to increase performance.
So since everything was configured to localhost my idea was rather than change that what I would do is set up an SSH tunnel to the new server running MySQL. Seems like that should work, but it doesn't.
I set everything up on the new computer. I shut down mysql copied all the files over, started MySQL on the new server. Everything tested fine.
Then I established the ssh tunnel and everything looks good, but the applications just didn't see it. I did some experiments and if I set it to 127.0.0.2 it works, but not on 127.0.0.1.
I am setting up an internal network for management only. So, assign an IP for the second NIC, and activate it, but it seems not working. I have tried this
#ifconfig eth1 192.168.2.14 netmask 255.255.255.0 broadcast 192.168.2.255 #ifconfig eth1 up
checking dmesg, it shows the NIC is up # dmesg ADDRCONF(NETDEV_UP): eth1: link is not ready tg3: eth1: Link is up at 100 Mbps, full duplex. tg3: eth1: Flow control is off for TX and off for RX.
checking routing table seeing the 192.168.2.x routed through eth1 # route -e 192.168.2.0 * 255.255.255.0 U 0 0 0 eth1 192.168.1.0 * 255.255.255.0 U 0 0 0 eth0 169.254.0.0 * 255.255.0.0 U 0 0 0 eth1 default reserve1.somename 0.0.0.0 UG 0 0 0 eth0
Repeat those steps for other boxes, but when pinging, all return errors # ping 192.168.2.20 PING 192.168.2.20 (192.168.2.20) 56(84) bytes of data. From 192.168.2.14 icmp_seq=1 Destination Host Unreachable From 192.168.2.14 icmp_seq=2 Destination Host Unreachable From 192.168.2.14 icmp_seq=3 Destination Host Unreachable
Before I went to register with GoDaddy, I looked back at some web hosts I was considering. Some real good ones include free domains. What are advantages to bundling a domain with the hosting package? Is setup usually quicker? What if, at the end of a yearly contract, I decide I want to host my site with a different company? I certainly hope domain names are transferrable around the expiration period.
Anyone aware of a hosting company with all of their hardware in Canada who offers in their basic accounts the ability to host multiple domains without using sub-domains or sub-folders.
I want to host several domains with individual administration and security so that a bad script or hack of one wont affect the other domains.
Is there anyone here using Softlayer for Windows dedicated servers but at the same time using a server management company to manage the same?
I use Platinum Server Management for my Linux server, but they don't do Windows. I'm looking for a Windows server management company who has experience with Windows 2008 Enterprise and MSSQL 2008 Standard.
I found the page listing all of the 3rd party server management companies, but what I want to hear are successful marriages between Softlayer and the management company based on experiences of real users here.
my vbulletin site has been growing significantly and the server has crashed many times due to the high loads. My server guys tell me that mysql is hitting loads of 30 (not sure what that means) and i need to get another server for mysql alone.
They recommend that I shld go for raid-5 for the mysql server due to performance and redundancy. Thus if i was to upgrade now, I shld just go straight for a raid-5. Is that true?
if it is better to host two related websites on single host or on separate servers?
currently we are hosting three related websites on 3 separate webhosts. one in US, another in UK & another in Nepal. can anyone please explain if is it better to use single webhost?
I'm starting to see this, or maybe it's always existed, but it seems like bigger sites are hosting their images on external servers. I've even seen some sites use Flickr as the host for all of their images. I guess for Flickr that means you have a guarenteed image CMS, but I really don't see that as why Flickr was created.
I'm sure there are bandwidth advantages, and maybe that's the main reason. Is there a point where the traffic gets so high that moving images off site would improve load times and sever loads? Is it a worthwhile endeavor for smaller sites? I'm curious to see what the thoughts are on this trend.
My family is getting into the blogging business and they want to be hosted together to share costs. What features should I look for in hosting 4 or 5 small but growing blogs?
Info that may help you give a recomendation:I plan to have a separate url for each blog's root directory.
I plan to use wordpress.
I want each site to have it's own email addresses.
In an effort to install an SSL cert for a subdomain (secure.domain.com), I recreated my accounts in WHM. Account 1 has userA and domain domain.com, and Account 2 has userB and domain secure.domain.com. I think I have everything back to normal, but I want to get everything stable before testing the cert install.
My question is, when visiting cpanel.domain.com, to enter the cpanel for that account, I am able to login with both userA and userB credentials, and the same when logging in to cpanel.secure.domain.com. As stated, I have separate WHM accounts for the main domain and the secure subdomain, I have dedicated an IP address for the secure subdomain, and the main domain uses the share IP address, and also, there are separate DNS zones setup for the secure subdomain and the main domain.
How do I set it up so that only userA can login to cpanel.domain.com and only userB can login to cpanel.secure.domain.com? Or is this not an ideal setup, and if not, what would be the ideal setup here?
We have a VPS service with ServInt to host only our website (www.ourdomain.com for example) and not our email - the nameservers are also not on our VPS. This all works great but it means that any emails which are sent from our VPS to xxx@ourdomain.com are getting routed to the VPS and not the email server and so are being dropped.
Is there a way around this because ServInt support seem to be stumped because they have suggested the only way to fix it is to setup nameservers on the VPS instead of where they are now?