Load: Upgrade Server Hardware/software Or Set Up Cluster
Apr 9, 2008
We have a quad code with 8GB ram dedicated for one website, but still the load goes through the roof and crashes the server. The site has one vB forum (with minimum hacks), and a custom CMS for the front pages which uses a minimum of queries.
I'm not an expert, but it would seem like mySQL is the one that crashes. When the site crashes and someone browse the site, you can see the "could not connect to mySQL through socket" error message. At that point the load just skyrocket (been up to 4-500), and then the server crashes and has to be rebooted.
* Is our only option to make some sort of cluster?
* Could upgrading to i.eg Apache 2.x or installing an op code cacher like xCache help?
* Is it possible to run the databases from RAM to save IO (so it only writes to the HDD on update/insert/delete etc)?
I have root access, so if you need me to run more commands to look up statistics, just let me know.
I'm working on a huge project that will take like 2 months or so to release. The thing is, as I expect, this site is going to grow massively. My question is, How can I handle lot of traffic and give lot of space to my users? With a load balancing right? or server cluster? my question is? how does this work? where do I get it? what are the prices like?
All info on it is appreciated, i want to start with one from day one, so I can handle the grownth of the site once it happens.
I have a P4 2.8Ghz 1GB RAM dedicated server that runs one main site. The site runs vBulletin that I've extended to operate cross-site (keeping track of all members and guests) and receives around 10,000-12,000 daily unique visitors, of which the server can currently handle no more than 300-350 users online (based on a 15 minute timeout).
My top stats during CPU spikes (of which are occurring more and more frequently) indicate that the server is hitting the memory ceiling, so I need to make a decision on whether to upgrade the memory to 2GB or to purchase a new server.
Do you believe 2GB will be sufficient to solve my current load problems and maybe make room for a further 100-200 users online, or is this something that would require a better server (of which I have no idea what I would need)?
My company is trying to setup a large network to serve around 2.5 million monthly visitors. We are in need of a network consultant to help us out. Does anyone have any recommendations?
I'm looking for a reliable hosting provider with a well-connected network and a responsive customer support team. I like my current provider, but they can't handle DB clustering, SANs, etc.
Details are below. I would provide all of my own OS and DB software. Suggestions based on first-hand experience would be appreciated ......
it was very fast until mysql upgraded to 5.0.45 it was 4.. i can’t even turn my forum if it is a busy time cos it is so slow i get page not found after a while but when it is quiet it is not too bad... but it was alot more faster with mysql 4 i don't really want to downgrade please give me some ideas to fix this issue ...........
And on cluster02 and cluster03, I did something like that: - srv01 (synchronize changes) - cluster01 (synchronize changes) - cluster03 (standalone) And - srv01 (synchronize changes) - cluster01 (synchronize changes) - cluster02 (standalone)
1. So, is that correct?
2. It seems that when I click on 'syncronize all DNS records on all the servers' only cluster01 and srv01 got all the DNS records. So is it normal?
Yet If I add a domain on cluster02 for example, where I need to add the DNS? cluster02 named.conf or on cluster01/srv01?
I have started to move my websites over to my UK Colocation But would like a little guidence on what the best solution would be.
I would like to build up a Server Cluster that will handle all of my sites really and also have redundancy, so If 1 server goes down the other Web/SQL/Whatever server will be used instead.
I have websites ranging from large forums to streaming & download websites.
Should I got for a setup for example:
X Web Servers + X Database Servers Connected to X Storage (see link below)
Connecting the Web Servers in something like a a round robin config or use a Load Balancer / Other
OR Should I setup multiple: Web Server + Database Server + Media Server
OR another config?
Below are my current setups
Current UK Setup (Colocation)
Web Server Quad Core, 8GB Ram, 250gb HDD Raid 1 Quad Core, 8GB Ram, 250gb HDD Raid 1 (just ordered)
SQL Server Quad Core, 4GB Ram, 250gb HDD Raid 10
Storage Server HP StorageWorks NAS 1200s 1TB (just Ordered) Link: [url]
Current US Setup (Dedicated Servers)
Web Server Quad Core x2, 8GB Ram, 3TB HDD
SQL Server Quad Core x2, 8GB Ram, 1TB HDD
Media Server Quad Core x2, 8GB Ram, 3TB HDD Dual Core, 4GB Ram, 3TB HDD
i am going to use with hsphere preferently i want to use Dell blade server 1955 with exchange and sharepoint, cause the low HD capacity i will like to add and HD array could be NAS or SAN,
put together a high availability cluster for a PHP + MySQL based app to run on a LAN. We're going to use Linux, and cost is a major consern. The app itself doesn't use / need too much resources, as it will only be accessed by 2 / 3 people at a time, so I'm using the following:
2 identical PC's with: 3Ghz PIV CPU 1GB RAM 2x SATAII 160GB HDD space setup as RAID 1 10/100 Mbps LAN NIC's, on a 100MB 8 port switch
Up to now I have been running MySQL-Max 5.0.15 to run a MySQL master-master replication server, which works fine, but the setup involved a lot of manual work, and downloading of the right binaries.
Furthermore I used Linux Heartbeat todo auto switchover between the two servers & RSYNC to sync the application files between the two. This has been working fine untill one of the server's HDD's failed recently corrupting both HDD's
So, I need a better way of doing this, and want to meet the following requirements: If 1 HDD fails on either server, the server still needs to be able to run without a problem. Replacing a HDD & rebuilding the RAID array should be easy to manage, preferabbly over the net.
Setting up a cluster should be easy to manage, both for the MySQL DB server & the files that need to be synced between the two machines Re-installing the server should be easy todo as well.
For No.1 I have been thinking of setting up RAID 5 with 4x HDD's - how reliable / safe / redundant is this?
For No. 4 I have been thinking of using something like sysimager to backup the server once setup, but will / can it recreate the RAID array upon restoration? The MySQL DB & PHP files are being backed up to a removable HDD on a daily basis.
The client is 700Km's away, so we can't just drop-in to fix things as often as we like. Thus redundancy is of utter importance. Currently I'm running Suse 9.3, simply due to the fact that it's easy enough to tell the client over the phone howto do things with YaST. Suse 10.1 will be used for the new setup, but I could also use Fedora Core 5, and have also been thinking of using SME server 7.0.
I have 4 dedicated servers in 1and1 and i want to create a server cluster for windows media services to stabilize the server load. i tried to add the second server details in the first server's windows media services and it always says, access denied message.
how can i give permissions to create a server cluster for windows media services? i didn't installed any additional firewalls in the servers and i am using this for only Windows media services so IIS is disabled. my configuration and server details are below...
Windows 2003 Standard edition 64 bit Athlon 64x2 3800+ 2 x 2,0GHz 1 GB Ram
Anyone know of some good server load testers ( commercial )?
Im not looking for application based load testing, I need real web server load testing... need to see how much traffic this one site can take before it cries.
I have a small dns cluster with 4 servers, the problem is that when i want to update a dns registry one of them doesnt sync, i have to try like 6 or 8 times to get that server to sync with all the others, and im concern because the one who gets trouble to sync is my secondary dns server
my current servers are part of this mess with Alphared: [url]
what I'm looking for:
static content main server: average cpu, average ram 15-20gb data tops, but could use a fast drive need about 6tb/m of higher quality bandwidth 2 machine cluster for forums
only thing on this will be vBulletin forums. current database is about 6gb (~7 million posts) averaging about 800 members active per 15 mins this isn't for a business, so it all comes out of my pocket. however, after the $#@! with Alphared I do recognize the importance of a good host and I am willing to put money toward that as needed. however, my goal is in the $600-$800/m range for everything. is that price range doable? if not, what is a reasonable price for what I'm asking? and can anyone recommend reliable hosts (especially one that can correctly setup the cluster for the forums).
Hi there, i have few question for the best suited DNS Setup for our compagny.
We have tree server located in montreal. Two are running web services, one of them is only for dns ( home server ).
Two main server have Whm/Cpanel. One run Cpanel Dns only.
Main server have 7 ips each Dns server, only have 1
Let say we use domain xxx.com Right now we have ns1/ns2/ns3/ns4 point to server1 ns5/ns6/ns7 point to server2
We have no Nameserver that point to our dns only server for now. I'd like to advoid runing DNS Service on all of them, maybe having two slave one master would be fine. Question: What would be the best suited dns setup with my current config for best responding time and fast replication?
Currently, I run cPanel servers for my clients and also host my company website on them. However, I now wish to place my company website on a seperate system running ISP Manager, and in order to connect the servers to my DNS I presume that I would have to use DNS clustering. Here is my question - how would I create a DNS cluster between cPanel and ISP Manager? Anyone know how?
I work in a DC and am looking for a better way to deal with clients who have multiple servers hosted with us.
Heres the scenario. Client buys a server or two at the beginning, with a HW firewall or they are clustered together and require their own switch and down the road, they like what we do and want to buy more servers.
However, we've been selling other servers and the only way we would be able to accommodate them would be to run a cross connect to another cab with their new server in it. Hopefully you can see where I am going with this.
This can keep happening multiple times and with multiple clients. and eventually you can end up with spider web of cable everywhere .
My thought of doing it right but more work would be to schedule down time with a client and migrate all the HW to a new cabinet where they can grow.
Weve also been tossing around ideas like getting projected growth from clients and setting aside space for them to having dedicated cluster cabinets.
I've added a new Apache/MySQL node to our PPA cluster and we'd like to be able to host a single subscription on that node for the Apache webhosting and MySQL databases for that subscription while allowing that subscription to utilized the rest of the shared resources in the cluster, such as mail, DNS, etc. I'm looking for the best way to go about doing that.
I guess one simple way would be to set the new server to 'ready to provide' and set the rest to not ready, add the "linux shared hosting" hosting subscription to the customer account, then switch the new server to not ready and the rest back to ready. That works fine I suppose in a small cluster, but there has to be a better way. Is there a way to craft a service template that restricts subscribers to a particular node for Apache + MySQL and leaves them to rest of the "regular" nodes in the cluster for other services?
I'm having the oddest issue. For some reason, some of the websites on my server load fine, and some take a really long time to load (2 minutes).
Now, the server load is fine, and the size of the sites aren't the issue either. I've restarted Apache and a couple more services, and still the same sites seem to load very slow.
What could be causing this since it's only effecting certain websites?
I have centOS box with 1 x dual core CPU in it. The load average is between 1.5 and 3. When the traffic is on top the load average is between 2.5 - 3.5. Is it necessary to upgrade ? Server seems to be respond fast. Also I heard that Top command on centOS with dual core CPU doesn't show exact values.
I'm about to upgrade my co-locationed server from twin 2214 Opertons (dual core 2.2GHz) to
twin 2378 Opertons (quad core 2.4GHz). [Got to love the upgrade path on Opertons, single core to 6 core on the same socket.] I know I'll need to do a Bios upgrade but is there anything else I should worry about. I want to minimize downtime as much as possible.
