Apache Multi Process Limit

Jun 9, 2007

I am in a bind with Apache's multi process limit. Let me explain what I am doing. There's this website which has career details of all the football players since the beginning of professional football. They have a simple web form which allows you to look at a player's profile by entering his name or his 7 digit numeric id number (on that website).

One of my client wants a list of all the players with a certain "flag" in their profile. So I created an automatic form submission and HTML parsing script to get details of all the players with that "flag" in their profile. Let me not go into too much details and tell you that after applying a few pattern rules to the id number, the number of possible id numbers comes to about 1 million (instead of 10^7; each field can have {0,1,2,3,4,5,6,7,8,9}=10 digits, so net combinations = 10*10*10*10*10*10*10).

Therefore, to completely automate this process I wrote a script which would generate an id number, submit the form with that id number, and parse the resulting HTML profile for the "flag". If the script finds a hit on the flag, it stores all the fields of that player in a database. This script is working absolutely fine but the speed I was getting was about one check per second which means that I would have to leave the script running for about 11 days (to process all of about 1 million checks).

So i came up with this idea to divide the check into ten parts and i created separate scripts for each part. Now basically the first script checks for the first 100 thousand combinations, the second checks for another 100 thousand combinations, and so on.

The problem is that I am able to get only two of these scripts running at the same time. So it would still take me at least 5 days to get all the results. The rest of the scripts just sit there in the server's backlog. This is definitely due to Apache's limitation to handle multiple processes. The server I am using to run this script as well the target webserver both run on Apache2. I am sure it's not a problem with the receiving server. It has to be my Apache web server which is running the scripts. I have tried using mpm_winnt (on a windows server) as well as the prefork and worker modules (on a linux server) without any luck. Has any of you ever faced the same situation?

For those concerned about the legitimacy of this work, rest assured, this is absolutely legit. There's nothing in the website's use policy which restricts somebody from doing this. Moreover, my client hired me to do this only because the website owners were not able to hand over the data he required. They gave the stupid reason that they are helpless in providing the data because they don't have a system in place which would allow them to do a search restriction!

View 0 Replies


ADVERTISEMENT

Process Limit Exceeded For UID

Feb 27, 2008

I have seen some hosting provider limit the number of process per user id. Usually its shows an Internal Server error with the error message saying "Process Limit Exceeded For UID ******", how can i do this in my vps?

View 2 Replies View Related

Process With High Limit Time

Jan 16, 2008

top output from my server shows a this user was creating a lot of proccesses, even this process has been running for about 30 mins, how can I limit the time a process can stay alive? I suspect it was causing a high load on the server when started.

PID USER PR NI %CPU TIME+ %MEM VIRT RES SHR S COMMAND
5374 jvmcompa 30 10 0 0:30.01 0.3 16456 6740 3532 S php
15586 jvmcompa 30 10 0 0:00.02 0.3 16052 6380 3460 S php
8165 jvmcompa 30 10 0 0:00.02 0.3 15248 6372 3432 S php
15785 jvmcompa 30 10 0 0:00.02 0.3 15520 6368 3436 S php
15272 jvmcompa 30 10 0 0:00.02 0.3 16236 6348 3412 S php
15345 jvmcompa 30 10 0 0:00.02 0.3 17052 6316 3432 S php
15396 jvmcompa 30 10 0 0:00.02 0.3 16324 6312 3432 S php
15472 jvmcompa 30 10 0 0:00.02 0.3 15740 6312 3432 S php
15803 jvmcompa 30 10 0 0:00.02 0.3 15092 6312 3432 S php
8255 jvmcompa 30 10 0 0:00.02 0.3 16504 6304 3404 S php
8281 jvmcompa 30 10 0 0:00.02 0.3 15504 6304 3404 S php
15260 jvmcompa 30 10 0 0:00.02 0.3 15296 6304 3404 S php
8136 jvmcompa 30 10 0 0:00.02 0.3 16308 6280 3412 S php
8153 jvmcompa 30 10 0 0:00.02 0.3 16500 6280 3412 S php
8092 jvmcompa 30 10 0 0:00.02 0.3 15196 6276 3412 S php
8145 jvmcompa 30 10 0 0:00.02 0.3 15280 6264 3412 S php
32263 jvmcompa 25 10 0 0:00.10 0.1 9564 1204 776 S pure-ftpd
31773 jvmcompa 26 10 0 0:00.01 0.1 9448 1120 728 S pure-ftpd
14657 jvmcompa 25 10 0 0:00.00 0.0 8420 988 696 S pure-ftpd

View 3 Replies View Related

How To Create Multi Dns For One Domain To Multi Webhosting Servers

Jul 19, 2009

i have 100 web hosting clients that i want to move 50 clients to another server but i only now have one domain for the dns

server 1#

hostname : host01.dnsdomain.com
nameserver1 : host01.dnsdomain.com
nameserver2 : host02.dnsdomain.com

server 2#

hostname : host01.dnsdomain.com
nameserver1 : host03.dnsdomain.com
nameserver2 : host04.dnsdomain.com

and in the domain control panel i set the nameservers for the dnsdomain.com

nameserver1 : host01.dnsdomain.com
nameserver2 : host02.dnsdomain.com

and i didn't create account for it just dns only

is this a right way to create multi dns for multi webhosting servers?

and when i want to make subdomain hosting account site someting like

test02.dnsdomain.com

it didn't work

View 0 Replies View Related

Apache :: Multi VHost / Single File

Mar 20, 2015

I'm actually working on a project in wich one I use Zend Framework 2. In this project I have 4 websites. (this is require, I don't want to change it).

I have 1 Virtual Host for each website:

- com-mywebsite.com
- cp-mywebsite.com
- pos-mywebsite.com
- ap-mywebsite.com

Each Virtual Host redirect to the same folder and same file because everything is in the same project so same entry point (same index.php)

actually if I type each url in a browser, they all redirect to the same part of my project so I added some routes in ZF2 to access to one website and not another :

- com-mywebsite.com/com
- cp-mywebsite.com/cp
- pos-mywebsite.com/pos
- ap-mywebsite.com/ap

This is a quick and dirty fix because I also can access to the ap website with this url : com-mywebsite.com/ap

I'd like every website to be accessed from their root:

- com-mywebsite.com
- cp-mywebsite.com
- pos-mywebsite.com
- ap-mywebsite.com

And I don't want to display /something after it to access to the website even if after you can access to some other pages of each website.

View 1 Replies View Related

Apache :: SSL Cert Files And Mod Rewrite For Multi-tenant Hosting

Feb 21, 2015

I'm trying to set up a multi-tenant web application across multiple servers and would like to provide ssl for those tenants

I know this is possible to dynamically assign ssl using mod_rewrite, but I'm worried about speed.

Does apache cache the ssl cert file(s) when using mod_rewrite, or does apache lookup the ssl file every handshake / session?

How ssl cert files work and if using mod_rewrite is a worthy approach if connection speed is important.

View 1 Replies View Related

8 Apache Process

Mar 17, 2008

Ive recently installed installed and configured stuff on my new box but after, I realised abnormal memory usage.

Mysql server is taking 256mb, there are somewhere between 6 and 10 apache process taking up at least 40mb each.

Furthermore, when I do: top, I see that the memory usage is increasing by about 120ko each 3 sec.

I am running centos 5.1 and have a load of 0. Basically, there is no one on the server appart from me.

On the server I have at home running debian, I run all thoose thing and it take up 200mb
max.

View 3 Replies View Related

How To Reduce Apache Process

Jul 3, 2008

13438 nobody 15 0 42276 22m 13m R 22 2.2 1:51.94 httpd
10620 nobody 16 0 41928 16m 8468 S 19 1.7 0:28.54 httpd
11397 nobody 15 0 41524 12m 4784 S 18 1.3 0:06.04 httpd
10745 nobody 15 0 42376 14m 5316 S 17 1.4 0:06.62 httpd

The values in bold are the CPU percentage taken up by each apache process.

So i had to need to each apache process,who can i reduce it?what config i have to change to reduce it?

View 7 Replies View Related

Process Apache Too High - Server Goes Down

Apr 13, 2007

I have server in LT, the network is so good, but i got problem with the apache, it keep going down because the process too high ( i think)

when i list the process it show me :

nobody
0.000.250.0 Top Process%CPU 98.9/usr/local/apache/bin/httpd -DSSL Top Process%CPU 98.8/usr/local/apache/bin/httpd -DSSL Top Process%CPU 2.9
Other than that all domain only use not more than 10% process, I use Cpanel X and Cpanel XP skin, please help

Now my domain , will get blank page when try to access, i dont know why, even though all service is running and i already reboot the server

View 11 Replies View Related

Apache :: Debugging PHP Process Termination

Sep 25, 2014

I recently switched from XAMPP to a self-setup WAMP installation using Apache Lounge's 2.4.9 package in order to improve performance, to have more tweaking possibilities and to solve some problems that I was not able to solve in XAMPP (e.g. creating large PDF files using TCPDF) on my local Windows 7 development PC.PHP is running as FCGI module, which I thought was a good idea to achieve good performance, but I am afraid I have messed up the configuration a bit.

What happens is that sometimes, PHP script requests do not seem to terminate(?), but I do neither know why, nor do I know what is happening. It probably has something to do with scripts that process kind of a larger

View 2 Replies View Related

Apache :: Windows - How To Configure 1 Process Per Client

Sep 19, 2014

I've got a quite difficult problem which I don't know hoe to solve. We use a self created ISAPI module which is a "business server" running behind an Apache.

From time to time a client app crashes the server (the circumstances are not quite clear) - and because there is only one server process, all other clients crash as well. Here is an exemplary log of a crash:

Faulting application name: httpd.exe, version: 2.2.22.0, time stamp: 0x4f242d7a
Faulting module name: ABCServer.dll, version: 1.0.0.1, time stamp: 0x53cfffa5
Exception code: 0xc00000fd
Fault offset: 0x00004cf6
Faulting process id: 0x94c
Faulting application start time: 0x01cfc5cc18c67d57
Faulting application path: C:Program Files (x86)Apache Software FoundationApache2.2inhttpd.exe
Faulting module path: C:datawwwabcremoteABCServer.dll
Report Id: d27d5891-31da-11e4-93ff-0003ff4356f9
Faulting package full name:
Faulting package-relative application ID:

Exception code: 0xc00000fd means stack overflow as I learnt. Therefore we configured mpm_winnt_module to use a 8M ThreadStackSize but this didn't work.

A solution might be that Apache starts for every client its own server process with the module ABCServer.dll. Because it is quite small and there are not thousands of customers this sounds like the perfect solution. No other clients/customers would be affected by a crash.

Unfortunately mpm_winnt_module supports only 1 process AFAIK. Worker and Prefork MPM are not available in Apache's Windows version what I read.

How can we configure Apache to start a new module process per client?

View 3 Replies View Related

Multi Core Or Multi CPU

Apr 10, 2008

I'm starting to do my homework on a dedicated server and am really not that savvy on what's best for my needs.

Firstly, I'm just trying to determine how much grunt I need and am not really sure of the benefits of multi-core vs single core vs single processor vs multi processor.

I've been running on a low density VPS with 1 Gig ram for a while and it's doing fine but won't handle this setup too much longer. My site does a very high amount of disk read/writing and for the size of my site there are a lot of database calls.

I'm thinking a multi-processor will do wonders for a database intensive site, but will a single multi-core process do fairly well also? My budget is at the low end and obviously I can afford more for a multi-core single processor.

View 9 Replies View Related

Apache :: HTAccess Won't Process Rewrite Rule Despite Many Attempts

Apr 1, 2015

It should be a straight forward change. [URL] .... does not redirect to [URL]...... It simply tries to load /denver-cars/ and denver-cars is in the URL. Am I missing something here? I have tried moving it up and down the list of rules and have tried numerous types of flags to no avail. Everything else in the htacess works fine with out the line:

RewriteRule ^/(.*)-cars/ /newcars-in-$1/ [NC,R=301,L]

Here is my htaccess:

Options +FollowSymlinks
RewriteEngine on
RewriteBase /
# Force www
# Redirect google index dir's to new dir
RewriteRule ^/(.*)-cars/ /newcars-in-$1/ [NC,R=301,L]

[code]....

View 1 Replies View Related

Apache :: Forwarding Requests To A Custom Process On Host

Apr 10, 2013

I'm looking to pass the entries to a web form, via Apache, to an external process (listening on a port say 4321) running on the same host as Apache.Is there a way to "coerce" Apache into doing this?

View 1 Replies View Related

Weekly Offsite CPanel Backup Process Crashing Apache/bind

Mar 19, 2007

Right now I am using the built-in cpanel backup feature to backup all the accounts on my server to an offsite FTP backup account I have on a weekly basis. The problem I am having is that everytime the backup runs, the load (thats what I'm guessing is the cause) is crashing apache/bind, causing sites to be unreachable until I can restart the services. What options do I have to resolve this issue? Currently I already have spri installed, and it does help out a bit, but its still not enough.

View 4 Replies View Related

Apache 2.2 With Limit IP Mod

Jan 6, 2008

Anyone know if the mod_limitipconn works with Apache 2.2?

View 8 Replies View Related

Limit Box Ip On Apache

Jul 8, 2007

Im running the latest version of apache on my box and have 15 ip's on my box. Each ip goes to the site hosted on apache is there a way to limit it to one. Say for example i have these ips on my box 1.1.1.1 - 1.1.1.15

How do i select one of those ips to go to the site and have the rest not go anywhere.

View 6 Replies View Related

Apache Slot Limit

Nov 25, 2008

I'm facing a very critical issue in my server and i think its kind of DDOS attack!

the server is running normal and then i noticed that the server load is going up till reaches about 400! and all the services went down!

the cause of this issue was the Apache...

I noticed that the normal SLOT ( Total megabytes transferred this slot ) is in the range between 0.1 and 0.5(max) but the upnormal when the server load went up each slot was in range between (150 : 200)!
my conclusion is that someone sending a large packets to the server...
is there a limitation for this slot for not going up in that way?
Server Version: Apache/2.2.9 (Unix) mod_ssl/2.2.9 OpenSSL/0.9.8b mod_auth_passthrough/2.1 mod_bwlimited/1.4 FrontPage/5.0.2.2635 PHP/5.2.6

View 1 Replies View Related

Can I Limit Apache's Cpu Usage

Feb 2, 2007

I have a server running Apache 2 with php 5 as an apache module. There are 2 PHP scripts that get about 500k hits a day. These scripts have to parse data out of a remote webpage and display it on an image. They used to make loads go up to 40-50, but I have added a cache which only updates every 4 hours. This helped a lot, but loads are still around 10 when the script updates, and it slows down the server. Memory usage is fine.
The server is an AMD Athlon 64 2800+ with 1 gb of ram and an 80GB SATA hard drive.

Here's `top` when the cache had just been cleared.

Quote:

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
28004 named 16 0 121m 11m 3796 S 12.3 1.3 0:00.96 apache2
28003 named 15 0 121m 11m 3740 S 12.0 1.3 0:01.00 apache2
5316 tarball 15 0 43032 29m 2320 S 11.3 3.1 326:08.68 ircd
27998 named 16 0 121m 11m 3808 S 11.3 1.3 0:00.51 apache2
27989 named 15 0 121m 11m 3800 S 10.3 1.3 0:01.14 apache2
28007 named 16 0 121m 11m 3776 R 8.0 1.2 0:00.24 apache2
28008 named 15 0 121m 11m 3776 S 7.0 1.2 0:00.22 apache2
27979 named 16 0 121m 11m 3752 R 6.0 1.3 0:02.06 apache2
27983 named 16 0 121m 11m 3748 R 6.0 1.3 0:01.94 apache2
27985 named 15 0 121m 11m 3748 S 6.0 1.3 0:01.05 apache2
27992 named 16 0 121m 11m 3792 S 5.0 1.3 0:00.33 apache2
27980 named 15 0 121m 11m 3796 R 2.3 1.3 0:03.24 apache2
28009 named 15 0 121m 11m 3796 S 1.7 1.3 0:00.82 apache2
27715 root 15 0 5192 1164 844 R 0.3 0.1 0:00.94 top
27960 named 15 0 121m 11m 3808 S 0.3 1.3 0:01.42 apache2
27984 named 15 0 121m 11m 3804 S 0.3 1.3 0:01.94 apache2
27987 named 15 0 121m 11m 3796 S 0.3 1.3 0:01.04 apache2
28006 named 15 0 121m 10m 3292 S 0.3 1.2 0:00.50 apache2

Idle CPU usage usually goes anywhere from 30%-0%. Is there any way to limit apache from using more than 75% cpu, or any other ways to drop cpu usage?

View 10 Replies View Related

Limit Apache Usage And

Oct 23, 2007

i have one centos dedicated server and cpanel i will going to apache status is very request link and 2 site are very high in the list and my apache worked very hard and going to down any hours of your seems i must how control it?

View 7 Replies View Related

Apache :: Limit Number Of Sessions

Nov 18, 2014

I implemented a Reverse Proxy using apache2 v. 2.4... What i need to do is limit number of sessions against a Virtual Host. Is that possible?

View 13 Replies View Related

Limit Number Conection In Apache/cpanel

Oct 27, 2009

Cpanel have option for compile with limit number access from IP via apache?

I want earch IP can access 5 conection in apache.

Via cpanel is possible?

View 6 Replies View Related

How To Limit Apache Clients On One User On The Cpanel

Apr 28, 2008

i have 2 questions

1 ) iwant limit one user on the cpanel limit on the apache conections?

2 ) i want limit one user not use download manager for site clients

View 4 Replies View Related

Rule To Limit Apache (port 80) Connections From 1 IP To 15

Apr 12, 2007

any good rule to limit Apache (port 80) connections from 1 IP to 15 with iptables/csf?

And total connections to the box to 100?

View 6 Replies View Related

Limit Apache (thread) Connections Per Request

Jan 9, 2007

I've been having trouble the past few days with someone who's been "attacking" my site so to speak by continuously downloading very large files with as many connections as (he) can open. I operate a large downloads site for computer games, this person has selected the largest files (like 400-500MB). Not sure of the real intent other than to clog up my bandwidth capacity. Also he appears to be using proxies since as soon as I ban one, another shows up seeminly from China.

Anyway, I have mod_bw and I've limited the number of connections in the downloads area to 2. While that works ok, his tool uses threads like a download manager would and he's using up 30-40 child threads for his 2 file downloads.

So 2 questions,

Is there anyway to not only limit file downloads to 2, but limit the number of connections per request? Many of my visitors do use download managers and I'd like for them to continue using them but use a reasonable number of threads like 6 or 8, but not 30.

Also, is there a way to restrict access to someone using a proxy?

View 2 Replies View Related

Apache :: Limit Max Number Of Concurrent Access To Specified URL

Jul 11, 2014

Is it possible to limit the max number of concurrent access to an url?

Let's see the following example: URL...

/a1 concurrent access should be limited to for example 20.

While we have an other url:
https:/ssss.com/a2

/a2 should be limited to 30.

Is it possible to do it with some apache config?

View 1 Replies View Related

How To Increase Open Files Limit In Apache In Cpanel

Jul 14, 2008

How to increase the Open Files limits descriptor in Apache. In the earlier version of Cpanel, we had an option of Raise FD Size Limit to 16384, but the option no longer appear while rebuilding Apache. What is the way to do it and make the change permanent?

View 2 Replies View Related

Apache :: Header Field Exceeds Limit / Tomcat AJP

Feb 3, 2015

My configuration is Apache 2.2.3 using Tomcat - AJP with mod_proxy_ajp, mod_ssl.We have configured Kerberos but some users are getting an error - Size of a request header field exceeds server limit.

Users with headers above 8K are getting this error, users less than 8K can get in fine. How can I increase this header limit in Apache/Tomcat? I have tried multiple suggestions found on google and other sites.

Here is what I tried:

Adding the following to the http.conf
LimitRequestFieldSize 65536
ProxyIOBufferSize 65536

Adding the following to server.xml
packetSize="65536"

editing a workers.propeties file, but we dont have any files on the server with that name.

View 2 Replies View Related

Apache Under Attack :: Configured Request Variable Value Length Limit Exceeded

Apr 21, 2008

My server was unstable at this month sometimes fork 700 process and apache 80 access per second and that's made server very slow . very bad browsing

when i checked log files /var/log/messages found that errors

Apr 20 04:06:28 suhosin[798]: ALERT - configured request variable value length limit exceeded - dropped variable 'message' (attacker '212.107.116.238', file '/usr/local/cpanel/cgi-sys/php4')
Apr 22 00:27:05 suhosin[15442]: ALERT - configured request variable name length limit exceeded - dropped ....

View 6 Replies View Related

Multi WAN

Jan 26, 2008

A little confused about some technical aspects of a setup.

If anyone knows what I am trying to say please advise.

Question :

There are 4 WAN connections.
Conn01 = 10mbps upload Line with IP 111.111.111.111
Conn02 = 1mbps upload Line with IP 222.222.222.222
Conn03 = 100mbps download / 1mbpx upload Line with IP 333.333.333.333
Conn04 = Dialup line at 56kbps with IP 444.444.444.444

If I connect all these to a Multi WAN Router lets say Linksys RV016.

1) When a client tries to upload something to the server with IP 444.444.444.444 will it still run at 56kbps or will it be load balanced into the fastest line which is 10mbps.

2) When a Client's server connected at 111.111.111.111 tries to download something from the internet to this multi WAN setup, does he get a max of 10mbps or will he be routed to the 100mbps?

View 2 Replies View Related

Best Multi User IP KVM

Jul 9, 2009

I am currently looking for a new IP KVM. Right now I use a mix of HP and Raritan KVMs and I'm honestly not super happy with either of them. The main feature I'm looking for is the ability to setup multiple users and only allow them to access certain ports/devices on the KVM.

What would be the best IP KVM to look at for this?

View 10 Replies View Related







Copyrights 2005-15 www.BigResource.com, All rights reserved