Mod_rewrite And Archiving Directories -- SE Issues
Apr 27, 2007
I have many directories from years ago on a fileserver. Many of them are indexed on Google. I have five webservers reading from one fileserver for the data. I'd like to keep copies of the most recent data on the webservers and through mod_rewrite tell it to use local copies instead of reading through the fileserver. I would like to move most of my older directories into an "archived" directory.
If I move most of my older directories into an archived directory, the Google listings will then 404. I could put a 404 doc up redirecting to the index page, but Google will drop the link, which I would like to avoid.
I could add a new RewriteCond / RewriteRule (below) for each new directory. But, it would need to be added in the httpd.conf file for each of the webservers and restarted. With the number of new directories I add, this would be infeasible.
Does anyone know of a way to accomplish what I am trying to do? I do not need the older directories in the "archived" directory to be accessible or rewritten, I just don't want to lose the search engine listings from them. And, I want to reduce the strain on the fileserver for these files.
I also don't know of a way to say: rewrite everything locally unless it is in the /dir1/archived directory and if there is a 404, the directory probably existed at some point, redirect that to the index and give a 200 status code.
Does anyone have any suggestions? I tried mod_cache but it doesn't seem all that speedy.
RewriteEngine on
RewriteCond %{REQUEST_URI} ^/dir1/dir2
RewriteRule ^/dir1/dir2/(.*)$ /path/to/dir1-localcache/dir2/$1
View 0 Replies
ADVERTISEMENT
Sep 29, 2007
How do I archive a whole directory using ssh?
There is gzip and tar, but what command do I use to make an archive for a whole directory?
[Directory ---> One_Archive.tar]
It will be easier to transfer big directories this way by archiving it all into one.
View 3 Replies
View Related
Dec 23, 2007
I want to copy whole directories about 20gb to another server across the world.
If I type "mput *" it will say "not a plain file" for directories.
How do you move an entire site, I don't want to achive and move because it is big.
View 1 Replies
View Related
Jul 20, 2008
I was hesitant to even post this because I've been on the net for so long, that and I know just about every method out there. However, large corporations obviously can't live with loosing data so I figured I'd see what everybody else is doing out and figure out my next battle plan for archiving data.
Here's what happened. I had triple backups of some data. I burned them twice on DVD (yes, two DVD's of each archive) as well as had them on a WD hard drive. ALL are dead or unreadable. I had the discs in a DVD binder and they were never touched for a good 5 years. I put them in a player (multiple players) and only certain parts were read.
Other parts came up with errors. (Yes, I'm aware there are companies that offer recovery for both CD/DVD and Hard drives, but they always charge a fortune and in some cases, aren't worth it). This was Memorex media btw which might of had something to do with it, but at the time I thought it was the best. Next I went to the hard drive. This was stored in a room temp house over a good 5 years and when I plugged it in to a computer's IDE port, nothing. Not sure exactly what's wrong with the drive and I'm sure it could be fixed and recovered, but once again, that's not my question.
My Question: What methods are you using to store your archives over long periods of time? Any recommendations on hardware? I'm thinking of DLT Tape backups and of course doing RAID next but don't want to run into the same problem in 5 years. How can I sleep at night (which is already impossible) knowing that in 5 or 10 years when I'm ready to get into my backups that they will be there?
What are you doing and what do you recommend? Better yet, what the hell is Hollywood doing to keep all their music and movies safe?
View 3 Replies
View Related
Jan 17, 2008
Been running a server for 2 years now on Windows SBS 2003, and within the past 2 weeks, the server has been locking up or going very sluggish after only a few hours of use.
I've noticed that STORE.EXE is using a lot of memory, there are a number of people within the building using this server for various tasks with Microbiz, Quickbooks, and Exchange server. I researched the topic and was told if I can archive Exchange, that this should help with performance. Anyone know how to do this or to lower the use of memory with the server?
View 8 Replies
View Related
Jun 12, 2009
I've just moved a few webistes from Linux to Windows and I'm using IIS to run them. Does anybody know of any free alternatives to ISAPI_REWRITE so I can use mod_rewrite per account?
View 8 Replies
View Related
Oct 2, 2007
Its October and I have a Server at home with me running NO CONTROL PANEL... I have been using it for 5 years now... But my problem is my mod_rewrite is not working... I have tried fixing it... But I can't find it in the httpd.conf file where I heard it was at... They said it came by default by Apache..
I'm running Apache2.2.4, Fedora Core 7), PHP 5, MySQL 5.... I don't see the mod_rewrite on there....
View 14 Replies
View Related
Dec 15, 2005
I have a list of categories that i want to rewrite the URL to display the names instead.
I'm using this:
RewriteMap catlist txt:C:/web/apache2/htdocs/catnames.txt
RewriteRule ^/cats/(.*)$ /categories.php?catid=${catlist:$1|0}
catnames.txt consists of
CategoryName 6
AnotherCatName 8
OnemoreCatName 9
.....
and so on.
This works fine on my local windows PC since i'm using httpd.conf to set this up.
When i use this on my server under .htaccess, the error log says "RewriteMap" not allowed here.
I it only to find out that i cant use RewriteMap under .htaccess... Is there any other alternative to achieve this without listing all the category names with corresponding rewriteurl statements in my .htaccess file?
View 14 Replies
View Related
Sep 8, 2005
I have installed a Apache server version 1.3.33 on windows XP and would like to enable mod_rewrite so i can rewrite my ugly url´s. How do I install this great feature in Apache so i can test it locally?
Do i just remove # from
#LoadModule rewrite_module modules/mod_rewrite.so
#AddModule mod_rewrite.c
View 2 Replies
View Related
May 28, 2008
I've lots of:
[warn] RewriteCond: NoCase option for non-regex pattern '-f' is not supported and will be ignored.
[warn] RewriteCond: NoCase option for non-regex pattern '-d' is not supported and will be ignored.
Any ideas how to track them?
View 5 Replies
View Related
Oct 24, 2009
does mod-rewrite consume ram?
actually found in new vb discussion of seo friendly urls and mod rewrite was an option for most friendly url, so wanted to know if constant usage of mod-rewrite adds additional load to the server or not?
forum which I and my friends use are pretty big more than 6k in a forum and other above 25k, with 250k posts in 1 forum and 600k posts in the other, so just give me an idea on wat can happen due to constant overwritten?
View 8 Replies
View Related
Mar 29, 2009
So I've setup a server heres the spec provided by Webmin
Operating systemUbuntu Linux 8.10
Webmin version1.470
Time on systemSun Mar 29 18:56:12 2009
Kernel and CPULinux 2.6.27-11-server on i686
System uptime5 days, 19 hours, 42 minutes
I'm struggling with mod_rewrite their seems to be no such thing...
Its not mentioned in the apache2.conf or httpd.conf, httpd.conf was blank previously but I added in certain things to get php working but I cannot get mod_rewrite working, which brings the question forward what else am i missing?
I started out with the aim of blocking the ability of viewing directories.
Quote:
Loaded Modules core mod_log_config mod_logio prefork http_core mod_so mod_alias mod_auth_basic mod_authn_file mod_authz_default mod_authz_groupfile mod_authz_host mod_authz_user mod_autoindex mod_cgi mod_deflate mod_dir mod_env mod_mime mod_negotiation mod_php5 mod_setenvif mod_status mod_vhost_alias
So how can I go about getting mod_rewrite setup and/or what ever else I'm missing that I might find essential later on once I have everything setup?
View 4 Replies
View Related
May 15, 2009
I am struggling to get this .htaccess file to work with lighttpd, i am not a coder so its very hard for me to fix it, hopefully if someone knows how can tell me how to write rewrite code that will get it working.
{quote}
1. Comment the 2 lines below if the server returns 500 errors!
Options -Indexes
Options +FollowSymLinks
#Uncomment following lines if you want to use image caching!
#<IfModule mod_expires.c>
1. ExpiresActive On
2. ExpiresDefault A1209600
3. ExpiresByType text/html A1
#</IfModule>
1. Uncomment following lines if Apache doesnt support MultiViews!
<IfModule mod_rewrite.c>
RewriteEngine On
1. Uncomment the 2 lines below if you are using www.domain.com # as the baseurl for the site and users access your site # via domain.com (THIS IS REQUIRED FOR JQUERY TO WORK)
#RewriteCond %{HTTP_HOST} ^domain.com [NC]
#RewriteRule ^(.*)$ http://www.domain.com/$1 [L,R=301]
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule .* loader.php [L,QSA]
</IfModule>
1. Edit below lines and set to
2. ErrorDocument CODE /RELATIVE/error.php
3. If the script is installed in the default document
4. root then relative is null.
#ErrorDocument 401 /error.php
#ErrorDocument 403 /error.php
#ErrorDocument 404 /error.php {/quote}
looks like its calling the rule from loader.php file, now how can i convert this to lighttpd language,
View 4 Replies
View Related
Oct 28, 2009
I have been using apache and php-cgi and it works well together but when I tried to use
mod_rewrite it stopped working and I got "Internal Server Error" result.
Apache error log showed "FastCGI: incomplete headers (0 bytes) received from server"
I think that mod_rewrite rules are ok because when I refer to some HTML file then it all works.
Apache 2.2.14 and php 5.2.11
View 5 Replies
View Related
Mar 23, 2008
I have a VPS and I need to enable mod_rewrite.
Here is my PHP Info: [url]
I read a tutorial but I just don't get it. I would appreciate if you could help me out.
I need it for my Wordpress blog.
View 14 Replies
View Related
May 28, 2008
I'm trying to redirect everything except the subdomains from an old domain to a new domain. The following appears to work so far:
Options +FollowSymLinks
RewriteEngine on
RewriteCond %{HTTP_HOST} !^sub1.olddomain.com$ [NC]
RewriteCond %{HTTP_HOST} !^sub2.olddomain.com$ [NC]
RewriteCond %{HTTP_HOST} !^sub3.olddomain.com$ [NC]
RewriteCond %{HTTP_HOST} !^sub4.olddomain.com$ [NC]
RewriteRule ^(.*)$ http://newdomain.com/$1 [R=301,L]
But the subdomains also seem to be loading rather slow. Am I doing anything wrong here? Is there any way to optimise or simplify this (I have around 11 subdomains on the old domain)?
View 1 Replies
View Related
Aug 31, 2007
I am attempting to redirect any subdomain as follows:
subdomain(dot)domain(dot)com to
domain(dot)com/index.php?user=subdomain
I am having some issues doing this though. None of the samples online seem to work. Do I need a wildcard subdomain? Do I need to do anything to the dedicated linux server I am on? I have other sites on the same server all using mod_rewrite successfully.
Here is what I have so far:
RewriteEngine On
RewriteCond %{HTTP_HOST} !^w{3}. [NC]
RewriteCond %{HTTP_HOST} ^([^.]+).domain.com$ [NC]
RewriteRule ^.*$ /index.php?user=%1 [L]
Is there anything I am missing to get this thing working?
View 3 Replies
View Related
Aug 13, 2007
I had the sysadmin install SuPHP - so that my upload script would work properly, however now my mod_rewrite is broken.
You can view the problem here: [url]
It is supposed to show the item with id 29, as you can see. However it shows the gallery index (As if /gallery/ was typed in without the view-29)
The .htaccess file:
Code:
#.htaccess
RewriteEngine On
#This will force trailing slashes
RewriteCond %{SCRIPT_FILENAME} -f [OR]
RewriteCond %{SCRIPT_FILENAME} -d
RewriteRule .* - [L]
#RewriteCond %{REQUEST_URI} !^*(css|png|jpe?g|gif)
RewriteRule ^(.+)/(.+)/?$ $1.php?args=$2 [QSA,L]
RewriteRule ^(.+)$ $1.php [QSA,L,NC]
My very framework relies on the .htaccess working this way... I can turn it off, however I would really rather not - so if you have any idea how I can fix this, please do tell.
And on a related note, is it possible to run PHP under a user and not use cgi_php?
View 14 Replies
View Related
Aug 6, 2007
how can I run a equivalent on lighttpd like this:
# BEGIN WordPress
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteBase /blog/
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule . /blog/index.php [L]
</IfModule>
# END WordPress
View 0 Replies
View Related
Apr 3, 2007
I've got a big .htaccess file which works brilliantly in mod_rewrite for apache. However, the client I want to use it for uses a windows server which is based on IIS.
Does anyone have experience with rewriting urls on IIS. Is it easy, could I easily change this:
RewriteCond %{REQUEST_URI} !^/(.+).php$
RewriteCond %{REQUEST_URI} !^/$
RewriteCond %{REQUEST_URI} !^/products.php$
RewriteCond %{REQUEST_URI} !^/special-offers.php$
RewriteCond %{REQUEST_URI} !^/best-sellers.php$
RewriteCond %{REQUEST_URI} !^/spares.php$
RewriteCond %{REQUEST_URI} !^/images/
RewriteCond %{REQUEST_URI} !^/css/
RewriteCond %{REQUEST_URI} !^/components/
RewriteCond %{REQUEST_URI} !^/Special_Offers
RewriteCond %{REQUEST_URI} !^/Best_Sellers
RewriteCond %{REQUEST_URI} !^/Spares
RewriteRule ^([^/]+)/?$ products.php?show=cats&main_category=$1
Into something that would work. Someone mentioned using asp.net but I've never looked at this before, and can't afford to spend too long this.
Is there a quick/reliable solution (apart from switching webserver).
View 3 Replies
View Related
Dec 3, 2006
I have come across some stuff on the internet that has a file structure looking like this:
/~root/guests
/~operator/a
What does the ~ stand for? Is it something to do with a linux directory structure?
View 3 Replies
View Related
Sep 16, 2008
Which of those directories: usr and var are allowed to rename for a moment and mount their content on a new HD so that SSH and server will not stop work?
View 2 Replies
View Related
Jan 16, 2007
Running a Linux server, how can I see all the directories? And is there a common list of directories on all Linux servers?
View 10 Replies
View Related
May 1, 2006
Hey guys... Not sure if this was posted yet, couldn't find anything on a first-glance search.
Netfirms has finally added mod_rewrite capabilities as well as better .htacces support! Now I'm completely happy. I was considering switching over to Dreamhost due to the fact that I've started running blog software and messy URLs = crap. Now there's no need. That was pretty much the only thing that was holding me back from a full endorsement, so if anyone's looking for a good cheap hosting plan, here's some of the stuff that I'm really happy about for $5 a month:
- quick, personal customer service (I think there's only 1 or 2 guys, and they always seem to be able to answer my questions on the spot)
- mod_rewrite
- .htaccess
- reliable clean FTP (no _vti files or other annoying folders like so many companies these days)
- good online knowledgebase
- nice online site stats viewer
- a bunch of other great stuff that I probably have forgotten about or don't use
- only $5!
Just thought I'd share in case the news hadn't spread yet. Not sure when they added it, but I noticed the "NEW" sticker today.
View 3 Replies
View Related
May 2, 2007
If I want to apply a rule if (Condition A and (Condition B OR Condition C)) is true, will the following work?
RewriteCond Condition A
RewriteCond Condition B [OR]
RewriteCond Condition C
Or will the following?
RewriteCond Condition B [OR]
RewriteCond Condition C
RewriteCond Condition A
Or neither? Or both?
View 2 Replies
View Related
Jul 14, 2009
I'm moving a framework over to a new server for a client and they're using IIS. Is there an IIS equivalent to the following two lines of mod_rewrite code from Apache?
Code:
RewriteCond %{REQUEST_FILENAME} !-f
RewriteRule ^(.*)$ pamwf.php?PAMWF_PATH_QUERY=$1 [L,QSA]
View 4 Replies
View Related
Jun 3, 2009
figure out an .htaccess rewrite rule?
I am trying to rewrite everything in the web root folder to use a /blog/ folder.
So for example, if someone goes to [url] then I need it to actually serve the file from [url]
(But not a redirect.. ideally the browser should still show [url]
Is this possible?
View 1 Replies
View Related
May 15, 2008
I am trying to figure out how to use mod_rewrite to make my php url's friendly. I have read a few articles but none seem to do what I want.
Here is what I want:
/login.php -> /login
/home.php -> /home
/users/update_profile.php -> /users/update_profile
/users/update_profile.php?id=343242 -> /users/update_profile/343242
Basically just strip off the .php extension, so it seems like php files are actually folders.
View 0 Replies
View Related