how-to-diagnose-htaccess-speed-issues-via-rewritelog but more clearly explained below) We have a site

Posted in: #Htaccess #Performance #UrlRewriting

(Same issue as stackoverflow.com/questions/3987754/how-to-diagnose-htaccess-speed-issues-via-rewritelog but more clearly explained below)

We have a site which has scripts like this:
www.oursite.com/abcd/somescript.php

We also have URL rewritten pages like this:
www.oursite.com/abcd/events/Anything/Anything/abc/abc.html

All of these share 90% same content in terms of js, css, and image files.

But the URL rewritten pages are extra-ordinary slow to load. Similarly, clicking on ANY link within such a page which leads to another such page is also very slow!

It strongly looks like that the browser is reloading the page completely and not using the cached images which should be present on the browser.

I turned on RewriteLog (at level 2) in Apache's httpd.conf and it shows the below when I:

Accessed the homepage at: example.com/abcd/ Clicked on the link to browse categories
Clicked on the category - Language

URL/sid#ID = example.com/sid#2b06c5712d30

Step 1
IPADDRESS - - [DATETIME] [URL/sid#ID][rid#2b06d56caf10/initial] (1) [perdir ar/www/html/abcd/] pass through /var/www/html/abcd/index.php
Step 2
IPADDRESS - - [DATETIME] [URL/sid#ID][rid#2b06d56caf10/initial] (2) [perdir /var/www/html/abcd/] rewrite 'classes-events.html' -> 'browse.php?type=classes-events'
IPADDRESS - - [DATETIME] [URL/sid#ID][rid#2b06d56caf10/initial] (2) [perdir /var/www/html/abcd/] trying to replace prefix /var/www/html/abcd/ with /abcd/
IPADDRESS - - [DATETIME] [URL/sid#ID][rid#2b06d56caf10/initial] (1) [perdir /var/www/html/abcd/] internal redirect with /abcd/browse.php [INTERNAL REDIRECT]
IPADDRESS - - [DATETIME] [URL/sid#ID][rid#2b06d56d8528/initial/redir#1] (1) [perdir /var/www/html/abcd/] pass through /var/www/html/abcd/browse.php
IPADDRESS - - [DATETIME] [URL/sid#ID][rid#2b06d56caf10/initial] (1) [perdir /var/www/html/abcd/] pass through /var/www/html/abcd/ajax/showUserData.php
IPADDRESS - - [DATETIME] [URL/sid#ID][rid#2b06d56caf10/initial] (1) [perdir /var/www/html/abcd/] pass through /var/www/html/abcd/ajax/showUserData.php
IPADDRESS - - [DATETIME] [URL/sid#ID][rid#2b06d56caf10/initial] (1) [perdir /var/www/html/abcd/] pass through /var/www/html/abcd/ajax/showUserData.php
IPADDRESS - - [DATETIME] [URL/sid#ID][rid#2b06d56caf10/initial] (1) [perdir /var/www/html/abcd/] pass through /var/www/html/abcd/ajax/browse.php
Step 3
IPADDRESS - - [DATETIME] [URL/sid#ID][rid#2b06d56caf10/initial] (2) [perdir /var/www/html/abcd/] rewrite 'classes-events/Language/206.html' -> 'browse.php?type=classes-events&catId=206'
IPADDRESS - - [DATETIME] [URL/sid#ID][rid#2b06d56caf10/initial] (2) [perdir /var/www/html/abcd/] trying to replace prefix /var/www/html/abcd/ with /abcd/
IPADDRESS - - [DATETIME] [URL/sid#ID][rid#2b06d56caf10/initial] (1) [perdir /var/www/html/abcd/] internal redirect with /abcd/browse.php [INTERNAL REDIRECT]
IPADDRESS - - [DATETIME] [URL/sid#ID][rid#2b06d56d8948/initial/redir#1] (1) [perdir /var/www/html/abcd/] pass through /var/www/html/abcd/browse.php
IPADDRESS - - [DATETIME] [URL/sid#ID][rid#2b06d56ccf20/initial] (2) [perdir /var/www/html/abcd/] rewrite 'classes-events/Language/ajax/showUserData.php' -> 'ajax/showUserData.php'
IPADDRESS - - [DATETIME] [URL/sid#ID][rid#2b06d56ccf20/initial] (2) [perdir /var/www/html/abcd/] trying to replace prefix /var/www/html/abcd/ with /abcd/
IPADDRESS - - [DATETIME] [URL/sid#ID][rid#2b06d56ccf20/initial] (1) [perdir /var/www/html/abcd/] internal redirect with /abcd/ajax/showUserData.php [INTERNAL REDIRECT]
IPADDRESS - - [DATETIME] [URL/sid#ID][rid#2b06d56d59d8/initial/redir#1] (1) [perdir /var/www/html/abcd/] pass through /var/www/html/abcd/ajax/showUserData.php
IPADDRESS - - [DATETIME] [URL/sid#ID][rid#2b06d56ccf20/initial] (2) [perdir /var/www/html/abcd/] rewrite 'classes-events/Language/ajax/showUserData.php' -> 'ajax/showUserData.php'
IPADDRESS - - [DATETIME] [URL/sid#ID][rid#2b06d56ccf20/initial] (2) [perdir /var/www/html/abcd/] trying to replace prefix /var/www/html/abcd/ with /abcd/
IPADDRESS - - [DATETIME] [URL/sid#ID][rid#2b06d56ccf20/initial] (1) [perdir /var/www/html/abcd/] internal redirect with /abcd/ajax/showUserData.php [INTERNAL REDIRECT]
IPADDRESS - - [DATETIME] [URL/sid#ID][rid#2b06d56da9f8/initial/redir#1] (1) [perdir /var/www/html/abcd/] pass through /var/www/html/abcd/ajax/showUserData.php
IPADDRESS - - [DATETIME] [URL/sid#ID][rid#2b06d56cef30/initial] (2) [perdir /var/www/html/abcd/] rewrite 'classes-events/Language/ajax/showUserData.php' -> 'ajax/showUserData.php'
IPADDRESS - - [DATETIME] [URL/sid#ID][rid#2b06d56cef30/initial] (2) [perdir /var/www/html/abcd/] trying to replace prefix /var/www/html/abcd/ with /abcd/
IPADDRESS - - [DATETIME] [URL/sid#ID][rid#2b06d56cef30/initial] (1) [perdir /var/www/html/abcd/] internal redirect with /abcd/ajax/showUserData.php [INTERNAL REDIRECT]
IPADDRESS - - [DATETIME] [URL/sid#ID][rid#2b06d56f4268/initial/redir#1] (1) [perdir /var/www/html/abcd/] pass through /var/www/html/abcd/ajax/showUserData.php
IPADDRESS - - [DATETIME] [URL/sid#ID][rid#2b06d56cef30/initial] (2) [perdir /var/www/html/abcd/] rewrite 'classes-events/Language/ajax/browse.php' -> 'ajax/browse.php'
IPADDRESS - - [DATETIME] [URL/sid#ID][rid#2b06d56cef30/initial] (2) [perdir /var/www/html/abcd/] trying to replace prefix /var/www/html/abcd/ with /abcd/
IPADDRESS - - [DATETIME] [URL/sid#ID][rid#2b06d56cef30/initial] (1) [perdir /var/www/html/abcd/] internal redirect with /abcd/ajax/browse.php [INTERNAL REDIRECT]
IPADDRESS - - [DATETIME] [URL/sid#ID][rid#2b06d57127d8/initial/redir#1] (1) [perdir /var/www/html/abcd/] pass through /var/www/html/abcd/ajax/browse.php

Edit 1 - this is the .htaccess that we're using

RewriteEngine On
RewriteBase /abcd/

RewriteRule ^.*/codelibrary/(.*)$ codelibrary/ [L] #RewriteCond %{THE_REQUEST} in_upload/images/(.*) [NC,OR]
RewriteRule ^.*/in_upload/images/(.*)$ in_upload/images/ [L]
RewriteCond %{REQUEST_URI} !in_upload/(.*).
RewriteRule ^.*/images/(.*)$ images/ [L]
RewriteRule ^.*/admin/ajax/(.*)$ admin/ajax/ [L]
RewriteCond %{REQUEST_URI} !admin/(.*).
RewriteRule ^.*/ajax/(.*)$ ajax/ [L]

RewriteRule ^.*/banner_images/(.*)$ banner_images/ [L]
#php_flag magic_quotes_gpc off
RewriteRule (.*)invite/([a-zA-Z0-9]+)$ referer.php?in_name=
RewriteRule (.*)cms/([a-zA-Z-]*).html$ static-pages.php?page_url= [L]
RewriteRule ^([a-zA-Z0-9]+)$ t-profile-public.php?name=

RewriteRule (.*)cms/([a-zA-Z-]*).html$ static-pages.php?page_url= [L]

RewriteRule (.*)classes-events.html$ browse.php?type=classes-events [L]
RewriteRule (.*)ins.html$ browse.php?type=ins [L]
RewriteRule (.*)orgs.html$ browse.php?type=orgs [L]
RewriteRule (.*)random-content.html$ browse.php?type=content&random_order=1 [L]
RewriteRule (.*)content.html$ browse.php?type=content [L]

RewriteRule ^([a-zA-Z-]*)/([a-zA-Z0-9s]*)/([0-9]*).html$ browse.php?type=&catId= [L]
RewriteRule ^([a-zA-Z-]*)/([a-zA-Z0-9s]*)/([a-zA-Z0-9s]*)/([0-9]*)/([0-9]*).html$ browse.php?type=&catId=&subCatId= [L] #RewriteRule (.*)search/all/([a-zA-Z0-9s]*)$ searchall.php?type=all&srcval= [L]
#RewriteRule (.*)search/([a-zA-Zs-]*)/([a-zA-Z0-9s]*)$ search.php?type=&srcval= [L]
#RewriteRule (.*)search/([a-zA-Zs-]*)/all/([a-zA-Z0-9s]*)$ search.php?type=&srcval=&seeall=all [L]
#RewriteRule (.*)featured/([a-zA-Zs-]*)$ featured-listing.php?type=&feature=1 [L]
#RewriteRule (.*)featured/([a-zA-Z-]*)/([a-zA-Z0-9s]*)/([0-9]*).html$ featured-listing.php?type=&catId=&feature=1 [L]

RewriteRule (.*)search/all/(.*)$ searchall.php?type=all&srcval= [L]
RewriteRule (.*)search/([a-zA-Zs-]*)/all/(.*)$ search.php?type=&srcval=&seeall=all [L]
RewriteCond %{REQUEST_URI} !all/(.*).
RewriteRule (.*)search/([a-zA-Zs-]*)/(.*)$ search.php?type=&srcval= [L]
RewriteRule (.*)featured/(.*)$ featured-listing.php?type=&feature=1 [L]
RewriteRule (.*)featured/([a-zA-Z-]*)/(.*)/([0-9]*).html$ featured-listing.php?type=&catId=&feature=1 [L]
ErrorDocument 404 www.oursite.com/abcd/404.php

10.02% popularity Vote Up Vote Down

: Putting adverts on my website I'd like to start putting ads on my site but I'm quite fussy about the way things look so I'd like to have attractive adverts that work as a feature of the

@Debbie626

Posted in: #Advertising

3 Comments

: Categorize website based on visitors count my site is having around 300 unique visits/5000 pageviews per day. i want to know how many unique visits/page views (approx.) a site should have to

@Debbie626

Posted in: #HttpServer #WebHosting

2 Comments

: Measuring site load times after user is logged in? How can I test my site "as if" users have logged in and then accessing different parts of the website? I saw Is there a good way to measure

@Debbie626

Posted in: #LoadTime #Measure

3 Comments

: Best way to let users choose country/language when submiting an URL to a directory I want to offer the user the possibility to add the country/language for websites they would submit to a fairly

@Debbie626

Posted in: #Usability #UserFriendly #UserInput

1 Comments

Login to post a comment!

2 Comments

Sorted by latest first Latest Oldest Best

@Cofer257

Whew, that's one hefty .htaccess! One thing you may not be aware of is that the [L] flag doesn't completely stop processing on htaccess rules. Instead, it stops there and makes a new request for the rewritten URL - which starts matching the rules from the beginning again. See here for more details.

Some of your other rules look a little verbose. By default rules match anywhere in the URL, unless you specify ^ at the beginning or $ at the end. Therefore on this rule:

RewriteRule (.*)orgs.html$ browse.php?type=orgs [L]

The (.*) is not necessary and can be removed - Apache will still look for any URL ending in orgs.html.

Also check how necessary those rules are - do you really need to match any URL ending in orgs.html, or is it only ever at example.com/orgs.html ?

Finally, the asterisk modifier searches for "zero or more characters" - so cms/([a-zA-Z-]*).html$ would match cms/.html. Many of them ought to be replaced with the plus sign to match at least one character - e.g. cms/([a-zA-Z-]+).html$

10% popularity Vote Up Vote Down

@Ann8826881

How many rewrite rules do you have? If you have many rules, are you using the [L] modifier to make sure the rewrite engine doesn't check rules unnecessarily?

10% popularity Vote Up Vote Down

Feed

: URL rewritten pages take much longer to load (Same issue as https://stackoverflow.com/questions/3987754/how-to-diagnose-htaccess-speed-issues-via-rewritelog but more clearly explained below) We have a site

More posts by @Debbie626

: Putting adverts on my website I'd like to start putting ads on my site but I'm quite fussy about the way things look so I'd like to have attractive adverts that work as a feature of the

: Categorize website based on visitors count my site is having around 300 unique visits/5000 pageviews per day. i want to know how many unique visits/page views (approx.) a site should have to

: Measuring site load times after user is logged in? How can I test my site "as if" users have logged in and then accessing different parts of the website? I saw Is there a good way to measure

: Best way to let users choose country/language when submiting an URL to a directory I want to offer the user the possibility to add the country/language for websites they would submit to a fairly

Login to post a comment!

2 Comments

Back to top | Use Dark Theme