: Why is bingbot / msnbot appending %2Findex.php to my urls? My logs are showing bingbot / msnbot appending %2Findex.php to some of my urls. Any idea why? This makes them invalid and if any
My logs are showing bingbot / msnbot appending %2Findex.php to some of my urls. Any idea why? This makes them invalid and if any users were redirected with it, it would not take them to the correct page. I've poked around a bit and noticed that Findex is a common string in a referrer URL, but it is not valid on my website.
UPDATE
Some Details From the log:
These IPs are both listed as owned by Microsoft
157.55.39.21 - - [11/Jan/2016:10:09:02 -0800] "GET /index.php?grade=7&page=chemistry&page2=crystallization%2Findex.php HTTP/1.1" 200 7308 "-" "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
207.46.13.150 - - [11/Jan/2016:10:00:22 -0800] "GET /index.php?grade=1&page=Games%2Findex.php HTTP/1.1" 200 6427 "-" "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
More posts by @Murray155
1 Comments
Sorted by latest first Latest Oldest Best
I don't have a Findex.php on my server, yet msnbot is requesting this page.
It's not Findex.php, it's %2Findex.php, which (when unescaped) is /index.php. It's also part of the query string, rather than the URL-path (which explains why your server doesn't reject it - as it would on Apache by default if it was in the URL-path).
Do you see similar requests from anywhere else?
It's not uncommon to see quirky requests from scripts checking for vulnerabilities, etc. However, for this to come from bingbot my best guess is that bingbot must have found this URL somehow. Either from a URL (or form submission) on your own site, or from a malformed link to your site from elsewhere. Although if the later then you would perhaps expect to see requests for this URL from other sources.
Terms of Use Create Support ticket Your support tickets Stock Market News! © vmapp.org2024 All Rights reserved.