site+ForceRecrawl:+0 - 80 - 207.46.195.105

I'm seeing this in the iis-logs of two websites that I maintain:

GET /an/existing/page/on/my/site+ForceRecrawl:+0 - 80 - 207.46.195.105 HTTP/1.1 Mozilla/5.0+(compatible;+bingbot/2.0;++http://www.bing.com/bingbot.htm)

I get about one or two of these per day from these IP addresses: 207.46.195.105, 65.52.110.190.. an more, all belonging to msnbot-ip.search.msn.com

Probably Microsoft has a bug in their crawler? Any way, doing a search on "ForceRecrawl: 0" in major search engines comes up with a bunch of random sites. Doing the search on StackOverflow or here gave no results (to my amazement). Am I the only one seeing this? I first noticed these on the 9th of this month, and I'm seeing them pass almost daily since...

Another thing that I think is crazy, is that the URL www.bing.com/bingbot.htm redirects to mail.live.com (hotmail).

Currently I'm returning 404's but I'm considering to catch these, strip the trailing " ForceRecrawl: 0" and process as if it were a legitimate url.

Could anyone shed some light on this? Could it have to do with some configuration or so in Bing's Webmaster Tools?

10.02% popularity Vote Up Vote Down

: Do mobile devices support file uploads via HTML forms? I'm making a job application form for a website where one of the fields lets you attach a CV. I'm also mobile optimising the site with

@Angela700

Posted in: #Html #Mobile

1 Comments

: Streaming videos using Wowza I need to view the streaming videos in my website. For that I have searched and get the answer to use Wowza (just like FMS). I need to know how can I stream

@Angela700

Posted in: #Streaming #Video

2 Comments

: Sites & Tools for comparing domains What are some good tools or websites for comparing websites traffic, SEO, and other factors site owners might want to know about their competition.

@Angela700

Posted in: #Analytics #Seo #Tracking #Traffic

2 Comments

: Recording custom variables to identify individual users with Google Analytics I have been asked by our marketing department to add Google Analytics custom variable tracking to my company's website.

@Angela700

Posted in: #Analytics #AnalyticsApi #GoogleAnalytics

4 Comments

Login to post a comment!

2 Comments

Sorted by latest first Latest Oldest Best

@Speyer207

You should block the bots,

simple dissalow them on the robots.txt and the problem will never appear again, except if they change the name of the bot or create a new one, like the microsoft do, they use the msnbot, now they use the bingbot

10% popularity Vote Up Vote Down

@Si4351233

You're not the only one. It seems to stem from Bing Webmaster tools which includes the option to force the bot to recrawl specific url's. However, this seems to be happening without user request for such forced recrawls.

The bot seems to be adding the instruction %20ForceRecrawl%3A%200 to the end of url's and trying to crawl the url plus the bit on the end, this of course throws up a 404 error.

We've removed some of these using the block function in BWT but it is still throwing up others. It might correct itself, if not, expect a 301 redirect might be needed.

10% popularity Vote Up Vote Down

Feed

: Why does BingBot add "ForceRecrawl: 0" to URLs when crawling my sites? I'm seeing this in the iis-logs of two websites that I maintain: GET /an/existing/page/on/my/site+ForceRecrawl:+0 - 80 - 207.46.195.105

More posts by @Angela700

: Do mobile devices support file uploads via HTML forms? I'm making a job application form for a website where one of the fields lets you attach a CV. I'm also mobile optimising the site with

: Streaming videos using Wowza I need to view the streaming videos in my website. For that I have searched and get the answer to use Wowza (just like FMS). I need to know how can I stream

: Sites & Tools for comparing domains What are some good tools or websites for comparing websites traffic, SEO, and other factors site owners might want to know about their competition.

: Recording custom variables to identify individual users with Google Analytics I have been asked by our marketing department to add Google Analytics custom variable tracking to my company's website.

Login to post a comment!

2 Comments

Back to top | Use Dark Theme