: Unverified and verified Bing crawlers from same subnet I have some traffic from Bing crawlers I'm trying to verify. I'm using the method Bing suggests, namely reverse and then forward DNS lookup,

@Carla537

Posted in: #Bing #Dns #SearchEngines #WebCrawlers

I have some traffic from Bing crawlers I'm trying to verify. I'm using the method Bing suggests, namely reverse and then forward DNS lookup, but I'm seeing some strange results -

$ host 131.253.27.70
70.27.253.131.in-addr.arpa domain name pointer msnbot-131-253-27-70.search.msn.com.
$ host msnbot-131-253-27-70.search.msn.com
msnbot-131-253-27-70.search.msn.com has address 131.253.27.70
$ host 131.253.27.96
96.27.253.131.in-addr.arpa domain name pointer msnbot-131-253-27-96.search.msn.com.
$ host msnbot-131-253-27-96.search.msn.com
Host msnbot-131-253-27-96.search.msn.com not found: 3(NXDOMAIN)


As you can see I have one IP that resolves both the reverse and forward DNS lookups, so it's definitely verified. Then I have a second IP, from the same subnet that has the correct reverse DNS domain, but the forward DNS lookup returns no values.

What's going on here? These have to both be verified crawlers, right? Does Bing simply not maintain these DNS records properly?

Vote Up Vote Down

Login to post a comment!