: AdsBot-Google making requests that include the domain name and result in 404 AdsBot-Google bot has recently started making a lot of requests results in 404. These are not likely to ever be requested
AdsBot-Google bot has recently started making a lot of requests results in 404. These are not likely to ever be requested by users and all include the domain name so instead of requesting /index.html it requests /example.org/index.html which, of course, leads to 404.
Anyone else who has experienced similar things and have ideas on remedying the situation? For now, I think I'll simply add a block on the robots.txt file.
When this started happening, we weren't running AdSense on our website. However, some AdWords campaigns were created (yet not launched) if that helps.
Here are some sample requests. The IPs are from Google:
> IP[66.249.89.119] REQUEST[/colnect.com/en/stamps/list/year/1949/country/2979-Deutschland_DDR]
> REFERER[] AGENT[AdsBot-Google (+http://www.google.com/adsbot.html)]
> IP[66.249.89.119] REQUEST[/colnect.com/en/coins/list/page/4/currency/1601-Talar_niemiecki]
> REFERER[] AGENT[AdsBot-Google (+http://www.google.com/adsbot.html)]
> IP[66.249.89.121] REQUEST[/colnect.com/en/coins/list/currency/17-z▒_-_Polski_z▒oty/year/1966]
> REFERER[] AGENT[AdsBot-Google (+http://www.google.com/adsbot.html)]
> IP[66.249.89.121] REQUEST[/colnect.com/en/coins/list/country/2097-Malta] REFERER[]
> AGENT[AdsBot-Google (+http://www.google.com/adsbot.html)]
> IP[66.249.89.119] REQUEST[/colnect.com/en/coins/countries/collection/vargasvict]
> REFERER[] AGENT[AdsBot-Google (+http://www.google.com/adsbot.html)]
> IP[66.249.89.117] REQUEST[/colnect.com/en/coins/list/series/72659-1824~1830_-_Carlos_X/country/1208-Francia]
> REFERER[] AGENT[AdsBot-Google (+http://www.google.com/adsbot.html)]
> IP[66.249.89.121] REQUEST[/colnect.com/en/banknotes/series/country/4146-Rusija]
> REFERER[] AGENT[AdsBot-Google (+http://www.google.com/adsbot.html)]
> IP[66.249.89.117] REQUEST[/colnect.com/en/banknotes/list/variant/1489] REFERER[]
> AGENT[AdsBot-Google (+http://www.google.com/adsbot.html)]
> IP[66.249.89.121] REQUEST[/colnect.com/en/stamps/years/country/10648-▒е▒м▒д▒кие_▒▒▒▒ова]
> REFERER[] AGENT[AdsBot-Google (+http://www.google.com/adsbot.html)]
> IP[66.249.89.121] REQUEST[/colnect.com/en/phonecards/phonecard/454762-Zodiac_-Rabbit-KS-JTTLx_-_Zodiac_countrywide_valid-JITONG-中▒]
> REFERER[] AGENT[AdsBot-Google (+http://www.google.com/adsbot.html)]
More posts by @Sue5673885
Terms of Use Create Support ticket Your support tickets Stock Market News! © vmapp.org2024 All Rights reserved.