: How block only Yandex bot Can you show me how will look robots.txt when I block only yandex bot, allow Google bot and block Yandex bot.
Can you show me how will look robots.txt when I block only yandex bot,
allow Google bot and block Yandex bot.
More posts by @Kimberly868
1 Comments
Sorted by latest first Latest Oldest Best
There are many "Yandex bots". If you want to block all the Yandex bots then:
User-agent: Yandex
Disallow: /
However, if you only want to block the main indexing "YandexBot" then:
User-agent: YandexBot
Disallow: /
Source: yandex.com/support/webmaster/controlling-robot/robots-txt.xml
You don't need to do anything for Googlebot (or any other bot) if you want the other bots to crawl your site, since allow (crawling) is the default action.
Terms of Use Create Support ticket Your support tickets Stock Market News! © vmapp.org2024 All Rights reserved.