: For Google, in particular, the following rules will do the trick: User-Agent: * Allow: /$ Disallow: / For details, see Google's documentation of their supported robots.txt syntax. However, note
For Google, in particular, the following rules will do the trick:
User-Agent: *
Allow: /$
Disallow: /
For details, see Google's documentation of their supported robots.txt syntax. However, note that the middle line is non-standard for two reasons: first, it's an Allow directive (the basic robots.txt standard only supports Disallow) and second, it uses the non-standard end-of-URL anchor $. That said, several other major search engines, including Bing, do support more or less the same syntax.
More posts by @Phylliss660
Terms of Use Create Support ticket Your support tickets Stock Market News! © vmapp.org2024 All Rights reserved.