Mobile app version of vmapp.org
Login or Join
Turnbaugh106

: User-agent: * Disallow: / The one above tells robots not to crawl anything that matches the URL path. With the above instruction, Googlebot other search engine bots will not crawl your entire

@Turnbaugh106

User-agent: *
Disallow: /


The one above tells robots not to crawl anything that matches the URL path. With the above instruction, Googlebot other search engine bots will not crawl your entire website.

User-agent: *
Allow: /


The one above tells everything is allowed. All visiting bots including Googlebot is allowed to crawl the website.

10% popularity Vote Up Vote Down


Login to follow query

More posts by @Turnbaugh106

0 Comments

Sorted by latest first Latest Oldest Best

Back to top | Use Dark Theme