: Is "robots.txt" necessarily needed? Possible Duplicate: Do I need robots.txt? From my understanding robots.txt is only needed to do something different from the norm like exclude a
Possible Duplicate:
Do I need robots.txt?
From my understanding robots.txt is only needed to do something different from the norm like exclude a certain file directory and such, but if this is true why do so many people think it is important on every website? Should I just put it on every website to be sure?
More posts by @Radia820
1 Comments
Sorted by latest first Latest Oldest Best
If you don't have anything that you wan't to tell the searchengines you don't wan't indexed (or crawled) don't. It doesn't impact your indexing.
See this question answered by Google.
Terms of Use Create Support ticket Your support tickets Stock Market News! © vmapp.org2024 All Rights reserved.