: Could the robots.txt file be overridden by another robots.txt in sub folder? I know robots.txt is supposed to go in the root directory. But, could it be overridden by another robots.txt inside
I know robots.txt is supposed to go in the root directory. But, could it be overridden by another robots.txt inside a sub directory?
More posts by @Murray432
1 Comments
Sorted by latest first Latest Oldest Best
No. It is only valid to have one robots.txt file which is paced inside the root web directory of the website. Other robots.txt files are invalid and will be ignored (and never even looked for as crawlers only look in the root directory and never elsewhere. You can't even tell them to look elsewhere).
Terms of Use Create Support ticket Your support tickets Stock Market News! © vmapp.org2024 All Rights reserved.