: Robots.txt ignored I'm working on a joomla website, and robots.txt is messing with me... i have it in domain.com/website/robots.txt and I just wanna prevent users from browsing directories. By
I'm working on a joomla website, and robots.txt is messing with me... i have it in domain.com/website/robots.txt and I just wanna prevent users from browsing directories.
By default it had Disallow: /images/ and the rule works, can't access the folder. I tried to add Disallow: /images/thumbnails and that one didn't work.
I commented out Disallow: /images/ just to test. The folder IS STILL inaccessible.
There is no other instance of robots.txt on my domain.
Why are my changes on robots.txt being ignored ? Is there some other file that could override it ?
More posts by @Alves908
1 Comments
Sorted by latest first Latest Oldest Best
Robots.txt is not used for preventing users to browse directories. Directory browsing is handled by the web server settings.
All robots.txt does is asking search engines to not index the content within the directories that you specify.
Terms of Use Create Support ticket Your support tickets Stock Market News! © vmapp.org2024 All Rights reserved.