: If your controllers are not called directly via a URL (e.g. they are web pages that you can pull up in a browser and output HTML but are files that are included via a server side technology)
If your controllers are not called directly via a URL (e.g. they are web pages that you can pull up in a browser and output HTML but are files that are included via a server side technology) then Google won't index them or even know about them. Google doesn't see your server side code. They only see the HTML it produces.
Now if the pages that include those controllers are being indexed by Google then you need to block those URLs. Simply adding the directories where an included file resides will have absolutely no effect on search engine crawlers.
For example, if www.example.com/test/ uses a controller in the /floors/ directory:
If you want that page to be indexed, do nothing.
If you do not want www.example.com/test/ to be indexed, then you need to add /test/ to your robots.txt file.
Having /floors/ in your robots.txt will have no effect on www.example.com/test/ being indexed because Google doesn't see the /floors/ directory. They only see the output from www.example.com/test/.
FYI, Disallow: / tells search engines not to index your site at all. If you want Google to index your content you'll need to remove that line.
More posts by @Kristi941
Terms of Use Create Support ticket Your support tickets Stock Market News! © vmapp.org2024 All Rights reserved.