: What is better for SEO robots.txt file or dynamically generated robots.txt URL? I was relying on our custom WordPress package's dynamically generated robots.txt URL for a few sites but it was
I was relying on our custom WordPress package's dynamically generated robots.txt URL for a few sites but it was not being honoured by Google or Bing (plugin URLs were getting indexed despite the rule Disallow /wp-content in robots.txt). I waited for a couple of weeks and uploaded an actual file in the root with the same rules and it worked.
Does this mean that an actual file is better than dynamically generated robots.txt file or is it just me associating some coincidental events?
More posts by @Gonzalez347
2 Comments
Sorted by latest first Latest Oldest Best
No difference at all as far as crawlers are able to access them (with all your valid rules) with HTTP 200 response.
Terms of Use Create Support ticket Your support tickets Stock Market News! © vmapp.org2024 All Rights reserved.