: Google Webmaster Tools reports URLs blocked by robots.txt on my AVS tube website I added a tube (with AVS script) in Google Webmaster Tools, but the issue is with the robots.txt file which

@Angie530

Posted in: #GoogleSearchConsole #RobotsTxt #Sitemap

I added a tube (with AVS script) in Google Webmaster Tools, but the issue is with the robots.txt file which is blocking everything.

Here is my AVS tube robots.txt:

User-agent: *
Allow: /
Disallow: /siteadmin/
Disallow: /cache/
Disallow: /include/
Disallow: /install/
Disallow: /language/
Disallow: /media/
Disallow: /tmp/
Disallow: /classes/
Disallow: /templates/
Disallow: /scripts/
Disallow: /addons/
Disallow: /cron/
Disallow: /contrib/


Have to mention that the site is with non-www version. When someone types in the version of the site it will be redirected to non-www version.

This is the message from Webmaster Tools:


Url blocked by robots.txt.

Sitemap contains urls which are blocked by robots.txt.

Vote Up Vote Down

Login to post a comment!