: Google search console reports URLs blocked by robots.txt even though they shouldn't be Recently I sent a sitemap to Google Search Console and I got some warnings saying that some urls are blocked

@Gail5422790

Posted in: #GoogleSearchConsole #RobotsTxt #Sitemap

Recently I sent a sitemap to Google Search Console and I got some warnings saying that some urls are blocked by the robots.txt. I checked it and there is no single line that blocks the corresponding URLs.

However all the URLs shown in warning start with dash - character.

User-agent: *
Disallow: /Account/
Disallow: /random/
Disallow: /Random/
Disallow: /create/
Disallow: /login/
Disallow: /Login/
Disallow: /Edit/
Disallow: /edit/


This is my up-to-date robots.txt. Is there something about dash ("-") character related to robots.txt?



Update: The issue is solved without us doing nothing. It turns out that even though Google Search Console shows everything okay, robots.txt is not updated internally for a while. It took 16 days to "really" update it.

Vote Up Vote Down

Login to post a comment!