: Robots.txt blocking homepage on mobile SERP's but not desktop The meta data for the homepage on mobile is stating that the robots.txt file is blocking the page from being crawled. This is not

The meta data for the homepage on mobile is stating that the robots.txt file is blocking the page from being crawled.

This is not the case for desktop.

Desktop and mobile have the same domain, we have not changed the robots.txt file and this is a recent issue.

I know that there is a separate index for mobile and desktop but was wondering if there were any other reasons this could occur?

10.01% popularity Vote Up Vote Down

: How to improve the Autosuggestion Google Maps I have seen the following example of the Autosuggestion Google Maps feature https://developers.google.com/maps/documentation/javascript/examples/places-autocomplete?hl=en

@Connie744

Posted in: #GoogleMaps #Javascript #Usability

0 Comments

: Event based triggers in AB testing using VWO Is it possible to create an AB test where 100% of users see a page and only those that click a button are entered into the variation in VWO

@Connie744

Posted in: #ABTesting

1 Comments

: Only rel="prev" attribute At my site I can set only <link rel='prev' /> without next part. Will robots index pages in appropriate way (show first page instead of random page from list)

@Connie744

Posted in: #Html #Pagination #Rel #Seo

1 Comments

: How to switch to https in webmaster tools? We will be trying to add SSL to our website pretty soon , in the demo server we achieve everything perfect, the thing now is not to loose the

@Connie744

Posted in: #GoogleSearchConsole #Https

1 Comments

Login to post a comment!

1 Comments

Sorted by latest first Latest Oldest Best

@Cofer257

Open Search Console and go to Crawl -> 'robots.txt Tester'

At the dropdown for the latest version seen, it will list any times at which it had issues getting the robots.txt or times it was recently updated. Double check that Google isn't having problems reading it or has pulled an old copy. Then enter URL for the mobile homepage into the test area and hit 'TEST'.

It's also worth double checking that the page HTML doesn't contain a 'noindex' meta tag.

If all of that is fine, it's likely a bug you'll want to raise with Google. Homepages tend to be high priority and re-scraped often. Use the 'Help' dropdown top right to check.

10% popularity Vote Up Vote Down

Feed

: Robots.txt blocking homepage on mobile SERP's but not desktop The meta data for the homepage on mobile is stating that the robots.txt file is blocking the page from being crawled. This is not

More posts by @Connie744

: How to improve the Autosuggestion Google Maps I have seen the following example of the Autosuggestion Google Maps feature https://developers.google.com/maps/documentation/javascript/examples/places-autocomplete?hl=en

: Event based triggers in AB testing using VWO Is it possible to create an AB test where 100% of users see a page and only those that click a button are entered into the variation in VWO

: Only rel="prev" attribute At my site I can set only <link rel='prev' /> without next part. Will robots index pages in appropriate way (show first page instead of random page from list)

: How to switch to https in webmaster tools? We will be trying to add SSL to our website pretty soon , in the demo server we achieve everything perfect, the thing now is not to loose the

Login to post a comment!

1 Comments

Back to top | Use Dark Theme