Mobile app version of vmapp.org
Login or Join
Miguel251

: Google not re-crawling subpages after "fetch as Google" with the "directly linked pages" option After fixing a "noindex" issue on my WordPress website, where all my pages failed to be crawled

@Miguel251

Posted in: #Noindex #WebCrawlers

After fixing a "noindex" issue on my WordPress website, where all my pages failed to be crawled by Google, I used Google Webmaster to re-index the website (without waiting). But it worked only for the home page although I requested re-crawl of any directly-linked pages as well.

Example of a sub page that initially didn't get indexed:
www.trophit.com/index.php/what-is-trophit/

If I manually tell GW to crawl each page URL, then it does it, but that's not acceptable. Something still blocks Google from properly crawling the entire site on its own... Any ideas?

10.01% popularity Vote Up Vote Down


Login to follow query

More posts by @Miguel251

1 Comments

Sorted by latest first Latest Oldest Best

 

@Bryan171

Im going out on a limb and since there is no word of it. I will answer based on experience.

Submit a sitemap > then fetch as Google (usually takes a couple of minutes) > submit to index.

Creating a sitemap in Wordpress plugin

I have had a client ask me to use index, nofollow
They were crawled, then asked me to change to index, follow and it was updated within 1 week.

I have had sites live for long periods, without submitting a sitemap and only the home page was indexed.

Of course nothing is 100% when Google is concerned but you can narrow it down rather quickly.

10% popularity Vote Up Vote Down


Back to top | Use Dark Theme