Mobile app version of vmapp.org
Login or Join
Megan663

: Does a "nofollow" attribute on a link prevent URL discovery by search engines? I know that nofollow prevents link juice from being passed across a link. But if search engine robots discover

@Megan663

Posted in: #Nofollow #WebCrawlers

I know that nofollow prevents link juice from being passed across a link. But if search engine robots discover a link with a nofollow on it, will they add that link to their crawl queue?

In other words, if I create a link to a brand new page and put a rel=nofollow attribute on that link, will it prevent search engine bots (particularly Googlebot) from crawling the page. (Assuming that this link remains the only link into that page.)

I've read conflicting reports about this over the years and I'm looking for authoritative references about the current state of affairs. Official statements from Google or published results of independent testing would be ideal.

10.02% popularity Vote Up Vote Down


Login to follow query

More posts by @Megan663

2 Comments

Sorted by latest first Latest Oldest Best

 

@Megan663

This article from 2006 explains an experiment where a new page was created an linked to only with nofollow.

It finds that Google:


Follows the link (crawls the URL with Googlebot)
Does not index the content of the page


The article also publishes results for MSN and Yahoo.

In 2009 Google significantly changed the way that nofollow works. Results regarding nofollow from before before the change would be good to re-test. A 2012 experiment on the discovery of a URL from a nofollow link found that the page does not get indexed (although it does not report on whether or not it got crawled.) [Credit: moobot from the comments.]

10% popularity Vote Up Vote Down


 

@Kaufman445

Implementation of rel=nofollow on links will instruct a search engine not to follow the link. It won't, however (necessarily) prevent the linked page from getting indexed (purely as a URL) but it will prevent the contents at that URL from being indexed providing that there are no other followed links to the same destination elsewhere on the web.

This confirms what's already stated by both comments but also personal experience also confirms this is what happens also.

10% popularity Vote Up Vote Down


Back to top | Use Dark Theme