: Should I disallow(robots.txt) archive/author pages with links already available on the front page? I am working on a simple Wordpress blog where when an article is published, it appears on ALL

I am working on a simple Wordpress blog where when an article is published, it appears on ALL these pages:

Homepage - Headline(clickable) + 3-line summary
Parent category page - Headline(clickable) + 3-line summary
Child category page - Headline(clickable) + 3-line summary
Author page - Headline(clickable)
sitemap.xml

A good example of what I mean is:
wp-themes.com/twentyfourteen/
The "Worth A Thousand Words" article is available on the homepage.

But it's also available on the category page: wp-themes.com/?cat=1
And finally, it's also available on the author apge: wp-themes.com/?author=1
Does it makes sense to let Google crawl wp-themes.com/?author=1 knowing that all links on that page were already crawled elsewhere?

I've been in fact told that I should add all author pages to my robots.txt, under disallow, so as search engine bots do not spider /author/*(or anything with ?author for the above example) since all links on these pages are indeed available elsewhere.

Is this a good approach or maybe rel=nofollow is better, or maybe I shouldn't worry about this at all?

10.01% popularity Vote Up Vote Down

: Country specific SEO I have a wordpress site which is located at a .com address. The site is a simple 4 page personal site with my academic credentials, publications and a health blog that

@Lee4591628

Posted in: #MultipleDomains #Seo

1 Comments

: 301 redirect to 404 page or set status code to 404 and stay on page? I have a number of pages on my website that only administrators can access and access to these pages is given if a

@Lee4591628

Posted in: #301Redirect

4 Comments

: How to improve image indexing I have a curious problem: In Google Webmaster Tools, it shows that from my sitemap 330 images submitted and only 6 are indexed. I try to put alt tags, descriptive

@Lee4591628

Posted in: #GoogleImageSearch #GoogleSearchConsole #Images

0 Comments

: Can goals in Google Analytics be backdated after the goal's URL changed? We've redesigned our site, and the single goal URL that we used became out of date. We forgot to update it, but have

@Lee4591628

Posted in: #Goals #GoogleAnalytics

1 Comments

Login to post a comment!

1 Comments

Sorted by latest first Latest Oldest Best

@Annie201

Googlebot is very well aware of WordPress sites and it's highly unlikely that it will punish a WordPress site for having content on several very common WordPress pages.

If you start playing around with robots.txt and rel=unfollow it's easy to shoot yourself in the foot.

You could install one of the SEO plugins that only places short versions of articles on author and category pages, but I don't think it's worth the effort in most cases. Moreover you're more likely to attract long tail keyword traffic with author and category pages as they are.

So in short: Don't worry about it.

10% popularity Vote Up Vote Down

Feed

: Should I disallow(robots.txt) archive/author pages with links already available on the front page? I am working on a simple Wordpress blog where when an article is published, it appears on ALL

More posts by @Lee4591628

: Country specific SEO I have a wordpress site which is located at a .com address. The site is a simple 4 page personal site with my academic credentials, publications and a health blog that

: 301 redirect to 404 page or set status code to 404 and stay on page? I have a number of pages on my website that only administrators can access and access to these pages is given if a

: How to improve image indexing I have a curious problem: In Google Webmaster Tools, it shows that from my sitemap 330 images submitted and only 6 are indexed. I try to put alt tags, descriptive

: Can goals in Google Analytics be backdated after the goal's URL changed? We've redesigned our site, and the single goal URL that we used became out of date. We forgot to update it, but have

Login to post a comment!

1 Comments

Back to top | Use Dark Theme