Mobile app version of vmapp.org
Login or Join
Barnes591

: Does Google crawl page when G+ logo is embedded? I have a robots.txt file in the root to prevent search engines indexing any of my sites. I have a social media management application embedded

@Barnes591

Posted in: #Pagerank #RobotsTxt #Seo #SocialMedia

I have a robots.txt file in the root to prevent search engines indexing any of my sites. I have a social media management application embedded on my site that includes all major social media channels including G+.

I heard that once the G+ symbol is on a site Google will index sites despite having a robots.txt in the root. Is this true?

My thought behind locking out robots for a while is so I increase visitors per day first before allowing robots to crawl. Once I e.g. reach 100 visitors a day I will remove robots.txt file and will then receive a better initial page rank (in mind that PR is only updated every couple of months). Is this reasonable? How much emphasize is placed on the factor %visitor increase/day?

10.02% popularity Vote Up Vote Down


Login to follow query

More posts by @Barnes591

2 Comments

Sorted by latest first Latest Oldest Best

 

@Megan663

If you put a Google +1 button on your page, Googlebot will crawl the page even if the page is blocked by robots.txt. From the Google+ Webmaster FAQ:


Does +1 affect how Google crawls my site?

When you add the +1 button to a page, Google assumes that you want that page to be publicly available and visible in Google Search results. As a result, we may fetch and show that page even if it is disallowed in robots.txt.

10% popularity Vote Up Vote Down


 

@Yeniel560

You appear to have many misconceptions about how search engines and ranking works, so I would suggest reading through the various Google help files. Google itself has an SEO starter guide. To answer some basic points:


PageRank is based purely on links to your site and nothing else.
If your site is new then Googlebot will not be visiting very often anyway, so there is no reason to block it.
The number of visitors to your site (or visitor increases) is not a ranking factor at all. Google cannot possibly know how many people are visiting your site besides the ones it sends directly.
robots.txt prevents crawling of a page, but the URL may appear in search results under certain conditions.
However as Stephen points out in his answer, Google may crawl URLs with Google+ buttons, even if they are blocked by robots.txt

10% popularity Vote Up Vote Down


Back to top | Use Dark Theme