Mobile app version of vmapp.org
Login or Join
Welton855

: Google indexed my home page incorrectly: How can I fix it? I finished my website and launched it, I think I had a problem with my robots.txt - so I changed it to look like this: 03/08/2012

@Welton855

Posted in: #Seo

I finished my website and launched it, I think I had a problem with my robots.txt - so I changed it to look like this:

03/08/2012
# Allows all bots

Sitemap: www.mysite.co.za/sitemap.xml
User-agent: *
Disallow: /dashboard/


When I google my domain.co.za - I get this back:
Home

A description for this result is not available because of this site's robots.txt – learn more.
You've visited this page 3 times. Last visit: 2012/08/15


Now since I fixed this and added a 301 redirect to redirect mysite.co.za to mysite.co.za I would love it if google bot would come do a visit.

Is there anything I can do to get this fixed?

10.04% popularity Vote Up Vote Down


Login to follow query

More posts by @Welton855

4 Comments

Sorted by latest first Latest Oldest Best

 

@Sherry384

Dave is right on the money (virtual +1 as my score is still too low)

Please Do the Following


Go to Webmaster Tools
Do a "Fetch as Googlebot"
once fetched, a "Submit to Index" option will appear.
When a question pops-up, select "This and all linked URLs"


This will speed things up, but don't expect any instant results.

10% popularity Vote Up Vote Down


 

@Mendez628

You can now use the 'Fetch as Googlebot' tool in Google Webmaster Tools as a way to persuade Google to re-crawl (or crawl for the first time) a page - googlewebmastercentral.blogspot.co.uk/2011/08/submit-urls-to-google-with-fetch-as.html

10% popularity Vote Up Vote Down


 

@Shelton105

I would like to add that it is not necessary to add a robots.txt file on your website to get it crawled. I found many people having misconceptions about the robots.txt file. Search engine bots will crawl your website even though they don't have the robots.txt file.

If you don't want to show some content to search engine, however, robots.txt is required.

In your case the following steps will result in your website being crawled quickly:


Submit your website to relevant directories
Bookmark your website in leading bookmarking websites like (digg, stubleupon, reddit)
If you are having good marketing budget, write press releases about launch of your website and publish on reputed PR website like, prweb.com etc.

10% popularity Vote Up Vote Down


 

@Alves908

# 03/08/2012
# Allows all bots


You should comment out (prefix with #) the first line also.

Google should refetch your robots.txt file quite quickly (within a few days, depending on the cache headers of your site), but it could take a while longer for your site to be reindexed. Unfortunately you're probably just going to have to be patient.

10% popularity Vote Up Vote Down


Back to top | Use Dark Theme