citrusbug.com. We did not have proper content before so to prevent search engine from crawling our site we added a robots.txt with code

Posted in: #Googlebot #GoogleIndex #WebCrawlers

I own a website citrusbug.com.
We did not have proper content before so to prevent search engine from crawling our site
we added a robots.txt with code to prevent crawling.

Now we had updated our sites content and want to get it crawled, but Google is not crawling it yet. We removed the code from robots.txt to prevent Googlebot to crawl, but still it is not getting crawled.

We almost did this change before 20-21 days but still Google is not crawling our site and if search I search on Google it displays:

A description for this result is not available because of this site's
robots.txt – learn more.

Kindly guide me, what I need to do for this?

10.02% popularity Vote Up Vote Down

: What is the best WordPress permalink structure for a website with daily new posts and updates? I have a WordPress website where users contribute a lot of posts and comments. I am now using

@Tiffany637

Posted in: #Permalinks #Seo #Wordpress

2 Comments

: For Google Rich Snippets, should the last item in a breadcrumb be a link? A website has the following breadcrumb trail when on the "Labrador" page: Services > Squirrel Chasing > Labrador

@Tiffany637

Posted in: #Breadcrumbs #GoogleSearch #Microdata #RichSnippets

2 Comments

: Screen resolution of Googlebot mobile? Does Googlebot-Mobile have a viewport resolution it sends across? If so, what is it? It's a general question with broad relevance, but I am asking with

@Tiffany637

Posted in: #Googlebot #GooglebotMobile #Mobile #Resolution #WebCrawlers

3 Comments

: Am I changing my title of the site for SEO reasons in a correct way? I have a slang dictionary website. I saw that they only have the postname / title and there own website as the title.

@Tiffany637

Posted in: #Google #Seo #Title

2 Comments

Login to post a comment!

2 Comments

Sorted by latest first Latest Oldest Best

@Jennifer507

Your site is being by crawled Google, you can see pages are getting indexed here

You may need to just give it a bit more time to crawl and re-index the enitre site.

I see you have a sitemap.xml file, have you submitted it in Google Web Master Tools? If not, do this, it could speed up the process.

10% popularity Vote Up Vote Down

@Murphy175

I'd highly recommend signing up to Google's Webmaster Tools: www.google.com/webmasters/.
You can submit your site to Google there, check for crawl errors and get stats and details on how your site is performing in Google Search.

10% popularity Vote Up Vote Down

Feed

: Google not crawling my website I own a website http://citrusbug.com. We did not have proper content before so to prevent search engine from crawling our site we added a robots.txt with code

More posts by @Tiffany637

: What is the best WordPress permalink structure for a website with daily new posts and updates? I have a WordPress website where users contribute a lot of posts and comments. I am now using

: For Google Rich Snippets, should the last item in a breadcrumb be a link? A website has the following breadcrumb trail when on the "Labrador" page: Services > Squirrel Chasing > Labrador

: Screen resolution of Googlebot mobile? Does Googlebot-Mobile have a viewport resolution it sends across? If so, what is it? It's a general question with broad relevance, but I am asking with

: Am I changing my title of the site for SEO reasons in a correct way? I have a slang dictionary website. I saw that they only have the postname / title and there own website as the title.

Login to post a comment!

2 Comments

Back to top | Use Dark Theme