And I'm trying to get testing it using the Fetch as Googlebot option in the Google Webmasters Tools. When I

Posted in: #GoogleSearchConsole #RobotsTxt

I have a website: 46.105.30.3/
And I'm trying to get testing it using the Fetch as Googlebot option in the Google Webmasters Tools.

When I try it it returns Denied by robots.txt.

My robots.txt contains:

User-agent: *
Disallow: /js/
Disallow: /style/

Any ideas why the Googlebot is denied access?

10.01% popularity Vote Up Vote Down

: Looking for a CMS to publish online tutorials Possible Duplicate: Which Content Management System (CMS) should I use? I want to create a site with tutorials on a specific topic.

@Fox8124981

Posted in: #Cms #LookingForAScript

2 Comments

: How do I get google to see keywords on a one page web application site? I'm going to have to link to the web site to explain this, http://www.diagram.ly, it's a free service, so I hope this

@Fox8124981

Posted in: #GoogleSearch #Keywords #Seo

2 Comments

: Preventing Spiders on One Subdomain? We currently host multiple sites on the same domain that all live in the same physical directory on the server. Each is database driven and lives at a unique

@Fox8124981

Posted in: #GoogleSearch #RobotsTxt #Subdomain

3 Comments

: MySQL is a relational database management system (RDBMS) that runs as a server providing multi-user access to a number of databases. MySQL is officially pronounced /maɪˌɛskjuːˈɛl/ ("My S-Q-L"),

@Fox8124981

0 Comments

Login to post a comment!

1 Comments

Sorted by latest first Latest Oldest Best

@Candy875

Your robots.txt looks good. Did you have an old one which blocked robots? Did you unblocked them recently? Maybe GWMT have the old one in its cache and you should wait a little bit before it gets refreshed.
Sign into GWMT goto Site Configuration -> Crawler access. You can see your robots.txt there and last date googlebot grab it. You can test your robots file there too.

10% popularity Vote Up Vote Down

Feed

: Google Webmasters Tools: Denied by robots.txt I have a website: http://46.105.30.3/ And I'm trying to get testing it using the Fetch as Googlebot option in the Google Webmasters Tools. When I

More posts by @Fox8124981

: Looking for a CMS to publish online tutorials Possible Duplicate: Which Content Management System (CMS) should I use? I want to create a site with tutorials on a specific topic.

: How do I get google to see keywords on a one page web application site? I'm going to have to link to the web site to explain this, http://www.diagram.ly, it's a free service, so I hope this

: Preventing Spiders on One Subdomain? We currently host multiple sites on the same domain that all live in the same physical directory on the server. Each is database driven and lives at a unique

: MySQL is a relational database management system (RDBMS) that runs as a server providing multi-user access to a number of databases. MySQL is officially pronounced /maɪˌɛskjuːˈɛl/ ("My S-Q-L"),

Login to post a comment!

1 Comments

Back to top | Use Dark Theme