Mobile app version of vmapp.org
Login or Join
Dunderdale272

: What is the difference between Disallow and Allow? I had 2 questions in my mind: what is the difference between Allow and Disallow? which one should I use to allow Google bot for AdSense?

@Dunderdale272

Posted in: #GoogleAdsense #RobotsTxt #WebCrawlers

I had 2 questions in my mind:


what is the difference between Allow and Disallow?
which one should I use to allow Google bot for AdSense?



User-agent: Mediapartners-Google
Disallow:

User-agent: Mediapartners-Google*
Allow: /

10.01% popularity Vote Up Vote Down


Login to follow query

More posts by @Dunderdale272

1 Comments

Sorted by latest first Latest Oldest Best

 

@Bryan171

The difference is Allow is not defined in specifications of robots.txt.

However, several web crawlers understand Allow like Disallow. It's the case for Mediapartners-Google bot. Therefore, you can use lines you want but if you want to respect specifications, choose the first ones:

User-agent: Mediapartners-Google
Disallow:

10% popularity Vote Up Vote Down


Back to top | Use Dark Theme