Mobile app version of vmapp.org
Login or Join
Gloria169

: Google bots and iframe Here is the problem: Let say I have mydomain.com. The externaldomain.com/article/mydomain has an iframe with mydomain.com inside but the externaldomain.com robots.txt contains:

@Gloria169

Posted in: #Googlebot #Iframe #RobotsTxt #Subdirectory #WebCrawlers

Here is the problem:

Let say I have mydomain.com. The externaldomain.com/article/mydomain has an iframe with mydomain.com inside but the externaldomain.com robots.txt contains:

Disallow: /article/


Will Google crawl mydomain.com inside the iframe at externaldomain.com/article/mydomain or it will block mydomain.com, because externaldomain.com robots.txt disallow the folder /article?

10.01% popularity Vote Up Vote Down


Login to follow query

More posts by @Gloria169

1 Comments

Sorted by latest first Latest Oldest Best

 

@BetL925

Disallow: /article/ will block the URL (or page) article/ and all subfolders or subpages.

That's why, if the robots.txt of externaldomain.com applies this directive for the user agent is googlebot, don't worry.

Here are Google instructions on this.

10% popularity Vote Up Vote Down


Back to top | Use Dark Theme