Can it'll affect anyhow ?? And how much time

What if I put same robots.txt file in multiple directories and folders?

User-agent: *
Disallow: /otherdirname/dirname2/

Can it'll affect anyhow ??

And how much time it generally takes to refine the search engine results?

Regards

10.03% popularity Vote Up Vote Down

: How can I redirect all files in a directory that doesn't conform to a certain filename structure? I have a website where a previous developer had updated several webpages. The issue is that

@Hamaas447

Posted in: #301Redirect #Htaccess #ModRewrite

1 Comments

: How to stop Feedreader fetching content from my site using iFrame? As you all can see from the picture below, my site's content is duplicated by FeedReader (using iFrame) and indexed at Google.

@Hamaas447

Posted in: #DuplicateContent #Iframe

1 Comments

: My sitemap is indexed but I don't see the site pages being indexed Hi I have a site and my site map is being indexed by google correctly (almost I have 1.165 links and it indexed 1.156).

@Hamaas447

Posted in: #Google #GoogleSearchConsole #Seo

1 Comments

: Why Google skips page title Possible Duplicate: Does Google use the Meta Description Tag for Description of Page? I have no idea why this is happening. Title tag is: Unfurnished

@Hamaas447

Posted in: #Google #GoogleIndex #Seo

1 Comments

Login to post a comment!

2 Comments

Sorted by latest first Latest Oldest Best

@Alves908

If you add robot text, then search engine can't crawl that pages as you disallow those pages.

10% popularity Vote Up Vote Down

@Murphy175

First: it's useless to put a robots.txt file anywhere else than the website roots. Web crawler ONLY check at this places: www.yourwebsite.com/robots.txt
Your example tell to EVERY web crawler (of course, only "legal" one, bad robots don't care) to not index /otherdirname/dirname2/. It's NOT disalowing to crawl /otherdirname.

You might need MANY Disallow command to reflect your needs.

Please see the "official" web site for help: www.robotstxt.org/

10% popularity Vote Up Vote Down

Feed

: Robots.txt file Help needed What if I put same robots.txt file in multiple directories and folders? User-agent: * Disallow: /otherdirname/dirname2/ Can it'll affect anyhow ?? And how much time

More posts by @Hamaas447

: How can I redirect all files in a directory that doesn't conform to a certain filename structure? I have a website where a previous developer had updated several webpages. The issue is that

: How to stop Feedreader fetching content from my site using iFrame? As you all can see from the picture below, my site's content is duplicated by FeedReader (using iFrame) and indexed at Google.

: My sitemap is indexed but I don't see the site pages being indexed Hi I have a site and my site map is being indexed by google correctly (almost I have 1.165 links and it indexed 1.156).

: Why Google skips page title Possible Duplicate: Does Google use the Meta Description Tag for Description of Page? I have no idea why this is happening. Title tag is: Unfurnished

Login to post a comment!

2 Comments

Back to top | Use Dark Theme