Mobile app version of vmapp.org
Login or Join
Frith620

: Bots cannot crawl old parts of site with "Disallow: /old/" and "Disallow: /old"? Correct me if I am wrong, this means bots cannot crawl the old parts of the site? User-agent: * Disallow: /old/

@Frith620

Posted in: #RobotsTxt

Correct me if I am wrong, this means bots cannot crawl the old parts of the site?

User-agent: *
Disallow: /old/
Disallow: /old


Since it has been days that I have not received any traffic and found out about the robot.txt setup.

10.01% popularity Vote Up Vote Down


Login to follow query

More posts by @Frith620

1 Comments

Sorted by latest first Latest Oldest Best

 

@Alves908

This does not meant "old" as in "advanced age", it means /old as in directory/URL. For example, example.com/old/how-to-bake-special-brownies.html.
I assume /old is not your entire site, however if it is, then that would explain things.

10% popularity Vote Up Vote Down


Back to top | Use Dark Theme