: What is the difference between Disallow: /? and Disallow: /*?* in robots.txt? We have many parameters in our URL and I wonder what will do the parameters pasted below. Will they disallow all

@Harper822

Instance 1

Disallow: /?


This will disallow any URL's where ? follows a /.

For example:-
www.example.net/? http://www.example.net/page/? www.example.net/page/sub/? http://www.example.net/page/sub/?89y398th03th


Instance 2

Disallow: */?


This will disallow any URL's where ? exists in the URL after a /:-
www.example.net/? http://www.example.net/page/? www.example.net/page/sub/? http://www.example.net/page/sub/?89y398th03th www.example.net/search?q=url http://www.example.net/type?paramater=query


You would benefit from reading the robotstxt documentation where all of this is explained.

Vote Up Vote Down