: Re-indexing website with clean URL's So I have a website with URL's like this: http://www.domain.com/profile.php?id=151 I've now cleaned them up with mod_rewrite into this: http://www.domain.com/profile/firstname-lastname/151
So I have a website with URL's like this:
www.domain.com/profile.php?id=151
I've now cleaned them up with mod_rewrite into this:
www.domain.com/profile/firstname-lastname/151
I've fetched and re-indexed my website after the change.
What is the best way to make the old dirty ones disappear from search results and keep the clean ones? Is blocking profile.php with robots.txt enough?
More posts by @Heady270
2 Comments
Sorted by latest first Latest Oldest Best
Don't block the old URLs, or they won't work for people or engines that try to access them.
If you can, get the old URLs to return a 301 Redirect to the new URLs. A redirect will this ensure that any existing bookmarks or links to the old URLs will continue to work, including search results. More importantly, a 301 redirect specifically tells search engines understand that the old URLs have been permanently replaced with the new ones, and should also help SEO by transferring most of the "linkjuice" the old pages had.
Regardless, it will take time for search engines to recrawl your site. I would expect at least a month before the old ones disappear from search results, possibly more. However, if you have a redirect, it won't matter that much while you're waiting, and if you send a 301 redirect it should help things update faster.
However you can try to get Google to recrawl your site faster by going to Health > Fetch as Google and inputting a URL, then clicking "Submit to Index" followed by "URL and all linked pages," which presents the following message:
Select if your site has changed significantly. Google will use this URL as a starting point in indexing your site content. Google doesn't guarantee to index all pages on your site.
You should also specify canonical URLs on the new pages to further enforce their new status and reduce any potential duplication issues.
Blocking profile.php with robots.txt would be bad for several reasons. You should setup 301 redirects - support.google.com/webmasters/bin/answer.py?hl=en&answer=93633
Terms of Use Create Support ticket Your support tickets Stock Market News! © vmapp.org2024 All Rights reserved.