: Adult website crawlability issue I got a mission and asking for some help with this scenario for a new website. The site is an adult escorts advertising service. It is developed fine, works
I got a mission and asking for some help with this scenario for a new website.
The site is an adult escorts advertising service. It is developed fine, works and looks good, but the issue is with crawlability.
Google webmaster tools index the same content for everypage. Let me explain further.
If any client try to access any page the website show a default agreement/warning page. If client clicks "proceed" a session variable is set and client is redirected (302) to original page back.
If client says "no", then he is redirected for another website (google, wikipedia, news portals...).
Well, this is a safe process, but causes the crawlability issue I told. So, any lights upon this? How make the after agreement content be correctly crawled and indexed?
More posts by @Lee4591628
2 Comments
Sorted by latest first Latest Oldest Best
Change your script to not show the agreement for the googlebot user agent.
Search engines don't generally follow forms like links so in effect you're blocking your content from them. Try using an XML sitemap and submitting internal pages to them directly. I'd submit an HTML sitemap to them as they can use that to discover other internal links.
Terms of Use Create Support ticket Your support tickets Stock Market News! © vmapp.org2024 All Rights reserved.