: Do Search Engine Spider's submit POST forms? If I have content behind a POST form (a select box, in my case) will Googlebot, or other Search Engine Spiders be able to crawl the content behind
If I have content behind a POST form (a select box, in my case) will Googlebot, or other Search Engine Spiders be able to crawl the content behind that form?
For example, if I were to have 4 translations of one page, and the language selection were a POST form to the same URL, which then redirected to the language-specific URL, would Googlebot be able to crawl the "other" languages?
More posts by @BetL925
3 Comments
Sorted by latest first Latest Oldest Best
Bing absolutely does. Before I told it not to it would continually submit both a contact form and a survey form. I knew it was Bingbot because I included $_SERVER['HTTP_USER_AGENT'] in the $_POST information. No other spider ever submitted those forms.
They can and do. I've got a simple email collection form on the front of a site I'm about ready to launch. I just received a submission from that form from IP 66.249.73.214, which is a GoogleBot IP.
The Googlebot can submit forms, but it generally doesn't unless it can detect a reason to do so.
So from the links, if your translations were AJAX'd and built properly, Googlebot may very well submit the form to see what the results would be. However, this behavior (especially on POST), is not guaranteed and you should probably use GET to make things more accessible to the robots.
Terms of Use Create Support ticket Your support tickets Stock Market News! © vmapp.org2024 All Rights reserved.