Mobile app version of vmapp.org
Login or Join
Angela700

: Generating snapshots of Ajax content for BingBot vs GoogleBot We have a website whose content is generated dynamically via JavaScript. For the purpose of search engine indexing we also provide

@Angela700

Posted in: #Ajax #Bingbot #Noscript

We have a website whose content is generated dynamically via JavaScript. For the purpose of search engine indexing we also provide snapshots of the pages.

Here are some examples:

www.recreyo.com https://www.recreyo.com/yangtze-river-cruise-china www.recreyo.com/beijing-xian-train-china

If you view the HTML source of one of these links, you will notice that there is content specified within noscript tags. This is a mirror of the dynamic JavaScript generated content that users will see, and has been put in place for search engine crawlers to process.

Now GoogleBot has correctly processed the noscript content and displays them in search results, but BingBot is not indexing the pages.

Google Results

Bing Results

I've made sure the sitemap has been submitted and waited for about four days.

How do we solve the problem? Ideally, I'd like to do it the noscript way as it is simple and elegant. Alternatively, I could add the content in standard markup and use CSS to hide it, but I would like to avoid doing that if possible, because that is just unnecessary extra work for the browser.

Does any have any insight into this problem? Specifically, is there any evidence that BingBot will not process content within noscript tags?

10.02% popularity Vote Up Vote Down


Login to follow query

More posts by @Angela700

2 Comments

Sorted by latest first Latest Oldest Best

 

@Berumen354

In my cases, I design fully Ajaxified content and found that it is difficult to crawl properly by bots.
So I redesign it. When pages opened for first time ,the visible content is exactly same as it created using javascript events.In short, each piece of content got their own URL and listed all URLs to a sitemap. Finally, I found most URLs get crawled and indexed.

You can see my site for example: learn.servloci.com

additionally you can check using site:[given url] as its cache.

10% popularity Vote Up Vote Down


 

@Heady270

I'm a little surprised that the noscript tags work for Google. Google released a standard for crawlable AJAX where your page has a meta tag that causes the crawler to fetch the snapshot from the URL with an additional parameter on it.

Bing now support this standard too, so implementing it will get your content indexed in both Google and Bing.

10% popularity Vote Up Vote Down


Back to top | Use Dark Theme