Mobile app version of vmapp.org
Login or Join
Reiling115

: Google Site Search (commercial) not indexing files in sitemap I have a client for whom we have purchased Google Site Search. It works well for HTML pages served by the CMS, but files aren't

@Reiling115

Posted in: #GoogleIndex #GoogleSiteSearch #XmlSitemap

I have a client for whom we have purchased Google Site Search. It works well for HTML pages served by the CMS, but files aren't being reliably indexed.

I wrote a script to generate an XML feed (sitemap) of all the files in the CMS which I've plugged in to Google Webmaster Tools for the site. It says that for that sitemap 923 URLs have been submitted, but only 26 have been indexed.

The client relies heavily on searching within files, which is why we decided to use Google search, so this is a bit of a problem.

Many of the files aren't linked to from any page on the site, as they are old and therefore don't merit having a page of their own. But they still need to be accessible through search for archiving purposes.

The file archive XML can be found at sniffer.org.uk/file-archive and the standard XML sitemap (of pages) can be found at sniffer.org.uk/sitemap.xml.

10.01% popularity Vote Up Vote Down


Login to follow query

More posts by @Reiling115

1 Comments

Sorted by latest first Latest Oldest Best

 

@Heady270

I'm not seeing a big problem with indexing.

If I search on google for site:www.sniffer.org.uk it shows 2640 indexed pages and documents. There are lots of PDF and RTF documents indexed when I click through the pages of the SERPs.

I spot checked about five files from the sitemap.xml and ten files from file-archive. In all cases, I opened the document or page, copied a sentence out of it. Put it in quotes, and search for it on Google. Here is an example that I tried from the file-archive: www.google.com/search?q=%22redeveloped+housing+requires+retrofit%22
One problem I came across was a page in the sitemap.xml that is 404 on the website: www.sniffer.org.uk/?cID=253
When I did this search: www.google.com/search?q=%22which+soil+issues+are+addressed+in+other+countries%22 Google appears to only index a copy of the document on some other site. It didn't return www.sniffer.org.uk/files/5713/4183/7996/UKLQ01.pdf

10% popularity Vote Up Vote Down


Back to top | Use Dark Theme