: Google doesn't follow links outside sitemap Today I was looking at what googles shows in relation to my site and I discovered something which I wasn't expecting. Here is what my site map looks
Today I was looking at what googles shows in relation to my site and I discovered something which I wasn't expecting.
Here is what my site map looks like.
?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
<url>
<loc>http://domain.com/pub</loc>
<lastmod>2013-06-06</lastmod>
<changefreq>weekly</changefreq>
</url>
</urlset>
So to get an idea at /pub I have a number of articles which are doFollow (checked that) and everyone of the articles has a canonical link in the header
<link rel="canonical" href="http://domain.com/pub/article/327" />
Now I've discovered that google indexed only the /pub directory, without following the links to the articles. I read somewhere that it is not a requirement to have every article's link in the sitemap. In my case it is user generated content so I can't be updating that on a weekly basis it has to be automated in some way.
What am I doing wrong? I need to get that content indexed.
More posts by @Looi9037786
2 Comments
Sorted by latest first Latest Oldest Best
Don't get rid of the sitemap. Just add the links to your public articles to it. The sitemap can help get your articles indexed quicker and help Google, Bing and others to understand your site better.
Much of the point of having a sitemap is letting Google know about new content. If you are only putting one central page in the sitemap and expecting Google to crawl from there, there isn't much point in having that sitemap -- Google can find central pages and crawl from those without much help.
I have sites with user generated content that is constantly being created. I re-generate the sitemaps nightly.
Terms of Use Create Support ticket Your support tickets Stock Market News! © vmapp.org2024 All Rights reserved.