Mobile app version of vmapp.org
Login or Join
Cooney921

: Tell Google the list of URLs to crawl Consider the case of Quora, which is really SEO-friendly. The problem is that there are no links to questions from Quora homepage. Essentially nothing (even

@Cooney921

Posted in: #Google #Url #WebCrawlers

Consider the case of Quora, which is really SEO-friendly. The problem is that there are no links to questions from Quora homepage. Essentially nothing (even via an indirect URL). So I could never find any link to Quora questions from its homepage; I could only do so via Google (or other search engines), or have a Quora account.

So my question is how to tell Google the list of pages to crawl without listing them all in the homepage (or via an indirect links)?

10.02% popularity Vote Up Vote Down


Login to follow query

More posts by @Cooney921

2 Comments

Sorted by latest first Latest Oldest Best

 

@Alves908

The problem is that there is no links to questions from Quora homepage.


There is a link to the Directory (at the bottom of the page) which then links to People, Topics, Questions and Blogs which then drills down further. Once the Topics have been indexed then this will also help to discover new questions (together with a possible XML Sitemap, as Ivo Vdv mentions). There is also an RSS feed on the homepage which appears to list a large number of questions.

10% popularity Vote Up Vote Down


 

@Ravi8258870

You're looking for a sitemap. Basically, it's an XML file with the list of (preferably) all of your pages. You can read more about it on support.google.com/webmasters/answer/156184?hl=en.

10% popularity Vote Up Vote Down


Back to top | Use Dark Theme