Mobile app version of vmapp.org

Samaraweera270

: Do I reference all my *.xml.gz sitemap files in robots.txt I have a website with over 1 million url's. As such, I have 1 sitemap.xml file which acts as an index to many sitemap0000.xml.gz,

@Samaraweera270

Posted in: #RobotsTxt #Sitemap

I have a website with over 1 million url's. As such, I have 1 sitemap.xml file which acts as an index to many sitemap0000.xml.gz, sitemap0001.xml.gz ... sitemap0030.xml.gz etc. files.

My question is: In my robots.txt file how do I specify the sitemap file?

Do I refernce the sitemap.xml only? As in the following:

User-agent: *
Allow: /
Sitemap: mysite.com/sitemap/sitemap.xml

Or do I have to specify ALL the *.xml.gz files in the sitemap too?

10.01% popularity Vote Up Vote Down

Login to follow query

More posts by @Samaraweera270

Samaraweera270

: Visual aspects of JAVASCRIPT and logical aspects of JAVASCRIPT? What is good for a web designer, aspiring to be and UI designer? Visual aspects of JAVASCRIPT and logical aspects of JAVASCRIPT?

@Samaraweera270

Posted in: #Gui #Javascript #Jquery #WebsiteDesign

Samaraweera270

: RSS aggregator with related headlines...like Google News Does anybody know of a script that would allow me to aggregate RSS feeds (and possibly have users submit their own) while also identifying

@Samaraweera270

Posted in: #Aggregators #Rss

Samaraweera270

: Whatchamacallit: You know how there are breadcrumbs and sliders and whatnot What do you call it when a web site (especially corporate/retail) has a series of rows with thumbnails, each with a

@Samaraweera270

Posted in: #Design #Theme #WebsiteDesign

Samaraweera270

: What is the preparation of before apply for ads? I have built a new site(finished last week, but no SEO, no clients). I know apply for ads need a long time. So I send my request to google

@Samaraweera270

Posted in: #Advertising

Login to post a comment!

1 Comments

Sorted by latest first Latest Oldest Best

Yes, only refer to the index file. (See under the "Using robots.txt" heading.) It will then lead the crawler to the others.

10% popularity Vote Up Vote Down

Terms of Use Create Support ticket Your support tickets Stock Market News! © vmapp.org2024 All Rights reserved.

Back to top | Use Dark Theme