: Submitting sitemap, removing sitemap afterwards - effects on SEO I manage a website which is in fact a search engine for a specific branch of industry. Because most of the sites are dynamically
I manage a website which is in fact a search engine for a specific branch of industry. Because most of the sites are dynamically accessed via form (where a user can input a keyword to search for), I thought of submitting a sitemap to Google to inform their crawlers about my pages.
There are two problems:
I have 25 million pages (and I think the limit per sitemap is ~50 MB, which will be exceeded)
I want to remove the sitemap after submit, because I did not want to be crawled by competitors
Should I submit a sitemap to Google or is it better to let the crawlers index the page by themselves?
More posts by @Gail5422790
1 Comments
Sorted by latest first Latest Oldest Best
First up, Google doesn't want to index search results pages - if you want to see an example of just how much Google doesn't want to go and look what happened to Giphy recently.
Putting that to one side, you can have multiple sites maps and a sitemap of sitemaps to help with indexing very large sites. You can also have multiple sitemap indexes, you get the idea.
You seem to be stuck in two schools of thought here - get pages indexed and found or don't get pages indexed and found just in case competitors see it. Pick one because as soon as Google finds your pages your competitors will be able to see it.
Terms of Use Create Support ticket Your support tickets Stock Market News! © vmapp.org2024 All Rights reserved.