: Robots.txt and sitemaps If i where to block a web page, say 404Error.aspx, in robots,txt (i see no reason for this page to be indexed by google). However, do i still include this page in

If i where to block a web page, say 404Error.aspx, in robots,txt (i see no reason for this page to be indexed by google). However, do i still include this page in the xml sitemap or not?

Edit:

If i wanted my page to be indexed (google follows the links in it), but not show up in search results, should i remove robots.txt and use the robots meta tag with "noindex" ?

10.02% popularity Vote Up Vote Down

: How to get a share of Google's search revenue? Mozilla gets money from Google when somebody searches in Google through Firefox and then clicks an ad. If people search on your own website with

@Yeniel560

Posted in: #Google #Revenue #Search

1 Comments

: Shared hosting uses one server for many sites and is pretty common (although I've never heard of as many as 500 on one server before). Contrary to what others said, there is a small chance

@Yeniel560

0 Comments

: Copyright my website name. Is this possible? I am wondering if besides owning my domain name, should I copyright the actual name of the site? If my site is called mysite.com. Could I go

@Yeniel560

Posted in: #Copyright

1 Comments

: Where does UBB store its settings? We're moving a UBB forum from one host to another. (This is temporary; we're going to replace the forum eventually, but moving hosts has a higher priority.)

@Yeniel560

Posted in: #Database #Forum

1 Comments

Login to post a comment!

2 Comments

Sorted by latest first Latest Oldest Best

@Pope3001725

If i wanted my page to be indexed (google follows the links in it),
but not show up in search results, should i remove robots.txt and use
the robots meta tag with "noindex" ?

Yes.

10% popularity Vote Up Vote Down

@Bryan171

If you want to stop Google and the other Search Engines to have in their index this page, I see no reason to have the link in the sitemap too. You should have the link only in your robots.txt

10% popularity Vote Up Vote Down

Feed

: Robots.txt and sitemaps If i where to block a web page, say 404Error.aspx, in robots,txt (i see no reason for this page to be indexed by google). However, do i still include this page in

More posts by @Yeniel560

: How to get a share of Google's search revenue? Mozilla gets money from Google when somebody searches in Google through Firefox and then clicks an ad. If people search on your own website with

: Shared hosting uses one server for many sites and is pretty common (although I've never heard of as many as 500 on one server before). Contrary to what others said, there is a small chance

: Copyright my website name. Is this possible? I am wondering if besides owning my domain name, should I copyright the actual name of the site? If my site is called mysite.com. Could I go

: Where does UBB store its settings? We're moving a UBB forum from one host to another. (This is temporary; we're going to replace the forum eventually, but moving hosts has a higher priority.)

Login to post a comment!

2 Comments

Back to top | Use Dark Theme