: How can I prevent a search engine from indexing a specific file or files on my website? Possible Duplicate: Blocking Search Engines to Crawl Parts of a Website? In general, I want

Posted in: #Indexing #Search #SearchEngines

Possible Duplicate:
Blocking Search Engines to Crawl Parts of a Website?

In general, I want my site to be indexed, but there are certain files I don't wish to be searchable from Google, Yahoo, etc...

I know you can block your site from being indexed using a robots file, but what if I only want certain files to not be indexed?

10.01% popularity Vote Up Vote Down

: Registrar with good security, DNS hosting, and DNSSEC and IPv6 resolvers? I'm looking to move my domains away from GoDaddy, but I'm having a tough time finding anyone with comparable features

@Jessie594

Posted in: #Dns #DomainRegistrar #DomainRegistration #Domains #Godaddy

7 Comments

: Does Lucida Sans Unicode font in Windows 7 have a bold style? I am trying to set an alternative to Mac Lucida Grande font with Lucida Sans Unicode for Windows users and found out that I

@Jessie594

Posted in: #Fonts #Typography

1 Comments

: How do you create a mobile app that basically allows you to....? I was wondering what the simplest and cheapest way to create a reliable mobile app (android or iphone) would be for the following

@Jessie594

Posted in: #Android #Apple #Application #Iphone #Mobile

2 Comments

: Webmin and SPF records I'm using VPS server with ubuntu and webmin. And in one of my domain I'd like to use google apps, but neither in webmin panel nor in conf file I see a place to add

@Jessie594

Posted in: #Dns #DnsServers #Webmin

2 Comments

Login to post a comment!

1 Comments

Sorted by latest first Latest Oldest Best

@Vandalay111

For this you can use robots.txt too. Then you would write several disallow statements. Here are some examples:

Disallow: /tmp
Disallow: /logs

For more information see the specification of the robots file.

But be aware that not every spider respects this file. So maybe you need other methods like e.g. the nofollow meta tag if you really want to be sure.

10% popularity Vote Up Vote Down

Feed

: How can I prevent a search engine from indexing a specific file or files on my website? Possible Duplicate: Blocking Search Engines to Crawl Parts of a Website? In general, I want

More posts by @Jessie594

: Registrar with good security, DNS hosting, and DNSSEC and IPv6 resolvers? I'm looking to move my domains away from GoDaddy, but I'm having a tough time finding anyone with comparable features

: Does Lucida Sans Unicode font in Windows 7 have a bold style? I am trying to set an alternative to Mac Lucida Grande font with Lucida Sans Unicode for Windows users and found out that I

: How do you create a mobile app that basically allows you to....? I was wondering what the simplest and cheapest way to create a reliable mobile app (android or iphone) would be for the following

: Webmin and SPF records I'm using VPS server with ubuntu and webmin. And in one of my domain I'd like to use google apps, but neither in webmin panel nor in conf file I see a place to add

Login to post a comment!

1 Comments

Back to top | Use Dark Theme