: Index site via domain name, but not via direct IP For some context, I'm modifying somebody's website. This particular site is not yet published - it is accessible via direct IP. Problem: Google

Posted in: #Domains #IpAddress #RobotsTxt

For some context, I'm modifying somebody's website. This particular site is not yet published - it is accessible via direct IP.

Problem: Google has crawled the direct IP, and people are reaching the site. If we put a robots.txt into the root directory of the site, that would also prevent Google from indexing the site once it's published on an actual domain.

Is there any way using robots.txt to prevent search engines from indexing the site's pages over direct IP, but allow it to index the site via its domain name?

(If not, then what would be required is to serve a different robots.txt depending on what domain the site is running on. The server could look at the HOST header to do this, but what is the best way?)

10.01% popularity Vote Up Vote Down

: Trying to install web2py on a shared server (Dreamhost) I've been trying to install web2py on a subdomain on my shared account at Dreamhost. There used to be some info in their knowledge base,

@Dunderdale272

Posted in: #Apache2 #Linux #Python #WebDevelopment

1 Comments

: Any real benefit from using a subdomain vs a folder vs just a page name? Besides the SEO issues, are there any legit long term benefits from having one type of URL vs the other from the

@Dunderdale272

Posted in: #Seo #Subdomain

3 Comments

: How can I reappear in Google search result? My website recently got a manual action penalty by Google due to "Sneaky mobile redirects" and not appearing on Google search results. This is what

@Dunderdale272

Posted in: #Penalty #Redirects

0 Comments

: Upper case beginnning letters of a domain using HTTP_HOST For the past couple of months I've been thinking of a website I'd like to launch for a small community of people in my neighborhood.

@Dunderdale272

Posted in: #CaseSensitive #Domains #Http #Title

1 Comments

Login to post a comment!

1 Comments

Sorted by latest first Latest Oldest Best

@Fox8124981

You need to do a 301 redirect from the IP address to the pages. Also use rel="canonical" microformat at the html head, here you state the url for every page.

10% popularity Vote Up Vote Down

Feed

: Index site via domain name, but not via direct IP For some context, I'm modifying somebody's website. This particular site is not yet published - it is accessible via direct IP. Problem: Google

More posts by @Dunderdale272

: Trying to install web2py on a shared server (Dreamhost) I've been trying to install web2py on a subdomain on my shared account at Dreamhost. There used to be some info in their knowledge base,

: Any real benefit from using a subdomain vs a folder vs just a page name? Besides the SEO issues, are there any legit long term benefits from having one type of URL vs the other from the

: How can I reappear in Google search result? My website recently got a manual action penalty by Google due to "Sneaky mobile redirects" and not appearing on Google search results. This is what

: Upper case beginnning letters of a domain using HTTP_HOST For the past couple of months I've been thinking of a website I'd like to launch for a small community of people in my neighborhood.

Login to post a comment!

1 Comments

Back to top | Use Dark Theme