: What is better for SEO robots.txt file or dynamically generated robots.txt URL? I was relying on our custom WordPress package's dynamically generated robots.txt URL for a few sites but it was

Posted in: #Indexing #RobotsTxt #WebCrawlers #Wordpress

I was relying on our custom WordPress package's dynamically generated robots.txt URL for a few sites but it was not being honoured by Google or Bing (plugin URLs were getting indexed despite the rule Disallow /wp-content in robots.txt). I waited for a couple of weeks and uploaded an actual file in the root with the same rules and it worked.

Does this mean that an actual file is better than dynamically generated robots.txt file or is it just me associating some coincidental events?

10.02% popularity Vote Up Vote Down

: Do subdomains have an impact on a root domain? My domain discountbox.in was performing well on the Google search engine. A couple of days back we launched the blog and forum on the subdomain

@Gonzalez347

Posted in: #GoogleAnalytics #GoogleSearchConsole #Seo

0 Comments

: In nano 000-default.conf (as root user) in Apache2 on EC2 Ubuntu Instance on AWS page is blank? When I SSH into my ubuntu server on EC2 in Amazon Web Services, and I change to the root user

@Gonzalez347

Posted in: #AmazonAws #AmazonEc2 #Apache #Apache2 #Ubuntu

0 Comments

: How do websites with 'premium content' go about SEO? While searching for news, I am often presented with pages that have 'premium content'. For example this story by The Australian. I checked

@Gonzalez347

Posted in: #Content #Ranking

3 Comments

: Backlinks from hidden iframe to one page of my site.Has a positive or negative effect on my site seo? i have more than 60000 backlink too one page of my site because i put a hidden iframe

@Gonzalez347

Posted in: #Backlinks #Iframe #Pagerank #Ranking #Seo

0 Comments

Login to post a comment!

2 Comments

Sorted by latest first Latest Oldest Best

@Sue5673885

No difference at all as far as crawlers are able to access them (with all your valid rules) with HTTP 200 response.

10% popularity Vote Up Vote Down

@BetL925

There is no difference to search engines between those two methods. You can generate it like you want.

Moreover, you need to know blocking a page with robots.txt is not the perfect way to prevent indexing of pages.
You can read this question for more information.

10% popularity Vote Up Vote Down

Feed

: What is better for SEO robots.txt file or dynamically generated robots.txt URL? I was relying on our custom WordPress package's dynamically generated robots.txt URL for a few sites but it was

More posts by @Gonzalez347

: Do subdomains have an impact on a root domain? My domain discountbox.in was performing well on the Google search engine. A couple of days back we launched the blog and forum on the subdomain

: In nano 000-default.conf (as root user) in Apache2 on EC2 Ubuntu Instance on AWS page is blank? When I SSH into my ubuntu server on EC2 in Amazon Web Services, and I change to the root user

: How do websites with 'premium content' go about SEO? While searching for news, I am often presented with pages that have 'premium content'. For example this story by The Australian. I checked

: Backlinks from hidden iframe to one page of my site.Has a positive or negative effect on my site seo? i have more than 60000 backlink too one page of my site because i put a hidden iframe

Login to post a comment!

2 Comments

Back to top | Use Dark Theme