: Ahrefs is checking my site for backlinks all the time I have a Magento site and I realize that the ahrefs.com crawler visits my site all the time everyday. I visit ahrefs.com and I check

Posted in: #Backlinks #Magento #WebCrawlers

I have a Magento site and I realize that the ahrefs.com crawler visits my site all the time everyday. I visit ahrefs.com and I check my backlinks (they are good).

Is it good or bad, something like that? (To check all the time). Googlebot doesn't crawl my site all the time.
Maybe it slow down my site? (many requests)
Can I reduce the times it checks?

10.01% popularity Vote Up Vote Down

: Best way to segment data in Google analytics? I have a web site which has a number of distinct parts, there is a public marketing site, a members area and a admin section for staff, all

@Eichhorn148

Posted in: #GoogleAnalytics #Tracking

1 Comments

: Having some amount of duplicate content is expected on every site. Most sites are going to have the same links in multiple places. Sites based on Wordpress and similar CMS systems are

@Eichhorn148

0 Comments

: Why does Google index pages of my blog in seconds, while pages on the rest of the website take longer to get indexed I have a questions and answers website in Portuguese about a specific

@Eichhorn148

Posted in: #Google #GoogleIndex #Indexing

1 Comments

: Can I improve load times by reusing images? I've created a website that has multiple pages, and each page has it's own dedicated folder. Inside of each page's folder I've created a dedicated

@Eichhorn148

Posted in: #Images #LoadTime

1 Comments

Login to post a comment!

1 Comments

Sorted by latest first Latest Oldest Best

@Megan663

From: ahrefs.com/robot/

...you can control the frequency of AhrefsBot visiting your site by specifying the minimum acceptable delay between two [consecutive] requests from our bot as follows (in robots.txt):

User-Agent: AhrefsBot
Crawl-Delay: 2

where the value of Crawl-Delay parameter is time in seconds (you can use fractional seconds too)

10% popularity Vote Up Vote Down

Feed

: Ahrefs is checking my site for backlinks all the time I have a Magento site and I realize that the ahrefs.com crawler visits my site all the time everyday. I visit ahrefs.com and I check

More posts by @Eichhorn148

: Best way to segment data in Google analytics? I have a web site which has a number of distinct parts, there is a public marketing site, a members area and a admin section for staff, all

: Having some amount of duplicate content is expected on every site. Most sites are going to have the same links in multiple places. Sites based on Wordpress and similar CMS systems are

: Why does Google index pages of my blog in seconds, while pages on the rest of the website take longer to get indexed I have a questions and answers website in Portuguese about a specific

: Can I improve load times by reusing images? I've created a website that has multiple pages, and each page has it's own dedicated folder. Inside of each page's folder I've created a dedicated

Login to post a comment!

1 Comments

Back to top | Use Dark Theme