Web crawler lookup

What is AhrefsBot?

AhrefsBot is a generic crawler operated by Ahrefs. Use this crawler profile to identify user-agent tokens, operator signals, platform hints, and recommended handling.

AhrefsBot

Ahrefs · SEO audit crawler

Version
7.0
First seen
May 20, 2026
Confidence
Known user-agent token

Crawler tags

SEO audit crawlerAutonomousNot AI trainingObeys robots.txtBrowser-like UA

Directory facts

AI model training
Not listed as training
Acts on behalf of user
No, autonomous
Obeys directives
Yes, listed as obeying robots.txt

What is AhrefsBot?

AhrefsBot is a generic crawler operated by Ahrefs. AhrefsBot is classified as a generic crawler that may fetch pages for search, SEO, monitoring, or data collection workflows.

AhrefsBot matched a known crawler token in the user-agent string, but this page alone does not prove IP ownership.

How to identify AhrefsBot in logs

Search server logs for AhrefsBot. Matching those tokens is useful for discovery, but IP verification is still recommended before trusting the identity.

AhrefsBot

Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/)

Use this as a web-crawler lookup reference for identifying how this user-agent presents itself in server logs. After you identify crawler traffic, run the WebMCP Compatibility Checker to confirm whether AI crawlers and agents can understand your site.

User-agent signals

Product tokens
Mozilla/5.0, AhrefsBot/7.0
Contact
None found
Platform
Unknown · Unknown
Browser profile
Unknown · Unknown
Browser-like UA
Yes
HTTP library
Unknown
Spoof risk
Medium

Questions answered by this crawler profile

What is AhrefsBot?

AhrefsBot is classified as a generic crawler that may fetch pages for search, SEO, monitoring, or data collection workflows.

Who operates AhrefsBot?

AhrefsBot is associated with Ahrefs.

How do I identify AhrefsBot in logs?

Search server logs for AhrefsBot. Matching those tokens is useful for discovery, but IP verification is still recommended before trusting the identity.

Should I allow AhrefsBot?

Verify IP ownership or behavior before making security decisions because user-agent strings can be spoofed. Monitor crawl rate and paths, then allow normal traffic or rate-limit/block if behavior becomes abusive.

Does AhrefsBot respect robots.txt?

Robots.txt compliance cannot be proven from a user-agent string alone. Check the crawler operator documentation and your own logs before assuming behavior.