Web crawler lookup

What is ClaudeBot?

ClaudeBot is a ai or training crawler operated by Anthropic. Use this crawler profile to identify user-agent tokens, operator signals, platform hints, and recommended handling.

ClaudeBot

Anthropic · AI or training crawler

Version
1.0
First seen
May 20, 2026
Last seen
May 25, 2026
Confidence
Known user-agent token

What is ClaudeBot?

ClaudeBot is a ai or training crawler operated by Anthropic. ClaudeBot is likely used by Anthropic to collect or evaluate public web content for AI, language, or training systems.

ClaudeBot matched a known crawler token in the user-agent string, but this page alone does not prove IP ownership.

How to identify ClaudeBot in logs

Search server logs for ClaudeBot, anthropic-ai. Matching those tokens is useful for discovery, but IP verification is still recommended before trusting the identity.

ClaudeBotanthropic-ai

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)

Use this as a web-crawler lookup reference for identifying how this user-agent presents itself in server logs.

User-agent signals

Product tokens
Mozilla/5.0, AppleWebKit/537.36, Gecko, ClaudeBot/1.0
Documentation
None found in user-agent
Contact
+claudebot@anthropic.com
Platform
Unknown · Unknown
Browser profile
Unknown · WebKit
Browser-like UA
Yes
HTTP library
Unknown
Spoof risk
Medium

Questions answered by this crawler profile

What is ClaudeBot?

ClaudeBot is likely used by Anthropic to collect or evaluate public web content for AI, language, or training systems.

Who operates ClaudeBot?

ClaudeBot is associated with Anthropic.

How do I identify ClaudeBot in logs?

Search server logs for ClaudeBot, anthropic-ai. Matching those tokens is useful for discovery, but IP verification is still recommended before trusting the identity.

Should I allow ClaudeBot?

Verify IP ownership or behavior before making security decisions because user-agent strings can be spoofed. Review your robots.txt and AI crawler policies, then allow, block, or rate-limit it based on your content usage preferences.

Does ClaudeBot respect robots.txt?

Robots.txt compliance cannot be proven from a user-agent string alone. Check the crawler operator documentation and your own logs before assuming behavior.