What is Claude-SearchBot?
Claude-SearchBot is a search/index operated by Anthropic. Use this crawler profile to identify user-agent tokens, operator signals, platform hints, and recommended handling.
Claude-SearchBot
Anthropic · AI search crawler
- Version
- 1.0
- First seen
- Jun 15, 2026
- Confidence
- Known user-agent token
Crawler tags
Directory facts
- AI model training
- Not listed as training
- Acts on behalf of user
- Yes, user-triggered
- Obeys directives
- Yes, listed as obeying robots.txt
What is Claude-SearchBot?
Claude-SearchBot is a search/index operated by Anthropic. Claude-SearchBot is likely used by Anthropic to discover, crawl, and index public web pages.
Claude-SearchBot matched a known crawler token in the user-agent string, but this page alone does not prove IP ownership.
How to identify Claude-SearchBot in logs
Search server logs for Claude-SearchBot. Matching those tokens is useful for discovery, but IP verification is still recommended before trusting the identity.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Claude-SearchBot/1.0; +searchbot@anthropic.com)
Use this as a web-crawler lookup reference for identifying how this user-agent presents itself in server logs. After you identify crawler traffic, run the WebMCP Compatibility Checker to confirm whether AI crawlers and agents can understand your site.
User-agent signals
- Product tokens
- Mozilla/5.0, AppleWebKit/537.36, Gecko, Claude-SearchBot/1.0
- Documentation
- None found in user-agent
- Contact
- +searchbot@anthropic.com
- Platform
- Unknown · Unknown
- Browser profile
- Unknown · WebKit
- Browser-like UA
- Yes
- HTTP library
- Unknown
- Spoof risk
- Medium
Questions answered by this crawler profile
What is Claude-SearchBot?
Claude-SearchBot is likely used by Anthropic to discover, crawl, and index public web pages.
Who operates Claude-SearchBot?
Claude-SearchBot is associated with Anthropic.
How do I identify Claude-SearchBot in logs?
Search server logs for Claude-SearchBot. Matching those tokens is useful for discovery, but IP verification is still recommended before trusting the identity.
Should I allow Claude-SearchBot?
Verify IP ownership or behavior before making security decisions because user-agent strings can be spoofed. Allow it if you want this crawler to discover public pages, and use robots.txt or rate limits for policy control.
Does Claude-SearchBot respect robots.txt?
Robots.txt compliance cannot be proven from a user-agent string alone. Check the crawler operator documentation and your own logs before assuming behavior.