What is SiteAuditBot?
SiteAuditBot is a generic crawler. Use this crawler profile to identify user-agent tokens, operator signals, platform hints, and recommended handling.
SiteAuditBot
SEO audit crawler
- Version
- 0.97
- First seen
- Jun 1, 2026
- Confidence
- Inferred user-agent token
Crawler tags
Directory facts
- AI model training
- Not listed as training
- Acts on behalf of user
- Yes, user-triggered
- Obeys directives
- Yes, listed as obeying robots.txt
What is SiteAuditBot?
SiteAuditBot is a generic crawler. SiteAuditBot is classified as a generic crawler that may fetch pages for search, SEO, monitoring, or data collection workflows.
SiteAuditBot was inferred from a bot-like product token in the user-agent string.
How to identify SiteAuditBot in logs
Search server logs for SiteAuditBot. Matching those tokens is useful for discovery, but IP verification is still recommended before trusting the identity.
Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 (KHTML, like Gecko) Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; SiteAuditBot/0.97; +http://www.semrush.com/bot.html)
Use this as a web-crawler lookup reference for identifying how this user-agent presents itself in server logs. After you identify crawler traffic, run the WebMCP Compatibility Checker to confirm whether AI crawlers and agents can understand your site.
User-agent signals
- Product tokens
- Mozilla/5.0, iPhone, CPU, OS, Mac, AppleWebKit/536.26, Gecko, Version/6.0
- Documentation
- http://www.semrush.com/bot.html
- Contact
- None found
- Platform
- iOS · Mobile
- Browser profile
- Safari · WebKit
- Browser-like UA
- Yes
- HTTP library
- Unknown
- Spoof risk
- High
Questions answered by this crawler profile
What is SiteAuditBot?
SiteAuditBot is classified as a generic crawler that may fetch pages for search, SEO, monitoring, or data collection workflows.
Who operates SiteAuditBot?
The operator for SiteAuditBot is not known from the user-agent alone.
How do I identify SiteAuditBot in logs?
Search server logs for SiteAuditBot. Matching those tokens is useful for discovery, but IP verification is still recommended before trusting the identity.
Should I allow SiteAuditBot?
Verify IP ownership or behavior before making security decisions because user-agent strings can be spoofed. Monitor crawl rate and paths, then allow normal traffic or rate-limit/block if behavior becomes abusive.
Does SiteAuditBot respect robots.txt?
Robots.txt compliance cannot be proven from a user-agent string alone. Check the crawler operator documentation and your own logs before assuming behavior.