What is SemrushBot?
SemrushBot-SI is listed as a seo audit crawler operated by Semrush. Use this crawler profile to identify user-agent tokens, operator signals, platform hints, and recommended handling.
SemrushBot
Semrush · SEO audit crawler
- Version
- 0.97
- First seen
- Sep 17, 2025
- Confidence
- Known user-agent token
Crawler tags
Directory facts
- AI model training
- Not listed as training
- Acts on behalf of user
- No, autonomous
- Obeys directives
- Yes, listed as obeying robots.txt
What is SemrushBot?
SemrushBot-SI is listed as a seo audit crawler operated by Semrush. SemrushBot is classified as a generic crawler that may fetch pages for search, SEO, monitoring, or data collection workflows.
SemrushBot matched a known crawler token in the user-agent string, but this page alone does not prove IP ownership.
How to identify SemrushBot in logs
Search server logs for SemrushBot, SemrushBot-SI. Matching those tokens is useful for discovery, but IP verification is still recommended before trusting the identity.
Mozilla/5.0 (compatible; SemrushBot-SI/0.97; +http://www.semrush.com/bot.html)
Use this as a web-crawler lookup reference for identifying how this user-agent presents itself in server logs. After you identify crawler traffic, run the WebMCP Compatibility Checker to confirm whether AI crawlers and agents can understand your site.
User-agent signals
- Product tokens
- Mozilla/5.0, SemrushBot-SI/0.97
- Documentation
- http://www.semrush.com/bot.html
- Contact
- None found
- Platform
- Unknown · Unknown
- Browser profile
- Unknown · Unknown
- Browser-like UA
- Yes
- HTTP library
- Unknown
- Spoof risk
- Medium
Questions answered by this crawler profile
What is SemrushBot-SI?
SemrushBot-SI is listed as a seo audit crawler operated by Semrush. SemrushBot is classified as a generic crawler that may fetch pages for search, SEO, monitoring, or data collection workflows.
Does SemrushBot-SI train AI models?
SemrushBot-SI is not listed as being used to train AI or LLM systems.
Is SemrushBot-SI user-triggered?
SemrushBot-SI is listed as operating independently of a direct user action.
How do I identify SemrushBot-SI in logs?
Search server logs for SemrushBot, SemrushBot-SI. Matching those tokens is useful for discovery, but IP verification is still recommended before trusting the identity.
Does SemrushBot-SI respect robots.txt?
This directory entry lists the crawler as obeying robots.txt directives. Confirm behavior in your logs before relying on user-agent strings alone.