What is SemrushBot?
SemrushBot is a generic crawler operated by Semrush. Use this crawler profile to identify user-agent tokens, operator signals, platform hints, and recommended handling.
SemrushBot
Semrush · Generic crawler
- Version
- Unknown
- First seen
- May 20, 2026
- Last seen
- May 23, 2026
- Confidence
- Known user-agent token
What is SemrushBot?
SemrushBot is a generic crawler operated by Semrush. SemrushBot is classified as a generic crawler that may fetch pages for search, SEO, monitoring, or data collection workflows.
SemrushBot matched a known crawler token in the user-agent string, but this page alone does not prove IP ownership.
How to identify SemrushBot in logs
Search server logs for SemrushBot. Matching those tokens is useful for discovery, but IP verification is still recommended before trusting the identity.
Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)
Use this as a web-crawler lookup reference for identifying how this user-agent presents itself in server logs.
User-agent signals
- Product tokens
- Mozilla/5.0
- Documentation
- http://www.semrush.com/bot.html
- Contact
- None found
- Platform
- Unknown · Unknown
- Browser profile
- Unknown · Unknown
- Browser-like UA
- Yes
- HTTP library
- Unknown
- Spoof risk
- Medium
Questions answered by this crawler profile
What is SemrushBot?
SemrushBot is classified as a generic crawler that may fetch pages for search, SEO, monitoring, or data collection workflows.
Who operates SemrushBot?
SemrushBot is associated with Semrush.
How do I identify SemrushBot in logs?
Search server logs for SemrushBot. Matching those tokens is useful for discovery, but IP verification is still recommended before trusting the identity.
Should I allow SemrushBot?
Verify IP ownership or behavior before making security decisions because user-agent strings can be spoofed. Monitor crawl rate and paths, then allow normal traffic or rate-limit/block if behavior becomes abusive.
Does SemrushBot respect robots.txt?
Robots.txt compliance cannot be proven from a user-agent string alone. Check the crawler operator documentation and your own logs before assuming behavior.