Web crawler lookup

What is SemrushBot?

SemrushBot-SWA is listed as a seo audit crawler operated by Semrush. Use this crawler profile to identify user-agent tokens, operator signals, platform hints, and recommended handling.

SemrushBot

Semrush · SEO audit crawler

Version
Unknown
First seen
Sep 17, 2025
Confidence
Known user-agent token

Crawler tags

SEO audit crawlerAutonomousNot AI trainingObeys robots.txt

Directory facts

AI model training
Not listed as training
Acts on behalf of user
No, autonomous
Obeys directives
Yes, listed as obeying robots.txt

What is SemrushBot?

SemrushBot-SWA is listed as a seo audit crawler operated by Semrush. SemrushBot is classified as a generic crawler that may fetch pages for search, SEO, monitoring, or data collection workflows.

SemrushBot matched a known crawler token in the user-agent string, but this page alone does not prove IP ownership.

How to identify SemrushBot in logs

Search server logs for SemrushBot, SemrushBot-SWA. Matching those tokens is useful for discovery, but IP verification is still recommended before trusting the identity.

SemrushBotSemrushBot-SWA

SemrushBot-SWA

Use this as a web-crawler lookup reference for identifying how this user-agent presents itself in server logs. After you identify crawler traffic, run the WebMCP Compatibility Checker to confirm whether AI crawlers and agents can understand your site.

User-agent signals

Product tokens
SemrushBot-SWA
Documentation
None found in user-agent
Contact
None found
Platform
Unknown · Unknown
Browser profile
Unknown · Unknown
Browser-like UA
No
HTTP library
Unknown
Spoof risk
Medium

Questions answered by this crawler profile

What is SemrushBot-SWA?

SemrushBot-SWA is listed as a seo audit crawler operated by Semrush. SemrushBot is classified as a generic crawler that may fetch pages for search, SEO, monitoring, or data collection workflows.

Does SemrushBot-SWA train AI models?

SemrushBot-SWA is not listed as being used to train AI or LLM systems.

Is SemrushBot-SWA user-triggered?

SemrushBot-SWA is listed as operating independently of a direct user action.

How do I identify SemrushBot-SWA in logs?

Search server logs for SemrushBot, SemrushBot-SWA. Matching those tokens is useful for discovery, but IP verification is still recommended before trusting the identity.

Does SemrushBot-SWA respect robots.txt?

This directory entry lists the crawler as obeying robots.txt directives. Confirm behavior in your logs before relying on user-agent strings alone.