Web crawler lookup

What is SemrushBot?

SemrushBot-CT is listed as a seo audit crawler operated by Semrush. Use this crawler profile to identify user-agent tokens, operator signals, platform hints, and recommended handling.

SemrushBot

Semrush · SEO audit crawler

Version
Unknown
First seen
Sep 17, 2025
Confidence
Known user-agent token

Crawler tags

SEO audit crawlerNot AI trainingObeys robots.txtSystem-triggered

Directory facts

AI model training
Not listed as training
Acts on behalf of user
No, system-triggered
Obeys directives
Yes, listed as obeying robots.txt

What is SemrushBot?

SemrushBot-CT is listed as a seo audit crawler operated by Semrush. SemrushBot is classified as a generic crawler that may fetch pages for search, SEO, monitoring, or data collection workflows.

SemrushBot matched a known crawler token in the user-agent string, but this page alone does not prove IP ownership.

How to identify SemrushBot in logs

Search server logs for SemrushBot, SemrushBot-CT. Matching those tokens is useful for discovery, but IP verification is still recommended before trusting the identity.

SemrushBotSemrushBot-CT

SemrushBot-CT

Use this as a web-crawler lookup reference for identifying how this user-agent presents itself in server logs. After you identify crawler traffic, run the AI Agent Readiness Scanner to confirm whether AI crawlers and agents can understand your site.

User-agent signals

Product tokens
SemrushBot-CT
Documentation
None found in user-agent
Contact
None found
Platform
Unknown · Unknown
Browser profile
Unknown · Unknown
Browser-like UA
No
HTTP library
Unknown
Spoof risk
Medium

Questions answered by this crawler profile

What is SemrushBot-CT?

SemrushBot-CT is listed as a seo audit crawler operated by Semrush. SemrushBot is classified as a generic crawler that may fetch pages for search, SEO, monitoring, or data collection workflows.

Does SemrushBot-CT train AI models?

SemrushBot-CT is not listed as being used to train AI or LLM systems.

Is SemrushBot-CT user-triggered?

SemrushBot-CT is listed as operating independently of a direct user action.

How do I identify SemrushBot-CT in logs?

Search server logs for SemrushBot, SemrushBot-CT. Matching those tokens is useful for discovery, but IP verification is still recommended before trusting the identity.

Does SemrushBot-CT respect robots.txt?

This directory entry lists the crawler as obeying robots.txt directives. Confirm behavior in your logs before relying on user-agent strings alone.