Web crawler lookup

What is tranco-crawler?

tranco-crawler is a generic crawler. Use this crawler profile to identify user-agent tokens, operator signals, platform hints, and recommended handling.

tranco-crawler

Generic crawler

Version
1.0
First seen
Jul 23, 2026
Confidence
Inferred user-agent token

Crawler tags

Generic crawler

What is tranco-crawler?

tranco-crawler is a generic crawler. tranco-crawler is classified as a generic crawler that may fetch pages for search, SEO, monitoring, or data collection workflows.

tranco-crawler was inferred from a bot-like product token in the user-agent string.

How to identify tranco-crawler in logs

Search server logs for tranco-crawler. Matching those tokens is useful for discovery, but IP verification is still recommended before trusting the identity.

tranco-crawler

tranco-crawler/1.0

Use this as a web-crawler lookup reference for identifying how this user-agent presents itself in server logs. After you identify crawler traffic, run the AI Agent Readiness Scanner to confirm whether AI crawlers and agents can understand your site.

User-agent signals

Product tokens
tranco-crawler/1.0
Documentation
None found in user-agent
Contact
None found
Platform
Unknown · Unknown
Browser profile
Unknown · Unknown
Browser-like UA
No
HTTP library
Unknown
Spoof risk
High

Questions answered by this crawler profile

What is tranco-crawler?

tranco-crawler is classified as a generic crawler that may fetch pages for search, SEO, monitoring, or data collection workflows.

Who operates tranco-crawler?

The operator for tranco-crawler is not known from the user-agent alone.

How do I identify tranco-crawler in logs?

Search server logs for tranco-crawler. Matching those tokens is useful for discovery, but IP verification is still recommended before trusting the identity.

Should I allow tranco-crawler?

Verify IP ownership or behavior before making security decisions because user-agent strings can be spoofed. Monitor crawl rate and paths, then allow normal traffic or rate-limit/block if behavior becomes abusive.

Does tranco-crawler respect robots.txt?

Robots.txt compliance cannot be proven from a user-agent string alone. Check the crawler operator documentation and your own logs before assuming behavior.