Web crawler lookup

What is EtaoSpider?

EtaoSpider is listed as a url fetcher. Use this crawler profile to identify user-agent tokens, operator signals, platform hints, and recommended handling.

EtaoSpider

URL fetcher

Version
Unknown
First seen
Sep 17, 2025
Confidence
Known user-agent token

Crawler tags

URL fetcherRobots control limited

Directory facts

AI model training
Unknown
Acts on behalf of user
Unknown
Obeys directives
No, do not rely on robots.txt alone

What is EtaoSpider?

EtaoSpider is listed as a url fetcher. EtaoSpider is classified as a generic crawler that may fetch pages for search, SEO, monitoring, or data collection workflows.

EtaoSpider matched a known crawler token in the user-agent string, but this page alone does not prove IP ownership.

How to identify EtaoSpider in logs

Search server logs for EtaoSpider. Matching those tokens is useful for discovery, but IP verification is still recommended before trusting the identity.

EtaoSpider

EtaoSpider

Use this as a web-crawler lookup reference for identifying how this user-agent presents itself in server logs. After you identify crawler traffic, run the WebMCP Compatibility Checker to confirm whether AI crawlers and agents can understand your site.

User-agent signals

Product tokens
EtaoSpider
Documentation
None found in user-agent
Contact
None found
Platform
Unknown · Unknown
Browser profile
Unknown · Unknown
Browser-like UA
No
HTTP library
Unknown
Spoof risk
Medium

Questions answered by this crawler profile

What is EtaoSpider?

EtaoSpider is listed as a url fetcher. EtaoSpider is classified as a generic crawler that may fetch pages for search, SEO, monitoring, or data collection workflows.

Does EtaoSpider train AI models?

The directory does not say whether EtaoSpider is used in AI development.

Is EtaoSpider user-triggered?

The directory does not say whether EtaoSpider is user-triggered.

How do I identify EtaoSpider in logs?

Search server logs for EtaoSpider. Matching those tokens is useful for discovery, but IP verification is still recommended before trusting the identity.

Does EtaoSpider respect robots.txt?

This directory entry lists the crawler as not obeying robots.txt directives. Use server-side access controls, firewall rules, or rate limits when policy enforcement matters.