Web crawler lookup

What is dcrawl bot?

dcrawl bot is listed as a url fetcher. Use this crawler profile to identify user-agent tokens, operator signals, platform hints, and recommended handling.

dcrawl bot

URL fetcher

Version
1.0
First seen
Sep 17, 2025
Confidence
Known user-agent token

Crawler tags

URL fetcherNot AI trainingRobots control limitedUser-triggered

Directory facts

AI model training
Not listed as training
Acts on behalf of user
Yes, user-triggered
Obeys directives
No, do not rely on robots.txt alone

What is dcrawl bot?

dcrawl bot is listed as a url fetcher. dcrawl bot is likely a user-triggered fetcher that retrieves a page after someone asks for, previews, or opens a URL.

dcrawl bot matched a known crawler token in the user-agent string, but this page alone does not prove IP ownership.

How to identify dcrawl bot in logs

Search server logs for dcrawl bot, dcrawl. Matching those tokens is useful for discovery, but IP verification is still recommended before trusting the identity.

dcrawl botdcrawl

dcrawl/1.0

Use this as a web-crawler lookup reference for identifying how this user-agent presents itself in server logs. After you identify crawler traffic, run the WebMCP Compatibility Checker to confirm whether AI crawlers and agents can understand your site.

User-agent signals

Product tokens
dcrawl/1.0
Documentation
None found in user-agent
Contact
None found
Platform
Unknown · Unknown
Browser profile
Unknown · Unknown
Browser-like UA
No
HTTP library
Unknown
Spoof risk
Medium

Questions answered by this crawler profile

What is dcrawl bot?

dcrawl bot is listed as a url fetcher. dcrawl bot is likely a user-triggered fetcher that retrieves a page after someone asks for, previews, or opens a URL.

Does dcrawl bot train AI models?

dcrawl bot is not listed as being used to train AI or LLM systems.

Is dcrawl bot user-triggered?

dcrawl bot is listed as being triggered by a real user action.

How do I identify dcrawl bot in logs?

Search server logs for dcrawl bot, dcrawl. Matching those tokens is useful for discovery, but IP verification is still recommended before trusting the identity.

Does dcrawl bot respect robots.txt?

This directory entry lists the crawler as not obeying robots.txt directives. Use server-side access controls, firewall rules, or rate limits when policy enforcement matters.