Web crawler lookup

What is Meta-ExternalFetcher?

Meta-ExternalFetcher is listed as a ai search crawler. Use this crawler profile to identify user-agent tokens, operator signals, platform hints, and recommended handling.

Meta-ExternalFetcher

AI search crawler

Version
1.1
First seen
Sep 17, 2025
Confidence
Known user-agent token

Crawler tags

AI search crawlerSearch crawlerNot AI trainingRobots control limitedUser-triggered

Directory facts

AI model training
Not listed as training
Acts on behalf of user
Yes, user-triggered
Obeys directives
No, do not rely on robots.txt alone

What is Meta-ExternalFetcher?

Meta-ExternalFetcher is listed as a ai search crawler. Meta-ExternalFetcher is likely used to discover, crawl, and index public web pages.

Meta-ExternalFetcher matched a known crawler token in the user-agent string, but this page alone does not prove IP ownership.

How to identify Meta-ExternalFetcher in logs

Search server logs for Meta-ExternalFetcher. Matching those tokens is useful for discovery, but IP verification is still recommended before trusting the identity.

Meta-ExternalFetcher

meta-externalfetcher/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)

Use this as a web-crawler lookup reference for identifying how this user-agent presents itself in server logs. After you identify crawler traffic, run the WebMCP Compatibility Checker to confirm whether AI crawlers and agents can understand your site.

User-agent signals

Product tokens
meta-externalfetcher/1.1
Contact
None found
Platform
Unknown · Unknown
Browser profile
Unknown · Unknown
Browser-like UA
No
HTTP library
Unknown
Spoof risk
Medium

Questions answered by this crawler profile

What is Meta-ExternalFetcher?

Meta-ExternalFetcher is listed as a ai search crawler. Meta-ExternalFetcher is likely used to discover, crawl, and index public web pages.

Does Meta-ExternalFetcher train AI models?

Meta-ExternalFetcher is not listed as being used to train AI or LLM systems.

Is Meta-ExternalFetcher user-triggered?

Meta-ExternalFetcher is listed as being triggered by a real user action.

How do I identify Meta-ExternalFetcher in logs?

Search server logs for Meta-ExternalFetcher. Matching those tokens is useful for discovery, but IP verification is still recommended before trusting the identity.

Does Meta-ExternalFetcher respect robots.txt?

This directory entry lists the crawler as not obeying robots.txt directives. Use server-side access controls, firewall rules, or rate limits when policy enforcement matters.