CrawlConsole documentation

CrawlConsole gives technical and growth teams one place to understand how search engines and AI agents interact with their sites. Use these docs to install telemetry, connect an AI agent through MCP, and turn crawl and backlink data into actions.

Choose a starting point

• Get started if this is your first CrawlConsole property.
• Install crawler analytics to begin collecting verified crawler requests.
• Connect an AI agent to query CrawlConsole through MCP.
• Set up WebMCP to expose safe, structured browser tools on your site.
• Understand backlinks to work with Domain Score, referring domains, and link evidence.

Built for people and agents

Every published page is available as HTML and Markdown. Add .md to a documentation URL for the Markdown version, or use llms.txt and llms-full.txt to discover or ingest the full documentation set.

The docs also expose a searchable MCP tool through the CrawlConsole MCP server. This keeps product answers grounded in the same published pages that people can read here.

Documentation lifecycle

Documentation can be edited in Git as Markdown or managed in the CrawlConsole admin CMS. A publish action updates navigation, search, Markdown exports, and the documentation sitemap from one source.