Web crawler lookup

What is ShapBot?

ShapBot is Parallel's crawler for discovering and indexing websites for Parallel's web APIs. Use this crawler profile to identify user-agent tokens, operator signals, platform hints, and recommended handling.

ShapBot

Parallel · AI search crawler

Version
0.1.0
First seen
May 20, 2026
Confidence
Known user-agent token

Crawler tags

AI search crawlerSearch crawlerAutonomousNot AI trainingObeys robots.txtBrowser-like UA

Directory facts

AI model training
Not listed as training
Acts on behalf of user
No, autonomous
Obeys directives
Yes, listed as obeying robots.txt

What is ShapBot?

ShapBot is Parallel's crawler for discovering and indexing websites for Parallel's web APIs. Parallel says allowing ShapBot can help maximize a site's visibility in Parallel search results.

Parallel publishes ShapBot IP ranges separately from the user-agent string; use those ranges to validate crawler identity.

How to identify ShapBot in logs

Search server logs for ShapBot or ShapBot/0.1.0. The full documented user-agent string is Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ShapBot/0.1.0.

ShapBotShapBot/0.1.0

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ShapBot/0.1.0

Use this as a web-crawler lookup reference for identifying how this user-agent presents itself in server logs. After you identify crawler traffic, run the WebMCP Compatibility Checker to confirm whether AI crawlers and agents can understand your site.

User-agent signals

Product tokens
Mozilla/5.0, AppleWebKit/537.36, Gecko, ShapBot/0.1.0
Contact
support@parallel.ai
Platform
Unknown · Unknown
Browser profile
Unknown · WebKit
Browser-like UA
Yes
HTTP library
Unknown
Spoof risk
Medium

Questions answered by this crawler profile

What is ShapBot?

ShapBot is the crawler Parallel uses to discover and index websites for Parallel's web APIs.

Who operates ShapBot?

ShapBot is operated by Parallel.

How do I identify ShapBot in logs?

Search server logs for ShapBot or ShapBot/0.1.0. The full documented user-agent string is Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ShapBot/0.1.0.

Should I allow ShapBot?

Parallel publishes designated ShapBot IP ranges; verify requests against the official IP list before trusting the user-agent string. Allow ShapBot for public pages you want visible through Parallel's web APIs, permit the designated ShapBot IP ranges, and keep private or sensitive URLs behind normal access controls.

Does ShapBot respect robots.txt?

Parallel recommends allowing ShapBot in robots.txt if you want to maximize your site's visibility in Parallel search results. Parallel also recommends permitting connections from its designated ShapBot IP ranges.

Where are ShapBot IP ranges published?

Parallel links the current ShapBot IP list from its crawler docs at https://docs.parallel.ai/resources/shapbot.json.

How do I contact Parallel about ShapBot?

Parallel's crawler docs list support@parallel.ai for crawler questions and assistance.