Detect website crawl drift

GET 
/api/v1/chatbots/:chatbotId/crawls/drift

Compares a chatbot's crawled URL set for a domain against the domain's CURRENT sitemap.xml, reporting pages ADDED (in the sitemap but not yet crawled) and REMOVED (crawled but no longer in the sitemap). The domain MUST be one the chatbot has already crawled (SSRF-bounded). Content changes on already-crawled pages are NOT detected — no per-page baseline is stored for existing crawls. Required scope: documents:read.

Request

Responses

200

Crawl-drift report for the domain.

400

Bad Request — invalid input

401

Unauthorized — missing or invalid API key

403

Forbidden — key lacks required scope

404

Not Found

429

Too Many Requests — rate limit exceeded