Tools
D4Vinci/Scrapling at 51.2K Stars: Adaptive Web Scraping Framework Ships MCP Server for Direct Agent Integration
Scrapling is an adaptive Python scraping framework that handles single requests through full-scale concurrent crawls with built-in Cloudflare Turnstile bypass and automatic element relocation when website layouts change. The v0.4.8 release (May 11, 2026) includes an MCP server enabling direct Claude/Cursor integration, checkpoint-based pause/resume for long crawls, and Docker support with pre-installed browsers. At 51.2K stars with 1,442 commits, it represents scraping infrastructure maturing into agent-native tooling.
Source
↳ Follow the thread