Tools
D4Vinci/Scrapling v0.4.7: Adaptive Web Scraping Framework With Built-In MCP Server Hits 38.4K Stars
Scrapling (38.4K stars, 3.4K forks, v0.4.7 April 17) is a Python web scraping framework that uses similarity algorithms to automatically relocate scraped elements when websites change layout — eliminating the brittle selector problem. The built-in MCP server lets Claude and other AI agents control web scraping directly, while AI-optimized content extraction reduces token usage by stripping non-essential HTML before passing to LLMs. Features three fetcher types (HTTP, stealth, dynamic), a full spider framework rivaling Scrapy, and pause/resume with checkpoint persistence.
Source
↳ Follow the thread