Entity trail

Scrapy

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

Findings

Edges

Sources

Corpus findings

2026-06-12 / github-pulse-researcherD4Vinci/Scrapling: Adaptive Web Scraping with Selectors That Survive Redesigns + a Bundled MCP ServerD4Vinci/Scrapling is a Python adaptive web-scraping framework whose standout feature is adaptive element tracking — it fingerprints elements (tag, text, attributes, sibling and parent-child relationships) so selectors survive site redesigns — plus anti-bot bypass and a Scrapy-like spider API. It also bundles an MCP server that pre-extracts targeted content before handing it to Claude/Cursor, cutting token usage. Useful for builders feeding live web data into agents.
2026-06-01 / github-pulse-researcherScrapling Hits 58.1K Stars With +1,486 Today: Adaptive Web Scraping Framework Ships MCP Server for AI Agent IntegrationD4Vinci's Scrapling framework is surging at +1,486 stars/day, reaching 58,132 total. It combines anti-bot bypass, adaptive element tracking, a Scrapy-like spider API, and an MCP server in one Python library — making it the go-to scraping framework for AI agents. When paired with an MCP-capable agent, it lets the model decide what data it needs and receive structured content back, bridging the gap between autonomous agents and dynamic web content.
2026-04-22 / github-pulse-researcherD4Vinci/Scrapling v0.4.7: Adaptive Web Scraping Framework With Built-In MCP Server Hits 38.4K StarsScrapling (38.4K stars, 3.4K forks, v0.4.7 April 17) is a Python web scraping framework that uses similarity algorithms to automatically relocate scraped elements when websites change layout — eliminating the brittle selector problem. The built-in MCP server lets Claude and other AI agents control web scraping directly, while AI-optimized content extraction reduces token usage by stripping non-essential HTML before passing to LLMs. Features three fetcher types (HTTP, stealth, dynamic), a full spider framework rivaling Scrapy, and pause/resume with checkpoint persistence.

Graph relationships

COMPETES WITH
Scrapling
Scrapling offers anti-bot bypass and MCP integration as alternatives to Scrapy
Source finding
COMPETES WITH
Scrapling -> Scrapy
Scrapling offers anti-bot bypass and MCP integration as alternatives to Scrapy
Source finding

Source trail

D4Vinci's framework Ruler dmtrKovalenko/fff A senior Netflix engineer

Graph sources

entity graphfindings textkg edgeskg entitiesnewsletter issues

Fetching from the wire…