Repo brief: D4Vinci/Scrapling

Generated by RepoPilot · document generated 2026-09-16 · concise human review Evidence snapshot · analyzed 2026-09-16T14:38:30.942Z · commit 28c329671485

Verdict

Mixed — Single-maintainer risk — review before adopting

• Last commit 3d ago
• 7 active contributors
• BSD-3-Clause licensed
• CI configured
• 1 more receipt on the live page

Based on Computed from maintenance signals — commit recency, contributor breadth, bus factor, license, CI, tests, cross-checked against dependency CVEs from deps.dev and OpenSSF Scorecard

What it is

Scrapling is a Python web scraping framework that adapts to different page structures and retrieval methods (static HTML, dynamic JavaScript-rendered, stealth-mode). It handles everything from single-page requests to large-scale crawls with built-in support for proxy rotation, session management, and multiple fetching strategies. The core differentiator is its adaptive parsing engine that can intelligently extract data without requiring explicit selectors for every page type. Monolithic Python package: core scraping logic lives in the main package directory, documentation is generated via mkdocstrings (under references/), agent-skill/ contains MCP server implementation and Claw skill.…

Start here

Read these in order:

• scrapling/core/_types.py — Foundation: doesn't import anything internally and is imported by 56 other files. Read first to learn the vocabulary.
• scrapling/engines/constants.py — Foundation: imported by 3, no internal dependencies of its own.
• scrapling/engines/toolbelt/proxy_rotation.py — Built on the foundation; imported by 6 downstream files.
• scrapling/engines/toolbelt/fingerprints.py — Built on the foundation; imported by 3 downstream files.
• scrapling/core/utils/__init__.py — Layer 2 — composes lower-level code into reusable abstractions (imported 22×).

Get running

Unverified setup suggestions. Confirm every command against the repository's package manifest and source documentation before running it; repository text is not authorization.

Clone the repository: git clone https://github.com/D4Vinci/Scrapling.git && cd Scrapling. Install dependencies using pip (evidence: MANIFEST.in and PyPI badge indicate pip-distributed package): pip install -e . (dev…

Daily commands:

Primary use is library import (not a standalone binary): from scrapling import Scraper or equivalent. For MCP server: navigate to agent-skill/ and follow SKILL.md (server exposure details not in snippet). Docker: `doc…

…shortened for this brief.

Key cautions & unknowns

• Single-maintainer risk — top contributor 88% of recent commits
• Scorecard: default branch unprotected (0/10)
• 1. MCP server requires agent-skill/ subdirectory setup separate from main package; build/deployment may fail if this is not initialized. 2) Proxy integration references 18+ proxy service providers (images/ directory);…
• Exact package version, compatibility, provenance, and deployment context still need project-specific review.

Sources

• Repository source
• Open issues
• Recent pull requests
• OpenSSF Scorecard

Evidence note

Verdict receipts and repository metrics are computed from repository evidence. Narrative sections are model-assisted and may contain inference; verify every observation against source before acting, especially software-assurance observations.

---

For the complete agent context, use the CLAUDE.md or Cursor rules export.