Scrapling
Python scraping framework from single requests to concurrent crawls
What it is
Scrapling is a Python library for fetching, parsing, and crawling websites. It combines plain HTTP requests with stealth browser fetching and JavaScript rendering, offers CSS, XPath, and regex selection with adaptive element tracking, and runs concurrent spiders with proxy rotation, retries, pause and resume, and JSON or CSV export. Developers and data collectors can drive it from Python code, a CLI and interactive shell, or let AI agents use it via the bundled MCP server and agent skill.