replacing ScrapingBee
Web scraping API with proxy rotation and JavaScript rendering — ScrapingBee pricing: Paid plans from $19/month, up to $599/month for the largest tier. Below: 3 free, self-hostable open source projects that cover the same ground, ranked by real GitHub adoption.
There are 3 open source ScrapingBee alternatives tracked on this registry, against ScrapingBee pricing of Paid plans from $19/month, up to $599/month for the largest tier. The most-adopted is Crawl4AI with 84,048 GitHub stars under Apache-2.0, written in Python. Together the set has 192,778 stars across 2 languages and 2 licences. All 3 are free to self-host with no licence fee, and 3 of 3 received a commit in the last 90 days. 3 head-to-head ScrapingBee comparisons are available.
The open source projects below are free to self-host. If you would rather pay for a managed service, these are the hosted products in the same space — listed with the vendor's own pricing.
Crawl4AI is an open-source web crawler and scraper designed to prepare website content for large language model (LLM) workflows. It lives in the Python ecosystem and targets data extraction for RAG, agents, and AI pipelines. Unlike many tools that require API keys or paid subscriptions, Crawl4AI provides direct, self-hosted access to web content with output structured specifically for LLM consumption.
Apache-2.0 · Python · ScrapingBee vs Crawl4AI →
Scrapling is an open-source Python framework for web scraping that spans the whole range from one fetch to a concurrent crawl. Its parser learns from website changes and automatically relocates your elements when pages update, so a selector that worked before a redesign can still find the same data afterward. Its fetchers are built to bypass anti-bot systems such as Cloudflare Turnstile out of the box, and its spider framework scales to concurrent, multi-session crawls with pause and resume, automatic proxy rotation, and a crawl speed that adapts to how fast each website responds and backs off when the site starts blocking.
BSD-3-Clause · Python · ScrapingBee vs Scrapling →
Crawlee is a web scraping and browser automation library for Node.js, written in TypeScript and published on npm as the `crawlee` package. It lives in the JavaScript and TypeScript ecosystem, and it covers crawling and scraping end to end: fetching pages, following links, extracting data, and storing the results to disk or to the cloud. The project also has a Python counterpart, Crawlee for Python, maintained alongside it by Apify.
Apache-2.0 · TypeScript · ScrapingBee vs crawlee →
LLM-ready web crawler built for AI data pipelines
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDce
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or G
last updated nightly · ranking method: github stars, live-tracked
Crawl4AI is the most-starred open source alternative to ScrapingBee in this registry, with 84,048 GitHub stars. 3 alternatives are compared here in total.
Yes. Every project listed on this page is open source and free to self-host — there is no licence fee. Some projects also sell a managed hosted version, but the self-hosted path costs nothing.
Compare licence terms, community size (stars), primary language and release activity. A fast-moving project with a compatible licence and an active maintainer base matters more than raw star count when you are committing to a migration.