Open source data-extraction projects
Every project in the registry tagged data-extraction, ranked by real GitHub adoption.
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDce
Python scraper based on AI
The SDK to extract data and interact with any site on the web. Get started with Claude Code, Codex, Eve, Mastra, and more.
No-code web scraping, crawling, and extraction platform
Declarative data automation language and Go runtime for structured extraction workflows.
Browser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck. Parallel multi-task execution, indepen
A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.
Python package for scraping recipes data
ContextGem: Effortless LLM extraction from documents
To extract article from given URL
Lightweight library for scraping web-sites with LLMs
⛏️ The extraction engine behind Maigret: turn any profile URL into a structured OSINT record across 150+ sites
Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scra
The fastest PDF library for Python and Rust. Text extraction, image extraction, markdown conversion, PDF creation & editing. 0.8ms mean, 5× faster than industry
🤖 AI-powered web scraping editor with visual workflow builder. Build, test & deploy web scrapers using natural language. Powered by ScrapeGraphAI & LangGraph.
Undetected web-scraping & seamless HTML parsing in Python!
Open source web infrastructure for AI. Scrape, crawl, and automate the web, clean markdown, browser sessions, ready for your agents.
Related tags
Frequently asked questions
How many open source data-extraction projects are there?
This registry tracks 18 projects tagged data-extraction, with 363,380 GitHub stars between them. The most-adopted is firecrawl at 181,627 stars.
Are these data-extraction projects free to use?
Yes — 18 of the 18 carry an explicit open-source licence across 5 distinct licences, so there is no licence fee. Where a project also sells a hosted or enterprise version, the self-hosted path remains free.
Which data-extraction project should I choose?
The list above is ranked by GitHub stars, but stars measure attention rather than fit. Check three things on each card: the licence (permissive versus copyleft), the language it is written in, and the last-push date — a high-star project that has not been pushed in a year is a liability.
Are these data-extraction projects still maintained?
15 of the 18 were pushed in the last 90 days, and every card shows its exact last-push date so you can see the rest. Sort your shortlist by that date before committing to a migration.