Open source data-extraction projects
Every project in the registry tagged data-extraction, ranked by real GitHub adoption.
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDce
LLM-ready web crawler built for AI data pipelines
Python scraper based on AI
The SDK to extract data and interact with any site on the web. Get started with Claude Code, Codex, Eve, Mastra, and more.
No-code web scraping, crawling, and extraction platform
Browser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck. Parallel multi-task execution, indepen
Declarative data automation language and Go runtime for structured extraction workflows.
An agentic extractor for messaging platforms. Noria receives messages & URLs via chat; scrapes web data to evaluate the content against custom scoring matrices
A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.
Python package for scraping recipes data
ContextGem: Effortless LLM extraction from documents
To extract article from given URL
Converts a pdf file into a text file while keeping the layout of the original pdf. Useful to extract the content from a table in a pdf file for instance. This i
Lightweight library for scraping web-sites with LLMs
Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scra
The fastest PDF library for Python and Rust. Text extraction, image extraction, markdown conversion, PDF creation & editing. 0.8ms mean, 5× faster than industry
⛏️ The extraction engine behind Maigret: turn any profile URL into a structured OSINT record across 150+ sites
🤖 AI-powered web scraping editor with visual workflow builder. Build, test & deploy web scrapers using natural language. Powered by ScrapeGraphAI & LangGraph.
Undetected web-scraping & seamless HTML parsing in Python!
Open source web infrastructure for AI. Scrape, crawl, and automate the web, clean markdown, browser sessions, ready for your agents.
Related tags
Frequently asked questions
How many open source data-extraction projects are there?
This registry tracks 21 projects tagged data-extraction, with 486,890 GitHub stars between them. The most-adopted is firecrawl at 197,725 stars.
Are these data-extraction projects free to use?
Yes — 21 of the 21 carry an explicit open-source licence across 5 distinct licences, so there is no licence fee. Where a project also sells a hosted or enterprise version, the self-hosted path remains free.
Which data-extraction project should I choose?
The list above is ranked by GitHub stars, but stars measure attention rather than fit. Check three things on each card: the licence (permissive versus copyleft), the language it is written in, and the last-push date — a high-star project that has not been pushed in a year is a liability.
Are these data-extraction projects still maintained?
18 of the 21 were pushed in the last 90 days, and every card shows its exact last-push date so you can see the rest. Sort your shortlist by that date before committing to a migration.