Open source data projects
Every project in the registry tagged data, ranked by real GitHub adoption.
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDce
LlamaIndex is the document processing platform for AI
Unlock data insights with powerful, user-friendly analytics
Python-native workflow orchestration for data and ML teams
Open-source data integration for modern teams
A web interface to create custom vector-based visualizations on top of RAWGraphs core
Magical data pipeline tool for seamless transformations
Sync and transform data from any source to any destination
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
DeepAnalyze is the first agentic LLM for autonomous data science. 🎈你的AI数据分析师，自动分析大量数据，一键生成专业分析报告！
Preswald is a WASM packager for Python-based interactive data apps: bundle full complex data workflows, particularly visualizations, into single files, runnable
A system for agentic LLM-powered data processing and ETL
Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering
Python, SQL, and AI in a collaborative data notebook
The fastest business intelligence tool for humans and agents.
LLM based data scientist, AI native data application. AI-driven infinite thinking redefines BI.
Cookie-less analytics for privacy-focused insights
A Python stream processing engine modeled after Yahoo! Pipes
:bar_chart: :clipboard: Dashboards using YAML or JSON files
Supercharge BigQuery with BigFunctions
The agent harness for building analytics into your app on top of ClickHouse, Redpanda and other high-performance analytical infrastructure
Undetected web-scraping & seamless HTML parsing in Python!
Related tags
Frequently asked questions
How many open source data projects are there?
This registry tracks 22 projects tagged data, with 304,090 GitHub stars between them. The most-adopted is Scrapling at 92,628 stars.
Are these data projects free to use?
Yes — 20 of the 22 carry an explicit open-source licence across 4 distinct licences, so there is no licence fee. Where a project also sells a hosted or enterprise version, the self-hosted path remains free.
Which data project should I choose?
The list above is ranked by GitHub stars, but stars measure attention rather than fit. Check three things on each card: the licence (permissive versus copyleft), the language it is written in, and the last-push date — a high-star project that has not been pushed in a year is a liability.
Are these data projects still maintained?
19 of the 22 were pushed in the last 90 days, and every card shows its exact last-push date so you can see the rest. Sort your shortlist by that date before committing to a migration.