Open source data-engineering projects
Every project in the registry tagged data-engineering, ranked by real GitHub adoption.
Self-serve data exploration and dashboard builder
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Declarative workflow orchestration for data, AI, and infra
Python-native workflow orchestration for data and ML teams
Open-source data integration for modern teams
Turns Data and AI algorithms into production-ready web applications in no time.
An orchestration platform for the development, production, and observation of data assets.
Graph-Native Infrastructure for Context and Accountable AI Systems
Always know what to expect from your data.
Ultra-fast data transformation for AI with lineage
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
Magical data pipeline tool for seamless transformations
Open-source A/B testing and feature flagging platform
LLM-Driven Extraction of Unstructured Data — Built for API Deployments & ETL Pipeline Workflows
Transform SQL into beautiful data stories
Sync and transform data from any source to any destination
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
lakeFS - Data version control for your data lake | Git for data
DeepAnalyze is the first agentic LLM for autonomous data science. 🎈你的AI数据分析师，自动分析大量数据，一键生成专业分析报告！
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager,
Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering
A new SOTA for RAG — an original retrieval architecture and an open-source knowledge base for humans and agents.
🔥🔥🔥 Open source Reverse ETL - alternative to hightouch and census.
:bar_chart: :clipboard: Dashboards using YAML or JSON files
Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality,
First open-source data discovery and observability platform. We make a life for data practitioners easy so you can focus on your business.
Revolutionizing data processing with Compute Over Data
Supercharge BigQuery with BigFunctions
Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
Yet another redundant workflow engine
Connect APIs, databases, and streams without glue code
Related tags
Frequently asked questions
How many open source data-engineering projects are there?
This registry tracks 31 projects tagged data-engineering, with 356,877 GitHub stars between them. The most-adopted is Apache Superset at 75,392 stars.
Are these data-engineering projects free to use?
Yes — 27 of the 31 carry an explicit open-source licence across 4 distinct licences, so there is no licence fee. Where a project also sells a hosted or enterprise version, the self-hosted path remains free.
Which data-engineering project should I choose?
The list above is ranked by GitHub stars, but stars measure attention rather than fit. Check three things on each card: the licence (permissive versus copyleft), the language it is written in, and the last-push date — a high-star project that has not been pushed in a year is a liability.
Are these data-engineering projects still maintained?
28 of the 31 were pushed in the last 90 days, and every card shows its exact last-push date so you can see the rest. Sort your shortlist by that date before committing to a migration.