Open source data-pipelines projects
Every project in the registry tagged data-pipelines, ranked by real GitHub adoption.
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
An orchestration platform for the development, production, and observation of data assets.
Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
Magical data pipeline tool for seamless transformations
🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.
Preswald is a WASM packager for Python-based interactive data apps: bundle full complex data workflows, particularly visualizations, into single files, runnable
A system for agentic LLM-powered data processing and ETL
Data observability for modern data teams
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
First open-source data discovery and observability platform. We make a life for data practitioners easy so you can focus on your business.
Related tags
Frequently asked questions
How many open source data-pipelines projects are there?
This registry tracks 10 projects tagged data-pipelines, with 106,476 GitHub stars between them. The most-adopted is airflow at 47,344 stars.
Are these data-pipelines projects free to use?
Yes — 10 of the 10 carry an explicit open-source licence across 2 distinct licences, so there is no licence fee. Where a project also sells a hosted or enterprise version, the self-hosted path remains free.
Which data-pipelines project should I choose?
The list above is ranked by GitHub stars, but stars measure attention rather than fit. Check three things on each card: the licence (permissive versus copyleft), the language it is written in, and the last-push date — a high-star project that has not been pushed in a year is a liability.
Are these data-pipelines projects still maintained?
9 of the 10 were pushed in the last 90 days, and every card shows its exact last-push date so you can see the rest. Sort your shortlist by that date before committing to a migration.