Open source data-pipelines projects

Every project in the registry tagged data-pipelines, ranked by real GitHub adoption.

projects 6 combined stars ★ 51K refresh nightly
01 dagster ★ 16K

An orchestration platform for the development, production, and observation of data assets.

last push9 hours ago languagePython licenseApache-2.0
02 dolphinscheduler ★ 14K

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code

last push18 hours ago languageJava licenseApache-2.0
03 Mage ★ 8.8K

Magical data pipeline tool for seamless transformations

last push6 days ago languagePython licenseApache-2.0
04 fluvio ★ 5.3K

🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.

last push19 days ago languageRust licenseApache-2.0
05 docetl ★ 4.1K

A system for agentic LLM-powered data processing and ETL

last push12 days ago languagePython licenseMIT
06 Elementary Data ★ 2.4K

Data observability for modern data teams

last push20 hours ago languageHTML licenseApache-2.0

Related tags

← all tags

Frequently asked questions

How many open source data-pipelines projects are there?

This registry tracks 6 projects tagged data-pipelines, with 51,237 GitHub stars between them. The most-adopted is dagster at 16,169 stars.

Are these data-pipelines projects free to use?

Yes — 6 of the 6 carry an explicit open-source licence across 2 distinct licences, so there is no licence fee. Where a project also sells a hosted or enterprise version, the self-hosted path remains free.

Which data-pipelines project should I choose?

The list above is ranked by GitHub stars, but stars measure attention rather than fit. Check three things on each card: the licence (permissive versus copyleft), the language it is written in, and the last-push date — a high-star project that has not been pushed in a year is a liability.

Are these data-pipelines projects still maintained?

6 of the 6 were pushed in the last 90 days, and every card shows its exact last-push date so you can see the rest. Sort your shortlist by that date before committing to a migration.