Open source pipeline projects

Every project in the registry tagged pipeline, ranked by real GitHub adoption.

projects 8 combined stars ★ 55K refresh nightly
01 Prefect ★ 24K

Python-native workflow orchestration for data and ML teams

last push8 hours ago languagePython licenseApache-2.0
02 Mage ★ 8.8K

Magical data pipeline tool for seamless transformations

last push6 days ago languagePython licenseApache-2.0
03 GameDevMind ★ 6.5K

最全面的游戏开发技术图谱(Game Development Map)。帮助游戏开发者们在已知问题上节省时间,省出更多的精力投入到更有创造性的工作中去。

last push1 months ago languagePython licenseMIT
04 papermill ★ 6.5K

📚 Parameterize, execute, and analyze notebooks

last push2 months ago languagePython licenseBSD-3-Clause
05 nextflow ★ 3.5K

A DSL for data-driven computational pipelines

last push8 hours ago languageGroovy licenseApache-2.0
06 Timeplus ★ 2.3K

Real-time stream processing made simple and affordable

last push20 hours ago languageC++ licenseApache-2.0
07 go-streams ★ 2.2K

A lightweight stream processing library for Go

last push8 months ago languageGo licenseMIT
08 hop ★ 1.5K

Hop Orchestration Platform

last push9 hours ago languageJava licenseApache-2.0

Related tags

← all tags

Frequently asked questions

How many open source pipeline projects are there?

This registry tracks 8 projects tagged pipeline, with 55,091 GitHub stars between them. The most-adopted is Prefect at 23,857 stars.

Are these pipeline projects free to use?

Yes — 8 of the 8 carry an explicit open-source licence across 3 distinct licences, so there is no licence fee. Where a project also sells a hosted or enterprise version, the self-hosted path remains free.

Which pipeline project should I choose?

The list above is ranked by GitHub stars, but stars measure attention rather than fit. Check three things on each card: the licence (permissive versus copyleft), the language it is written in, and the last-push date — a high-star project that has not been pushed in a year is a liability.

Are these pipeline projects still maintained?

7 of the 8 were pushed in the last 90 days, and every card shows its exact last-push date so you can see the rest. Sort your shortlist by that date before committing to a migration.