Open source pipeline projects

Every project in the registry tagged pipeline, ranked by real GitHub adoption.

projects 13 combined stars ★ 65K refresh nightly
01 Prefect ★ 24K

Python-native workflow orchestration for data and ML teams

last push3 hours ago languagePython licenseApache-2.0
02 Mage ★ 8.8K

Magical data pipeline tool for seamless transformations

last push10 days ago languagePython licenseApache-2.0
03 GameDevMind ★ 6.7K

最全面的游戏开发技术图谱(Game Development Map)。帮助游戏开发者们在已知问题上节省时间,省出更多的精力投入到更有创造性的工作中去。

last push17 days ago languagePython licenseMIT
04 papermill ★ 6.5K

📚 Parameterize, execute, and analyze notebooks

last push28 days ago languagePython licenseBSD-3-Clause
05 jx ★ 4.7K

Jenkins X provides automated CI+CD for Kubernetes with Preview Environments on Pull Requests using Cloud Native pipelines from Tekton

last push10 hours ago languageGo licenseApache-2.0
06 nextflow ★ 3.5K

A DSL for data-driven computational pipelines

last push3 hours ago languageGroovy licenseApache-2.0
07 HuixiangDou ★ 2.5K

HuixiangDou: Overcoming Group Chat Scenarios with LLM-based Technical Assistance

last push11 months ago languagePython licenseBSD-3-Clause
08 Timeplus ★ 2.3K

Real-time stream processing made simple and affordable

last push4 days ago languageC++ licenseApache-2.0
09 go-streams ★ 2.2K

A lightweight stream processing library for Go

last push10 months ago languageGo licenseMIT
10 hop ★ 1.5K

Hop Orchestration Platform

last push4 hours ago languageJava licenseApache-2.0
11 oxidns ★ 617

A high-performance, programmable DNS engine in Rust with flexible pipeline-based routing.

last push20 hours ago languageRust licenseGPL-3.0
12 otelbin ★ 584

Web-based tool to facilitate OpenTelemetry collector configuration editing and verification

last push13 hours ago languageTypeScript licenseApache-2.0
13 ModularPipelines ★ 559

Write your pipelines in C# !

last push2 hours ago languageC# licenseMIT

Related tags

← all tags

Frequently asked questions

How many open source pipeline projects are there?

This registry tracks 13 projects tagged pipeline, with 64,547 GitHub stars between them. The most-adopted is Prefect at 24,109 stars.

Are these pipeline projects free to use?

Yes — 13 of the 13 carry an explicit open-source licence across 4 distinct licences, so there is no licence fee. Where a project also sells a hosted or enterprise version, the self-hosted path remains free.

Which pipeline project should I choose?

The list above is ranked by GitHub stars, but stars measure attention rather than fit. Check three things on each card: the licence (permissive versus copyleft), the language it is written in, and the last-push date — a high-star project that has not been pushed in a year is a liability.

Are these pipeline projects still maintained?

11 of the 13 were pushed in the last 90 days, and every card shows its exact last-push date so you can see the rest. Sort your shortlist by that date before committing to a migration.