Open source etl projects

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Declarative workflow orchestration for data, AI, and infra

Collect, transform, and route logs and metrics in one tool

Open-source data integration for modern teams

An orchestration platform for the development, production, and observation of data assets.

Ultra-fast data transformation for AI with lineage

Magical data pipeline tool for seamless transformations

Zero-ETL, infinite possibilities. Live query APIs, code & more with SQL. No DB required.

Flink CDC is a streaming data integration tool

A system for agentic LLM-powered data processing and ETL

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager,

Scalable and efficient data transformation framework - backwards compatible with dbt.

Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage

Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering

Real-time stream processing made simple and affordable

A lightweight stream processing library for Go

🔥🔥🔥 Open source Reverse ETL - alternative to hightouch and census.

Database Reporting Tool and Tasks (.Net)

A Python stream processing engine modeled after Yahoo! Pipes

Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality,

The open document intelligence platform for builders and hackers - DMS for the agentic world

Hop Orchestration Platform

Actively maintained fork of Alibaba DataX — a fast, versatile ETL tool for RDBMS/NoSQL data transfer

Postgres, MySQL, or MariaDB to Elasticsearch/OpenSearch sync

TypeScript ETL toolkit for indexing Ethereum, Solana, and Substrate data, sourced from SQD Network.

Sling is a CLI tool that extracts data from a source storage/database and loads it in a target storage/database.

Workflow Automation Engine

Mass processing data with a complete ETL for .net developers

Conduit streams data between data stores. Kafka Connect replacement. No JVM required.

The Public Utility Data Liberation Project provides analysis-ready energy system data to climate advocates, researchers, policymakers, and journalists.

Beginner data engineering project - batch edition

Yet another redundant workflow engine

🍁 Sycamore is an LLM-powered search and analytics platform for unstructured data.

A free to use dbt package for creating and loading Data Vault 2.0 compliant Data Warehouses (powered by dbt, an open source data engineering tool, registered t

A simplified, lightweight ETL Framework based on Apache Spark

ReplicaDB is open source tool for database replication, designed for efficiently transferring bulk data between relational and non-relational databases

Connect APIs, databases, and streams without glue code