Open source hadoop projects
Every project in the registry tagged hadoop, ranked by real GitHub adoption.
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
Actively maintained fork of Alibaba DataX — a fast, versatile ETL tool for RDBMS/NoSQL data transfer
Frequently asked questions
How many open source hadoop projects are there?
This registry tracks 3 projects tagged hadoop, with 33,460 GitHub stars between them. The most-adopted is luigi at 18,775 stars.
Are these hadoop projects free to use?
Yes — 3 of the 3 carry an explicit open-source licence across 1 distinct licence, so there is no licence fee. Where a project also sells a hosted or enterprise version, the self-hosted path remains free.
Which hadoop project should I choose?
The list above is ranked by GitHub stars, but stars measure attention rather than fit. Check three things on each card: the licence (permissive versus copyleft), the language it is written in, and the last-push date — a high-star project that has not been pushed in a year is a liability.
Are these hadoop projects still maintained?
3 of the 3 were pushed in the last 90 days, and every card shows its exact last-push date so you can see the rest. Sort your shortlist by that date before committing to a migration.