Open Source Data Warehousing Processing Tools

ClickHouse ★ 51K

Lightning-fast analytics for massive datasets

seaweedfs ★ 36K

SeaweedFS is a distributed storage system for object storage (S3), file systems, and Iceberg tables, designed to handle billions of files with O(1) disk access

rustfs ★ 36K

RustFS is an open-source, S3-compatible high-performance object storage system supporting migration and coexistence with other S3-compatible platforms such as M

parse-server ★ 21K

Parse Server for Node.js / Express

Apache Pinot ★ 6.2K

Distributed OLAP database for real-time analytics at scale

dlt ★ 6.1K

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

mountpoint-s3 ★ 5.8K

A simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system.

cubefs ★ 5.7K

cloud-native distributed storage

lakeFS ★ 5.6K

lakeFS - Data version control for your data lake | Git for data

ZeroFS ★ 3.2K

ZeroFS: A log-structured filesystem for S3. ZeroFS serves S3-compatible buckets as POSIX filesystems over NFS and 9P, or as raw block devices over NBD.

versitygw ★ 3.1K

A simple to deploy but feature rich S3 object storage server for your filesystem

cloudserver ★ 2.0K

Zenko CloudServer, an open-source Node.js implementation of the Amazon S3 protocol on the front-end and backend storage capabilities to multiple clouds, includi

aistore ★ 2.0K

AIStore: scalable storage for AI applications

hue ★ 1.4K

Open source SQL Query Assistant service for Databases/Warehouses

storage ★ 1.3K

S3 compatible object storage service that stores metadata in Postgres

bigquery-utils ★ 1.3K

Useful scripts, udfs, views, and other utilities for migration and data warehouse operations in BigQuery.

nitrite-java ★ 921

NoSQL embedded document store for Java

bigfunctions ★ 761

Supercharge BigQuery with BigFunctions

arc ★ 689

Open, SQL-native time-series database for telemetry you need to keep. 34M+ records/sec ingestion, 8M+ rows/sec queries. InfluxDB Line Protocol and Telegraf comp

Zenko ★ 672

Zenko is the open source multi-cloud data controller: own and keep control of your data on any cloud.

domainmod ★ 602

DomainMOD is an open source application written in PHP & MySQL used to manage your domains and other internet assets in a central location. DomainMOD also inclu

NoKV ★ 510

The State Layer of Agent Sandbox