odd-platform is a free, open source monitoring & observability project written in Java and released under Apache-2.0. It has 1,428 GitHub stars, 147 forks and 135 open issues, and was last pushed 4 days ago. On this registry it ranks #202 of 271 tracked projects in Monitoring & Observability, with 5 head-to-head comparisons available.

What is odd-platform?

ODD Platform (Open Data Discovery) is an Apache-2.0, Java-based, open-source data discovery and observability platform for data teams that need one place to catalogue, trace, monitor and govern the data moving through their pipelines.

What it is

ODD Platform is the reference implementation of the Open Data Discovery Spec and lives in the data engineering and observability ecosystem. It accumulates scattered metadata into a federated data catalogue, draws end-to-end lineage across data objects and microservices, stores that metadata, and serves it through its own lightweight UI. Ingestion runs as a separate enricher component, so the catalogue acts as a central hub rather than another pipeline stage.

The concrete problem it replaces is the manual, fragmented hunt for answers about data. Rather than chasing owners across chat threads, spreadsheets and wikis to learn where a dashboard's numbers come from, who uses a table, or whether a pipeline has broken, a team points ODD at its sources and reads the answer from the catalogue. The same platform covers governance: tags record how and by whom data is used, so compliance checks and deprecation decisions rest on recorded evidence.

Key capabilities

  • Federated data catalogue that accumulates scattered data insights in one place, with an ODD-native lightweight UI for browsing them.
  • End-to-end data object lineage, plus a separate end-to-end microservices lineage feature tracking data flow across the whole data landscape.
  • Pipeline monitoring with alerting, so broken or stalled pipelines raise warnings instead of staying silent.
  • Data Quality Dashboard showing metrics, trends and issues across datasets, with compatibility for Great Expectations and DBT tests and integration with any custom DQ framework.
  • Tags and usage transparency for data security and compliance.
  • ML experiment result storage that automatically logs experiment parameters.
  • Reference Data Management through Lookup Tables, holding key elements such as currency codes, country names and product categories as a single source of truth for pipelines and transformations.

Who uses it and how

  • Data platform and data engineering teams that need a shared catalogue across many sources instead of one catalogue per team.
  • Governance and compliance workstreams that tag how and by whom data is used, and that deprecate outdated objects only after assessing the risk.
  • Data quality owners running Great Expectations or DBT tests who want results in a dashboard rather than separate reports.
  • Master data management efforts that centralise lookup tables and wire them into pipelines for enrichment and validation.
  • Kubernetes-based organisations that deploy the platform through the project's Helm charts.

Getting started

Run the published container image ghcr.io/opendatadiscovery/odd-platform:latest against an existing PostgreSQL instance by setting SPRING_DATASOURCE_URL, SPRING_DATASOURCE_USERNAME and SPRING_DATASOURCE_PASSWORD, or start a full local stack with docker-compose -f docker/demo.yaml up -d odd-platform-enricher. Helm charts and further example configurations in docker/examples cover other setups, and a hosted demo runs at demo.oddp.io.

How it compares

The facts provided name no comparable products or paid alternatives, so ODD Platform stands alone in this registry as the only data discovery and observability platform listed. Its position rests on being the first open-source platform of its kind, released under Apache-2.0 with no vendor product named as the thing it replaces.

When to use it — and when not to

A self-hoster must supply and operate a PostgreSQL database, whether the platform runs as a container or under Helm, so teams without an existing Postgres instance take on that dependency. Teams that want a hosted, zero-operations catalogue, or that have no metadata sources to connect through adapters, will get little from it. The repository carries 135 open issues and the facts state no release version, so confirm current stability before committing.

project readme (upstream, from github) — read inline

 

Next-Gen Data Discovery and Data Observability Platform

Apache2 Maintenance GitHub contributors GitHub issues by-label

WebsiteLinkedInSlackDocumentationBlogDemo

Next-Gen Data Discovery and Data Observability Platform

Demo

Play with our demo app!

Introduction

ODD is an open-source data discovery and observability tool for data teams that helps to efficiently democratise data, power collaboration and reduce time on data discovery through modern user-friendly environment.

Key wins

  • Shorten data discovery phase
  • Have transparency on how and by whom the data is used
  • Foster data culture by continuous compliance and data quality monitoring
  • Accelerate data insights
  • Know the sources of your dashboards and ad hoc reports
  • Deprecate outdated objects responsibly by assessing and mitigating the risks
  • :point_right: ODD Platform is a reference implementation of Open Data Discovery Spec

Features

Data Discovery and Observability

  • Accumulate scattered data insights in Federated Data catalogue
  • Gain observability through E2E Data objects Lineage
  • Benefit from cutting-edge E2E microservices Lineage feature in tracking your data flow through the whole data landscape
  • Be warned and alerted by Pipeline Monitoring tools
  • Store your metadata
  • Use ODD-native modern lightweight UI

ML First citizen

  • Save results of your ML Experiments by automatically logging its parameters

Data Security & Compliance

  • Manage Tags to prevent any abuse of the data
  • Refer to Tags to stay compliant with data security standards
  • Have full transparency on how and by whom the data is used

Data Quality

  • Utilize advanced Data Quality Dashboard to gain insights into data quality metrics, trends, and issues across your datasets, enabling proactive data quality management
  • Simplify DQ processes by using ODD with Great Expectations and DBT tests compatibility
  • Integrate ODD with any custom DQ framework

Reference Data Management (Lookup Tables) - a part of Master Data Management (MDM)

  • Manage and store reference data centrally, ensuring a single source of truth for key data elements like currency codes, country names, and product categories, etc.
  • Easily integrate Lookup Tables with data pipelines and transformations, enhancing data enrichment and validation processes
  • Support data governance and compliance efforts by maintaining accurate and consistent reference data across all data assets

Getting Started

Running as a separate container

Setting up PostgreSQL connection details, for example:

export POSTGRES_HOST=172.17.0.1
export POSTGRES_PORT=5432
export POSTGRES_DATABASE=postgres
export POSTGRES_USER=postgres
export POSTGRES_PASSWORD=mysecretpassword

Starting new instance of the platform:

docker run -d \
  --name odd-platform \
  -e SPRING_DATASOURCE_URL=jdbc:postgresql://${POSTGRES_HOST}:${POSTGRES_PORT}/${POSTGRES_DATABASE} \
  -e SPRING_DATASOURCE_USERNAME=${POSTGRES_USER} \
  -e SPRING_DATASOURCE_PASSWORD=${POSTGRES_PASSWORD} \
  -p 8080:8080 \
  ghcr.io/opendatadiscovery/odd-platform:latest

Go to localhost:8080 in case of local environment.

Running Locally with Docker Compose

docker-compose -f docker/demo.yaml up -d odd-platform-enricher

Deploying to Kubernetes with Helm Charts

Example configurations

There are various example configurations (via docker-compose) within docker/examples directory.

Contributing

Contributing to ODD Platform is very welcome. For basic contributions, all you need is being comfortable with GitHub and Git. The best ways to contribute are:

  • Work on new adapters
  • Work on documentation

To ensure equal and positive communication, we adhere to our Code of Conduct. Before starting any interactions with this repository, please read it and make sure to follow.

Please before contributing check out our Contributing Guide and issues labeled "good first issue":

GitHub issues by-label


Integrations

OpenDataDiscovery Platform offers comprehensive data source support to meet your needs.

Existing integrations
Proxy Adapter Airflow Airflow 2+
Apache Druid Cassandra Clickhouse
Elasticsearch Hive Kafka
Feast MSSQL MySQL
Microsoft ODBC MongoDB Neo4j
MariaDB Oracle PostgreSQL
Redshift Snowflake Vertica
Tarantool Athena DynamoDB<

readme truncated — read the full docs on github

Frequently asked questions

Is odd-platform free to use?

odd-platform is open source under the Apache-2.0 licence. There is no licence fee and no seat count — you can self-host it or, where the project offers one, pay a vendor for a managed version instead.

What does odd-platform do?

First open-source data discovery and observability platform. We make a life for data practitioners easy so you can focus on your business.

What is odd-platform written in?

odd-platform is primarily written in Java. Its source is publicly available at https://github.com/opendatadiscovery/odd-platform, and it has 1,428 GitHub stars.