Onyx is an open source AI application layer that gives teams a self-hostable chat interface with retrieval-augmented generation over their own company data and more than 50 indexing connectors.
What it is
Onyx is the application layer for large language models, distributed as a Python and Next.js project that provides a feature-rich chat interface which anyone can host. It lives in the LLM chat, retrieval-augmented generation and enterprise search ecosystem, and it sits between the models an organisation already runs or rents and the data that organisation already stores. It supports self-hosted providers such as Ollama, LiteLLM and vLLM alongside proprietary providers such as Anthropic, OpenAI and Gemini, which means the model choice stays separate from the interface and the indexing pipeline.
The concrete problem it solves is the assembly work of a production retrieval stack. Most teams otherwise wire together a chat UI, a connector sync pipeline, a vector store, a keyword index and a job runner by hand, then maintain each piece. Onyx replaces that ad hoc combination with one deployable system: a hybrid vector and keyword index for retrieval, background containers that run job queues and workers for syncing knowledge from connectors, and AI model inference servers used during indexing and inference. Advanced capabilities such as RAG, web search, code execution, file creation and deep research are exposed through the same interface rather than bolted on.
Key capabilities
- Agentic RAG that combines a hybrid index with AI agents for information retrieval.
- Deep Research producing in-depth reports through a multi-step research flow, benchmarked on
onyx_deep_research_bench.
- More than 50 indexing-based connectors out of the box, plus MCP for connecting further applications.
- Web Search through Serper, Google PSE, Brave and SearXNG, with an in-house web crawler and support for Firecrawl and Exa.
- Custom Agents built with unique instructions, knowledge and actions, where Actions and MCP let agents interact with external applications with flexible authentication options.
- Code Execution inside a sandbox for data analysis, graph rendering and file modification, alongside Artifacts for generating downloadable documents and graphics.
- Voice Mode using text-to-speech and speech-to-text, and Image Generation from user prompts.
Who uses it and how
- Individual users and small teams evaluating quickly run Onyx Lite, which needs under 1GB of memory and a less complex stack, and covers the Chat UI and Agents functionality.
- Larger teams deploy Standard Onyx, which adds the vector and keyword index, background containers for job queues and workers, inference servers, a Redis in-memory cache and a MinIO blob store for performance at scale.
- Enterprises rely on SSO through Google OAuth, OIDC or SAML, group syncing and user provisioning via SCIM, RBAC over agents and actions, analytics broken down by team, LLM or agent, and query history for auditing adoption.
- Security and compliance groups use custom code to remove PII, reject sensitive queries or run custom analysis, and administrators can whitelabel naming, icons and banners.
- Platform teams deploy through Docker, Kubernetes, Helm and Terraform, with guides for major cloud providers.
Getting started
Deploy with a single command: curl -fsSL https://onyx.app/install_onyx.sh | bash. A hosted option, Onyx Cloud, is available at cloud.onyx.app/signup for trying the platform without deploying.
How it compares
The provided facts name no paid products that Onyx replaces, so no licence, hosting or cost-model comparison can be drawn. In this registry, Onyx stands alone as the entry covering unified AI-powered enterprise search.
When to use it — and when not to
A self-hoster running Standard Onyx must operate the vector and keyword index, the background job queues and connector workers, the model inference servers, Redis and MinIO; Lite mode removes those components but also removes RAG and connector syncing. Teams that only need a simple chat front end, or that cannot run containers and object storage, should look elsewhere. The licence also deserves attention before adoption: the GitHub metadata reports NOASSERTION while the README describes a Community Edition under the MIT licence covering Chat, RAG, Agents and Actions, with a second edition whose description is cut off — verify the terms directly. The repository also carries 451 open issues, which signals active but unsettled development.
project readme (upstream, from github) — read inline
Onyx - The Open Source AI Platform
Onyx is the application layer for LLMs - bringing a feature-rich interface that can be easily hosted by anyone.
Onyx enables LLMs through advanced capabilities like RAG, web search, code execution, file creation, deep research and more.
Connect your applications with over 50+ indexing based connectors provided out of the box or via MCP.
[!TIP]
Deploy with a single command:
curl -fsSL https://onyx.app/install_onyx.sh | bash

⭐ Features
- 🔍 Agentic RAG: Get best in class search and answer quality based on hybrid index + AI Agents for information retrieval
- Benchmark to release soon!
- 🔬 Deep Research: Get in depth reports with a multi-step research flow.
- 🤖 Custom Agents: Build AI Agents with unique instructions, knowledge, and actions.
- 🌍 Web Search: Browse the web to get up to date information.
- Supports Serper, Google PSE, Brave, SearXNG, and others.
- Comes with an in house web crawler and support for Firecrawl/Exa.
- 📄 Artifacts: Generate documents, graphics, and other downloadable artifacts.
- ▶️ Actions & MCP: Let Onyx agents interact with external applications, comes with flexible Auth options.
- 💻 Code Execution: Execute code in a sandbox to analyze data, render graphs, or modify files.
- 🎙️ Voice Mode: Chat with Onyx via text-to-speech and speech-to-text.
- 🎨 Image Generation: Generate images based on user prompts.
Onyx supports all major LLM providers, both self-hosted (like Ollama, LiteLLM, vLLM, etc.) and proprietary (like Anthropic, OpenAI, Gemini, etc.).
To learn more - check out our docs!
🚀 Deployment Modes
Onyx supports deployments in Docker, Kubernetes, Helm/Terraform and provides guides for major cloud providers.
Detailed deployment guides found here.
Onyx supports two separate deployment options: standard and lite.
Onyx Lite
The Lite mode can be thought of as a lightweight Chat UI. It requires less resources (under 1GB memory) and runs a less complex stack.
It is great for users who want to test out Onyx quickly or for teams who are only interested in the Chat UI and Agents functionalities.
Standard Onyx
The complete feature set of Onyx which is recommended for serious users and larger teams. Additional components not included in Lite mode:
- Vector + Keyword index for RAG.
- Background containers to run job queues and workers for syncing knowledge from connectors.
- AI model inference servers to run deep learning models used during indexing and inference.
- Performance optimizations for large scale use via in memory cache (Redis) and blob store (MinIO).
[!TIP]
To try Onyx for free without deploying, visit Onyx Cloud.
🏢 Onyx for Enterprise
Onyx is built for teams of all sizes, from individual users to the largest global enterprises:
- 👥 Collaboration: Share chats and agents with other members of your organization.
- 🔐 Single Sign On: SSO via Google OAuth, OIDC, or SAML. Group syncing and user provisioning via SCIM.
- 🛡️ Role Based Access Control: RBAC for sensitive resources like access to agents, actions, etc.
- 📊 Analytics: Usage graphs broken down by teams, LLMs, or agents.
- 🕵️ Query History: Audit usage to ensure safe adoption of AI in your organization.
- 💻 Custom code: Run custom code to remove PII, reject sensitive queries, or to run custom analysis.
- 🎨 Whitelabeling: Customize the look and feel of Onyx with custom naming, icons, banners, and more.
📚 Licensing
There are two editions of Onyx:
- Onyx Community Edition (CE) is available freely under the MIT license and covers all of the core features for Chat, RAG, Agents, and Actions.
- Onyx Enterprise Edition (EE) includes extra features that are primarily useful for larger organizations.
For feature details, check out our website.
👪 Community
Join our open source community on Discord!
💡 Contributing
Looking to contribute? Please check out the Contribution Guide for more details.