| CI/CD |     |
| Docs |  |
| Package |         |
| Meta |   |
🎉🎊✨ Haystack 3.0 is out! ✨🎊🎉
Read the announcement here!
🥳 🎈 🎆 🪅 🎇 🍾 🥂 🎁 🌈
Haystack is an open-source AI orchestration framework for building production-ready LLM applications in Python.
Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Build scalable RAG systems, multimodal applications, semantic search, question answering, and autonomous agents, all in a transparent architecture that lets you experiment, customize deeply, and deploy with confidence.
Table of Contents
- Installation
- Documentation
- Features
- Haystack Enterprise: Support & Platform
- Telemetry
- 🖖 Community
- Contributing to Haystack
- Organizations using Haystack
Installation
The simplest way to get Haystack is via pip:
pip install haystack-ai
Install nightly pre-releases to try the newest features:
pip install --pre haystack-ai
Haystack supports multiple installation methods, including Docker images. For a comprehensive guide, please refer to the documentation.
Documentation
If you're new to the project, check out "What is Haystack?" then go through the "Get Started Guide" and build your first LLM application in a matter of minutes. Keep learning with the tutorials. For more advanced use cases, or just to get some inspiration, you can browse our Haystack recipes in the Cookbook.
At any given point, hit the documentation to learn more about Haystack, what it can do for you, and the technology behind.
Features
Agents built for production
Extend agent behavior with lifecycle hooks (before_llm, before_tool, on_exit, …) for guardrails and custom logic, and track step_count, token_usage, and tool calls out of the box for monitoring and cost control. Get started fast with ready-made agents from Agent Pack (e.g., a deep research agent, or an advanced RAG agent) or give your own agents progressive skill discovery via SkillToolset, so skill descriptions only enter context when needed.
Built for context engineering
Design flexible systems with explicit control over how information is retrieved, ranked, filtered, combined, structured, and routed before it reaches the model. Define pipelines and agent workflows where retrieval, memory, tools, and generation are transparent and traceable.
Native Async Support
One Pipeline runs synchronously or asynchronously and streams token by token. Agent can run concurrent tool calls.
Modular and customizable
Use built-in components for retrieval, indexing, tool calling, memory, and evaluation, or create your own. Add loops, branches, and conditional logic to precisely control how context moves through your pipelines and agent workflows.
Model- and vendor-agnostic
Integrate with OpenAI, Mistral, Anthropic, Cohere, Hugging Face, Google, Azure OpenAI, AWS Bedrock, local models, and many others. Swap models or infrastructure components without rewriting your system.
Extensible ecosystem
Build and share custom components through a consistent interface that makes it easy for the community and third parties to extend Haystack and contribute to an open ecosystem.
[!TIP]
Would you like to deploy and serve Haystack pipelines as **R