Open source llmops projects
Every project in the registry tagged llmops, ranked by real GitHub adoption.
LLM gateway for auth, load balancing, and spend tracking
Open source LLM engineering platform for AI-powered applications
Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into act
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simpl
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready d
Complete production stack for AI teams
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
Open-source LLM tracing & evaluation for AI optimization
BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent,
Monitor LLM performance with open-source observability
Build reliable AI apps with comprehensive observability
🐢 Open-Source Evaluation & Testing library for LLM Agents
Next-generation AI Agent Optimization Platform: Cozeloop addresses challenges in AI agent development by providing full-lifecycle management capabilities from d
Simulation-based testing and evaluation for AI agents
AI-powered platform for engineering LLM products
🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, obs
An open-source visual programming environment for battle-testing prompts to LLMs.
Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastructure.
🏕️ Reproducible development environment for humans and agents
Waku Waku! Waku Agent is a local-first AI agent harness you actually own, including loop, memory, eval, all in code built to stay legible as it grows.
The SmythOS Runtime Environment (SRE) is an open-source, cloud-native runtime for agentic AI. Secure, modular, and production-ready, it lets developers build, r
Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics f
Enables organizations to create and deploy customizable AI agents with support for multiple LLM providers, real-time chat, voice, document training, analytics,
LLM observability: cost, latency, and traces in one place
Trace, evaluate, and protect every LLM call in one SDK
Related tags
Frequently asked questions
How many open source llmops projects are there?
This registry tracks 25 projects tagged llmops, with 280,928 GitHub stars between them. The most-adopted is LiteLLM at 62,569 stars.
Are these llmops projects free to use?
Yes — 22 of the 25 carry an explicit open-source licence across 3 distinct licences, so there is no licence fee. Where a project also sells a hosted or enterprise version, the self-hosted path remains free.
Which llmops project should I choose?
The list above is ranked by GitHub stars, but stars measure attention rather than fit. Check three things on each card: the licence (permissive versus copyleft), the language it is written in, and the last-push date — a high-star project that has not been pushed in a year is a liability.
Are these llmops projects still maintained?
22 of the 25 were pushed in the last 90 days, and every card shows its exact last-push date so you can see the rest. Sort your shortlist by that date before committing to a migration.