head to head · open source
Dify vs promptfoo
Dify has 160,251 GitHub stars, 25,336 forks, 1,067 open issues and last shipped yesterday. promptfoo has 26,753 stars, 2,633 forks, 651 open issues and last shipped yesterday. Dify leads on adoption by 499% (160,251 vs 26,753 stars). Dify is written in Python under a custom or non-standard licence; promptfoo is written in TypeScript under MIT. Dify has attracted 16% as many forks as stars, promptfoo 10%. promptfoo was the more recently maintained of the two, and both are self-hostable with no licence fee. The two share 1 topic tag (llm), so they are genuine substitutes rather than adjacent tools.
Two open source projects, one decision. Both are free and self-hostable — the differences are community size, license terms, language stack and release pace.
← all 20902 open source comparisons
Side by side
| Dify | promptfoo | |
|---|---|---|
| GitHub stars | ★ 160K | ★ 27K |
| License | Custom / other | MIT |
| Written in | Python | TypeScript |
| Last push | 2026-11-02 | 2026-11-02 |
| Forks | ⑂ 25K | ⑂ 2.6K |
| Self-hosting | Yes | Yes |
| Data ownership | Your server | Your server |
pick Dify if
- You weight community size — 160K stars and counting
- You want the Custom / other license terms
- Your stack matches Python
- You value the larger contributor base for long-term maintenance
pick promptfoo if
- You want the promptfoo feature set and don't need the biggest community
- You prefer the MIT license terms
- Your stack matches TypeScript
- You evaluated both and promptfoo fits your workflow better
About Dify
Dify Cloud · Self hosting · Documentation · Dify edition overview Dify is an open source LLM app development platform. Its intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features (including Opik, Langfuse, and Arize Phoenix) and more, letting you quickly go from prototype to production. Here's a list of the core features: Quick start Before installing Dify, make sure your machine meets the following minimum system requirements: CPU = 2 Core RAM = 4 GiB The easiest way to start the Dify server is through Docker Compose. Before running Dify with the…
About promptfoo
Promptfoo: LLM evals & red teaming promptfoo is a CLI and library for evaluating and red teaming LLM apps. Stop the trial and error approach start shipping secure, reliable AI apps. Website · Getting Started · Red Teaming · Documentation · Discord Promptfoo is now part of OpenAI. Promptfoo remains open source and MIT licensed. Read the company update. Quick Start Requires Node.js =22.22.0 for npm and npx usage. Node.js 24 LTS is recommended; see the runtime support guide. Also available via brew install promptfoo and pip install promptfoo . You can also use npx promptfoo@latest to run any command without…
read the full promptfoo overview →
More in AI & Machine Learning
Related comparisons
More AI Development Platforms projects
Compare either of these against the rest of the AI Development Platforms field.
Frequently asked questions
Is Dify or promptfoo more popular?
Dify has 160,251 GitHub stars and promptfoo has 26,753. Dify has the larger community by that measure.
Are Dify and promptfoo free?
Both are open source. Dify has no licence declared in this registry, and promptfoo is licensed under MIT. Both are free to self-host.
What is the difference between Dify and promptfoo?
Dify is written in Python and promptfoo in TypeScript. The practical differences are community size, licence terms, language stack and release cadence — all compared in the table above.
Which should I choose, Dify or promptfoo?
Choose Dify if you want the larger community (160,251 stars) or its Custom / other licence terms. Choose promptfoo if its feature set, stack or MIT licence fits better. Both are self-hostable.