head to head · open source
Dify vs promptfoo
Dify has 156,510 GitHub stars, 24,688 forks, 1,067 open issues and last shipped today. promptfoo has 25,297 stars, 2,344 forks, 651 open issues and last shipped today. Dify leads on adoption by 519% (156,510 vs 25,297 stars). Dify is written in TypeScript under a custom or non-standard licence; promptfoo is written in TypeScript under MIT. Dify has attracted 16% as many forks as stars, promptfoo 9%. Dify was the more recently maintained of the two, and both are self-hostable with no licence fee. The two share 1 topic tag (llm), so they are genuine substitutes rather than adjacent tools.
Two open source projects, one decision. Both are free and self-hostable — the differences are community size, license terms, language stack and release pace.
← all 20902 open source comparisons
Side by side
| Dify | promptfoo | |
|---|---|---|
| GitHub stars | ★ 157K | ★ 25K |
| License | Custom / other | MIT |
| Written in | TypeScript | TypeScript |
| Last push | 2026-09-20 | 2026-09-20 |
| Forks | ⑂ 25K | ⑂ 2.3K |
| Self-hosting | Yes | Yes |
| Data ownership | Your server | Your server |
pick Dify if
- You weight community size — 157K stars and counting
- You want the Custom / other license terms
- Your stack matches TypeScript
- You value the larger contributor base for long-term maintenance
pick promptfoo if
- You want the promptfoo feature set and don't need the biggest community
- You prefer the MIT license terms
- Your stack matches TypeScript
- You evaluated both and promptfoo fits your workflow better
About Dify
Dify is an open source LLM application development platform built in TypeScript. It provides a visual interface for designing, testing, and deploying AI workflows, RAG pipelines, and agentic systems without writing extensive code. The platform lives in the generative AI development ecosystem and targets teams needing to move from prototype to production using consistent tooling across environments.
About promptfoo
Promptfoo is an open source command line tool and TypeScript library for evaluating and red teaming large language model applications, aimed at developers, AI engineers, and security teams who need measurable evidence that a prompt, agent, or retrieval augmented generation pipeline behaves correctly and safely before it reaches users.
read the full promptfoo overview →
More in AI & Machine Learning
Related comparisons
More AI Development Platforms projects
Compare either of these against the rest of the AI Development Platforms field.
Frequently asked questions
Is Dify or promptfoo more popular?
Dify has 156,510 GitHub stars and promptfoo has 25,297. Dify has the larger community by that measure.
Are Dify and promptfoo free?
Both are open source. Dify has no licence declared in this registry, and promptfoo is licensed under MIT. Both are free to self-host.
What is the difference between Dify and promptfoo?
Dify is written in TypeScript and promptfoo in TypeScript. The practical differences are community size, licence terms, language stack and release cadence — all compared in the table above.
Which should I choose, Dify or promptfoo?
Choose Dify if you want the larger community (156,510 stars) or its Custom / other licence terms. Choose promptfoo if its feature set, stack or MIT licence fits better. Both are self-hostable.