head to head · open source
promptfoo vs AutoPrompt
promptfoo has 25,297 GitHub stars, 2,344 forks, 651 open issues and last shipped today. AutoPrompt has 3,019 stars, 265 forks, 23 open issues and last shipped 10 months ago. promptfoo leads on adoption by 738% (25,297 vs 3,019 stars). promptfoo is written in TypeScript under MIT; AutoPrompt is written in Python under Apache-2.0. promptfoo has attracted 9% as many forks as stars, AutoPrompt 9%. promptfoo was the more recently maintained of the two, and both are self-hostable with no licence fee. The two share 1 topic tag (prompt-engineering), so they are genuine substitutes rather than adjacent tools.
Two open source projects, one decision. Both are free and self-hostable — the differences are community size, license terms, language stack and release pace.
← all 20902 open source comparisons
Side by side
| promptfoo | AutoPrompt | |
|---|---|---|
| GitHub stars | ★ 25K | ★ 3.0K |
| License | MIT | Apache-2.0 |
| Written in | TypeScript | Python |
| Last push | 2026-09-20 | 2025-12-02 |
| Forks | ⑂ 2.3K | ⑂ 265 |
| Self-hosting | Yes | Yes |
| Data ownership | Your server | Your server |
pick promptfoo if
- You weight community size — 25K stars and counting
- You want the MIT license terms
- Your stack matches TypeScript
- You value the larger contributor base for long-term maintenance
pick AutoPrompt if
- You want the AutoPrompt feature set and don't need the biggest community
- You prefer the Apache-2.0 license terms
- Your stack matches Python
- You evaluated both and AutoPrompt fits your workflow better
About promptfoo
Promptfoo is an open source command line tool and TypeScript library for evaluating and red teaming large language model applications, aimed at developers, AI engineers, and security teams who need measurable evidence that a prompt, agent, or retrieval augmented generation pipeline behaves correctly and safely before it reaches users.
read the full promptfoo overview →
About AutoPrompt
AutoPrompt is an open source Python framework, released under the Apache 2.0 licence, that improves and perfects prompts for large language models by applying an Intent based Prompt Calibration method, and it is built for developers, ML engineers, and product teams who need robust production grade prompts without doing all of the prompt engineering by hand.
read the full AutoPrompt overview →
More in AI & Machine Learning
Related comparisons
More AI Development Platforms projects
Compare either of these against the rest of the AI Development Platforms field.
Frequently asked questions
Is promptfoo or AutoPrompt more popular?
promptfoo has 25,297 GitHub stars and AutoPrompt has 3,019. promptfoo has the larger community by that measure.
Are promptfoo and AutoPrompt free?
Both are open source. promptfoo is licensed under MIT and AutoPrompt under Apache-2.0. Neither carries a licence fee.
What is the difference between promptfoo and AutoPrompt?
promptfoo is written in TypeScript and AutoPrompt in Python. The practical differences are community size, licence terms, language stack and release cadence — all compared in the table above.
Which should I choose, promptfoo or AutoPrompt?
Choose promptfoo if you want the larger community (25,297 stars) or its MIT licence terms. Choose AutoPrompt if its feature set, stack or Apache-2.0 licence fits better. Both are self-hostable.