head to head · open source
garak vs api-relay-audit
garak has 9,850 GitHub stars, 1,439 forks, 429 open issues and last shipped 3 days ago. api-relay-audit has 905 stars, 83 forks, 26 open issues and last shipped 9 days ago. garak leads on adoption by 988% (9,850 vs 905 stars). garak is written in Python under Apache-2.0; api-relay-audit is written in Python under AGPL-3.0. garak has attracted 15% as many forks as stars, api-relay-audit 9%. garak was the more recently maintained of the two, and both are self-hostable with no licence fee. The two share 1 topic tag (llm-security), so they are genuine substitutes rather than adjacent tools.
Two open source projects, one decision. Both are free and self-hostable — the differences are community size, license terms, language stack and release pace.
← all 20902 open source comparisons
Side by side
| garak | api-relay-audit | |
|---|---|---|
| GitHub stars | ★ 9.8K | ★ 905 |
| License | Apache-2.0 | AGPL-3.0 |
| Written in | Python | Python |
| Last push | 2026-11-02 | 2026-10-27 |
| Forks | ⑂ 1.4K | ⑂ 83 |
| Self-hosting | Yes | Yes |
| Data ownership | Your server | Your server |
pick garak if
- You weight community size — 9.8K stars and counting
- You want the Apache-2.0 license terms
- Your stack matches Python
- You value the larger contributor base for long-term maintenance
pick api-relay-audit if
- You want the api-relay-audit feature set and don't need the biggest community
- You prefer the AGPL-3.0 license terms
- Your stack matches Python
- You evaluated both and api-relay-audit fits your workflow better
About garak
garak, LLM vulnerability scanner Generative AI Red teaming & Assessment Kit garak checks if an LLM can be made to fail in a way we don't want. garak probes for hallucination, data leakage, prompt injection, misinformation, toxicity generation, jailbreaks, and many other weaknesses. If you know nmap or msf / Metasploit Framework, garak does somewhat similar things to them, but for LLMs. garak focuses on ways of making an LLM or dialog system fail. It combines static, dynamic, and adaptive probes to explore this. garak 's a free tool. We love developing it and are always interested in adding functionality to…
read the full garak overview →
About api-relay-audit
API Relay Audit Local security audit for AI API relays and LLM proxies. DSH Plugin Your Agent Is Mine: what you can test locally Your Agent Is Mine documents malicious API relays injecting payloads and exfiltrating credentials. Anthropic's September 10, 2026 report describes fraudulent Claude resellers swapping models and harvesting credentials through their client tooling. In his September 11 disclosure, co author Chaofan Shou reports buying router data containing users' credentials. API Relay Audit is an independent, local security audit tool for AI API relays and LLM proxies, informed by the paper. The…
read the full api-relay-audit overview →
More in AI & Machine Learning
Related comparisons
More AI Security & Privacy projects
Compare either of these against the rest of the AI Security & Privacy field.
Frequently asked questions
Is garak or api-relay-audit more popular?
garak has 9,850 GitHub stars and api-relay-audit has 905. garak has the larger community by that measure.
Are garak and api-relay-audit free?
Both are open source. garak is licensed under Apache-2.0 and api-relay-audit under AGPL-3.0. Neither carries a licence fee.
What is the difference between garak and api-relay-audit?
garak is written in Python and api-relay-audit in Python. The practical differences are community size, licence terms, language stack and release cadence — all compared in the table above.
Which should I choose, garak or api-relay-audit?
Choose garak if you want the larger community (9,850 stars) or its Apache-2.0 licence terms. Choose api-relay-audit if its feature set, stack or AGPL-3.0 licence fits better. Both are self-hostable.