head to head · open source

garak vs api-relay-audit

garak has 9,308 GitHub stars, 1,294 forks, 429 open issues and last shipped 4 days ago. api-relay-audit has 839 stars, 81 forks, 26 open issues and last shipped 4 days ago. garak leads on adoption by 1,009% (9,308 vs 839 stars). garak is written in Python under Apache-2.0; api-relay-audit is written in Python under AGPL-3.0. garak has attracted 14% as many forks as stars, api-relay-audit 10%. garak was the more recently maintained of the two, and both are self-hostable with no licence fee. The two share 1 topic tag (llm-security), so they are genuine substitutes rather than adjacent tools.

Two open source projects, one decision. Both are free and self-hostable — the differences are community size, license terms, language stack and release pace.

garak ★ 9.3K api-relay-audit ★ 839 category AI & Machine Learning

← all 20902 open source comparisons

Side by side

garak api-relay-audit
GitHub stars ★ 9.3K ★ 839
License Apache-2.0 AGPL-3.0
Written in Python Python
Last push 2026-09-16 2026-09-16
Forks ⑂ 1.3K ⑂ 81
Self-hosting Yes Yes
Data ownership Your server Your server

pick garak if

  • You weight community size — 9.3K stars and counting
  • You want the Apache-2.0 license terms
  • Your stack matches Python
  • You value the larger contributor base for long-term maintenance

full garak profile →

pick api-relay-audit if

  • You want the api-relay-audit feature set and don't need the biggest community
  • You prefer the AGPL-3.0 license terms
  • Your stack matches Python
  • You evaluated both and api-relay-audit fits your workflow better

full api-relay-audit profile →

About garak

garak is a free, Apache 2.0 command line vulnerability scanner for large language models that probes generative AI systems for hallucination, data leakage, prompt injection, misinformation, toxicity generation, and jailbreaks, and it is aimed at security engineers, red teamers, and AI developers who need to test the models they ship.

read the full garak overview →

About api-relay-audit

API Relay Audit is an independent, local security audit tool for AI API relays, mirrors, gateways, and LLM proxies. It is written in Python, released under the AGPL 3.0 license, and lives in the AI security and privacy ecosystem alongside the OpenAI compatible and Anthropic compatible proxy tooling it is designed to examine. The project is informed by the paper Your Agent Is Mine , Anthropic's September 10, 2026 threat intelligence report on fraudulent Claude resellers, and a September 11 disclosure by co author Chaofan Shou regarding router data containing user credentials. It ships both as a standalone script a…

read the full api-relay-audit overview →

More in AI & Machine Learning

OpenClaw ★ 390K Hermes Agent ★ 247K Ollama ★ 181K Dify ★ 157K Open WebUI ★ 153K langchain ★ 147K

Related comparisons

strix vs garak strix vs shannon strix vs skillspector strix vs ifixai strix vs codex-security strix vs ai-infra-guard strix vs giskard-oss strix vs agentic-bug-hunter openclaw vs hermes-agent openclaw vs opencode openclaw vs n8n openclaw vs open-webui openclaw vs comfyui openclaw vs odysseus openclaw vs lobechat openclaw vs anythingllm openclaw vs ollama ollama vs llama-cpp ollama vs vllm ollama vs odysseus ollama vs gpt4all ollama vs llama-index ollama vs localai open-webui vs gpt4all

More AI Security & Privacy projects

Compare either of these against the rest of the AI Security & Privacy field.

garak vs strix garak vs shannon garak vs SkillSpector garak vs iFixAi garak vs codex-security garak vs AI-Infra-Guard garak vs giskard-oss garak vs Agentic-Bug-Hunter garak vs nono garak vs CyberStrike garak vs AiSOC garak vs pentest-ai-agents

Frequently asked questions

Is garak or api-relay-audit more popular?

garak has 9,308 GitHub stars and api-relay-audit has 839. garak has the larger community by that measure.

Are garak and api-relay-audit free?

Both are open source. garak is licensed under Apache-2.0 and api-relay-audit under AGPL-3.0. Neither carries a licence fee.

What is the difference between garak and api-relay-audit?

garak is written in Python and api-relay-audit in Python. The practical differences are community size, licence terms, language stack and release cadence — all compared in the table above.

Which should I choose, garak or api-relay-audit?

Choose garak if you want the larger community (9,308 stars) or its Apache-2.0 licence terms. Choose api-relay-audit if its feature set, stack or AGPL-3.0 licence fits better. Both are self-hostable.