Open detection standard -- like Sigma, but for AI agents. 425 rules, shipped in Microsoft AGT, Cisco AI Defense, MISP, OWASP A-S-R-H. 97.1% recall on NVIDIA garak. NIST OSCAL Path 1.
-
Updated
Jul 9, 2026 - TypeScript
Open detection standard -- like Sigma, but for AI agents. 425 rules, shipped in Microsoft AGT, Cisco AI Defense, MISP, OWASP A-S-R-H. 97.1% recall on NVIDIA garak. NIST OSCAL Path 1.
Vulntrex - View, Run & Compare Garak Scans in one sleek web interface.
Projet issu du codelab Devfest Nantes 2025 “La guerre des prompts” : atelier de 2h pour apprendre à pirater des IA et comment les protéger via des frameworks open source
Python + SQL toolkit for LLM threat intelligence — flags prompt injection, jailbreaks, and data exfiltration mapped to OWASP LLM Top 10 (2025) & MITRE ATLAS.
Red teaming AI Goat™ to explore OWASP Top 10 for LLM Applications (2025), prompt injection, RAG poisoning, MCP-assisted auditing, and AI security vulnerabilities.
KYA (Know Your Agents) — Open-source trust, governance, and evidentiary assurance infrastructure for autonomous systems. Built on KYP (Know Your Principal), a unified trust model for human users, AI agents, service accounts, and machine identities.
Out-Of-Tree Llama Stack Eval Provider for Red Teaming LLM Systems with Garak
Production-grade LLM evaluation pipeline for RAG chatbot — DeepEval + RAGAS + Garak + CI/CD | Financial domain | 7 metrics | Adversarial testing
Automated prompt injection vulnerability assessment of local LLMs using Garak
Iterative AI purple-team harness: 5 specialist agents under a deterministic state machine, ATT&CK + ATLAS aware. Includes reproducible findings against GPT-4o (EchoLeak-style injection, MCP tool-description poisoning) and an upstream PR for garak detector calibration drift.
An OWASP-LLM-Top-10-2025 red-team teaching lab
Single-file, fully-local three-layer AI red-team smoke test for LLMs + MCP servers — honest, CI-ready, not a compliance tool.
Web-based GUI for Garak LLM security scanner. Test local Ollama models with an intuitive interface.
IA ofensiva sin censura, contenida y segura para su operador — red teaming ético asistido por IA sobre Kali.
Security audit of LLM-based multi-agent systems with indirect prompt-injection PoCs and mitigations.
This repo consist of exploratory work related to AI pen testing using open source versions of garak, promptfoo
Automated Prompt Injection Testing across 5 LLMs using Nvidia Garak
Hands-on LLM security assessment: prompt injection and system-prompt leakage (garak + custom eval), mapped to OWASP LLM Top 10 and NIST AI RMF
Add a description, image, and links to the garak topic page so that developers can more easily learn about it.
To associate your repository with the garak topic, visit your repo's landing page and select "manage topics."