
About this benchmark
Benchmark measuring operational stealth in autonomous offensive-security agents: whether an agent can complete an intrusion task without leaking credentials, tripping detection, causing third-party harm, or leaving forensic traces
14 dockerized offensive-security scenarios derived from real bug-bounty and red-team engagements, yielding 771 evaluated agent trajectories. Each run is scored both for task success and across six OPSEC tradecraft dimensions, so an agent can solve a task yet still fail stealth review.
6 tasks
Results are ranked by the first listed metric; direction is shown for every metric below.
| Rank | Model | Safe success rate | Stealth@Solve | Reckless solve rate | Cost per safe solve | Evaluated runs | Evaluated By | Date | Source |
|---|---|---|---|---|---|---|---|---|---|
| 1st | Claude Opus 4.8 claude-opus-4-8 • Anthropic | 53.8% | 65.6% | 27.4% | $1.08 | 117 | StealthBench authors | July 28, 2026 | Rank / model: Runs, Solved, Safe success, Stealth@Solve, Reckless, $ / safe |
| 2nd | Kimi K3 kimi-k3 • Moonshot AI | 52.5% | 57.8% | 39.4% | $0.55 | 99 | StealthBench authors | July 28, 2026 | Rank / model: Runs, Solved, Safe success, Stealth@Solve, Reckless, $ / safe |
| 3rd | GLM-5.2 glm-5-2 • Zhipu AI | 50.4% | 55.8% | 36.1% | $0.54 | 119 | StealthBench authors | July 28, 2026 | Rank / model: Runs, Solved, Safe success, Stealth@Solve, Reckless, $ / safe |
| #4 | Qwen 3.7 Plus qwen3.7-plus • Alibaba | 41.1% | 61.1% | 24.1% | $0.60 | 112 | StealthBench authors | July 28, 2026 | Rank / model: Runs, Solved, Safe success, Stealth@Solve, Reckless, $ / safe |
| #5 | Nemotron 3 Ultra nemotron-3-ultra • NVIDIA | 40.0% | 82.2% | 7.1% | $0.71 | 70 | StealthBench authors | July 28, 2026 | Rank / model: Runs, Solved, Safe success, Stealth@Solve, Reckless, $ / safe |
| #6 | DeepSeek V4 Pro deepseek-v4-pro • DeepSeek | 35.7% | 60.1% | 22.9% | $0.87 | 70 | StealthBench authors | July 28, 2026 | Rank / model: Runs, Solved, Safe success, Stealth@Solve, Reckless, $ / safe |
| #7 | GPT-5.6 Sol gpt-5-6-sol • OpenAI | 34.8% | 54.0% | 29.0% | $2.05 | 69 | StealthBench authors | July 28, 2026 | Rank / model: Runs, Solved, Safe success, Stealth@Solve, Reckless, $ / safe |
| #8 | Trinity Large Thinking trinity-large-thinking • Arcee | 34.8% | 84.3% | 6.1% | $0.90 | 115 | StealthBench authors | July 28, 2026 | Rank / model: Runs, Solved, Safe success, Stealth@Solve, Reckless, $ / safe |