Cyber LLM Benchmark Hub Logo
Cyber LLM Benchmark Hub
  • Home
  • Benchmarks
  • Contact
  • About
Support
Cyber LLM Benchmark Hub Logo
Cyber LLM Benchmark Hub
  • Home
  • Benchmarks
  • Contact
  • About
Support
46 Benchmarks • 10 Categories

Cyber LLM
Benchmark Hub

The definitive source for cybersecurity LLM performance.
Compare models across

Explore Benchmarks
46
Benchmarks
207
Models
10
Categories
358
Results

Benchmark Categories

Comprehensive evaluation across 10 cybersecurity domains

Malware Analysis

1 benchmark

Penetration Testing

7 benchmarks

Incident Response

6 benchmarks

Comprehensive Security

2 benchmarks

CTF Challenges

4 benchmarks

Vulnerability Analysis

12 benchmarks

Security Knowledge

7 benchmarks

Threat Intelligence

5 benchmarks

Threat Modeling

0 benchmarks

LLM Safety & Jailbreaking

2 benchmarks

Featured Benchmarks

Latest cybersecurity LLM evaluation datasets

View All
StealthBench
Penetration Testing

Benchmark measuring operational stealth in autonomous offensive-security agents: whether an agent can complete an intrusion task without leaking credentials, tripping detection, causing third-party harm, or leaving forensic traces

View Details
July 28, 2026
AgentCyberRange
Penetration Testing

Open multi-range benchmark measuring whether frontier AI systems can carry out realistic end-to-end attacks, spanning web exploitation and post-exploitation lateral movement across live multi-host cyber ranges

View Details
June 12, 2026
CyberGym-E2E
Vulnerability Analysis

Large-scale benchmark evaluating AI agents across the full vulnerability lifecycle on real open-source code: discovering the vulnerability, generating a crashing proof-of-concept, and producing a patch that holds without breaking the test suite

View Details
June 3, 2026
CyberThreat-Eval
Threat Intelligence

Benchmark testing whether LLMs can automate a real-world threat-research workflow end to end, covering article triage and prioritization, deep search for related sources, and threat-intelligence drafting, scored with analyst-centric rather than text-similarity metrics

View Details
March 10, 2026
SecVulEval
Vulnerability Analysis

Statement-level benchmark for real-world C/C++ vulnerability detection with rich program context.

View Details
May 26, 2025
SecLLMHolmes
Vulnerability Analysis

A Comprehensive Evaluation Framework and Benchmarks for LLMs in Security Vulnerability Identification and Reasoning

View Details
December 19, 2023

Contribute to the Community

Help build the most comprehensive cybersecurity LLM benchmark database. Submit your evaluation results or support the project.

Support the Project
Cyber LLM Benchmark Hub

Cyber LLM Benchmark Hub

Benchmarking frontier models across cybersecurity tasks.

BenchmarksContactAbout

© 2026 Cyber LLM Benchmark Hub