Cyber LLM Benchmark Hub Logo
Cyber LLM Benchmark Hub
  • Home
  • Benchmarks
  • Contact
  • About
Support
Cyber LLM Benchmark Hub Logo
Cyber LLM Benchmark Hub
  • Home
  • Benchmarks
  • Contact
  • About
Support
42 Benchmarks • 10 Categories

Cyber LLM
Benchmark Hub

The definitive source for cybersecurity LLM performance.
Compare models across

Explore Benchmarks
42
Benchmarks
199
Models
10
Categories
331
Results

Benchmark Categories

Comprehensive evaluation across 10 cybersecurity domains

Malware Analysis

1 benchmark

Penetration Testing

5 benchmarks

Incident Response

6 benchmarks

Comprehensive Security

2 benchmarks

CTF Challenges

4 benchmarks

Vulnerability Analysis

11 benchmarks

Security Knowledge

7 benchmarks

Threat Intelligence

4 benchmarks

Threat Modeling

0 benchmarks

LLM Safety & Jailbreaking

2 benchmarks

Featured Benchmarks

Latest cybersecurity LLM evaluation datasets

View All
SecVulEval
Vulnerability Analysis

Statement-level benchmark for real-world C/C++ vulnerability detection with rich program context.

View Details
May 26, 2025
SecLLMHolmes
Vulnerability Analysis

A Comprehensive Evaluation Framework and Benchmarks for LLMs in Security Vulnerability Identification and Reasoning

View Details
December 19, 2023
CAIBench
Comprehensive Security

Cybersecurity AI Benchmark - A Meta-Benchmark for Evaluating Cybersecurity AI Agents

View Details
October 28, 2025
CTIArena
Threat Intelligence

Benchmarking LLM Knowledge and Reasoning Across Heterogeneous Cyber Threat Intelligence

View Details
October 13, 2025
SEvenLLM
Threat Intelligence

Benchmarking, Eliciting, and Enhancing Abilities of Large Language Models in Cyber Threat Intelligence

View Details
May 6, 2024
SecEval
Security Knowledge

A Comprehensive Benchmark for Evaluating Cybersecurity Knowledge of Foundation Models

View Details
December 1, 2023

Contribute to the Community

Help build the most comprehensive cybersecurity LLM benchmark database. Submit your evaluation results or support the project.

Support the Project
Cyber LLM Benchmark Hub

Cyber LLM Benchmark Hub

Benchmarking frontier models across cybersecurity tasks.

BenchmarksContactAbout

© 2026 Cyber LLM Benchmark Hub