🏆 Guardrail Leaderboard
Benchmark comparison of guardrails across accuracy, precision, recall, and latency
--
Guardrails Benchmarked
--
Test Cases
--
Average Accuracy
--
Average Latency
Rank
Guardrail
Accuracy
Precision
Recall
Latency
Type
Loading guardrail benchmarks...
📊 Benchmark Methodology
All guardrails are evaluated using their calibration datasets and real-world test cases. Metrics are calculated based on actual guardrail performance:
- Accuracy = (TP + TN) / (TP + TN + FP + FN) — Overall correctness
- Precision = TP / (TP + FP) — How many blocks were correct
- Recall = TP / (TP + FN) — How many violations were caught
- Latency = P50 response time in milliseconds (measured on Cloud Run)
Data Sources: Metrics are derived from calibration data, actual evaluation logs, and standardized benchmark suites. Smart Guardrails (SSG-v3) include 3-zone logic with calibrated thresholds.
Last updated: Loading...