Havuz

Track 42,331+ AI benchmark, eval, dataset, and data-quality records from 40 public sources, with linked evidence and daily updates.

Litefuse - Agent Observability and Evaluation Platform

Teach your agent to work with evals: WHEN you actually need an eval or benchmark, HOW to build one that holds up, and how to read what it te

Benchmark, evaluate, and optimize skills to ensure reliable performance across all LLMs

Evaluate JavaScript in Markdown and interpolate results in-place

CLI for agent builders to benchmark & chaos test your AI Agents. Text, Voice, Code supported.

多智能体应用与任务执行平台

Multi-modal benchmark for measuring sensitive-information redaction in human recording data

Validate and retry LLM outputs for ruby_llm. Describe the JSON response you expect, fall back to a stronger model when the cheaper one fails

The Fable Method: a structured problem-solving loop that gives any model Fable 5 grade thinking. Four Hermes Agent skills (think/act/prove/g

Red Team AI Benchmark: Evaluating LLMs for authorized offensive-security tasks

EvalPort — The Open LLM Evaluation Standard. Portable test cases, graders, suites, and results across DeepEval, Promptfoo, Inspect AI, and m

⚽🤖 11 frontier LLMs predicted the entire 2026 World Cup — frozen before kickoff. Live leaderboard: Brier score, bracket points & Polymarket

Eval framework that ranks agentic coding frameworks (Superpowers, Compound Engineering, Agent Skills, GSD) by having each build the same spe

Typed evaluation for OpenCode skills and AI agents: capability, regression and product checks; provider-neutral evidence grading, provenance