Havuz

A Benchmark for Retrieving Papers that Inspire New Research

The Humanness Index: the open benchmark for how human voice AI sounds, built by Vapi. Blind same-voice battles, pure-vote Elo, with a real-h

A Kubernetes lab that reproduces real production incidents on a live, instrumented microservice stack — for testing root-cause-analysis tool

A consistent, fair, benchmark for structured extraction.

Benchmark and correctness oracle for matching engines, with CI/CD checks against 100 billion order messages of precomputed consensus. Five

Adversarial multi-turn benchmark for LLM debate quality, using side-swapped matchups and multi-model judging to rank models by judged debate

🌟 [Survey & Benchmark] A unified taxonomy, geometric framework, and cross-domain benchmark for modern optimizers

AI coding agent harness for any hardware, local or cloud (OpenAI-compatible engines). Tuned for AMD Strix Halo: Qwen3.8 125B on the iGPU, NP

Benchmarking data agents for verifiable analytics over heterogeneous workspaces.

Reproduce Lium's LocalMaxxing leaderboard runs (7 boards, 20 Verified) on a rented Lium GPU in one script — vLLM/llama.cpp recipes, measured

Official code for the paper: "Multi-User Large Language Model Agents"

Lynn GitHub 镜像仓 · Qwen3.8-27B Coder390 EfficientThink 本地 GGUF（llama.cpp Q2/Q3，内置 Q4 MTP）· 主仓 https://github.com/MerkyorLynn/Lynn · 下载 https:

DrugTargetWorld: a synthetic biobank for training and benchmarking AI scientists on end-to-end drug target discovery. Paper: arXiv:2610.0955

llama.cpp speculative decoding measured on one RTX 3090, Qwen3.6-35B-A3B UD-Q4_K_XL, commit 3737e4137. Published figures are re-derived from

UI-UX: a 4B multimodal LLM for mobile UX defect diagnosis, with UXBench — the first vision–language benchmark for UX reasoning (CVPR 2026 Fi

PatientAgentBench: A Benchmark Framework for Evaluating Patient-Facing Health AI Agents

Benchmarking headless browsers as agent runtimes

Benchmark coding agents and models on your own repository with private Harbor-formatted evals built from its merged pull requests.

How many simultaneous 4K transcodes can your GPU sustain? Multi-vendor (Intel/AMD/NVIDIA/CPU) benchmark for Unraid with HDR tone-mapping, su

Reproducible benchmark for sanctions name-screening effectiveness. Measures recall across 18 documented classes of name variation — translit

Cache-aware frequency sort: a header-only C++20 sort for low-cardinality integer arrays on x86-64.

RLCDAlignBench: 44 alignment-failure detection benchmarks and code for 'Just Ask Jev' (RLCD zero-shot detector of AI alignment failures)

Laya (open source, local) vs TypeSafe Jev (API): two AI models race in Snake and fight in a Mortal-Kombat-style arena. Every move is a real

🛡️ Regex catches 0%, Meta's Prompt Guard 2 catches 1% of 629 realistic AgentDojo injection attacks when they're buried in tool output. Repro

Compare web access APIs (web unblockers / scrape APIs) head-to-head against a fixed suite of ~90 real-world, hard-to-scrape URLs

Benchmark and compare Ollama models across local and cloud endpoints with rich, sortable tables.

A public reference benchmark for radiology finding-to-report generation.

Verification-gated skill routing and self-improvement harness for Hermes-style agent skills

Multi-modal benchmark for measuring sensitive-information redaction in human recording data

Make every model cheaper or better. Zero-config behavioral harness for Claude Code, with a reproducible 408-run benchmark

Daily LLM value rankings - compare 300+ models by intelligence, speed and price. OpenRouter + Artificial Analysis. 大模型性价比排行榜

View planning with multi-turn VLM agents: ViewSuite 6-DoF benchmark on real ScanNet scenes + iterative RL-SFT training

Independent, evidence-based map of when TypeSafe's Jev actually holds up vs. breaks down — real API-call receipts, not a leaderboard. 中文為主的雙

Beyond Time Shifts (ECCV 2026): a reference-free audio-visual synchronization evaluator built on Qwen2.5-Omni-3B, with SynthSync data, R-GRP

TRACE Bench: Task-driven Roleplay Agentic Checklist Evaluation

The same HTTP API in 10 languages at 3 sizes, 30 implementations. Token cost for LLM agents, plus cold start, latency, throughput, CPU and m

A benchmark suite for differentiable physics solvers.

RigMark benchmarks local AI the way coding agents actually use it.

NarrowWide: A LiDAR-inertial dataset with repeated transitions between confined and open spaces (IEEE T-FR 2026)

SWE-bench for your codebase — mine your merged PRs into local, contamination-free coding-agent benchmarks. Adapters: claude-code, aider (Opu

WRBench: camera-controlled generation and diagnostic evaluation of video world models.

Give Vercel AI SDK agents a real persistent filesystem with Amazon S3 Files.

Logic-first AI code review via semi-formal execution tracing (Premises → Trace → Divergence → Trigger → Remedy). Catches behavioral bugs, ty

Community-driven benchmark suite for MLX inference engines on Apple Silicon

HoloGeo: Evidence-driven VLM for robust image geo-localization and landmark-bias mitigation.

AI-detector auditing toolkit: measures how often a detector flags genuine human writing, how stable its verdict is across seeds, and whether

⚽️🤖 Benchmarking LLMs and deep-research agents on real-world football prediction — from the tactical "who scores in minute 67" to the strate

A preservation-aware benchmark for natural-language SVG repair with deterministic binary rewards and complete model traces.

[ACM MM 2026] Official implementation of Self in Space: Benchmarking Self-Awareness and Spatial Cognition in UAV Embodied Intelligence

Real-time AI model power rankings (水墨战力榜) — usage, benchmarks, price-performance & speed from OpenRouter, as an ink-wash Streamlit dashboard