Havuz

[ECCV 2026] Towards Spatial Supersensing in the Wild

Evidence profiles for AI-generated RTL that expose what functional benchmarks miss. Seeking collaborators, design partners, and validation

Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini, and pinned OpenRouter calls with token usage, failure, and billing-integrity re

Open benchmark for Claude Code SEO skills — real headless execution against fixture sites with planted-defect answer keys. Deterministic sco

TRACE Bench: Task-driven Roleplay Agentic Checklist Evaluation

Advanced DNS benchmark (UDP, DoH, DoT) with scoring, latency tests and detailed reports

Bittensor Subnet Repository maintainer agent + a GitHub-history benchmark that scores it — can an agent make the maintainer decisions a stro

Offline cyber security agent for your apps and AI coding tools. Open R&D: measured in public, improved every release.

Diagnosing policy grounding in LLM judges via causal erasure. Companion code to the AIES 2026 submission READ.

CatchBench: a benchmark for auditing agent failures across the full lifecycle.

Benchmarking repository-borne prompt injection attacks and lightweight defenses for local coding agents. DL4C @ ICML 2026.

Ultra-Fast Python Solutions: 110x Speed Optimization Guide 2026

Lynn GitHub 镜像仓 · Qwen3.8-27B Coder390 EfficientThink 本地 GGUF（llama.cpp Q2/Q3，内置 Q4 MTP）· 主仓 https://github.com/MerkyorLynn/Lynn · 下载 https:

Open source evals for physical AI. Run any LLM/VLA on any arm/humanoid against any real/sim benchmark.

Benchmarks and notes for running modern LLMs with vLLM on 8x Tesla V100-32GB in 2026.

[ICML 2026] Unison: Benchmarking Unified Multimodal Models via Synergistic Understanding and Generation

ICML 2026 benchmark and MechVL models for multimodal understanding of mechanical engineering drawings.

AI-detector auditing toolkit: measures how often a detector flags genuine human writing, how stable its verdict is across seeds, and whether

Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation,

Daily LLM value rankings - compare 300+ models by intelligence, speed and price. OpenRouter + Artificial Analysis. 大模型性价比排行榜

Accepted at ISCSLP 2026 · Target-level benchmark for raw-input Chinese news TTS pronunciation

Same model, different wrapper: a from-scratch benchmark comparing coding-agent harnesses (codex, pi, opencode, cursor, devin) and open model

Anti-slop skills for AI agents: slopbeth cleans the shipped writing, slopgent cleans the conversation.

The marketplace for verifiable AI outcomes: state a task, get a fixed price upfront, and Primitive Bench routes across tools to complete it,

Open benchmark datasets republished in stressed form to evaluate ML/LLM robustness. Curated by Santander AI Lab.

WRBench: camera-controlled generation and diagnostic evaluation of video world models.

GateMem: a benchmark and evaluation toolkit for memory governance in multi-principal shared-memory LLM agents.

Alignment-research scaffold (autoresearch-style) for LLM guardrails: search over a single policy.md surface

EMNLP 2026 Industry Track | A benchmark for shopping agents on long-horizon tasks with distributed hidden intent.

Baba Is Harbor - AI agent benchmark on Baba is You

Make every model cheaper or better. Zero-config behavioral harness for Claude Code, with a reproducible 408-run benchmark

An external memory for LLMs: a bi-temporal knowledge graph with hybrid (keyword + vector) retrieval and a self-improving reflection loop. Be

Use many on device and cloud models with Apple's Foundation Models framework in iOS and macOS with a full chat experience.

glTF 2.0 versions of common graphics research scenes

A reproducible benchmark for bimanual manipulation in simulation and the real world.

The Humanness Index: the open benchmark for how human voice AI sounds, built by Vapi. Blind same-voice battles, pure-vote Elo, with a real-h

UI-UX: a 4B multimodal LLM for mobile UX defect diagnosis, with UXBench — the first vision–language benchmark for UX reasoning (CVPR 2026 Fi

CoderCup — the continuous public benchmark for AI coding agents, refereed by TestSprite

An objective reconstruction evaluation toolkit for audio tokenizers, neural codecs, audio VAEs, and vocoders

Открытый бенчмарк LLM: какая нейросеть лучше пишет код 1С:Предприятие (BSL). Объективная оценка LLM по методике SMOP с реальным исполнением

🌟 [Survey & Benchmark] A unified taxonomy, geometric framework, and cross-domain benchmark for modern optimizers

⚽🤖 11 frontier LLMs predicted the entire 2026 World Cup — frozen before kickoff. Live leaderboard: Brier score, bracket points & Polymarket

Eval framework that ranks agentic coding frameworks (Superpowers, Compound Engineering, Agent Skills, GSD) by having each build the same spe

Lightweight agent that pulls and runs LLM benchmarks from Protorikis Bench

One-shot LLM eval cases by NAGI STUDIO - same prompt, different agents (model + harness), runnable artifacts side by side.

EC2-Bench (EC²-Bench): benchmark for edge-cloud collaboration in long-horizon LLM agents — task performance, resource usage & privacy exposu

Рейтинг VPS-хостингов по тестам сообщества: что взять под ноду, мост или бота

[EMNLP 2026] WeaveBench: A Long-Horizon, Real-World Benchmark for Computer-Use Agents with Hybrid Interfaces

A Benchmark for Evaluating Agent Self-Evolution on Real Business Tasks

Honest local LLM deployment planning and benchmarking for high unified-memory Macs and future Linux/NVIDIA rigs.