Havuz

Real-time AI model power rankings (水墨战力榜) — usage, benchmarks, price-performance & speed from OpenRouter, as an ink-wash Streamlit dashboard

Design-fidelity QA for DeepSeek Harness: lend any text-only model an eye, then judge whether the implementation matches the mock. Ships the

Placebo-controlled benchmark of the most-starred coding agent skills

How much does an image model change what you told it to leave alone? Chained-edit benchmark for image models + installable scorer and Claude

SRA-Bench and SR-Agents: a benchmark and toolkit for skill-retrieval-augmented LLM agents.

多智能体小说写作框架 | Multi-agent novel-writing framework — 每个角色都有自己的脑子,每一章都有质量门禁

Official code for EmbodiedCLBench: Evaluating Continual Learning for Self-Evolving Embodied Agents.

deedchain, browser agent raporlarındaki iddiaları kaydedilmiş ground truth ile karşılaştırarak rapor doğruluğunu ölçen bir benchmark ve Python kütüphanesidir.

Neden yükseliyor · Repo yalnızca 23 günlük ve 28 yıldızlı; son 28 gün commit ve farklı yazar verisi ölçülmediği için yükselişin arkasındaki aktivite veya benimsenme düzeyi doğrulanamıyor. Rapor doğruluğunu ayrı bir değerlendirme konusu yapması dikkat çekici olsa da README'deki “first benchmark” iddiası bağımsız olarak doğrulanmış değil.

Continuous benchmarks for multi-device CoW filesystems (btrfs, ZFS, bcachefs): snapshots, aging, compression, redundancy layouts

Create your own benchmark for coding AI Agents

One-shot LLM eval cases by NAGI STUDIO - same prompt, different agents (model + harness), runnable artifacts side by side.

AI coding agent harness for any hardware, local or cloud (OpenAI-compatible engines). Tuned for AMD Strix Halo: Qwen3.8 125B on the iGPU, NP

An open benchmark for what consent banners cost the pages they sit on — time to banner, payload, viewport blocked and page stability, measur

Compare two local Persian (Farsi) speech-to-text models side by side: a Persian Whisper fine-tune vs. general large-v3, on Apple Silicon.

SWE-Serve: an agentic benchmark of 53 production inference-engineering tasks derived from merged SGLang pull requests, run with Harbor.

AnyFlow - flow-matching video generation: training, inference and VBench evaluation for t2v and i2v models.

A consistent, fair, benchmark for structured extraction.

[NeurIPS 2026] MedMemoryBench: Benchmarking Agent Memory in Personalized Healthcare.

MiniMax H3: 4.9x faster local generation and seam-free 4K via synchronized tiles (SyncTile). Benchmarks included.

Move whole tables between databases fast — Postgres, MySQL, ClickHouse, BigQuery. Rust engine, one-line Python API, bounded memory.

Benchmark self-evolving Agent upon realistic large-scale file workspaces

[ECCV 2026] AerialMetric: Benchmarking and Adapting UAV Monocular Metric Depth Estimation in the Real World

Audio-Oscar is a multi-agent framework for generating long-form, controllable audio from complex audio scene descriptions.

Reproducible benchmark for measuring Jev reranking quality, latency, and cost in RAG

RigMark benchmarks local AI the way coding agents actually use it.

Benchmarking headless browsers as agent runtimes

Autoresearch agents that improve your benchmark: independent re-measurement, enforced budgets, results as pull requests

Give Vercel AI SDK agents a real persistent filesystem with Amazon S3 Files.

A Kubernetes lab that reproduces real production incidents on a live, instrumented microservice stack — for testing root-cause-analysis tool

ICML 2026 benchmark and MechVL models for multimodal understanding of mechanical engineering drawings.

[COLM'26] SkillLearnBench is the first benchmark for evaluating continual learning methods that automatically generate agent skills.

A Minesweeper benchmark for LLM agents. One identical board, up to nine models in parallel, one clock, one tool layer.

Χ-Bench: Can AI Agents Automate End-to-End, Long-Horizon, Policy-Rich Healthcare Workflows?

Can my GPU run this? Pick a GPU to get 3 fitting AI models, quantization, VRAM, speed ranges, and run commands. 한국어·English.

An auditable and reproducible evaluation suite for LeWM-compatible latent world models, with official-compatible and difficulty-controlled p

Reproducible on-device LLM benchmarks for Apple Silicon (iPhone 17 Pro, M4 Max): Apple Core AI, MLX, llama.cpp, LiteRT-LM and Core ML on the

Open benchmark for Claude Code SEO skills — real headless execution against fixture sites with planted-defect answer keys. Deterministic sco

Phone and word timestamp accuracy on human-labeled TIMIT and Buckeye, clean and under reverb, noise, music and babble. Two tracks, forced al

First LLM Studio: local-first LLM workbench for Apple Silicon + MLX. 本地优先 LLM 工作台，覆盖 Agent、对比、微调、评测与运行时遥测。

Can LLM/MARL agents coordinate in long-horizon, open-ended tasks? NeurIPS 2026 (Evaluations and Datasets).

Open benchmark on observability tasks built on Harbor

Открытый бенчмарк LLM: какая нейросеть лучше пишет код 1С:Предприятие (BSL). Объективная оценка LLM по методике SMOP с реальным исполнением

The same HTTP API in 10 languages at 3 sizes, 30 implementations. Token cost for LLM agents, plus cold start, latency, throughput, CPU and m

[NeurIPS 2026 Meta-Agents] SAEScientist-Bench: Can AI agents conduct autonomous SAE interpretability research?

Several coding agents, one repo, at the same time: a reproducible lab to measure how they coordinate, and Médula, a kernel that decides who

What can Jev actually do? Reproducible experiments and research reports exploring its capabilities and limits.

Qwen3.8-27B on RTX 5090 Laptop 24GB — TWIN-TURBO NVFP4 (native llama.cpp) vs Coder390 Q3 LynnStyle (.ninfer + NInfer engine in WSL2/Docker):

同一份提示词，两座汴京：Claude Opus 5.5 与 GPT 6 Sol 各自从零写出的《清明上河图》实时 3D 网页 · Same prompt, two cities — a real-time 3D Bianjing benchmark for LLMs

The benchmark tasks and evaluation harness for "PhysicianBench: Evaluating LLM Agents in Real-World EHR Environments".

MiniMax H3 video generation on 2080Ti 22G (Turing sm_75) - field-tested handbook, workflows & FAQ