Havuz

Can coding agents build the agent you actually want? A benchmark of 25 agent software engineering tasks across creation, editing and optimiz

Real-event-anchored benchmark for detecting AI-generated videos in real-world crisis settings.

Official code for InfoVis: one 9B model for slide image generation and editing, with the VisSlideBench benchmark and 15M+ training records.

[ICML 2026] Autonomous AI agent for end-to-end spatial proteomics analysis, with SP-Bench for agentic multiplexed-imaging workflows.

Evidence-backed AMD Strix Halo local-AI setup and benchmarks: Qwen3.8, Ollama, llama.cpp, Vulkan/ROCm, large GGUFs, and cross-OEM results.

ReviewBench is an open, reproducible benchmark for evaluating AI code review systems on real-world pull requests.

Speedrunning LoRA fine-tuning: frozen task, frozen hardware, public wall-clock leaderboard. modded-nanogpt for fine-tuning.

Рейтинг VPS-хостингов по тестам сообщества: что взять под ноду, мост или бота

Best Open Source Aim Trainer Benchmark Tool 2026

A counterfactual battery for instruction following in vision-language-action policies: change one word of the instruction, hold the scene, a

Aim Genetics Lab Open Research Tools 2026: Build Precision Breeding Models

aws-bench measures how well AI agents and model combinations perform on real AWS work — diagnosing misconfigurations, provisioning infrastru

Chinese-first LLM jailbreak benchmark & red-team toolkit | 中文LLM安全评测框架 | by POJIA.AI

Agents can work. They cannot declare success. A governed coordination protocol for multi-agent AI work: eight contracts (task, resource, own

🦞 ResearchClawBench: Evaluating AI Agents for Automated Research from Re-Discovery to New-Discovery

An agent skill that plays ARC-AGI-3. One rule: say what an action will do before you spend it. Claude Code on Opus 5 finished all 25 public

[EMNLP 2026] WeaveBench: A Long-Horizon, Real-World Benchmark for Computer-Use Agents with Hybrid Interfaces

GameWorld: Towards Standardized and Verifiable Evaluation of Multimodal Game Agents

DolphinBench - Mapping the Pareto frontier of Agent Memory

Practical local LLM recipes and benchmarks for RTX 5060 Ti setups

A Benchmark for Retrieving Papers that Inspire New Research

Blinded battles between coding agents: two agents, one prompt, you pick the winner. Desktop app, runs locally.

A benchmark for testing whether coding agents can resolve engineering tasks in scientific software

Same model, different wrapper: a from-scratch benchmark comparing coding-agent harnesses (codex, pi, opencode, cursor, devin) and open model

GateMem: a benchmark and evaluation toolkit for memory governance in multi-principal shared-memory LLM agents.

Measurement harness for proxy providers, browser engines and scraping targets. Every claim carries the run it came from.

glTF 2.0 versions of common graphics research scenes

A benchmark for AI-driven CAD generation and editing

Alignment-research scaffold (autoresearch-style) for LLM guardrails: search over a single policy.md surface

NarrowWide: A LiDAR-inertial dataset with repeated transitions between confined and open spaces (IEEE T-FR 2026)

Ultra-Fast Python Solutions: 110x Speed Optimization Guide 2026

Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini, and pinned OpenRouter calls with token usage, failure, and billing-integrity re

Run a 110B on a 2016 PC with 16 GB RAM. Know your tok/s before you download. Placement beats budget: predicts speed + memory fit for any GGU

The marketplace for verifiable AI outcomes: state a task, get a fixed price upfront, and Primitive Bench routes across tools to complete it,

Self-healing DNS optimizer for servers in Iran. Benchmarks 60+ DNS servers, installs a local caching resolver, auto-detects Docker, and runs

🚀 Automated scraper & injector for 100+ free AI coding models into 9router combos. Live pre-tested, ranked by coding benchmarks & zero-conf

A composable framework for reproducible evaluation of long-running agents.

WorldMemBench: A Comprehensive Benchmark for Memory of Video World Models

[NeurIPS 2026] SpatialBench: Is Your Spatial Foundation Model an All-Round Player?

NEXBENCH measures what an autonomous agent can actually do on-chain — execute transactions, route swaps, bridge funds, manage DeFi positions

Anti-slop skills for AI agents: slopbeth cleans the shipped writing, slopgent cleans the conversation.

A Benchmark for Evaluating Agent Self-Evolution on Real Business Tasks

Aim Genetics Lab: CRISPR Gene Editing & Bioinformatics Tools 2026

📖 Data Engineering from Raw Corpora

DrugTargetWorld: a synthetic biobank for training and benchmarking AI scientists on end-to-end drug target discovery. Paper: arXiv:2610.0955

RLCDAlignBench: 44 alignment-failure detection benchmarks and code for 'Just Ask Jev' (RLCD zero-shot detector of AI alignment failures)

Benchmark coding agents and agent harnesses on 226 deterministic file-editing tasks with byte-exact verification and a public leaderboard.

🛡️ Regex catches 0%, Meta's Prompt Guard 2 catches 1% of 629 realistic AgentDojo injection attacks when they're buried in tool output. Repro

A benchmark for evaluating LLM × harness performance.

Offline cyber security agent for your apps and AI coding tools. Open R&D: measured in public, improved every release.