Havuz

Future AGI, LLM ve AI agent uygulamalarını değerlendirme, izleme, simüle etme ve koruma işlerini self-host edilebilen tek bir platformda birleştiriyor.

Neden yükseliyor · Konu, agent uygulamalarında evaluation ve observability ihtiyacının artmasıyla örtüşüyor; 157 günlük repo yaşına karşılık 2.081 yıldız ve son 28 günde 597 commit geliştirme temposuna işaret ediyor. Farklı yazar sayısı 6; bu veriler ilginin nedenini tek başına kanıtlamaz ve yıldızlar benimseme ya da kalite ölçüsü değildir.

agentacct, coding agent oturumlarını yerel verilerden toplayıp yapılan işleri, kullanılan araçları, kontrolleri, token tüketimini ve tahmini maliyeti dashboard ile TUI üzerinden gösterir.

Neden yükseliyor · 65 günde 755 yıldıza ve son 28 günde 198 commite ulaşması hızlı ilgi ve aktif geliştirme sinyali veriyor; ancak aynı dönemde yalnızca 2 farklı yazar bulunması katkı tabanının dar olduğunu gösteriyor. Bu ilginin kesin nedenini ölçümlerden çıkarmak mümkün değil.

Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

Run coding agents without babysitting them. Keep jobs focused, bounded, checked and accountable from start to finish. Finally run your agent

Local proxy that compresses your LLM API requests so you pay less, with no change to the answers. Trims wasted tokens from prompts, history,

Free, local, open-source LLM cost analyzer - see where your LLM bill leaks, on your machine.

The open-source agentic framework to build, orchestrate, and operate production AI agents.

Cheaper and better Greptile alternative runs on your own github actions.

Self-hosted, Docker-first OpenAI-compatible LLM gateway with provider routing, fallbacks, API keys, and usage controls.

Open-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock & more — routin

Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini, and pinned OpenRouter calls with token usage, failure, and billing-integrity re

Selfhost modern LLM stacks. Run the whole fleet from your terminal

Open-source infrastructure for the full inference lifecycle: deploy, observe, scale, optimize, and safely release self-hosted models behind

Local outcome-loop + reward layer for coding agents — remember what worked, ship the next move, measure how it landed. Docs at nimroboai.com

A 21-day hands-on journey to mastering AI for DevOps — covering LLMs, GenAI, CI/CD, Kubernetes, cloud, automation, and AI-powered DevOps pro

Local-first observability your agent reads back. TMA1 records every LLM call, then routes what it sees into the agent's next turn via hooks

Agent and LLM API performance monitoring via network packet probe. Measures performance of OpenClaw, Claude, Codex, DeepAgents and more — de

Verify which LLM an OpenAI-compatible API really serves — single-token behavioral fingerprinting (Jensen-Shannon) from the paper "One Token

Six Claude Code skills that harden Opus 4.8 toward frontier behavior. Written by Fable 5, pressure-tested on the target model with transcrip

Aixle Flow — orchestrate coding agents through durable, inspectable workflows.

End-to-end Langfuse workshop using a TypeScript Agent to teach the AI engineering loop: tracing, prompt management, monitoring, datasets, ex

Turn scattered knowledge, operational data, and history into source-linked context that your agents can inspect, explain, and reuse.

Agentic Runtime

Multi-agent orchestration & workflow engine. Declarative YAML workflows, LLM coordinator with hub-and-spoke mailboxes, race-safe delivery. O

CONTINUUM: Verifiable semantic recovery for long-running AI agents. Semantic checkpoints (not conversation dumps), an idempotent action ledg

Bring your own key (BYOK) relay to enable lightweight frontend-only apps to use LLMs using the user's API keys without hitting CORS.

Bounded, inspectable LLM inference pipelines from declared YAML — runs offline against Ollama or any OpenAI-compatible local server, emittin

Langfuse on GreptimeDB. Self-hosted LLM observability.

Open-source, self-hosted control plane for OpenClaw and Hermes AI-agent fleets on Docker/Kubernetes — REST, CLI, and MCP.

Observable diagnostics, failure attribution, metrics, and no-key replay for multi-agent runtimes.

Economical human-readable logs and structural (event pattern) retrieval for agentic trajectories

Audit any agent decision across its past, present, and future, on one typed graph.

Open-source LLM control plane: observe every call, recommend savings, then apply only human-approved, reversible routing.

A token-spend profiler and cost-regression gate for AI agents.

Diff your AI agent's behavior between two runs. See exactly which tool calls, args, costs and outputs changed when you swap models or edit p

Regression testing and configuration sweeps for RAG pipelines, with the statistics to know whether a change actually helped.

Lightweight cost observability for every API call in your stack. Track LLM tokens, database ops, and external services from your terminal.

Self-hostable agentic OS. Build, run & audit multi-agent AI teams from signed plugins. Bring your own LLM key, own all your data, EU/GDPR-re

The whole eve stack. On your own machine. Durable Postgres sessions, a Docker sandbox, memory, approvals, schedules, 1,070 tool integrations

Open-source control plane for private, governed enterprise AI — one gateway for every model, composable governed pipelines, and apps your wh

Snapshot testing for LLM apps and agents, built to run locally and block regressions in CI.

Control plane for AI coding agents: route tasks, reduce token spend, run multi-agent workflows, fallback executors, and track cost per task.

Enterprise-ready CI/CD reference for Microsoft Foundry AI agents, with parallel GitHub Actions and Azure DevOps pipelines, evaluation-driven

Evidence-grounded evaluation for AI agents — verifies each claim against the agent's real tool outputs (constrained, evidence-grounded model

The operations layer for your local LLM stack

Deterministic cost / loop / time budgets · full observability · crash-resumable runs · human-approval gates · a memory you own. Self-hosted.

Session-layer circuit breaker for LLM & agent traffic — a transparent streaming proxy that meters every session and kills the one that goes

Verdict-first output for AI coding agents. Tiny prompt + installer for Claude Code, Codex, Gemini, Cursor, opencode, and 30+ agents.

Typed evaluation for OpenCode skills and AI agents: capability, regression and product checks; provider-neutral evidence grading, provenance