Havuz

A decision library for running local LLMs on multi-GPU machines without NVLink: parallelism, communication, quantization, speculative decodi

One control plane for every AI asset — MCP servers, skills, agents, AI apps. Self-hosted ledger with lifecycle state machine, 85 permission

Trace-native CI/CD for AI agents: grade production traces, cluster failures, freeze them into replayable regression tests, and block PRs tha

端到端智能体平台：把本机的 AI Agent 变成人人可用的 Web 产品（Vue 3 + Flask + Go WS 网关 + Docker 部署）

Open-source LLM gateway in Rust. One endpoint for OpenAI, Anthropic, Gemini and every other vendor. Any SDK, any model, any tool.

Behavioral regression testing for AI apps and agents: pytest plugin, behavior diff, CI gate, and document extraction metrics

Local, self-hosted agent infrastructure — one endpoint for every AI client (Claude Code, Codex CLI, Gemini CLI, OpenCode). Unified model acc

A 21-day hands-on journey to mastering AI for DevOps — covering LLMs, GenAI, CI/CD, Kubernetes, cloud, automation, and AI-powered DevOps pro

Open-source infrastructure for the full inference lifecycle: deploy, observe, scale, optimize, and safely release self-hosted models behind

CONTINUUM: Verifiable semantic recovery for long-running AI agents. Semantic checkpoints (not conversation dumps), an idempotent action ledg

Regression testing and configuration sweeps for RAG pipelines, with the statistics to know whether a change actually helped.

Cheaper and better Greptile alternative runs on your own github actions.

Aixle Flow — orchestrate coding agents through durable, inspectable workflows.

The whole eve stack. On your own machine. Durable Postgres sessions, a Docker sandbox, memory, approvals, schedules, 1,070 tool integrations

The open-source agentic framework to build, orchestrate, and operate production AI agents.

agentacct, coding agent oturumlarını yerel verilerden toplayıp yapılan işleri, kullanılan araçları, kontrolleri, token tüketimini ve tahmini maliyeti dashboard ile TUI üzerinden gösterir.

Neden yükseliyor · 65 günde 755 yıldıza ve son 28 günde 198 commite ulaşması hızlı ilgi ve aktif geliştirme sinyali veriyor; ancak aynı dönemde yalnızca 2 farklı yazar bulunması katkı tabanının dar olduğunu gösteriyor. Bu ilginin kesin nedenini ölçümlerden çıkarmak mümkün değil.

Diff your AI agent's behavior between two runs. See exactly which tool calls, args, costs and outputs changed when you swap models or edit p

Verify which LLM an OpenAI-compatible API really serves — single-token behavioral fingerprinting (Jensen-Shannon) from the paper "One Token

A token-spend profiler and cost-regression gate for AI agents.

Snapshot testing for LLM apps and agents, built to run locally and block regressions in CI.

Observable diagnostics, failure attribution, metrics, and no-key replay for multi-agent runtimes.

Self-hosted, Docker-first OpenAI-compatible LLM gateway with provider routing, fallbacks, API keys, and usage controls.

Control plane for AI coding agents: route tasks, reduce token spend, run multi-agent workflows, fallback executors, and track cost per task.

Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini, and pinned OpenRouter calls with token usage, failure, and billing-integrity re

Open-source control plane for private, governed enterprise AI — one gateway for every model, composable governed pipelines, and apps your wh

Selfhost modern LLM stacks. Run the whole fleet from your terminal

Agentic Runtime

Free, local, open-source LLM cost analyzer - see where your LLM bill leaks, on your machine.

Evidence-grounded evaluation for AI agents — verifies each claim against the agent's real tool outputs (constrained, evidence-grounded model

Open-source LLM control plane: observe every call, recommend savings, then apply only human-approved, reversible routing.

Audit any agent decision across its past, present, and future, on one typed graph.

Mutation testing for your LLM evals — degrade the system under test and check whether your evals would actually catch a regression.

Ground truth for enterprise AI: your AI coding tools, your accounts and every session on your own server, from one web console, CLI or API.

Langfuse on GreptimeDB. Self-hosted LLM observability.

Six Claude Code skills that harden Opus 4.8 toward frontier behavior. Written by Fable 5, pressure-tested on the target model with transcrip

Session-layer circuit breaker for LLM & agent traffic — a transparent streaming proxy that meters every session and kills the one that goes

Local proxy that compresses your LLM API requests so you pay less, with no change to the answers. Trims wasted tokens from prompts, history,

Economical human-readable logs and structural (event pattern) retrieval for agentic trajectories

Transparent LLM gateway trace recorder · sub2api / CLIProxyAPI / new-api 的 LLM 网关流量录制器

Deterministic cost / loop / time budgets · full observability · crash-resumable runs · human-approval gates · a memory you own. Self-hosted.

Typed evaluation for OpenCode skills and AI agents: capability, regression and product checks; provider-neutral evidence grading, provenance

Open-source, self-hosted AI-assisted operations for Kubernetes and Linux. Start here for source, architecture, deployment, and contributions

Bounded, inspectable LLM inference pipelines from declared YAML — runs offline against Ollama or any OpenAI-compatible local server, emittin

Enterprise-ready CI/CD reference for Microsoft Foundry AI agents, with parallel GitHub Actions and Azure DevOps pipelines, evaluation-driven

Local outcome-loop + reward layer for coding agents — remember what worked, ship the next move, measure how it landed. Docs at nimroboai.com

End-to-end Langfuse workshop using a TypeScript Agent to teach the AI engineering loop: tracing, prompt management, monitoring, datasets, ex

Turn scattered knowledge, operational data, and history into source-linked context that your agents can inspect, explain, and reuse.

Local CLI for auditing AI agent skills, conflicts, duplicates, safety risks, and context cost across coding agents.

Self-hostable agentic OS. Build, run & audit multi-agent AI teams from signed plugins. Bring your own LLM key, own all your data, EU/GDPR-re

Multi-agent orchestration & workflow engine. Declarative YAML workflows, LLM coordinator with hub-and-spoke mailboxes, race-safe delivery. O