Havuz

Open-source LLM gateway in Rust. One endpoint for OpenAI, Anthropic, Gemini and every other vendor. Any SDK, any model, any tool.

Trace-native CI/CD for AI agents: grade production traces, cluster failures, freeze them into replayable regression tests, and block PRs tha

Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

One control plane for every AI asset — MCP servers, skills, agents, AI apps. Self-hosted ledger with lifecycle state machine, 85 permission

Waku, yerel SQLite memory, agent loop ve eval araçlarını bir araya getiren, Python tabanlı kişisel AI assistant uygulamasıdır.

Neden yükseliyor · 79 günlük bir repo için 1.849 yıldızın yanında son 28 günde 30 commit ve 7 farklı yazar bulunması görünür ilgi ve devam eden geliştirme gösteriyor. README'nin sade, okunabilir agent loop ve entegre memory/eval yaklaşımı da projeyi agent harness arayan geliştiricilere çekici kılıyor; bu metrikler benimsenme veya üretim başarısını tek başına kanıtlamıyor.

Future AGI, LLM ve AI agent uygulamalarını değerlendirme, izleme, simüle etme ve koruma işlerini self-host edilebilen tek bir platformda birleştiriyor.

Neden yükseliyor · Konu, agent uygulamalarında evaluation ve observability ihtiyacının artmasıyla örtüşüyor; 157 günlük repo yaşına karşılık 2.081 yıldız ve son 28 günde 597 commit geliştirme temposuna işaret ediyor. Farklı yazar sayısı 6; bu veriler ilginin nedenini tek başına kanıtlamaz ve yıldızlar benimseme ya da kalite ölçüsü değildir.

The open-source agentic framework to build, orchestrate, and operate production AI agents.

NeMo Helix: Make the agents you ship faster, more accurate, and safer.

Mirror of https://git.getbusbar.dev/GetBusbar/busbar. Read-only; contribute on Forgejo. The execution control plane for AI agents. Govern ev

Open-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock & more — routin

Audit trail database for AI agents. Tamper-evident, checksum-backed decision logs with session replay and time-travel debugging to support E

Local proxy that compresses your LLM API requests so you pay less, with no change to the answers. Trims wasted tokens from prompts, history,

Local, self-hosted agent infrastructure — one endpoint for every AI client (Claude Code, Codex CLI, Gemini CLI, OpenCode). Unified model acc

Aixle Flow — orchestrate coding agents through durable, inspectable workflows.

Myrtia — agent-native red teaming for LLMs and AI agents: a deliberating council of attacker models (propose, cross-critique, Borda vote, ch

Verify which LLM an OpenAI-compatible API really serves — single-token behavioral fingerprinting (Jensen-Shannon) from the paper "One Token

端到端智能体平台：把本机的 AI Agent 变成人人可用的 Web 产品（Vue 3 + Flask + Go WS 网关 + Docker 部署）

Behavioral regression testing for AI apps and agents: pytest plugin, behavior diff, CI gate, and document extraction metrics

A decision library for running local LLMs on multi-GPU machines without NVLink: parallelism, communication, quantization, speculative decodi

End-to-end Langfuse workshop using a TypeScript Agent to teach the AI engineering loop: tracing, prompt management, monitoring, datasets, ex

Evidence-driven skill evolution for Hermes Agent — reports, dry-run proposals, candidate search, and guarded apply

Ground truth for enterprise AI: your AI coding tools, your accounts and every session on your own server, from one web console, CLI or API.

Local-first observability your agent reads back. TMA1 records every LLM call, then routes what it sees into the agent's next turn via hooks

Run-aware token governance for multi-agent systems.

Open-source test harness for AI agents. Stress-test production agents with adversarial multi-turn scenarios in CI

Audit any agent decision across its past, present, and future, on one typed graph.

The operations layer for your local LLM stack

Companion code for the Manning book 'LLM Customization and Fine-Tuning.' Adapt open-weights LLMs end to end: prompting and RAG, LoRA/QLoRA,

Commented SHIP? Full briefs for 3 pile-two AI engineering projects: LLM Ops, Agent Evals, Auto Routing. What to build, what to measure, what

Free, local, open-source LLM cost analyzer - see where your LLM bill leaks, on your machine.

An orchestration runtime for multi-agent AI systems. Declare agents, tools, and policies as YAML; Orloj schedules, executes, routes, and gov

Enterprise RAG ecosystem managing 32000+ semantic chunks. Features hybrid parsing (LlamaParse/PyMuPDF) and 256-dim MRL embeddings for 512MB

Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini, and pinned OpenRouter calls with token usage, failure, and billing-integrity re

Local outcome-loop + reward layer for coding agents — remember what worked, ship the next move, measure how it landed. Docs at nimroboai.com

Turn scattered knowledge, operational data, and history into source-linked context that your agents can inspect, explain, and reuse.

Open-source, self-hosted control plane for OpenClaw and Hermes AI-agent fleets on Docker/Kubernetes — REST, CLI, and MCP.

Bring your own key (BYOK) relay to enable lightweight frontend-only apps to use LLMs using the user's API keys without hitting CORS.

Agentic Runtime

A prompt-aware LLM router that predicts which models can complete each request, then selects the cheapest capable one: 53.2% lower cost and

Phoenix-native LLM evaluation, prompt testing, model comparison, red teaming, and observability for Elixir

Langfuse on GreptimeDB. Self-hosted LLM observability.

Self-hostable agentic OS. Build, run & audit multi-agent AI teams from signed plugins. Bring your own LLM key, own all your data, EU/GDPR-re

Prove an AI-written fix actually fixes the bug. mini-ork certify reproduces the bug against your repo's own code, attacks the patch with gen

200+ AI, Gen AI, LLM, agentic AI, Forward Deployed Engineer (FDE), AI systems architect, applied AI, LLMOps and AI platform engineering inte

Why is LLM inference slow — and how do you make it fast? A hands-on, first-principles course: roofline → KV cache → quantization → paralleli

Benchmark LLMs head-to-head on your own prompts.

Declarative Python SDK for building AI inference platforms on Kubernetes — bare machines to a served model, composed rather than hand-assemb

Open-source control plane for private, governed enterprise AI — one gateway for every model, composable governed pipelines, and apps your wh

Compression with a quality contract — cache-aware, causally-pruned LLM context compression for agentic runtimes, certified non-inferior acro

Evidence-grounded evaluation for AI agents — verifies each claim against the agent's real tool outputs (constrained, evidence-grounded model