Havuz

Open-source LLM gateway in Rust. One endpoint for OpenAI, Anthropic, Gemini and every other vendor. Any SDK, any model, any tool.

Open-source AI gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

One control plane for every AI asset — MCP servers, skills, agents, AI apps. Self-hosted ledger with lifecycle state machine, 85 permission

Waku, yerel SQLite memory, agent loop ve eval araçlarını bir araya getiren, Python tabanlı kişisel AI assistant uygulamasıdır.

Neden yükseliyor · 79 günlük bir repo için 1.849 yıldızın yanında son 28 günde 30 commit ve 7 farklı yazar bulunması görünür ilgi ve devam eden geliştirme gösteriyor. README'nin sade, okunabilir agent loop ve entegre memory/eval yaklaşımı da projeyi agent harness arayan geliştiricilere çekici kılıyor; bu metrikler benimsenme veya üretim başarısını tek başına kanıtlamıyor.

A decision library for running local LLMs on multi-GPU machines without NVLink: parallelism, communication, quantization, speculative decodi

Future AGI, LLM ve AI agent uygulamalarını değerlendirme, izleme, simüle etme ve koruma işlerini self-host edilebilen tek bir platformda birleştiriyor.

Neden yükseliyor · Konu, agent uygulamalarında evaluation ve observability ihtiyacının artmasıyla örtüşüyor; 157 günlük repo yaşına karşılık 2.081 yıldız ve son 28 günde 597 commit geliştirme temposuna işaret ediyor. Farklı yazar sayısı 6; bu veriler ilginin nedenini tek başına kanıtlamaz ve yıldızlar benimseme ya da kalite ölçüsü değildir.

Audit trail database for AI agents. Tamper-evident, checksum-backed decision logs with session replay and time-travel debugging to support E

Open-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock & more — routin

Local proxy that compresses your LLM API requests so you pay less, with no change to the answers. Trims wasted tokens from prompts, history,

Local, self-hosted agent infrastructure — one endpoint for every AI client (Claude Code, Codex CLI, Gemini CLI, OpenCode). Unified model acc

Myrtia — agent-native red teaming for LLMs and AI agents: a deliberating council of attacker models (propose, cross-critique, Borda vote, ch

NeMo Helix: Make the agents you ship faster, more accurate, and safer.

Multi-agent orchestration & workflow engine. Declarative YAML workflows, LLM coordinator with hub-and-spoke mailboxes, race-safe delivery. O

Open-source test harness for AI agents. Stress-test production agents with adversarial multi-turn scenarios in CI

Selfhost modern LLM stacks. Run the whole fleet from your terminal

Agentic Runtime

A 21-day hands-on journey to mastering AI for DevOps — covering LLMs, GenAI, CI/CD, Kubernetes, cloud, automation, and AI-powered DevOps pro

200+ AI, Gen AI, LLM, agentic AI, Forward Deployed Engineer (FDE), AI systems architect, applied AI, LLMOps and AI platform engineering inte

Ground truth for enterprise AI: your AI coding tools, your accounts and every session on your own server, from one web console, CLI or API.

Control plane for AI coding agents: route tasks, reduce token spend, run multi-agent workflows, fallback executors, and track cost per task.

The whole eve stack. On your own machine. Durable Postgres sessions, a Docker sandbox, memory, approvals, schedules, 1,070 tool integrations

Commented SHIP? Full briefs for 3 pile-two AI engineering projects: LLM Ops, Agent Evals, Auto Routing. What to build, what to measure, what

Mutation testing for your LLM evals — degrade the system under test and check whether your evals would actually catch a regression.

Free, local, open-source LLM cost analyzer - see where your LLM bill leaks, on your machine.

The open-source agentic framework to build, orchestrate, and operate production AI agents.

Self-hosted, Docker-first OpenAI-compatible LLM gateway with provider routing, fallbacks, API keys, and usage controls.

An orchestration runtime for multi-agent AI systems. Declare agents, tools, and policies as YAML; Orloj schedules, executes, routes, and gov

Local-first observability your agent reads back. TMA1 records every LLM call, then routes what it sees into the agent's next turn via hooks

Enterprise RAG ecosystem managing 32000+ semantic chunks. Features hybrid parsing (LlamaParse/PyMuPDF) and 256-dim MRL embeddings for 512MB

Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini, and pinned OpenRouter calls with token usage, failure, and billing-integrity re

Agent and LLM API performance monitoring via network packet probe. Measures performance of OpenClaw, Claude, Codex, DeepAgents and more — de

Radicalbit AI Gateway

An open source, Native AI Gateway and LLM proxy built in Rust

Operational doctrine for practical AI systems design.

Self-hosted LLM router. Cost effective, deterministic, and fast. Secure and private by default.

Verify which LLM an OpenAI-compatible API really serves — single-token behavioral fingerprinting (Jensen-Shannon) from the paper "One Token

Langfuse on GreptimeDB. Self-hosted LLM observability.

Aixle Flow — orchestrate coding agents through durable, inspectable workflows.

Enterprise-ready CI/CD reference for Microsoft Foundry AI agents, with parallel GitHub Actions and Azure DevOps pipelines, evaluation-driven

CONTINUUM: Verifiable semantic recovery for long-running AI agents. Semantic checkpoints (not conversation dumps), an idempotent action ledg

Open-source control plane for private, governed enterprise AI — one gateway for every model, composable governed pipelines, and apps your wh

Compression with a quality contract — cache-aware, causally-pruned LLM context compression for agentic runtimes, certified non-inferior acro

Evidence-grounded evaluation for AI agents — verifies each claim against the agent's real tool outputs (constrained, evidence-grounded model

Companion code for the Manning book 'LLM Customization and Fine-Tuning.' Adapt open-weights LLMs end to end: prompting and RAG, LoRA/QLoRA,

Open-source, self-hosted AI-assisted operations for Kubernetes and Linux. Start here for source, architecture, deployment, and contributions

Snapshot testing for LLM apps and agents, built to run locally and block regressions in CI.

Local CLI for auditing AI agent skills, conflicts, duplicates, safety risks, and context cost across coding agents.

Typed evaluation for OpenCode skills and AI agents: capability, regression and product checks; provider-neutral evidence grading, provenance

Transparent LLM gateway trace recorder · sub2api / CLIProxyAPI / new-api 的 LLM 网关流量录制器

Know when an AI conversation thread is still safe to continue — a deterministic, dependency-free continuity planner.