Havuz

Agentic Runtime

200+ AI, Gen AI, LLM, agentic AI, Forward Deployed Engineer (FDE), AI systems architect, applied AI, LLMOps and AI platform engineering inte

Multi-agent orchestration & workflow engine. Declarative YAML workflows, LLM coordinator with hub-and-spoke mailboxes, race-safe delivery. O

A prompt-aware LLM router that predicts which models can complete each request, then selects the cheapest capable one: 53.2% lower cost and

CONTINUUM: Verifiable semantic recovery for long-running AI agents. Semantic checkpoints (not conversation dumps), an idempotent action ledg

Bring your own key (BYOK) relay to enable lightweight frontend-only apps to use LLMs using the user's API keys without hitting CORS.

Bounded, inspectable LLM inference pipelines from declared YAML — runs offline against Ollama or any OpenAI-compatible local server, emittin

Proxima lets existing GPUs serve 4x more concurrent requests

Langfuse on GreptimeDB. Self-hosted LLM observability.

Evidence-driven skill evolution for Hermes Agent — reports, dry-run proposals, candidate search, and guarded apply

An open source, Native AI Gateway and LLM proxy built in Rust

Open-source, self-hosted control plane for OpenClaw and Hermes AI-agent fleets on Docker/Kubernetes — REST, CLI, and MCP.

Observable diagnostics, failure attribution, metrics, and no-key replay for multi-agent runtimes.

Economical human-readable logs and structural (event pattern) retrieval for agentic trajectories

Python SDK for LLM guardrails with safety classification, PII detection, prompt injection defense, and grounding checks. Protect AI applicat

Local, self-hosted agent infrastructure — one endpoint for every AI client (Claude Code, Codex CLI, Gemini CLI, OpenCode). Unified model acc

Audit any agent decision across its past, present, and future, on one typed graph.

LLM spend tracking and budgets for Rails — by user, feature, or any tag, in your own database, no proxy.

Open-source LLM control plane: observe every call, recommend savings, then apply only human-approved, reversible routing.

Auto-delegation, status truth, and cost-aware model routing for OpenClaw agents

Prove an AI-written fix actually fixes the bug. mini-ork certify reproduces the bug against your repo's own code, attacks the patch with gen

Compile an AI agent's repeated workflows into deterministic, auditable routines that replay for free, with a fallback to the agent.

A token-spend profiler and cost-regression gate for AI agents.

Diff your AI agent's behavior between two runs. See exactly which tool calls, args, costs and outputs changed when you swap models or edit p

Benchmark LLMs head-to-head on your own prompts.

Open-source test harness for AI agents. Stress-test production agents with adversarial multi-turn scenarios in CI

Why is LLM inference slow — and how do you make it fast? A hands-on, first-principles course: roofline → KV cache → quantization → paralleli

Regression testing and configuration sweeps for RAG pipelines, with the statistics to know whether a change actually helped.

Lightweight cost observability for every API call in your stack. Track LLM tokens, database ops, and external services from your terminal.

Phoenix-native LLM evaluation, prompt testing, model comparison, red teaming, and observability for Elixir

The whole eve stack. On your own machine. Durable Postgres sessions, a Docker sandbox, memory, approvals, schedules, 1,070 tool integrations

Self-hostable agentic OS. Build, run & audit multi-agent AI teams from signed plugins. Bring your own LLM key, own all your data, EU/GDPR-re

Open-source control plane for private, governed enterprise AI — one gateway for every model, composable governed pipelines, and apps your wh

Enterprise-ready CI/CD reference for Microsoft Foundry AI agents, with parallel GitHub Actions and Azure DevOps pipelines, evaluation-driven

Compression with a quality contract — cache-aware, causally-pruned LLM context compression for agentic runtimes, certified non-inferior acro

Snapshot testing for LLM apps and agents, built to run locally and block regressions in CI.

Control plane for AI coding agents: route tasks, reduce token spend, run multi-agent workflows, fallback executors, and track cost per task.

The operations layer for your local LLM stack

Enterprise-grade sovereign AI for organizations where SaaS AI isn’t an option.

Evidence-grounded evaluation for AI agents — verifies each claim against the agent's real tool outputs (constrained, evidence-grounded model

Practical LLM evaluation for teams that ship to production. Deterministic + LLM-as-judge evaluators, dataset support, CI/CD integration.

Deterministic cost / loop / time budgets · full observability · crash-resumable runs · human-approval gates · a memory you own. Self-hosted.

Ground truth for enterprise AI: your AI coding tools, your accounts and every session on your own server, from one web console, CLI or API.

Session-layer circuit breaker for LLM & agent traffic — a transparent streaming proxy that meters every session and kills the one that goes

Reference implementation of a list-building path for GTM engineers: a plain-English campaign brief becomes a deduped, qualified, enriched, s

LLM providers frequently update their models without changing the model string or announcing behavioral shifts. These changes cause silent r

A production-ready toolkit to accelerate and automate the end-to-end lifecycle of AI Agent development.

Verdict-first output for AI coding agents. Tiny prompt + installer for Claude Code, Codex, Gemini, Cursor, opencode, and 30+ agents.

Claw is a local-first AI control plane that runs powerful open models on your machine and connects to top LLM providers. It intelligently ro

👻 MoEWatch: A lightweight diagnostic and audit library for Mixture-of-Experts (MoE) models in HuggingFace Transformers — the pytest for MoE