Havuz

A tiny, rate-limit-aware OpenAI-compatible proxy for the NVIDIA NIM API, built for agent harnesses like OpenCode, Codex, n8n, and anything e

Run LLMs and Ollama Qwen across AMD XDNA1 NPU, CPU, and GPU on Ryzen AI Linux systems.

Open-source media intelligence & social listening. A self-hostable, AI-agnostic alternative to Talkwalker and Brandwatch, built on free data

Rust port of earendil-works/pi — coding agent harness (pi-ai + pi-agent + pi CLI)

Run local LLMs entirely in your browser, with no server, no install and no traces. A private, single-file AI chat UI and AGENT that also wor

Proof of concept: turn old Android phones into an LLM inference cluster. ADB zero-touch provisioning, llama.cpp on each phone, OpenAI-compat

AI-routed gateway for free LLM APIs — reads your prompt and routes it to the best free model (Gemini, Groq, Cerebras, NVIDIA NIM, Mistral, O

collabosm, kullanıcının Google Colab hesabında GPU başlatıp Qwen3.8 modellerini yerel uygulama ve OpenAI uyumlu API üzerinden kullanmasını sağlar.

Neden yükseliyor · 3 günlük bir repoda 87 yıldız dikkat çekici bir başlangıç; ancak yıldızların neden geldiği ve kullanıcıların uygulamayı gerçekten çalıştırıp çalıştırmadığı mevcut verilerden anlaşılamıyor. Son 28 günlük commit ve farklı yazar ölçümleri de yok.

Run any local LLM engine, auto-tuned to your GPU — polished web UI + OpenAI/Anthropic-compatible API. Point Claude Code at your own machine

JoyCode API 代理 — 协议翻译成 Anthropic/OpenAI 兼容格式，让 Claude Code 直接调用 JoyCode支持的模型，比如GLM 5.1等

Convert CodeBuddy/WorkBuddy (Tencent coding assistant) subscription into an OpenAI-compatible API. Use CodeBuddy GLM-5.2/Kimi/DeepSeek model

OpenAI-compatible gateway aggregating 8 free LLM providers with automatic failover, circuit breakers, and smart routing. 32+ models, zero c

OpenAI-compatible speech serving in Rust: streaming TTS and full-duplex voice over GPT-Live. 128 concurrent PersonaPlex sessions on one GPU.

AI companion framework for WeChat-style chat, persona memory, proactive messages, and multi-provider adapters.

Local AI for your whole house: chat, images and voice on your own GPU. Computes each model's flags, fits them to your VRAM, and hot-swaps th

Universal AI router — save 20-40% tokens with RTK and never stop coding. Connect Claude Code, Cursor, Antigravity, Kiro, Copilot, Codex, Cli

croit AIplane — one plane for all your AI. Self-hosted AI infrastructure connecting applications and users with models, agents, tools and en

Use GPT-6-Astra from local Codex for free - no paid plan, no API key, just a signed-in prism.openai.com session

把 OpenAI Prism 折射成标准 API 的 Go 网关：OpenAI Chat / Responses、Anthropic Messages、Codex CLI 开箱即用，多账号池调度与内置管理控制台

The best model under 200B at near 10 token/s exact batch throughput on a single laptop CPU, with an automatic 8 GB RAM path. Native C, no GP

Free GPT/Claude/Mistral via duck.ai — Telegram bot + OpenAI-compatible API (no keys, no browser, pure JS)

Native iOS DeepSeek Harness port: BYOK inference, on-device Agent tools, iSH sandbox, Cordis plugins, and trajectory.

llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.

Turn scattered notes, docs and transcripts into a queryable Markdown wiki — an LLM knowledge-base compiler with MCP access, no embeddings, s

感谢马斯克 让我grok自由，免费注册grok 无数个号。然后cpa自由使用

Selfhost modern LLM stacks. Run the whole fleet from your terminal

OpenAI-compatible HTTP server for OmniVoice text-to-speech

Multi-Agent AI Desktop Client — 20 specialists auto-collaborate on your tasks. Visual Skill Store, PM orchestrator, streaming chat. Works wi

Multi-Provider AI Gateway - No personal logs by design. Model autodiscovery, Failover groups, High availability, Android companion app, and

Self-hosted GPT Image / OpenAI-compatible WebUI for text-to-image, image editing, reference-based generation, and multilingual creative wor

OpenAI-compatible server with a live view into any HF model's residual stream. pip install brainscope

AI-Powered Presentation Generator — pure HTML+CSS+vanilla JS, zero frameworks

Customized New API gateway with SnowAPI UI, LinuxDO OAuth, invitation codes, usage analytics and model health monitoring.

NPU-first local LLM runtime for Snapdragon X Elite (Windows on ARM)

Smart AI proxy router that connects Claude Code, Cursor, Codex, Copilot, and 50+ coding tools to 40+ AI providers with 100+ models. Saves 20

Run the native 284B-A13B DeepSeek-V4-Flash-0731 LLM locally on one laptop CPU: pure C, 8 GB RAM minimum, no GPU, best TPOT 0.892 s/token, re

FastAPI reference app for Statewave memory integration. Wraps every chat turn with get_context before the LLM call and record_episode after;

Self-hosted OpenAI-compatible mock server — test your LLM integrations without exposing your API key. By Axium.

Self-hosted LLM gateway in Rust: one OpenAI- and Anthropic-compatible endpoint for Claude, Codex, Qoder, Cline, Grok, Antigravity, CodeBuddy

Qwen3.8-27B on one laptop CPU: up to 2.52 token/s, 8 GB tested, no runtime accuracy loss. Native OpenAI-compatible API with function tools;

Declarative Python SDK for building AI inference platforms on Kubernetes — bare machines to a served model, composed rather than hand-assemb

CubicLM is a unified cross-platform AI workspace with local GPU acceleration (GGUF, LiteRT-LM). Supports on-device image generation, 23+ clo

GLM-5.2 NVIDIA NIM Go 客户端 / OpenAI 兼容反向代理 — 自动化 hCaptcha 凭证池 + 流式推理，支持 Docker 部署。Go client & OpenAI-compatible proxy for NVIDIA Playground's

网页版登录态 → OpenAI 兼容本地反代：DeepSeek / Qwen / Doubao 免费额度驱动 ZCode。Web login → OpenAI-compatible local API.

Native Rust, single-binary MLX inference server for Apple Silicon. OpenAI/Anthropic-compatible LLM serving — text, vision, audio, embeddings

Self-hosted Rust LLM API gateway with OpenAI-compatible and Anthropic-compatible APIs, model routing, multi-tenant keys, usage tracking, bil

API Scraper — Hunt down leaked API keys in GitHub commits, validate them against live endpoints, and check remaining balances. Multi-service

A local LLM server built for concurrent work. Drop-in replacement for Ollama and/or OpenAI and Ollama APIs on one port. Requests that share

Run your AI agents on machines you already own, as one private P2P mesh. OpenAI-compatible, sandboxed with Podman, signed reputation, no clo

Self-hosted, Docker-first OpenAI-compatible LLM gateway with provider routing, fallbacks, API keys, and usage controls.