Havuz

PortableLM — Zero-dependency, air-gapped local AI that runs entirely from a USB drive. Chat, generate images, and synthesize speech offline

A local-first AI control plane for orchestrating agents, models, tools, and machines from one desktop app.

The models on your disk, put to work. A private desktop app for open models — chat, a coding agent built for small models, text-to-image, te

Durable local inference for Oh My Pi: NInfer + Qwen3.8 27B on one RTX 3090/4090/5090, with restart-resumable OpenAI Responses state.

Autonomous AI-powered penetration testing platform. LLM-driven recon, vulnerability analysis, and exploit validation for internal & external

Agentic Runtime

A local-first Python personal AI assistant for reasoning, memory, voice, vision, automation, and device control.

Fast KV-cache quantization for Apple Silicon (MLX) — 43 research-adapted compression methods with Metal kernels

Local AI for your whole house: chat, images and voice on your own GPU. Computes each model's flags, fits them to your VRAM, and hot-swaps th

The operations layer for your local LLM stack

Introducing Muse Glimmer: open-weight 30B agentic multimodal model that runs on your device (Meta). Interactive local agent lab + guide. Apa

Winning Qwen and DeepSeek setups for AMD Strix Halo: pinned Ansible recipes and matched benchmarks on a 128 GiB Ryzen AI Max+ 395 / Radeon 8

Local-model (Ollama) integration for DeepSeek Harness: discover, pull, remove, and inspect local models, route requests to them by task type

The best model under 200B at near 10 token/s exact batch throughput on a single laptop CPU, with an automatic 8 GB RAM path. Native C, no GP

Qwen3.8-27B on RTX 5090 Laptop 24GB — TWIN-TURBO NVFP4 (native llama.cpp) vs Coder390 Q3 LynnStyle (.ninfer + NInfer engine in WSL2/Docker):

MCP server that delegates Claude Code agent work to local models (llama.cpp / vLLM) on your own hardware

MCP server that delegates Claude Code subagents to local models (LiteLLM/llama.cpp/Ollama), DeepSeek, AWS Bedrock, or any OpenAI/Anthropic-c

Open-source Windows AI IDE built with .NET 10 WPF, featuring a fine-tuned local AI router (1.5B), live Blender & Unity copilots, self-healin

A local-first autonomous agent harness with a web UI, live charts and buttons in its answers, sparks that keep working while you sleep, voic

A memory system for AI agents modeled on human memory: episodic, affective, reconstructive.

VRChat向けのAIエージェント実装です。音声認識、ローカルLLM、VOICEVOX系TTS、VRChat OSC、YOLO/Pose、VLM、長期記憶、感情/欲求モデル、自律行動を組み合わせ、会話だけでなくアバターの移動、視線、表情、エモート、Use/Grab、ピアノ演奏まで

OnDevice Local AI Studio — run LLMs on iPhone offline. SwiftUI workbench with MLX, llama.cpp, whisper.cpp, RAG, and authenticated OpenAI/Ant

Raise your own dragon: fine-tune a language model on your own documents, from R. Writes the training data, trains on your laptop, RAG built

llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.

Hive compute for coding agent swarms - expand your personal compute by adding on-demand agentic swarms

A local coding harness for Mac. Chat with coding agents across cloud and local models, watch every tool call in a live activity feed, and dr

Selfhost modern LLM stacks. Run the whole fleet from your terminal

Run a 110B on a 2016 PC with 16 GB RAM. Know your tok/s before you download. Placement beats budget: predicts speed + memory fit for any GGU

Self-hosted personal AI agent with a WebUI, memory, tools, MCP, sub-agents and automations. Connect local or cloud LLMs.

A nightly newspaper that writes itself: an agent runs the desks, the figures come from code, and it refuses to publish an edition with marks

CPU-only, pure-Rust implementation of LiquidAI's LFM2.5-8B-A1B LLM

Run Kimi K3 (2.8 T parameters,1.56 TB) on iPhone 16 Pro? Weights stream from your SSD through a memory budget you set. Free, local, on Mac a

Open-source platform for creating, distributing and running sovereign EU-compliant LLMs. Verticalize any model for your domain, language and

Benchmark your local LLMs: speed, memory, and quality, in one command. TUI leaderboard for Ollama, LM Studio, llama.cpp, and vLLM.

Android keyboard with local AI (Ollama, Whisper, MCP) or cloud (Gemini, Groq, OpenAI)

Local LLM-maintained personal wiki, built on Karpathy's LLM-Wiki pattern. Runs on Ollama + Qwen3 + QMD.

🚀 Multi-agent orchestration for Qwen Code CLI. 24 specialized AI agents and 82+ skills working as a professional dev department. Built for A

Give any local LLM a billion-token memory. Open-source, local-first context + memory engine for Ollama and AI agents — runs on your own mach

llmBench is a high-depth benchmarking tool designed to measure the raw performance of local LLM runtimes (Ollama, llama.cpp) while providing

Hemmingway-1: a 27B model that writes the way a person writes. Open weights, free for non-commercial use (CC BY-NC 4.0); commercial use by a

Run AI models on Apple Silicon and Raspberry Pi

MCP server for Git with local Ollama — zero tokens for git operations

A TypeScript proxy that intercepts Antigravity's Gemini API and routes to NVIDIA or OpenRouter — chat, tools, browser automation, all worki

Free, open-source AI coding agent for terminal and browser. A Claude Code / Cursor alternative that runs offline with Ollama or with your ow

Low-memory C++20 LLM inference runtime for quantized GGUF models on CPU — mmap-backed weights, paged KV cache, Q4/Q8 kernels, and reproducib

Android SDK and MCP server: 157 tools for calendar, contacts, SMS, files, camera, sensors, notifications and UI automation, for on-device LL

An LLM-powered social simulation and roleplaying engine where NPCs have their own lives too.

Zero-config local LLM optimization for Ollama, LM Studio, and Apple Silicon MLX. Reduces TTFT by 40%, wall time for local agents by 46%, and

Private, self-hosted document chat for attorneys: parse legal PDFs and query them with local open-source LLMs (Ollama) + verifiable page cit

NPU-first local LLM runtime for Snapdragon X Elite (Windows on ARM)