Havuz

A local-LLM privacy layer for anything you paste into a cloud model — detect, tokenize, restore. Zero deps, reversible, strong on Chinese.

Self-hosted, browser-based AI dungeon RPG, fully local on an AMD Strix Halo APU: narrator + per-character agents on one local LLM (Gemma 4 2

MoE expert compression toolkit — prune, merge, and forge specialist models for local inference.

Local-first, LLM-agnostic memory system — hybrid retrieval (vector + lexical + graph), multi-signal ranking. Runs on 4GB RAM, CPU-only, no c

Self-aware cognitive AI agent with a persistent soul: reads, modifies & verifies its own code, plans autonomously, dreams in idle time, reme

Local LLM chat app for Apple Silicon Macs.

A local-first Python personal AI assistant for reasoning, memory, voice, vision, automation, and device control.

A free, private, local AI for any app. One command, OpenAI-compatible, no API key.

NPU-first local LLM runtime for Snapdragon X Elite (Windows on ARM)

End-to-end agentic quantum-ML pipeline: PennyLane GPU quantum-kernel anomaly detection + LangGraph multi-agent system + locally-hosted Qwen3

Benchmark llama.cpp on your own GPU/CPU boxes and compare against everyone else's — sweep runner, an sha256-keyed index of ~4M GGUF files, a

llama.cpp speculative decoding measured on one RTX 3090, Qwen3.6-35B-A3B UD-Q4_K_XL, commit 3737e4137. Published figures are re-derived from

Portable offline AI assistant powered by llama.cpp and GGUF models. Run a private local chatbot directly from a USB drive on Windows with no

MCP server that shrinks logs, JSON, docs and web pages before your AI reads them. Offline, deterministic, ~3ms, no API key. 66% fewer tokens

Self-hosted AI companion with a simulated daily life, long-term memory, and consistent-identity selfies. Your keys, your data, your machine.

Run the LLM Swarm Router on machines to distribute Local Ai to the Swarm - More Machines - MORE SPEED

Fast KV-cache quantization for Apple Silicon (MLX) — 43 research-adapted compression methods with Metal kernels

Zero-config local LLM optimization for Ollama, LM Studio, and Apple Silicon MLX. Reduces TTFT by 40%, wall time for local agents by 46%, and

Local-first AI coding agent runtime — your models, fail-closed safety, evidence-gated self-improvement

A 100% local AI memory engine for your computer

A TUI around llama.cpp for running, managing, and benchmarking local GGUF models and launching the pi coding agent against your local server

Auto-tuning de modelos locais: TPS e contexto sob limite de PPL, com busca finita, protecoes de recursos e evidencias em SQLite.

Talk to your computer. Icebreaker transforms natural language into safe Linux actions through isolated AI brains, kernel-enforced sandboxes.

A memory system for AI agents modeled on human memory: episodic, affective, reconstructive.

Offline LLM app for iPhone: run open models from Hugging Face on-device with llama.cpp, MLX, Core ML and Apple Foundation Models. No account

Summarize, explain, fact-check, or translate any text, URL, or file. No GPU. No cloud. One command

Free, open-source AI coding agent & multi-agent teams for macOS — runs 100% on-device via Ollama or LM Studio. Autovisor, an autonomous Supe

An institutional-intelligence operating system: a council of 14 agents that remembers every deliberation, grades its own predictions against

Catch local LLMs spilling into the CPU. One run shows GPU placement, prefill, decode, memory, power and a verdict.

OnDevice Local AI Studio — run LLMs on iPhone offline. SwiftUI workbench with MLX, llama.cpp, whisper.cpp, RAG, and authenticated OpenAI/Ant

A local-first Windows AI assistant with a multi-model council pipeline, Python sandbox, web search, and cloud AI support. Free. Private. No

Local-first macOS AI workspace. Notch-native, 8 providers, your coding agents and their subagents in one place. ⌥Space anywhere.

Hikari's curated English measured notes on local LLM systems (serving, specdec, training, steering).

Local AI engine in Rust: run GGUF and ONNX models for chat, vision, speech and embeddings on your own GPU, RAM and CPU, with automatic place

Honeycomb Lab — hex map + OpenAI gateway control plane for a home AI fleet

Local-first AI assistant for Windows: voice (Whisper+Piper), webcam vision, FLUX image gen, image-to-3D, memory, 80+ tools. OpenAI-compatibl

The operations layer for your local LLM stack

Local and cloud GPU interference model orchestrator exposing OpenAI-compatible API from different engines

Browser-based operator console for managing and monitoring Lemonade on Linux inference servers.

LM Local is an AI coding assistant for Visual Studio 2022/2026 with agentic capabilities and subagents

Use Ollama,OpenRouter, Gemini, cohere and moonshot ai with Codex plugins, MCP tools, tool_search and apply_patch. Use any plugin you want wi

Run models too big for RAM on Apple Silicon — any Hugging Face model, dense or MoE — by streaming weights from disk

Private, offline AI coding agent for local Qwen models via Ollama — zero dependencies, real tools, multi-agent. Your code never leaves your

Use many on device and cloud models with Apple's Foundation Models framework in iOS and macOS with a full chat experience.

AI Powered Reverse Engineering Tool

macOS-Port von kimi-k3-in-c: Patch, Installer und Validierung für Apple Silicon. Ohne Modellgewichte.

Spec-driven software engineering for AI coding agents - a Python CLI that drives brainstorm, spec, plan, and execute phases over markdown ar

Arcgram — an interactive diagram engine for human–AI collaboration: an AI agent draws its reasoning as an auditable node-and-edge flow and s

One CLI for your whole machine: code worktrees, notes/brain, offline local AI, and Mac messages/calls/calendar — for you and your AI agents.

Raise your own AI partner — an open-source, local-first AI agent platform with persistent memory and evolving personality.