Havuz

Native Rust, single-binary MLX inference server for Apple Silicon. OpenAI/Anthropic-compatible LLM serving — text, vision, audio, embeddings

Hosomaki, the intelligence layer for Linux

Local agent infrastructure in one stdlib-only Go binary

AI Powered Reverse Engineering Tool

An institutional-intelligence operating system: a council of 14 agents that remembers every deliberation, grades its own predictions against

A high-performance, private, on-device AI chat client built with Flutter. AstraLM runs Large Language Models (LLMs) and Vision models 100% l

Faraday, the on-device AI voice agent for Android. Gemma 4 runs entirely on your phone: real voice conversation, long-term memory, and tools

One CLI for your whole machine: code worktrees, notes/brain, offline local AI, and Mac messages/calls/calendar — for you and your AI agents.

Hikari's curated English measured notes on local LLM systems (serving, specdec, training, steering).

Zero-Trust Semantic Scraper & Firewall Proxy for AI Coding Agents. Intercepts and neutralizes web-scraped prompt injections locally before t

Benchmark llama.cpp on your own GPU/CPU boxes and compare against everyone else's — sweep runner, an sha256-keyed index of ~4M GGUF files, a

We test whether self-hosted LLMs can run agents

An agent that builds agents — closed-loop AI system that interviews, designs, tests, and ships standalone Python agents.

Run stock llama.cpp with the stock Unsloth Qwen3.6-35B-A3B 4-bit on a 16 GB Mac.

Portable offline AI assistant powered by llama.cpp and GGUF models. Run a private local chatbot directly from a USB drive on Windows with no

KamehaDB is a cross-platform database GUI - AI. Support query via human language

Toggle OpenAI Codex between a local model (Ollama / OpenAI-compatible) and the native cloud model — interactive menu, surgical config edits,

A context-aware AI terminal with SSH, SFTP, and local/remote LLM support.

Open-source, Local-first AI (SI) Second Brain.

Typed decisions (choice / score / yes-no) from local Qwen models on Apple Silicon. Probabilities come straight from the logits, no text gene

The old advice to avoid Windows for local LLMs used to be right. It isn't anymore. The fixes for display-GPU desktop crashes and WSL memory

Offline LLM app for iPhone: run open models from Hugging Face on-device with llama.cpp, MLX, Core ML and Apple Foundation Models. No account

Make your own private AI bot on your own computer. Say what bot you want; BuildBot finds apps, books and live info, shows one plan, and buil

Run Qwen3.8-Flash-Next on ONE RTX 3090 (24 GB) + 64 GB RAM: 128K context, up to 2,100 tok/s prefill, 43–51 tok/s decode. vLLM runtime with h

macOS-Port von kimi-k3-in-c: Patch, Installer und Validierung für Apple Silicon. Ohne Modellgewichte.

Arcgram — an interactive diagram engine for human–AI collaboration: an AI agent draws its reasoning as an auditable node-and-edge flow and s

Run NVIDIA's tri-modal Nemotron Omni (text+vision+audio) entirely on Apple Silicon — pure MLX runtime, parity-verified against NVIDIA's refe

A blazing-fast, local-first AI agent ecosystem. Orchestrate local LLMs with Python, run them in a native Rust terminal, or integrate directl

Unofficial .NET bindings for Google's LiteRT-LM — on-device LLM inference (Gemma) for Windows, Linux, Android, macOS & MAUI

Qwen3.6 vLLM Toolkit — Launcher + Templates, Optimized for 2×24 GB. vLLM launcher with an optimized hybrid chat template drawing from the be

Open-Source Agentic Harness for Reliable Task Completion, even on small local models. 💻🧠🤖

MoE expert compression toolkit — prune, merge, and forge specialist models for local inference.

🟢 A private, local AI assistant for macOS — voice, vision, and automation powered by local LLMs via Ollama. 100% on your machine. No cloud,

Open-source Android AI chat, on-device agent, local models, Live2D, Skills, MCP, and Vibe Coding

Knowledge graph and context manager for AI coding agents: Claude Code, Codex, Gemini CLI, Cursor, Copilot and local models. Code map with Pa

Serve DeepSeek and Qwen, run an on-demand model library, and fine-tune with Unsloth QLoRA on 2x NVIDIA DGX Spark. TP=2 vLLM lanes behind one

Fine-tune Qwen2.5-Coder-7B for free (QLoRA on Kaggle T4) and run a local coding agent that runs your code instead of guessing — 8 GB Mac, ll

Honest local LLM deployment planning and benchmarking for high unified-memory Macs and future Linux/NVIDIA rigs.

Local OCR, metadata automation and RAG document chat for Paperless-ngx using PaddleOCR and Ollama, designed for CPU-only self-hosted servers

Local and cloud GPU interference model orchestrator exposing OpenAI-compatible API from different engines

Local AI chat and personal agents for macOS. Ollama-powered conversations, customizable characters, controllable memory, and a browser-based

Next-gen AI-native server ops panel with an in-workspace SRE agent. Crash self-healing, safe rollbacks, Docker/game servers, and local Ollam

Talk to your computer. Icebreaker transforms natural language into safe Linux actions through isolated AI brains, kernel-enforced sandboxes.

Typed decisions from unstructured state: one forward pass, zero generated text. Local, deterministic, Jev-compatible. Not affiliated with ty

Measures which GGUF quant of a model to run on your GPU: real speed and quality loss (KL divergence), not estimates.

Pools consumer laptops into one local runtime for Meta Llama models. Measures the free VRAM each machine reports, splits the model across CU

Apple’s on-device LLM, text-to-speech and speech recognition for Node.js and Python, with an OpenAI/Ollama-compatible server. macOS 26+ on A

Local-first multi-engine AI agent dashboard — Claude Code, Codex & built-in ReAct in one window. MCP support, skills auto-loading, long-term

EchoMemory, konuşmaları cihazda yazıya döküp aranabilir belleğe kaydeden ve bu kayıtlar hakkında yerel bir RAG chatbot ile soru sormayı sağlayan bir uygulamadır.

Neden yükseliyor · 11 günde 68 yıldız ve son 28 günde 16 commit ile erken ilgi ve geliştirme hareketliliği var; ancak yalnızca 2 farklı yazar görülüyor. Yerel AI, gizlilik ve konuşma belleğini tek bir kullanıma hazır uygulamada birleştirmesi ilgi çekici olabilir; yıldız sayısı benimseme veya kalite kanıtı değil.