Havuz

Copper does not rust and is essential for modern infrastructure, written in rust

Fully local AI companion with Long-Term Memory RAG, branch-isolated worldlines, Live2D/VRM 3D avatars, and real-time TTS for consumer GPUs (

Fine-tune Qwen2.5-Coder-7B for free (QLoRA on Kaggle T4) and run a local coding agent that runs your code instead of guessing — 8 GB Mac, ll

Unified native AI runtime for Java 17+, Java 22+ (Panama FFM), Android & C++. Run GGUF LLMs, Vision, Video, Whisper ASR, TTS & Embeddings in

Which local LLMs can your computer run? Hardware-aware CLI, TUI and GUI: yes/slow/no verdicts and tok/s from your GPU VRAM and RAM, then ver

MCP server that delegates Claude Code subagents to local models (LiteLLM/llama.cpp/Ollama), DeepSeek, AWS Bedrock, or any OpenAI/Anthropic-c

Deploy Qwen3.6-35B-A3B (Q4_K_XL) + MTP speculative decoding on a single NVIDIA L4 24GB — GCP g2-standard-8 — via the official llama.cpp Dock

Plug-and-play llama.cpp runtime for Intel Arc GPUs. Auto-detects your card, picks safe SYCL defaults, and exposes an OpenAI-compatible API.

A memory system for AI agents modeled on human memory: episodic, affective, reconstructive.

A 6.87 GiB GGUF build of Qwen 3.8 27B — full 27B quality on 8 GB RAM. 96.7% HumanEval, 92.9% MMLU retention, no distillation.

Local AI video dubbing studio with voice cloning, speech translation, speaker diarization and audio separation. Edit, preview and export dub

Local agentic AI runtime optimized for CPU-only consumer hardware, tool use and efficient local inference.

Catch local LLMs spilling into the CPU. One run shows GPU placement, prefill, decode, memory, power and a verdict.

Look inside any local LLM (GGUF from Ollama, LM Studio, Hugging Face, Jan, llama.cpp): layers, heads, vocabulary, chat template, weights. Ex

Run a team of AI agents on your own computer. Your files, browser sessions and passwords stay local. Works with Claude Code, Codex, hosted o

一键本地 AI 工作站：模型市场（多源测速+断点续传）、llama.cpp+MNN 双引擎、多芯片检测（NVIDIA/AMD ROCm/华为昇腾）、LLM/TTS/图像/视频/3D/超分、Agent 助手；Electron + 原生 JS + Python sidecar，数据默

AI-assisted rescue boot USB — a Ventoy multi-boot drive on Ubuntu 24.04 with offline LLM inference (Ollama + llama.cpp), pre-installed agent

面向内存受限端侧设备的 MoE 大模型推理运行时优化系统

What I run on my inference server: Qwen3.8-Flash-Next on two RTX 3090s, and how I got here

A dashboard for a home cluster of NVIDIA GB10 (DGX Spark / ASUS GX10) inference servers: GPU and system health, plus live per-model metrics

Local-first semantic search engine for your files — hybrid BM25 + vector + HyDE search over docs, PDFs, images, audio and video. 100% offlin

BANTAM FACTORY — Your model. Your hardware. A coding factory that can improve itself.

MCP server that delegates Claude Code agent work to local models (llama.cpp / vLLM) on your own hardware

Local AI model manager

Pure-Rust MoE inference engine for Qwen3.5/3.6 GGUF. CPU+GPU hybrid experts, NVRTC CUDA kernels, OpenAI-compatible server. 2x llama.cpp pref

AI Infra 推理系统学习资料：从深度学习算子到 vLLM 服务端部署

Measures which GGUF quant of a model to run on your GPU: real speed and quality loss (KL divergence), not estimates.

SDK for building on-device AI applications on Arm with reusable building blocks across inference runtimes.

Learn languages by reading and listening, just like LingQ, with a local AI. Free. Forever.

OnDevice Local AI Studio — run LLMs on iPhone offline. SwiftUI workbench with MLX, llama.cpp, whisper.cpp, RAG, and authenticated OpenAI/Ant

Benchmark llama.cpp on your own GPU/CPU boxes and compare against everyone else's — sweep runner, an sha256-keyed index of ~4M GGUF files, a

Lightweight agent that pulls and runs LLM benchmarks from Protorikis Bench

Multi-GPU prefill acceleration for llama.cpp

Find anything on your PC by what's in it: local, private semantic search for Windows. Photos, screenshots, PDFs, documents, recordings and v

An agent that builds agents — closed-loop AI system that interviews, designs, tests, and ships standalone Python agents.

Run stock llama.cpp with the stock Unsloth Qwen3.6-35B-A3B 4-bit on a 16 GB Mac.

Portable offline AI assistant powered by llama.cpp and GGUF models. Run a private local chatbot directly from a USB drive on Windows with no

Proof of concept: turn old Android phones into an LLM inference cluster. ADB zero-touch provisioning, llama.cpp on each phone, OpenAI-compat

USB-portable offline AI assistant. AES-256 encrypted history, Turkish-tuned LLM (Trendyol), RAG over PDF/DOCX. KVKK uyumlu, %100 offline.

方寸智匣 LocalBrain：本地大模型、文件与媒体工作台。Windows/Linux 2.2.8，Apple Silicon Mac 2.2.7；按平台维护运行环境，支持本地工具与 MCP 接入。

Qwen 3.8 27B on a $1,400 Strix Halo: frozen optimal config, 262k needle-exact retrieval, vision fixed, delegation-card certified

A graph-native, local-first agent harness and Linux desktop shell: a voice-driven Executive Agent, a reviewed knowledge graph, per-Agent mem

single-executable / library which combines llama.cpp, whisper.cpp, and stable-diffusion.cpp

Offline LLM app for iPhone: run open models from Hugging Face on-device with llama.cpp, MLX, Core ML and Apple Foundation Models. No account

MoE expert compression toolkit — prune, merge, and forge specialist models for local inference.

OraType (formerly Typelite). Just say it. Free, open-source voice typing for macOS: speak in any app and get clean text. Runs on your comput

Run open AI models on your own computer — a friendly desktop app and local gateway for llama.cpp and more. Private, free, open source.

Ternary decision scoring with Jevfire-style inference, typed APIs, and reproducible Persian evaluation.

A production-oriented LLM engineering platform with OpenAI-compatible serving, streaming, observability, evaluation, reproducible experiment

Evidence-backed structural validation of Kimi K3 UD-IQ1_M and UD-Q4_K_XL split GGUF releases using OMIV.