Havuz

Turn any document or a whole zip into an interactive knowledge graph, using a self-hosted Qwen3.6-35B-A3B-MTP on a single NVIDIA L4

Clonación de voz y texto a voz 100% local con Qwen3-TTS y llama.cpp. Funciona en CPU y GPU, 10 idiomas, interfaz web en español.

Open source, terminal-first AI coding agent with fully transparent multi-model routing. Local (Ollama, LM Studio, MLX, llama.cpp) or cloud,

Published: 2026-10-18

Published: 2026-10-18

An assistant that lives next to your cursor on Windows. It sees your screen, talks with you, draws on things, solves the math you write, and

Hybrid GPU + CPU inference for mixture-of-experts models, written in Rust down to the CUDA kernels. A drop-in llama-server.

Pool RAM across old PCs, Macs, and Android devices into a unified local AI cluster

llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.

Practical local LLM recipes and benchmarks for RTX 5060 Ti setups

Instant context compaction for Hermes Agent. Builds the compaction summary in milliseconds with no LLM call, keeping the exact commands, exi

Run stock llama.cpp with the stock Unsloth Qwen3.6-35B-A3B 4-bit on a 16 GB Mac.

Open-source control panel for the real llama.cpp: see where a model lands in your VRAM before loading, every llama-server flag per model, on

AI, fully local on your computer.

Offline AI research assistant for Android. Answers from Wikipedia and other reference packs on the phone, with citations. Gemma 4 runs on th

ENGRAFT: write facts into an LLM's n-gram (Engram) memory table as a removable overlay: 100 facts in a 9 MB file, no weights touched, verifi

CPU-first LLM inference server on llama.cpp. Runs useful models on free-tier ARM boxes; rewriting the input made it ~6x faster and more accu

Open-source desktop AI agent: built-in free model, local GGUF models via llama.cpp, dispatch tasks from WeChat/Feishu/DingTalk. Files, brows

The self-hosted AI workflow automation platform for Git repositories.

Top AI Calorie Tracker GitHub 2026

Run a 110B on a 2016 PC with 16 GB RAM. Know your tok/s before you download. Placement beats budget: predicts speed + memory fit for any GGU

Find anything on your PC by what's in it: local, private semantic search for Windows. Photos, screenshots, PDFs, documents, recordings and v

Local diagnostic CLI for NVIDIA DGX Spark (GB10). Detects power caps, UMA pressure, thermal risk, CUDA 13/SM_121 wheel mismatches, Docker is

Started as a €70 used mini PC running an always-on AI agent (Hermes, n8n, Pi-hole, monitoring, Tailscale, encrypted backups). Now with a sec

GamePause for Local AI: a Windows tray app that pauses LM Studio, Ollama and other local AI servers while you game, and restores them afterw

A local LLM server built for concurrent work. Drop-in replacement for Ollama and/or OpenAI and Ollama APIs on one port. Requests that share

Selfhost modern LLM stacks. Run the whole fleet from your terminal

Self-hosted AI workspace where chat becomes visual workflows, multi-agent operations, and reviewable automations. Local memory; local or clo

Serving Qwen3.8-27B-FP8 on a single DGX Spark (GB10): 7.88 to 58.5 tok/s single-stream from decode strategy alone, weights untouched. Specul

Local AI video dubbing studio with voice cloning, speech translation, speaker diarization and audio separation. Edit, preview and export dub

User friendly GUI for configuring and launching llama.cpp

Ollama-compatible LLM server on a tuned llama.cpp fork. Beats vllm by 40% on single stream decode, and by 20% on multi stream decode, and be

Benchmark your local LLMs: speed, memory, and quality, in one command. TUI leaderboard for Ollama, LM Studio, llama.cpp, and vLLM.

Your personal context engine for macOS, with Windows and Linux in alpha: on-device meeting notes, screen recall, dictation, and autocomplete

Reproduce Lium's LocalMaxxing leaderboard runs (7 boards, 20 Verified) on a rented Lium GPU in one script — vLLM/llama.cpp recipes, measured

Covert Coder — a local-first sovereign AI development environment for governed models, workflows, execution, evidence, and verification.

Honest local LLM deployment planning and benchmarking for high unified-memory Macs and future Linux/NVIDIA rigs.

llama.cpp performance patches developed and measured on Tesla P100 (GP100, sm_60). Most are not Pascal-specific.

A terminal AI agent you can fully undo - every file and shell action is snapshotted and reversible. Model-agnostic (any LLM), and connects t

EchoMemory, konuşmaları cihazda yazıya döküp aranabilir belleğe kaydeden ve bu kayıtlar hakkında yerel bir RAG chatbot ile soru sormayı sağlayan bir uygulamadır.

Neden yükseliyor · 11 günde 68 yıldız ve son 28 günde 16 commit ile erken ilgi ve geliştirme hareketliliği var; ancak yalnızca 2 farklı yazar görülüyor. Yerel AI, gizlilik ve konuşma belleğini tek bir kullanıma hazır uygulamada birleştirmesi ilgi çekici olabilir; yıldız sayısı benimseme veya kalite kanıtı değil.

Local LLM Server Manager + LlaMA.cpp + Chat

Impulse by Velocity: run AI models on your own computer, on Windows and Linux. Load any GGUF model and chat with web search, files, charts a

Typed choices and probability distributions from text and images with llama.cpp, Ollama, and OpenRouter

Low-memory C++20 LLM inference runtime for quantized GGUF models on CPU — mmap-backed weights, paged KV cache, Q4/Q8 kernels, and reproducib

Can't find subtitles? Generate SRT/ASS subtitles from any video with local AI and auto-translate them — no internet, free. macOS & Windows.

AI coding agent harness for any hardware, local or cloud (OpenAI-compatible engines). Tuned for AMD Strix Halo: Qwen3.8 125B on the iGPU, NP

Open-source self-hosted home AI inference platform for AMD Strix Halo — multi-backend slots, OpenAI-compatible gateway, Vue 3 + FastAPI + sy

On-device AI meeting assistant — real-time transcription & LLM insights, 100% offline

A personal AI agent to help you think, create, and get things done. Powered by open models, on your computer or in the cloud.

Local LLM inference on Xbox Series S in Developer Mode: llama.cpp (GGUF) + ONNX Runtime GenAI, an OpenAI-compatible LAN endpoint (off by def