Havuz

Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine f

Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.

Atomic Agent, yerel veya cloud modellerle çalışan ve browser, dosya, onaylı shell komutları ile MCP araçlarını kullanabilen bir AI agent uygulamasıdır.

Neden yükseliyor · 159 günlük bir repoda 2.505 yıldız ve son 28 günde 648 commit dikkat çekiyor; yerel modellerle çalışan kapsamlı bir agent vaadi ve README'deki GAIA L1 karşılaştırması ilgiyi artırmış olabilir. Ancak commitlerin yalnızca 2 farklı yazardan gelmesi aktivitenin geniş bir katkıcı tabanına yayıldığını göstermiyor; yükselişin kesin nedeni bilinmiyor.

Rewrites AI drafts so they read like a person wrote them — runs locally, keeps the facts

37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cp

Speech synthesis, speech recognition and voice activity detection for voice conversation, in C++ on ggml: Qwen3-TTS, Irodori-TTS, Qwen3-ASR,

Screen Translator, Android ekranındaki yazıları OCR ile tanıyıp çeviren ve sonucu ekranın üzerine yerleştiren bir uygulamadır.

Neden yükseliyor · 97 günde 906 yıldız alması, özellikle oyun ve manga çevirisi gibi belirgin bir kullanım alanına hitap ettiğine işaret ediyor. Ancak son 28 günde 2 commit ve 1 farklı yazar bilgisi, ilginin sürdürülebilir geliştirme faaliyetiyle desteklendiğine dair sınırlı kanıt sunuyor.

Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https

Local inference for diffusion language models (LLaDA, Dream), written in Mojo

Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimiz

Local AI desktop app: a Chromium browser with a GPU-aware llama.cpp runtime, OpenAI-compatible API, AI chat and agents, Stable Diffusion ima

The most advanced, fully offline client-side AI suite on Android today.

Uncensored DeepSeek-V4.1-Flash IQ2_XS on Google Colab

llama.cpp fork for significantly improved performance on Ampere generation Nvidia cards (especially RTX 3090 / 3090 Ti): example: 110+ tok/s

A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interf

Open-source voice typing for Windows — a Wispr Flow / Superwhisper alternative. Press a shortcut, speak, and AI-polished text lands at your

Local decision model with calibrated probabilities: send a state and yes/no, choice or score questions, get a probability for every option.

Bilingual English and Mandarin text to speech in C++ and GGUF. Voice design, cloning, direction and experimental voice conversion. Vulkan ba

Run any local LLM engine, auto-tuned to your GPU — polished web UI + OpenAI/Anthropic-compatible API. Point Claude Code at your own machine

Zero-overhead, terminal-native local-LLM orchestrator. Run any engine, any model via the same proxy.

A tiny neural-network framework in pure Go with AVX2 SIMD kernels (GOEXPERIMENT=simd)

Evidence-backed AMD Strix Halo local-AI setup and benchmarks: Qwen3.8, Ollama, llama.cpp, Vulkan/ROCm, large GGUFs, and cross-OEM results.

llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.

Camelid: a Rust-native local inference backend with evidence-gated model compatibility.

JANG — GGUF for MLX. YOU MUST USE JANG_Q RUNTIME. Adaptive Mixed-Precision Quantization + Runtime for Apple Silicon