Havuz

Spark-X2.5, yerel çalıştırma ve agent iş akışları için tasarlanmış 1.7B ve 4B boyutlarında açık dil modelleri serisidir.

Neden yükseliyor · Yeni model serisi; uzun context, küçük model boyutu ve agent/coding yeteneklerini aynı anda öne çıkarıyor. README'de 34 günlük yaş, 386 yıldız ve son 28 günde 9 commit ile 2 farklı yazar bilgisi var; bunlar erken ilgi ve güncel çalışma gösteriyor, ancak model performansını bağımsız olarak kanıtlamıyor.

Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https

Bonsai-demo, Bonsai 2 27B modelini yerel donanımda çalıştırmak için kurulum betikleri ve llama.cpp/MLX tabanlı demo arayüzleri sunar.

Neden yükseliyor · Yerel LLM çalıştırma ve düşük bitli model formatlarına ilgiyle örtüşüyor; 186 günde 3.148 yıldızın yanında son 28 günde 54 commit ve 25 farklı yazar, depoda kayda değer güncel aktivite olduğunu gösteriyor. Bu metrikler ilginin nedenini tek başına kanıtlamaz; artışın kaynağına dair veri verilmemiş.

Zero-overhead, terminal-native local-LLM orchestrator. Run any engine, any model via the same proxy.

The most advanced, fully offline client-side AI suite on Android today.

LLM frontend for roleplay and creative writing

Private on-device AI chat for Android — runs any GGUF model locally via llama.cpp with ARM-optimised SIMD. Zero network permissions, encry

Open-source control panel for the real llama.cpp: see where a model lands in your VRAM before loading, every llama-server flag per model, on

User friendly GUI for configuring and launching llama.cpp

Single-HTML monitoring dashboard for llama.cpp — per-slot sampling, plain-language tuning hints, router-mode aware, with built-in chat. Zero

Local AI for your whole house: chat, images and voice on your own GPU. Computes each model's flags, fits them to your VRAM, and hot-swaps th

llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.

JANG — GGUF for MLX. YOU MUST USE JANG_Q RUNTIME. Adaptive Mixed-Precision Quantization + Runtime for Apple Silicon

AI inference, packed simply. A blazing-fast, zero-dependency WebGPU runtime to run GGUF models directly in the browser. Features a symmetric

Self-hosted meeting transcription portal — speech-to-text, speaker diarization, LLM-corrected transcripts, structured summaries and Word min

Local LLM Server Manager + LlaMA.cpp + Chat

🏆Winning Project | ModelGate is a contract-aware AI control plane that ingests customer contracts, extracts SLA/privacy/routing constraints,

Hit your limit? Need privacy? Just swap the model, everything else stays

AI inference library for mobile devices

A web-based memory usage and performance calculator for Huggingface GGUF models

Benchmark llama.cpp on your own GPU/CPU boxes and compare against everyone else's — sweep runner, an sha256-keyed index of ~4M GGUF files, a

The old advice to avoid Windows for local LLMs used to be right. It isn't anymore. The fixes for display-GPU desktop crashes and WSL memory

Typed decisions from unstructured state: one forward pass, zero generated text. Local, deterministic, Jev-compatible. Not affiliated with ty