Havuz
Takip ettiğimiz konularda yükselen açık kaynak projeler — yıldız ivmesi, gerçek geliştirme aktivitesi ve AI değerlendirmesiyle.
Yalnız hareketli, son 28 günde commit almamış repoları gizler (yıldızı olan ama bırakılmış projeler). Commit sayısı henüz ölçülmemiş repolar da gizlenir.
EtiketTüm GitHub etiketleri — repo sahiplerinin koyduğu topic'lergöster
Etiketler yükleniyor…
- 1
Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimiz
6/gün ort. +3 son gün 155 commit 3 yazar C++ 10 Tem 2026 güncellendi bugün - 2
Inference-native Tokenmaxxing Agent Harness for Loop Engineering
3,8/gün ort. +0 son gün 0 commit 0 yazar TypeScript 08 Haz 2026 güncellendi 18 Haz 2026 - 3
Entrpi/ds4, a Blackwell CUDA perf fork of antirez/ds4 on NVIDIA DGX Spark: one-command install, ~3x upstream prefill, ~1.5x decode, DSpark,
2,3/gün ort. +0 son gün 0 commit 0 yazar Shell 12 May 2026 güncellendi 27 Ağu 2026 - 4
Run any local LLM engine, auto-tuned to your GPU — polished web UI + OpenAI/Anthropic-compatible API. Point Claude Code at your own machine
2/gün ort. +3 son gün 517 commit 5 yazar TypeScript 12 Haz 2026 güncellendi 5 gün önce - 5
Your AI intranet: network the computers you already own for inference and training.
1,9/gün ort. -1 son gün 119 commit 3 yazar Python 17 Haz 2026 güncellendi 2 gün önce - 6
Provider-pluggable orchestration runtime for multi-model AI inference. ( Sakana Fugu style )
1,2/gün ort. +0 son gün 0 commit 0 yazar JavaScript 23 Haz 2026 güncellendi 16 Tem 2026 - 7
The lowest-overhead LLM router. Production-ready, highly available, one OpenAI-compatible endpoint in front of 80 providers and your own vLL
1,2/gün ort. +1 son gün 63 commit 2 yazar Rust 06 Ağu 2026 güncellendi 3 gün önce - 8
Camelid: a Rust-native local inference backend with evidence-gated model compatibility.
1,2/gün ort. +0 son gün 75 commit 3 yazar Rust 01 May 2026 güncellendi 20 gün önce - 9
Evidence-aware on-prem LLM inference sizing and TCO calculator
1,2/gün ort. +0 son gün 0 commit 0 yazar JavaScript 01 Ağu 2026 güncellendi 02 Ağu 2026 - 10
Frontier: A Discrete-Event Simulator for Modern LLM Serving
1/gün ort. -1 son gün 87 commit 1 yazar Python 21 May 2026 güncellendi 4 gün önce - 11
Zero-leak online detection of LLM decoding corruption and Free Web Search for your AI agents! Catch repetition loops, language drift and gar
1/gün ort. -1 son gün 0 commit 0 yazar Python 20 Tem 2026 güncellendi 21 Eyl 2026 - 12
CPU-first LLM inference server on llama.cpp. Runs useful models on free-tier ARM boxes; rewriting the input made it ~6x faster and more accu
0,9/gün ort. +0 son gün 1 commit 1 yazar C++ 06 Tem 2026 güncellendi 24 gün önce - 13
Run a 110B on a 2016 PC with 16 GB RAM. Know your tok/s before you download. Placement beats budget: predicts speed + memory fit for any GGU
0,9/gün ort. +0 son gün — commit Python 21 Tem 2026 güncellendi 29 gün önce - 14
Tree-based speculative decoding for Apple Silicon (MLX). ~10-15% faster than DFlash on code, ~1.5x over autoregressive. First MLX port with
0,7/gün ort. +0 son gün — commit Python 14 Nis 2026 güncellendi 15 Nis 2026 - 15
The htop for LLM inference see exactly where every GB of VRAM goes and get measured quantization savings.
0,7/gün ort. +0 son gün — commit Python 15 Tem 2026 güncellendi 28 Eyl 2026 - 16
Distributed LLM inference fabric for heterogeneous local clusters. Features zero-copy SPSC ring buffers, automated tuning, and an OpenAI-com
0,6/gün ort. +0 son gün — commit Rust 19 Haz 2026 güncellendi dün - 17
Open-source infrastructure for the full inference lifecycle: deploy, observe, scale, optimize, and safely release self-hosted models behind
0,6/gün ort. +0 son gün — commit Go 09 Ağu 2026 güncellendi 2 gün önce - 18
Network-faithful simulation of LLM serving and training deployments
0,5/gün ort. +0 son gün — commit Python 03 Ağu 2026 güncellendi 28 gün önce - 19
Open-source self-hosted home AI inference platform for AMD Strix Halo — multi-backend slots, OpenAI-compatible gateway, Vue 3 + FastAPI + sy
0,5/gün ort. +0 son gün — commit Python 15 May 2026 güncellendi bugün - 20
CPU-only, pure-Rust implementation of LiquidAI's LFM2.5-8B-A1B LLM
0,5/gün ort. +0 son gün — commit Rust 04 Haz 2026 güncellendi 16 Haz 2026 - 21
Frontier-class LLM inference on a laptop CPU — gpt-oss:20b at ~110 tok/s on Apple M4 Max, 7.5x llama.cpp, no GPU. From-scratch NEON/SME kern
0,5/gün ort. +0 son gün — commit Rust 04 Tem 2026 güncellendi 11 Ağu 2026 - 22
CPU-optimized LLM inference engine (C)
0,4/gün ort. +0 son gün — commit C 06 Haz 2026 güncellendi 6 gün önce - 23
Production-ready, bleeding-edge, upstream-first vLLM Docker image for the NVIDIA DGX Spark (GB10 / sm_121a), verified against real models on
0,4/gün ort. +0 son gün — commit Python 20 May 2026 güncellendi dün - 24
Native AI inference for PHP 8.3+ - run ONNX, GGUF (llama.cpp) and RubixML models directly in your PHP process via FFI. Chat, streaming, embe
0,3/gün ort. +3 son gün — commit PHP 04 Tem 2026 güncellendi 18 gün önce - 25
qMLX: Custom inference engine for Qwen 3.5 122B on Apple Silicon, extending MLX with hybrid attention support, SSD-backed KV cache, and RYS
0,3/gün ort. +0 son gün — commit Python 09 Tem 2026 güncellendi 5 gün önce - 26
Run AI models on Apple Silicon and Raspberry Pi
0,3/gün ort. +0 son gün — commit Rust 13 May 2026 güncellendi bugün - 27
SGLang Docker image for AMD Strix Halo (gfx1151 / Radeon 8060S)
0,3/gün ort. +0 son gün — commit Python 13 May 2026 güncellendi 17 Eyl 2026 - 28
ML model ports (ASR · TTS · LLM · VLM · vision · audio codecs) on the rlx multi-backend compiler + runtime — CPU/Metal/MLX/CUDA/wgpu
0,2/gün ort. +0 son gün — commit Rust 22 May 2026 güncellendi 2 gün önce