Açık kaynak radarı

Havuz

Takip ettiğimiz konularda yükselen açık kaynak projeler — yıldız ivmesi, gerçek geliştirme aktivitesi ve AI değerlendirmesiyle.

repo · sayfa 1 / 2

Sırala

Yıldız/gün (hız)Son gün (★/gün)Son hafta (★/gün)Son ay (★/gün)Toplam yıldız AI önem skoru Bana uyum Commit (28g)Yazar (28g)En yeni

Konu

Tümü AI / LLM18 Veri9 Geliştirici araçları13 Diğer3 SaaS altyapı13 Web11

Süz

Yalnız hareketli Yalnız analizli≥ 0 ≥ 100 ≥ 500 ≥ 2.000

Yalnız hareketli, son 28 günde commit almamış repoları gizler (yıldızı olan ama bırakılmış projeler). Commit sayısı henüz ölçülmemiş repolar da gizlenir.

EtiketTüm GitHub etiketleri — repo sahiplerinin koyduğu topic'lergöster

Sırala:

Etiketler yükleniyor…

Aktif mixture-of-experts

1
FareedKhan-dev/kimi-k3-in-c önem 38gpt6-luna uyum 20gpt6-luna 9.465
kimi-k3-in-c, Kimi K3 modelinde inference çalıştırmayı hedefleyen bağımlılıksız bir C99 motorudur.
Neden yükseliyor · 57 günde 8.683 yıldız alması ve Kimi K3'ü 8 GB RAM'li CPU'da çalıştırma iddiası dikkat çekiyor; ancak son 28 gündeki 12 commit'in tek yazardan gelmesi, ilginin bağımsız teknik doğrulama veya geniş katkıcı tabanıyla desteklendiğini göstermiyor.
100,7/gün ort. +191 son gün 0 commit 0 yazar C 01 Ağu 2026 güncellendi 02 Eki 2026
avx2 c99 cpu-inference deep-learning from-scratch inference-engine kimi-k3 linear-attention
9.465
2
mw00/project-maya 2.448
Project Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own GPU
87,4/gün ort. +55 son gün 897 commit 20 yazar Cuda 06 Eki 2026 güncellendi dün
cuda glm glm-5 llm llm-inference local-llm mixture-of-experts moe
2.448
3
wici-ai/inferssd 265
Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.
22,1/gün ort. +30 son gün 185 commit 3 yazar C++ 22 Eki 2026 güncellendi dün
apple-silicon cuda gguf inference llama-cpp llm metal mixture-of-experts
265
4
peonist-ai/halogen-flash-server önem 56gpt6-luna uyum 25gpt6-luna 1.196
halogen-flash-server, Qwen3.8-Flash-Next modelini AMD Strix Halo (gfx1151) donanımında çalıştırmak için özelleştirilmiş bir inference server'dır.
Neden yükseliyor · 32 günlük repo için 722 yıldız ve son 28 günde 99 commit dikkat çekiyor. README, belirli donanım üzerindeki ölçümleri ve ölçüm koşullarını açıklıyor; ancak performans iddiaları proje tarafından sunulmuş ve bağımsız doğrulama bilgisi burada yok. 99 commit'in tek yazardan gelmesi geliştirme hızını gösterirken bakım kapasitesine dair kanıtı sınırlıyor.
17,3/gün ort. +15 son gün 67 commit 1 yazar Shell 26 Ağu 2026 güncellendi 4 gün önce
amd gfx1151 gpu-inference hip inference-engine llm llm-serving local-llm
1.196
5
synchopate/llama-modchip 71
♟️ llama-modchip v2.1: Run 30B Sparse MoE LLMs on Pure CPU (0 GPUs) at 20–60.4 tok/s with a 256K Context Window via a 1.64MB Stockfish-PVS +
14,2/gün ort. +2 son gün 15 commit 1 yazar Python 29 Eki 2026 güncellendi dün
avx512 cpu-inference hpc llama-cpp mamba2 mixture-of-experts nemotron speculative-decoding
71
6
prabanta-dev/janas 583
37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cp
13,3/gün ort. +17 son gün 62 commit 1 yazar C 20 Eyl 2026 güncellendi dün
avx2 c cpu-inference gguf inference-engine linux llm local-llm
583
7
DevDock-AI/Speedy 25
Qwen3.8-Flash-Next (125B MoE) up to 1M context on one or two RTX cards (tuned on 3080 10gb). A measured, tuned and benchmarked fork of Str
12,5/gün ort. +0 son gün 54 commit 7 yazar C++ 01 Kas 2026 güncellendi 2 gün önce
cuda inference llm long-context mixture-of-experts multi-gpu qwen rtx-3080
25
8
carloslfu/slotstream önem 64gpt6-luna uyum 38gpt6-luna 645
Slotstream, büyük bir MoE modelini SSD’den parça parça yükleyip yoğun kullanılan expert’leri bellekte önbelleğe alarak Apple Silicon Mac’lerde çalıştıran yerel bir inference engine’dir.
Neden yükseliyor · README, 48 GB M5 Pro üzerinde belirli koşullarda 15.86 tok/s ölçümü ve prompt işleme iyileştirmeleri yayımlıyor; son 28 günde 271 commit ve 5 farklı yazar da yoğun geliştirme faaliyetine işaret ediyor. Ancak proje yalnızca 30 günlük ve mevcut sürüm için nitelikli tam yanıt hızı ölçümünün hâlâ beklediği belirtiliyor.
9,6/gün ort. +5 son gün 124 commit 3 yazar Swift 28 Ağu 2026 güncellendi 2 gün önce
apple-silicon claude-code inference-engine llm llm-inference local-ai local-llm macos
645
9
Magnvs7/Promethevs 85
PROMETHEVS: run the full DeepSeek-V4.1-Flash-1017 (510 GB) on a gaming PC with 64 GB RAM and a 12 GB GPU. PROMETHEVS engine (compress-then-c
6,5/gün ort. +55 son gün 12 commit 1 yazar 21 Eki 2026 güncellendi 12 gün önce
deepseek llm local-inference mixture-of-experts quantization consumer-hardware deepseek-v4 llm-inference
85
10
Helldez/BigMoeOnEdge 703
Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimiz
6,1/gün ort. +6 son gün 155 commit 3 yazar C++ 10 Tem 2026 güncellendi dün
android cpp edge-ai gemma gguf inference llama-cpp llm
703
11
leonxger/deepseek-colab 24
Uncensored DeepSeek-V4.1-Flash IQ2_XS on Google Colab
6/gün ort. +10 son gün 1 commit 1 yazar Python 30 Eki 2026 güncellendi 5 gün önce
colab cuda deepseek deepseek-v4 gguf google-colab gpu llama-cpp
24
12
DingoOz/llm-visuals 155
Live truecolor terminal dashboard for a locally running LLM: tok/s, TTFT, GPUs, context, MTP acceptance, layer and real expert routing (llam
2,9/gün ort. +2 son gün 107 commit 4 yazar Rust 11 Eyl 2026 güncellendi dün
gpu-monitoring llama-cpp llm mixture-of-experts ratatui rust tui
155
13
benmaster82/Pithos 18
A dependency-free C inference engine for Liquid AI's LFM2 / LFM2.5 models. Terminal chat, an OpenAI-compatible server, a web agent and a ter
2,6/gün ort. +4 son gün — commit C 27 Eki 2026 güncellendi dün
lfm2 lfm25 ai-agent avx2 c coding-agent cross-platform gguf
18
14
zhangshuibai/molten 23
Run a coding model at 300+ tok/s on your Mac. Native Rust + Metal inference engine for LiquidAI LFM2.5-24B-A2B (MLX 4-bit) on Apple Silicon.
2,6/gün ort. +0 son gün — commit Metal 25 Eki 2026 güncellendi 6 gün önce
apple-silicon gpu-kernels inference-engine inference-optimization lfm2 liquid-ai llama-cpp llm
23
15
JustVugg/lumabri 211
Run large AI models across your computers and servers. Powered by Colibri. Pure C.
2,3/gün ort. +1 son gün 327 commit 1 yazar C 04 Ağu 2026 güncellendi dün
c cluster-computing colibri distributed-inference llm-inference local-ai mixture-of-experts peer-to-peer
211
16
giannisanni/pulsar 234
SSD-streaming inference engine for giant MoE models (Rust + CUDA). GLM 5.2 743B at 2 tok/s and Hy3 295B at 7 tok/s on two consumer 16GB GPUs
2,1/gün ort. +3 son gün 0 commit 0 yazar Rust 13 Tem 2026 güncellendi 01 Eyl 2026
cuda gguf glm inference-engine llm local-llm mixture-of-experts moe
234
17
surya-koritala/condor 34
Qwen3.8-Flash-Next (180B MoE) on one 12-16 GB NVIDIA GPU, Linux or Windows. Own engine, own compression.
1,7/gün ort. +0 son gün — commit Python 14 Eki 2026 güncellendi 14 gün önce
cuda inference linux llm local-llm mixture-of-experts nvidia qwen
34
18
wuwangzhang1216/abliterix 278
Automated alignment adjustment for LLMs — direct steering, LoRA, and MoE expert-granular abliteration, optimized via multi-objective Optuna
1,2/gün ort. +3 son gün — commit Python 07 Mar 2026 güncellendi 2 gün önce
abliteration decensoring llm lora optuna pytorch transformers uncensored
278
19
FonaTech/Project_Chronos 206
⚡ Zero-Stall MoE Inference via Lookahead Prediction & Async DMA Prefetching. Optimized for SSD I/O with Hybrid MLA+Sliding Window Attention.
1/gün ort. +0 son gün — commit Python 19 Nis 2026 güncellendi 26 Nis 2026
high-throughput mixture-of-experts predictive-inference sliding-window-attention streaming-llm async-dma dual-layer-moe io-latency-hiding
206
20
1picassoai/kraits 14
Run stock llama.cpp with the stock Unsloth Qwen3.6-35B-A3B 4-bit on a 16 GB Mac.
1/gün ort. +0 son gün — commit Shell 20 Eki 2026 güncellendi 9 gün önce
apple-silicon ggml gguf llama-cpp llm llm-inference local-ai local-llm
14
21
fulvian/engraft-ngram 57
ENGRAFT: write facts into an LLM's n-gram (Engram) memory table as a removable overlay: 100 facts in a 9 MB file, no weights touched, verifi
1/gün ort. +0 son gün — commit Python 05 Eyl 2026 güncellendi 30 Eyl 2026
deepseek engram gguf interpretability knowledge-editing knowledge-injection llama-cpp llm
57
22
BobClawblaw/deepseek-v41-flash-mlx-m5-ultra 14
DeepSeek-V4.1-Flash-1017 on one 256 GB M5 Ultra: 1M context, 70.7-104.9 tok/s decode with DSpark drafts, 1,739-1,867 tok/s cold prompts (8k-
0,9/gün ort. +1 son gün — commit Python 19 Eki 2026 güncellendi 12 gün önce
apple-silicon deepseek deepseek-v4 llm llm-inference long-context m5-ultra metal
14
23
Tylogi/TyloQuant 95
Get more intelligence from every bit. Better quantization formats and smarter calibration let larger, stronger models run smoothly on the ha
0,9/gün ort. +1 son gün — commit C++ 24 Tem 2026 güncellendi 5 gün önce
apple-silicon cuda deepseek gemma gguf llm llm-inference llm-quantization
95
24
Singularity-Compute/super-decider 19
Decisions, not essays: a choice, a yes or no, or a score with a calibrated probability. Open weights, Jev-compatible API, adaptive thinking.
0,9/gün ort. +0 son gün — commit Python 13 Eki 2026 güncellendi 9 gün önce
ai-agents calibration classification decision-model diffusion-llm guardrails jev llm-routing
19
25
tuff-app/TUFF 69
The local AI app built for the Mac. Run LLMs like Qwen, Gemma and GPT-OSS on Apple Silicon, including models far bigger than your Mac's memo
0,9/gün ort. +0 son gün — commit Swift 16 Ağu 2026 güncellendi 2 gün önce
ai-chat apple-silicon gemma gpt-oss llm llm-inference local-ai local-ai-models
69
26
AarambhDevHub/aarambh-studio 112
🦀 Decoder-only LLM built from scratch in pure Rust using Candle — no Python, no PyTorch. Gated DeltaNet + sparse attention, fine-grained MoE
0,8/gün ort. +1 son gün — commit Rust 24 Haz 2026 güncellendi 21 Ağu 2026
ai-agents candle decoder-only deep-learning dora from-scratch gguf grpo
112
27
gpillon/ignis 51
OpenAI-compatible inference server for Qwen3.8 on one RTX 5090 / RTX PRO 6000: the 27B at ~170 tok/s (peaks ~370), Flash-Next (125B MoE) at
0,8/gün ort. +1 son gün — commit Rust 01 Eyl 2026 güncellendi dün
blackwell coding-agents cuda inference-engine llm llm-inference local-llm mixture-of-experts
51
28
gittensor-ai-lab/sparkinfer 92
Fastest MoE/LLM inference runtime for consumer and edge Blackwell GPUs. SN74 on Gittensor.
0,7/gün ort. +1 son gün — commit C++ 22 Haz 2026 güncellendi 24 gün önce
agentic-ai bittensor blackwell cuda edge-ai gittensor gpu gpu-programming
92
29
FareedKhan-dev/glm-5.2-in-c 75
GLM-5.2, a 744 billion parameter mixture of experts model, in a pure C inference engine: quantized to int4, experts streamed from disk, depl
0,7/gün ort. +0 son gün — commit C 15 Tem 2026 güncellendi 15 Tem 2026
c consumer-hardware cpu-inference cuda deep-learning edge-ai glm inference-engine
75
30
AMD-AGI/Instella-MoE 80
Instella MoE is a fully open state-of-the-art Mixture-of-Experts language model, trained end-to-end on AMD Instinct™ GPUs.
0,7/gün ort. +0 son gün — commit Python 07 Tem 2026 güncellendi 02 Eyl 2026
amd instella llm mixture-of-experts rocm
80
31
DaoyuanLi2816/tracedistill 85
Distill teacher chains-of-thought into a LoRA adapter via a strict boxed-answer format contract + two-phase Train→Nudge (silver-medal NVIDIA
0,6/gün ort. +0 son gün — commit Python 22 Haz 2026 güncellendi 27 Tem 2026
chain-of-thought fine-tuning kaggle llm lora mamba mixture-of-experts nemotron
85
32
RustingStudio/RustingStrata 14
Pure-Rust MoE inference engine for Qwen3.5/3.6 GGUF. CPU+GPU hybrid experts, NVRTC CUDA kernels, OpenAI-compatible server. 2x llama.cpp pref
0,6/gün ort. — commit Rust 10 Eki 2026 güncellendi 2 gün önce
cuda gguf inference llama-cpp llm local-llm mixture-of-experts moe
14
33
prayangshuuu/hummingbird 61
hummingbird is a lightweight, zero dependency runtime for massive open source Mixture of Experts (MoE) language models. It unifies SSD, RAM,
0,6/gün ort. +0 son gün — commit C 21 Tem 2026 güncellendi 31 Tem 2026
ai-inference artificial-intelligence c17 cross-platform deepseek glm gpt-oss high-performance-computing
61
34
arizqi/cpubrrr 57
Frontier-class LLM inference on a laptop CPU — gpt-oss:20b at ~110 tok/s on Apple M4 Max, 7.5x llama.cpp, no GPU. From-scratch NEON/SME kern
0,5/gün ort. +1 son gün — commit Rust 04 Tem 2026 güncellendi 11 Ağu 2026
apple-silicon cpu gpt-oss inference llm mixture-of-experts neon quantization
57
35
DominikBucko/qwen38-flash-next-3090 13
Run Qwen3.8-Flash-Next on ONE RTX 3090 (24 GB) + 64 GB RAM: 128K context, up to 2,100 tok/s prefill, 43–51 tok/s decode. vLLM runtime with h
0,4/gün ort. +0 son gün — commit Python 30 Eyl 2026 güncellendi 30 Eyl 2026
128k-context 24gb-vram consumer-gpu cpu-offloading int4 kv-cache-quantization llm llm-inference
13
36
WestWaters/pollard-weights 33
A tiered-memory system design for workloads that don't fit in RAM: measure the working set, pin the hot tier, stream the cold tier from flas
0,4/gün ort. +0 son gün — commit Python 07 Ağu 2026 güncellendi dün
diagnostics exl3 gguf gptq llama-cpp llm low-resource mac
33
37
shyringo/deepseek-v4-flash-0731-in-c 28
Run the native 284B-A13B DeepSeek-V4-Flash-0731 LLM locally on one laptop CPU: pure C, 8 GB RAM minimum, no GPU, best TPOT 0.892 s/token, re
0,4/gün ort. +0 son gün — commit C 16 Ağu 2026 güncellendi 09 Eyl 2026
ai c cpu-inference deepseek deepseek-v4 generative-ai inference inference-engine
28
38
siris9476/pulsarforge 23
0,3/gün ort. +0 son gün — commit C 25 Ağu 2026 güncellendi 10 Eyl 2026
avx2 c11 cpu-inference cpu-only disk-streaming gguf inference llama-cpp
23
39
rayl15/Godwit 25
Run GPT-OSS-120B on a 16 GB Mac. Streams mixture-of-experts weights from SSD so only the 2 GiB trunk stays resident. Swift + Metal, no depen
0,3/gün ort. +0 son gün — commit Swift 04 Ağu 2026 güncellendi 07 Ağu 2026
apple-silicon gpt-oss inference llm local-llm macos metal mixture-of-experts
25
40
melonmath/microkimi 26
The Kimi K3 and DeepSeek-V4-Flash-0731 architectures, reimplemented from scratch in pure Rust (zero dependencies) and verified 1:1 against t
0,3/gün ort. +0 son gün — commit Rust 31 Tem 2026 güncellendi 19 Ağu 2026
apple-silicon deepseek deepseek-v4 from-scratch inference-engine kimi linear-attention llm
26
41
egesabanci/reap-mlx 41
MLX-compatible REAP for pruning MoE models on Apple Silicon
0,3/gün ort. +0 son gün — commit Python 29 May 2026 güncellendi 9 gün önce
apple-silicon llm mixture-of-experts mlx mlx-lm moe model-compression reap
41
42
Joakimpalm-Zen/xyntetik-runner 30
Local inference you can prove. A single-binary GGUF engine in C: serves, scores, and trains LoRA through the quantized weights it deploys, b
0,3/gün ort. +0 son gün — commit C 10 Tem 2026 güncellendi dün
agents c constrained-decoding cuda edge-ai fine-tuning gguf inference
30
43
ruashots/flashnext-2x3090 17
What I run on my inference server: Qwen3.8-Flash-Next on two RTX 3090s, and how I got here
0,3/gün ort. +0 son gün — commit Python 27 Ağu 2026 güncellendi 23 gün önce
benchmark llama-cpp llm-inference local-llm mixture-of-experts qwen rtx-3090
17
44
hec-ovi/gamentic 29
Self-hosted, browser-based AI dungeon RPG, fully local on an AMD Strix Halo APU: narrator + per-character agents on one local LLM (Gemma 4 2
0,2/gün ort. +0 son gün — commit Python 09 Haz 2026 güncellendi 26 Tem 2026
agentic ai-dungeon ai-rpg amd-strix-halo comfyui docker-compose fastapi flux
29
45
NeuraLiying/Prism-MoE 31
Official implementation of Prism-MoE, an efficient dense-to-MoE conversion framework for visual autoregressive generation. ICML 2026 Poster.
0,2/gün ort. +0 son gün — commit Python 25 May 2026 güncellendi 03 Tem 2026
image-generation mixture-of-experts visual-autoregressive-model dense-to-moe
31
46
peonist-ai/crucible 13
MoE expert compression toolkit — prune, merge, and forge specialist models for local inference.
0,2/gün ort. +0 son gün — commit Python 27 Ağu 2026 güncellendi 7 gün önce
expert-pruning gguf llama-cpp llm llm-inference local-llm machine-learning mixture-of-experts
13
47
thc1006/qwen3.6-speculative-decoding-rtx3090 35
llama.cpp speculative decoding measured on one RTX 3090, Qwen3.6-35B-A3B UD-Q4_K_XL, commit 3737e4137. Published figures are re-derived from
0,2/gün ort. +0 son gün — commit Python 21 Nis 2026 güncellendi 15 gün önce
ampere benchmark cuda ggml inference-benchmark llama-cpp local-llm mixture-of-experts
35
48
MerkyorLynn/lynn-engine 28
Lynn 原生 LLM 推理引擎 · W4A8/NVFP4 量化 · 自写 CUDA/Triton kernel · MoE · 投机解码 | Lynn-native LLM inference engine for NVIDIA Blackwell
0,2/gün ort. +0 son gün — commit Python 08 May 2026 güncellendi 08 Haz 2026
ai-inference blackwell cuda deep-learning fp8 gpu gpu-acceleration high-performance-computing
28
49
pablo-reyes8/kimi-k3-pytorch 14
Build and train a mini Kimi K3 from scratch — a pure-PyTorch playground from a custom 88M model to 2T-scale LLM profiles.
0,1/gün ort. +0 son gün — commit Python 28 Tem 2026 güncellendi 2 gün önce
deep-learning generative-ai kimi-k3 kv-cache llm llm-training llm-training-from-scratch machine-learning
14
50
Dewaldnel11/LightLX 18
Run models too big for RAM on Apple Silicon — any Hugging Face model, dense or MoE — by streaming weights from disk
0,1/gün ort. +0 son gün — commit Python 22 Haz 2026 güncellendi 15 Eyl 2026
apple-silicon inference llm local-llm macos mixture-of-experts mlx mlx-lm
18