Açık kaynak radarı

Havuz

Takip ettiğimiz konularda yükselen açık kaynak projeler — yıldız ivmesi, gerçek geliştirme aktivitesi ve AI değerlendirmesiyle.

repo · sayfa 2 / 2

Sırala

Yıldız/gün (hız)Son gün (★/gün)Son hafta (★/gün)Son ay (★/gün)Toplam yıldız AI önem skoru Bana uyum Commit (28g)Yazar (28g)En yeni

Konu

Tümü AI / LLM18 Veri9 Geliştirici araçları13 Diğer3 SaaS altyapı13 Web11

Süz

Yalnız hareketli Yalnız analizli≥ 0 ≥ 100 ≥ 500 ≥ 2.000

Yalnız hareketli, son 28 günde commit almamış repoları gizler (yıldızı olan ama bırakılmış projeler). Commit sayısı henüz ölçülmemiş repolar da gizlenir.

EtiketTüm GitHub etiketleri — repo sahiplerinin koyduğu topic'lergöster

Sırala:

Etiketler yükleniyor…

Aktif inference

51
juxhinr/bindwidth 112
Evidence-aware on-prem LLM inference sizing and TCO calculator
1,2/gün ort. +0 son gün +0 son 30g 0 commit 0 yazar JavaScript 01 Ağu 2026 güncellendi 02 Ağu 2026
ai calculator inference javascript llm on-prem sizing tco
112
52
azrtydxb/Fastllm-proxy 109
The lowest-overhead LLM router. Production-ready, highly available, one OpenAI-compatible endpoint in front of 80 providers and your own vLL
1,2/gün ort. +1 son gün +0 son 30g 63 commit 2 yazar Rust 06 Ağu 2026 güncellendi 3 gün önce
ai-gateway inference litellm llm llm-gateway load-balancing observability openai-api
109
53
FastCrest/tether 86
FastCrest Tether: the OSS edge-to-cloud AI deploy CLI. Optimize, verify, deploy across Jetson, RTX, Apple Silicon, AMD. Hybrid edge-cloud in
0,4/gün ort. +0 son gün +0 son 30g — commit Python 13 Nis 2026 güncellendi 4 gün önce
cli deployment edge-ai groot inference jetson onnx pi0
86
54
helasaoudi/llm-inspector 76
The htop for LLM inference see exactly where every GB of VRAM goes and get measured quantization savings.
0,7/gün ort. +0 son gün +0 son 30g 0 commit 0 yazar Python 15 Tem 2026 güncellendi 28 Eyl 2026
gpu-monitoring htop inference llm llm-inference memory-profiler ollama pip
76
55
AEON-7/vllm-dflash 53
DFlash vLLM for DGX Spark — Plug & Play Block-Diffusion Speculative Decoding
0,3/gün ort. +0 son gün +0 son 30g — commit Python 13 Nis 2026 güncellendi 06 Eki 2026
blackwell block-diffusion dflash dgx-spark docker inference llm nvfp4
53
56
infercrane/infercrane 53
Open-source infrastructure for the full inference lifecycle: deploy, observe, scale, optimize, and safely release self-hosted models behind
0,6/gün ort. +0 son gün +0 son 30g 0 commit 0 yazar Go 09 Ağu 2026 güncellendi 2 gün önce
ai-infrastructure aws gcp golang inference kubernetes llm mlops
53
57
JINO-ROHIT/tachyon 49
a LLM inference engine to run on consumer hardware
0,2/gün ort. +0 son gün +0 son 30g — commit Python 14 Mar 2026 güncellendi 15 Nis 2026
inference llm nlp pytorch transformer
49
58
back2matching/turboquant 46
First open-source TurboQuant KV cache compression for LLM inference. Drop-in for HuggingFace. pip install turboquant.
0,2/gün ort. +0 son gün +0 son 30g — commit Python 25 Mar 2026 güncellendi 29 gün önce
compression gpu huggingface inference kv-cache llm machine-learning pytorch
46
59
enescingoz/mac-llm-bench 45
Community benchmark database for running LLMs on Apple Silicon Macs
0,2/gün ort. +0 son gün +0 son 30g — commit Shell 05 Nis 2026 güncellendi 23 Nis 2026
apple-silicon benchmark inference llama-cpp llm llm-benchmark local-llm tokens-per-second
45
60
ChuangtaoChen-TUM/KVPacket 40
Recomputation-free, context-independent KV caching for large language models
0,2/gün ort. +0 son gün +0 son 30g — commit Python 16 Nis 2026 güncellendi 12 Ağu 2026
inference kvcache llm pytorch transformers
40
61
RightNow-AI/TIDE 34
Dynamic per-token early exit for LLM inference. Skip layers tokens don't need
0,1/gün ort. +0 son gün +0 son 30g — commit Python 17 Mar 2026 güncellendi 18 Eyl 2026
early-exit inference inference-api inference-engine llm optimization transformer
34
62
jcartu/rasputin-memory 33
The ultimate memory backend for OpenClaw and Claude Code. Persistent conversation memory with LLM fact extraction, foundation-model rerankin
0,1/gün ort. +0 son gün +0 son 30g — commit Python 26 Mar 2026 güncellendi 25 Nis 2026
ai knowledge-graph llm memory nvidia qdrant rag self-hosted
33
63
gdevenyi/huggingface-estimate 30
A web-based memory usage and performance calculator for Huggingface GGUF models
0,1/gün ort. +0 son gün +0 son 30g — commit JavaScript 17 Nis 2026 güncellendi 20 Tem 2026
estimate huggingface llama-cpp llamacpp llm memory qwen deepseek
30
64
MaincodeHQ/from-tin-to-tokens 29
A free textbook on building an LLM inference stack from scratch in Rust.
0,3/gün ort. +0 son gün +0 son 30g — commit 13 Ağu 2026 güncellendi 13 Ağu 2026
book gpu inference llm machine-learning rust systems-programming
29
65
coderredlab/runNburn 28
Memory-aware GGUF inference runtime with OpenAI-compatible serving
0,3/gün ort. +0 son gün +0 son 30g — commit Rust 18 Tem 2026 güncellendi 27 Ağu 2026
cuda gguf inference llm metal openai-compatible rust
28
66
pur4v/p2ptokens 28
Distributed, peer-to-peer, decentralized network for LLM inference — peers seed & leech completions, metered by BitTorrent-protocol-style up
0,2/gün ort. +0 son gün +0 son 30g — commit Rust 12 Tem 2026 güncellendi 15 Tem 2026
ai decentralized distributed inference libp2p llm llm-inference p2p
28
67
TaewoooPark/DRIFT 26
🧠 One LLM, split across a Mac (Apple MPS) + a Windows PC (NVIDIA CUDA) — heterogeneous pipeline inference over a framework-neutral wire, bit
0,2/gün ort. +0 son gün +0 son 30g — commit Python 30 Haz 2026 güncellendi 06 Tem 2026
apple-silicon cuda decentralized distributed-inference edge-ai gemma heterogeneous-computing inference
26
68
tomiholtz/s3-files-ai-sdk 26
Give Vercel AI SDK agents a real persistent filesystem with Amazon S3 Files.
0,4/gün ort. +0 son gün +0 son 30g — commit Python 04 Eyl 2026 güncellendi 04 Eyl 2026
ai android benchmark devtools edge evaluation inference jvm
26
69
videlalvaro/emilio 24
Transformer inference via unconventional compute: a single algebraic primitive, a tag-system scheduler, and Apple's Neural Engine through co
0,1/gün ort. +0 son gün +0 son 30g — commit Python 15 Nis 2026 güncellendi 26 Nis 2026
apple-silicon inference llm machine-learning metal rust transformer
24
70
usedotai/dot-loom 165
Provider-pluggable orchestration runtime for multi-model AI inference. ( Sakana Fugu style )
1,2/gün ort. +0 son gün -0,1 son 30g 0 commit 0 yazar JavaScript 23 Haz 2026 güncellendi 16 Tem 2026
agents ai byok dot inference llm model-routing multi-agent
165
71
Tele-AI/Fluxon 126
An AI-native distributed data plane built in Rust that supports high performance RPC, KV Cache, Message Queue, and File & Object Acceleratio
0,9/gün ort. +0 son gün -0,1 son 30g — commit Rust 12 Haz 2026 güncellendi 7 gün önce
ai-native memory-pool message-queue nosql rpc mooncake distributed-cache inference
126