Havuz

Sleek, mobile-friendly web UI for NVIDIA LocateAnything-3B — open-vocabulary object detection & grounding on your own GPU, via one docker co

Dual-engine (llama.cpp + vLLM) LLM benchmarking pipeline for GGUF & safetensors on NVIDIA GPUs — speed, quality, live dashboard, publishable

Self-hosted homelab dashboard in one container — GPU, local-AI VRAM, Docker, systemd, energy costs. Read-only MCP server so AI agents can ex

Your reading list, as a podcast you own

Production-ready, bleeding-edge, upstream-first vLLM Docker image for the NVIDIA DGX Spark (GB10 / sm_121a), verified against real models on

Free Local Unity AI Motion Generate Tool.Based By Nvlab Kimodo.

让 Codex 白嫖 NVIDIA 免费顶级模型，一键接入 | Transparent proxy between Codex and NVIDIA NIM — use NVIDIA's free hosted top-tier models with Codex

The visual compute platform for AI and robotics — connecting agents, GPU workloads, simulation, training, and real robots through typed work

Object-storage-native KV cache for LLM inference & RL. Cross-restart, cross-conversation, cross-engine via shared S3 bucket.

Practical local LLM recipes and benchmarks for RTX 5060 Ti setups

Zero-dependency Go proxy for rotating free-tier AI API keys. No more 429s.

⚡ Adaptive multi-model LLM router — 80+ providers, Jev System One single-pass routing (model=jev-auto), pheromone-trail failover, parallel e

NeMo Helix: Make the agents you ship faster, more accurate, and safer.

Realtime TUI monitor for local LLM servers (ollama, llama.cpp). The only GPU monitor that knows what model is running and how much each toke

📊 Automated hourly benchmarks for 20+ NVIDIA NIM models — interactive dashboard, zero infra, self-hostable. Open-source & community-driven.

Local diagnostic CLI for NVIDIA DGX Spark (GB10). Detects power caps, UMA pressure, thermal risk, CUDA 13/SM_121 wheel mismatches, Docker is

Real-time hardware and LLM inference monitoring — GPU, CPU, memory, and vLLM metrics streamed to a dashboard.

Operator-grade GPU monitor for NVIDIA GPUs with native GB10 / DGX Spark coherent UMA support — PSI pressure, clock detection, ConnectX-7 net

DFlash vLLM for DGX Spark — Plug & Play Block-Diffusion Speculative Decoding

Self-hosted AI code review for GitHub pull requests.

Unified KV-cache compression for LLM inference: 12 Python-native methods, guarded add-on composition and routing, analytical capacity simula

Your adaptive AI agent for your work.

OpenAI-compatible gateway aggregating 8 free LLM providers with automatic failover, circuit breakers, and smart routing. 32+ models, zero c

Browser-based model and inference management for NVIDIA DGX Spark - inventory local and Hugging Face models, manage Ollama and LiteLLM, gene

Hermes Agent (NousResearch) sandboxed by NVIDIA OpenShell — hardware-enforced network/filesystem/syscall policy, full memory + gateway stack

The ultimate memory backend for OpenClaw and Claude Code. Persistent conversation memory with LLM fact extraction, foundation-model rerankin

TurboOCR, >200 img/s OmnidocBench. TensorRT FP16, PP-OCRv6, HTTP + gRPC

NVIDIA NemoClaw, OpenClaw, Hermes ve LangChain Deep Agents Code ajanlarını NVIDIA OpenShell sandbox’larında çalıştırmak için kurulum, inference yönetimi ve güvenlik politikaları sağlayan bir stack’tir.

Neden yükseliyor · 196 günde 22 bini aşan yıldız ve son 28 gündeki 751 commit ile 20 farklı yazar, güçlü ilgi ve yüksek geliştirme temposuna işaret ediyor. Agent güvenliği güncel ve gerçek bir ihtiyaç; NVIDIA markası ile birden fazla agent entegrasyonu da görünürlüğünü artırıyor. Ancak bu ölçüler tek başına üretim olgunluğunu veya güvenlik etkinliğini kanıtlamaz.

Legacy: self-hosted LLM/RAG stack installer for DGX Spark (arm64). The work continued as AGmind Systems Lab — measured local-LLM performance

Dashboard for InferenceX™, Open Source Continuous Inference | InferenceX 仪表板