Havuz

GLM-5.2 NVIDIA NIM Go 客户端 / OpenAI 兼容反向代理 — 自动化 hCaptcha 凭证池 + 流式推理，支持 Docker 部署。Go client & OpenAI-compatible proxy for NVIDIA Playground's

Hands-on GPU/HPC infrastructure operations: K8s GPU scheduling, HAMi sharing, Slurm, observability & vLLM inference. Learn it free on a lapt

Automate ongoing market research with an AI planner, Jules agents, live conversations, and organized GitHub reports.

A local music generation and remix studio built on audio.cpp. Generate, repaint, split into stems and swap voices, with every take kept and

Distill teacher chains-of-thought into a LoRA adapter via a strict boxed-answer format contract + two-phase Train→Nudge (silver-medal NVIDIA

DFlash vLLM for DGX Spark — Plug & Play Block-Diffusion Speculative Decoding

Serving 4-bit Qwen3.8-27B on a single DGX Spark (GB10): 75 tok/s single-stream, 246 tok/s aggregate at 8-way concurrency. NVFP4 vs MixedInt4

CPU-side action routing, context compression, and causal memory for AI agents — matches an LLM-everything agent at 58% fewer LLM calls and ~

Operator-grade GPU monitor for NVIDIA GPUs with native GB10 / DGX Spark coherent UMA support — PSI pressure, clock detection, ConnectX-7 net

The ultimate memory backend for OpenClaw and Claude Code. Persistent conversation memory with LLM fact extraction, foundation-model rerankin

The visual compute platform for AI and robotics — connecting agents, GPU workloads, simulation, training, and real robots through typed work

Windows utility focused on cuda setup, nvidia local AI, and cuda environment for local AI workflows.

Convert NVIDIA ARDY motion output (.npz) to BVH/FBX for Blender, Unity, Unreal

Object-storage-native KV cache for LLM inference & RL. Cross-restart, cross-conversation, cross-engine via shared S3 bucket.

Local desktop tool for managing multiple SSH servers: GPU/process monitoring, SFTP file manager and high-speed server-to-server transfer (El

Catch local LLMs spilling into the CPU. One run shows GPU placement, prefill, decode, memory, power and a verdict.

Headless Steam Big Picture in a rootless Podman container, streamed to a Steam Deck or any Moonlight client. Shares your game library, not y

⚡ Adaptive multi-model LLM router — 80+ providers, Jev System One single-pass routing (model=jev-auto), pheromone-trail failover, parallel e

Live per-node GPU, host, and vLLM stats for DGX Spark clusters, in your terminal

MCP server for NVIDIA GPU metrics give AI agents real-time access to GPU utilization, memory, temperature, and power

The old advice to avoid Windows for local LLMs used to be right. It isn't anymore. The fixes for display-GPU desktop crashes and WSL memory

Transactional cross-platform installer for DLSS5-Feeder, RenoDX, ReShade, and LumeniteFX

Docker compose configs for serving Qwen3.8-27B on a DGX Spark (GB10): vLLM+MTP current, SGLang+DSPARK + FP8 rollback stacks

Realtime TUI and web dashboard for multi-node NVIDIA DGX Spark clusters, with 200G ConnectX-7 RDMA fabric telemetry

Realtime TUI monitor for local LLM servers (ollama, llama.cpp). The only GPU monitor that knows what model is running and how much each toke

A code reviewer that reports only what it can prove: a test that shows the bug, or the data that confirms the risk. Open source, built by a

See every GPU in your lab in the terminal, the browser or a report — who holds each GPU, which ones sit idle. One Python file, nothing to in

High-performance CUDA inference engine for Qwen models, written from scratch in C++/CUDA

Serve DeepSeek and Qwen, run an on-demand model library, and fine-tune with Unsloth QLoRA on 2x NVIDIA DGX Spark. TP=2 vLLM lanes behind one

Serving Qwen3.8-27B-FP8 on a single DGX Spark (GB10): 7.88 to 58.5 tok/s single-stream from decode strategy alone, weights untouched. Specul