Havuz

Qwen 3.8 27B on a $1,400 Strix Halo: frozen optimal config, 262k needle-exact retrieval, vision fixed, delegation-card certified

Local LLM Server Manager + LlaMA.cpp + Chat

SNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere sm_86, 2× A5000/3090). Qwen3.6-35B-A

WarMatrix 2026: Next-Gen Tactical Simulation & AI Command Console

一个让 Claude Code 调用 Codex 干活，并可以同时调用多个模型（GPT、Kimi、DeepSeek 等）的 MCP 工具。

A private Claude-Code-style coding agent for Apple Silicon — run chat, code, and local model workflows on-device. MLX-native, Ollama/OpenAI

ApocData · AI-native financial database for China A-share market. Drop-in Skill / MCP for Claude,ChatGPT, Qwen, Kimi, DeepSeek agents.

Continuum — the agent runtime by ShyftLabs. Build, orchestrate, ship.

Git-Native Coding Agent for Mac

Free AI models in VS Code Copilot Chat / DSH via browser auth. No API keys required.

DFlash vLLM for DGX Spark — Plug & Play Block-Diffusion Speculative Decoding

Serving 4-bit Qwen3.8-27B on a single DGX Spark (GB10): 75 tok/s single-stream, 246 tok/s aggregate at 8-way concurrency. NVFP4 vs MixedInt4

A lightweight, general-purpose harness for tool-using LLM agents, fair benchmark evaluation, harness baselines, and personal assistant workf

We have caveman system prompts and skills for AI models to reduce token use, why not try bake it into the model itself with fine-tuning?

Pure-Rust, memory-safe, CPU-only runtime for Qwen3-TTS zero-shot voice cloning: no Python, no ML framework, no GPU. Verified seam-by-seam ag

Build & prompt Qwen3.x agents in their native dialect — extracted from qwen-code & Qwen-Agent

llama.cpp speculative decoding measured on one RTX 3090, Qwen3.6-35B-A3B UD-Q4_K_XL, commit 3737e4137. Published figures are re-derived from

UI-UX: a 4B multimodal LLM for mobile UX defect diagnosis, with UXBench — the first vision–language benchmark for UX reasoning (CVPR 2026 Fi

Native AI assistant for macOS, built with SwiftUI and llama.cpp. Run local LLMs offline, work with PDFs, and create custom AI assistants. Op

AI coding agent in your terminal. Works with any LLM - DeepSeek, Qwen, GPT-5, Claude, Gemini, Kimi, Ollama. 100+ models via litellm. ~1300 l

Run Qwen Code as a coding agent through an OpenAI-compatible API.

A web-based memory usage and performance calculator for Huggingface GGUF models

一键配置各类 AI Agent 工具的 MCP、Skills 和规则；支持 Claude Code、Codex、DeepSeek Harness、OpenCode、Cursor、Gemini CLI、Qwen Code 等。 One-click local setup for M

A local-first desktop application for AI agent workflows.

Multimodal AI studio powered by Qwen3.6-35B-A3B. End-to-end web app exposing visual reasoning, image captioning, and document understanding

The open-source Three.js-based modern LLM Engine that runs in your browser via WebGPU compute.

An evidence-grounded LLM agent for diagnosing PyTorch training failures and verifying proposed repairs through bounded retraining.

🧠 One LLM, split across a Mac (Apple MPS) + a Windows PC (NVIDIA CUDA) — heterogeneous pipeline inference over a framework-neutral wire, bit

Locally fine-tuned Russian RAG models: document splitter, query expansion, retrieval embedder. Teacher distillation → GGUF → llama.cpp on AM

Free & Open Source AI Agent — Self-Hosted, Self-Learning, No Vendor API. Qwen2.5-7B + LoRA. 35 tools. Built on Islamic Epistemology (IHOS).

A local-LLM privacy layer for anything you paste into a cloud model — detect, tokenize, restore. Zero deps, reversible, strong on Chinese.

A zero-allocation, header-only C++ BPE tokenizer for Qwen, built for maximum inference throughput.

食毅：已上线的 AI 饮食记录微信小程序，采用多模态识别、Human-in-the-loop 与确定性营养护栏

CPU-first, eager-execution tensor/autograd runtime and LLM inference engine written in pure Zig

Beastmode: MofA (Mixture of Agents) orchestration framework for Hermes/OpenClaw/Codex with MemroOS-style context continuity.

On-device streaming speech-to-text for macOS, built on Qwen3-ASR via MLX

Logic-based multi-LLM voice router for Home Assistant, combining native intents, local Qwen, GPU-aware desktop Ollama, and cloud AI with int

Deploy Qwen3.6-35B-A3B (Q4_K_XL) + MTP speculative decoding on a single NVIDIA L4 24GB — GCP g2-standard-8 — via the official llama.cpp Dock

An autonomous agentic pipeline that finds, proves, and patches real C memory-safety vulnerabilities end-to-end using a single 7B open-source

Run SemIf (Jev-style semantic-if decisions) on a CPU — no GPU. Reads typed option probabilities straight from an open model in one forward p

Private, offline AI coding agent for local Qwen models via Ollama — zero dependencies, real tools, multi-agent. Your code never leaves your

生产级 LangGraph + FastAPI AI Agent 框架，支持阿里云 Qwen / DashScope，含中文注释、长期记忆、向量检索完整链路。

Open-source local AI server configs, GFX906 runtime maintenance, reproducible benchmarks, and QC methods for affordable AI research infrastr

I Ran Qwen 3.8 27B on Just 4GB VRAM! (FreeToken Tutorial) - Edge-native MoE serving engine for local LLMs on low VRAM GPUs

中文公司调研 Agent

Agentic RAG consumer decision agent with ReAct, Text2SQL, multi-hop retrieval, memory and deterministic constraint checking.

Use third-party and Chinese model APIs as bounded Codex subagents while keeping Codex as the main agent.

An agent that builds agents — closed-loop AI system that interviews, designs, tests, and ships standalone Python agents.

Run stock llama.cpp with the stock Unsloth Qwen3.6-35B-A3B 4-bit on a 16 GB Mac.

The honest, local-first usage meter for AI coding tools. With full privacy and with no server or reading your chats.