Havuz

The models on your disk, put to work. A private desktop app for open models — chat, a coding agent built for small models, text-to-image, te

Git-Native Coding Agent for Mac

Run and serve local models headlessly

Airgapped closed-corpus QA loop: a self-hosted Qwen3.6 agent explores a .zip dataroom under a token budget with local tools

Free, open-source AI autocomplete for macOS — on-device ghost-text suggestions in every app. A private, local Cotypist alternative built wit

TurboQuant MLX: Flagship high-performance model quantization for Apple Silicon. Squeeze maximum inference speed and memory efficiency out of

LLM Steganography: Hide a meaningful text inside another plausible text of comparable length.

Local inference platform for K/IQ-quant GGUF models on Apple Silicon

System-wide, on-device AI autocomplete for macOS — Copilot-style suggestions in every text field, fully offline and private.

Local-first CLI for benchmarking LLMs on real hardware — quality, speed, reliability, and a real multi-turn agent loop.

Open, calibrated, single-pass typed-decision models (4B & 27B) for finance and trading

Self-hosted Thai AI infrastructure — Mac Mini M4 Pro running TURBO-Fable 27B at 18.5 tok/s for $0.54/day. Fleet of 9 machines, GOD CONFIG v7

Generative image and video runtimes for Apple Silicon (MLX): text/image-to-image, instruction editing, masked edit, text/image/reference-to-

MLX-compatible REAP for pruning MoE models on Apple Silicon

Local, real-time system-audio captioner + translator for macOS — Whisper + a local LLM + a glass overlay. Fully offline.

MLXUI is a Local AI Browser for MLX. Run MLX models AI Workflows.

A native macOS lab for teaching tiny language models to think — build the architecture, train the weights, and watch a small LLM emerge from

ML model ports (ASR · TTS · LLM · VLM · vision · audio codecs) on the rlx multi-backend compiler + runtime — CPU/Metal/MLX/CUDA/wgpu

Zero-config local LLM optimization for Ollama, LM Studio, and Apple Silicon MLX. Reduces TTFT by 40%, wall time for local agents by 46%, and

Qwen Image 2.1 for DeepSeek Harness: native image editing on Apple Silicon MLX/MFLUX or self-hosted CUDA, LoRA, ControlNet, inpainting, pres

Open, calibrated System 1 decision models: typed choice / score / yes-no answers with a probability for every option. 400M to 80B; CPU, NVID

qMLX: Custom inference engine for Qwen 3.5 122B on Apple Silicon, extending MLX with hybrid attention support, SSD-backed KV cache, and RYS

Pure MLX MiniMax-H3 text-to-video-and-audio inference for Apple Silicon.

Macaw — on-device AI agent for macOS. 2.7B LFM2.5 fine-tune, MLX 4-bit, 97 macOS tools, no cloud.

macOS 語音聽寫 App — MLX Whisper + Breeze-ASR-25，完全離線，Apple Silicon 最佳化

Personal fork of czlonkowski/simple-meeting-scribe (MIT) — local macOS meeting transcriber: Ukrainian support, summary export (Telegram/Obsi

Symbio is a self fine tuning AI agent that gives power to users through seamless interaction with their machines. This flexible system adapt

Fast KV-cache quantization for Apple Silicon (MLX) — 43 research-adapted compression methods with Metal kernels

A tiered-memory system design for workloads that don't fit in RAM: measure the working set, pin the hot tier, stream the cold tier from flas

A realtime assistant for Mac and Windows. Talk to it and it answers aloud, shows your schedule and mail as cards, and hands longer work to a

The first native Swift inference engine for Gemma 4 on Apple Silicon / iOS

Local AI workstation: chat by voice or text, transcribe, generate images and video (with sound on Apple Silicon), benchmark and serve open-w

Local LLM chat app for Apple Silicon Macs.

Run the LLM Swarm Router on machines to distribute Local Ai to the Swarm - More Machines - MORE SPEED

Local, open-source Jev alternative: browser agent decisions with Laya (System One model) on your own machine. No cloud, no API key. Playwrig

Community-driven benchmark suite for MLX inference engines on Apple Silicon

Your coding agent starts every session with amnesia — memo fixes that, 100% on your machine. Persistent memory for Claude Code, Codex, Curso

train your own chatbot from scratch on a mac

Local classification, routing, and scoring for AI agents, with option probabilities. Text + images, Python, MCP and agent skills.

Gemma 4 31B Abliterated — quality-preserving guardrail removal for Google's most capable open model. Apache 2.0. Runs on Apple Silicon via M

A free, local AI image generation studio for Apple Silicon Macs. Run FLUX.2, Krea 2, Z-Image-Turbo, Qwen-Image-2.1-Turbo and SDXL offline on

Writing that's kin to yours

On-device streaming speech-to-text for macOS, built on Qwen3-ASR via MLX

Local AI image & video generation for Apple Silicon: a native macOS app with an MLX Swift engine. FLUX.2 Klein, Z-Image Turbo, Qwen-Image 25

Native macOS image generator for FLUX.2 Klein — fully on-device on Apple Silicon via MLX. No Python, no ComfyUI, no server.

Which local LLMs can your computer run? Hardware-aware CLI, TUI and GUI: yes/slow/no verdicts and tok/s from your GPU VRAM and RAM, then ver

A native macOS companion for Draw Things: always-visible image and Moodboard inputs, a canvas you can draw on from an iPad (Sidecar), a loca

Run models too big for RAM on Apple Silicon — any Hugging Face model, dense or MoE — by streaming weights from disk

Local AI model manager

Native Rust, single-binary MLX inference server for Apple Silicon. OpenAI/Anthropic-compatible LLM serving — text, vision, audio, embeddings