Havuz

Local, real-time system-audio captioner + translator for macOS — Whisper + a local LLM + a glass overlay. Fully offline.

Android SDK and MCP server: 157 tools for calendar, contacts, SMS, files, camera, sensors, notifications and UI automation, for on-device LL

A native macOS lab for teaching tiny language models to think — build the architecture, train the weights, and watch a small LLM emerge from

Free, open-source AI coding agent & multi-agent teams for macOS — runs 100% on-device via Ollama or LM Studio. Autovisor, an autonomous Supe

3D scanner running fully on-device: 8 photos to a spinnable gaussian-splat scan in ~3s on an iPhone, via Depth Anything 3 + react-native-exe

Translate and rewrite without switching apps. Free, open-source, on-device writing for Mac. No account or API key.

Fast KV-cache quantization for Apple Silicon (MLX) — 43 research-adapted compression methods with Metal kernels

Provider-neutral bounded agent runtime for Android/JVM: controlled context (trust/priority/budgets), profile-scoped tools, OpenAI-compatible

Mobile-native agent SDK for building on-device AI agents with sandboxed execution, extensible tools, and x-app / x-agent / x-channel connect

On-device AI agent for Android, tuned for free OpenRouter/Kilo models with automatic model/key fallback and rate-limit recovery. Tools: web

Custom converter: open-weight Hugging Face LLMs/VLMs -> on-device LiteRT-LM (.litertlm), with one-command reproduction

Fast WebGPU runtime for 1-bit (binary-weight) LLMs in the browser. Bit-exact, zero runtime dependencies.

Fast, private, on-device dictation for Apple silicon Macs

Free, open-source Mac dictation built for accessibility. Press a key, speak, and it types in any app. Whisper and AI cleanup run fully on yo

100% offline voice dictation for macOS, Windows & Linux — Whisper & Parakeet on-device, no cloud, open source.

[Archived] AAOSP, predecessor to JibarOS. Early experiment in OS-level on-device AI (MCP + local LLM on Android 15). See JibarOS for the act

Android 16 fork. AI as a platform primitive. Twelve capabilities, one shared runtime, every app. OEM-pluggable. Apache 2.0.

Run the native 284B-A13B DeepSeek-V4-Flash-0731 LLM locally on one laptop CPU: pure C, 8 GB RAM minimum, no GPU, best TPOT 0.892 s/token, re

Introducing Muse Glimmer: open-weight 30B agentic multimodal model that runs on your device (Meta). Interactive local agent lab + guide. Apa

Relic is the open-source, end-to-end encrypted clipboard manager. Everything you ever copy, indexed by local AI, synced across Windows, macO

The first native Swift inference engine for Gemma 4 on Apple Silicon / iOS

A local-first macOS app to catalog, organize, and clone the open-source repos you actually use. No account, no cloud.

🧠 One LLM, split across a Mac (Apple MPS) + a Windows PC (NVIDIA CUDA) — heterogeneous pipeline inference over a framework-neutral wire, bit

Run GPT-OSS-120B on a 16 GB Mac. Streams mixture-of-experts weights from SSD so only the 2 GiB trunk stays resident. Swift + Metal, no depen

A local-first second brain for scientists, researchers, coders, and nerds.

Pi agent for Android — sideload the APK and run a Pi coding agent on your phone. Single-APK, on-device Termux runtime, Claude Pro/Max OAuth,

web-ai-sdk: TypeScript SDK for the Web AI surface (Prompt, Writer, Rewriter, Proofreader, Translator, Summarizer, Language Detector, WebMCP)

Qwen3.8-27B on one laptop CPU: up to 2.52 token/s, 8 GB tested, no runtime accuracy loss. Native OpenAI-compatible API with function tools;

The best model under 200B at near 10 token/s exact batch throughput on a single laptop CPU, with an automatic 8 GB RAM path. Native C, no GP

CubicLM is a unified cross-platform AI workspace with local GPU acceleration (GGUF, LiteRT-LM). Supports on-device image generation, 23+ clo

On-device streaming speech-to-text for macOS, built on Qwen3-ASR via MLX

Native macOS image generator for FLUX.2 Klein — fully on-device on Apple Silicon via MLX. No Python, no ComfyUI, no server.

P2P semantic matching for on-device AI agents. No server, no cloud.

Use many on device and cloud models with Apple's Foundation Models framework in iOS and macOS with a full chat experience.

Intents is a native macOS workbench for evaluating Apple's on-device Foundation Models.

A free, fully local, minimal-setup voice dictation app for macOS - built specifically for developers.

Tiny, Apache-2.0 wake-word detection you train yourself and run on-device in Python, the browser, and on mobile.

Private, offline AI assistant for Android and Windows: run local LLMs (Gemma 4, Qwen, any GGUF) on your phone or PC with llama.cpp, CUDA and

🔥 Run large open language models on your phone. A C++20 GGUF inference engine that streams models larger than RAM from flash, paces itself b

SDK for building on-device AI applications on Arm with reusable building blocks across inference runtimes.

Faraday, the on-device AI voice agent for Android. Gemma 4 runs entirely on your phone: real voice conversation, long-term memory, and tools

Framework to talk to AI models and intelligently route

Your own voice + text AI assistant, embedded with one script tag, running 100% in the visitor's browser.

Run stock llama.cpp with the stock Unsloth Qwen3.6-35B-A3B 4-bit on a 16 GB Mac.

AI agents and workflows for Kotlin Multiplatform, as small typed graphs: loops, parallel steps, streaming, save points and human approval. I

Native iOS DeepSeek Harness port: BYOK inference, on-device Agent tools, iSH sandbox, Cordis plugins, and trajectory.

Offline LLM app for iPhone: run open models from Hugging Face on-device with llama.cpp, MLX, Core ML and Apple Foundation Models. No account

Tidytalk：Mac 本地语音输入工具。按住说话，松开即可得到整理后的文本。语音识别完全本机运行，可搭配 Ollama 本地大模型润色转写内容，数据不会离开你的电脑。免费开源。| Private on-device voice input for Mac. Hold to s

中英混著講，落下的是乾淨的繁體中文。macOS 選單列語音輸入，whisper.cpp 全程在本機跑，kubectl、Terraform 這類術語內建修正。

Run NVIDIA's tri-modal Nemotron Omni (text+vision+audio) entirely on Apple Silicon — pure MLX runtime, parity-verified against NVIDIA's refe