Havuz

3D scanner running fully on-device: 8 photos to a spinnable gaussian-splat scan in ~3s on an iPhone, via Depth Anything 3 + react-native-exe

Native AI assistant for macOS, built with SwiftUI and llama.cpp. Run local LLMs offline, work with PDFs, and create custom AI assistants. Op

Free, open-source AI coding agent & multi-agent teams for macOS — runs 100% on-device via Ollama or LM Studio. Autovisor, an autonomous Supe

Translate and rewrite without switching apps. Free, open-source, on-device writing for Mac. No account or API key.

Fast KV-cache quantization for Apple Silicon (MLX) — 43 research-adapted compression methods with Metal kernels

Provider-neutral bounded agent runtime for Android/JVM: controlled context (trust/priority/budgets), profile-scoped tools, OpenAI-compatible

Mobile-native agent SDK for building on-device AI agents with sandboxed execution, extensible tools, and x-app / x-agent / x-channel connect

Offline AI research assistant for Android. Answers from Wikipedia and other reference packs on the phone, with citations. Gemma 4 runs on th

On-device AI agent for Android, tuned for free OpenRouter/Kilo models with automatic model/key fallback and rate-limit recovery. Tools: web

Fast WebGPU runtime for 1-bit (binary-weight) LLMs in the browser. Bit-exact, zero runtime dependencies.

Fast, private, on-device dictation for Apple silicon Macs

Custom converter: open-weight Hugging Face LLMs/VLMs -> on-device LiteRT-LM (.litertlm), with one-command reproduction

Free, open-source Mac dictation built for accessibility. Press a key, speak, and it types in any app. Whisper and AI cleanup run fully on yo

100% offline voice dictation for macOS, Windows & Linux — Whisper & Parakeet on-device, no cloud, open source.

[Archived] AAOSP, predecessor to JibarOS. Early experiment in OS-level on-device AI (MCP + local LLM on Android 15). See JibarOS for the act

Android 16 fork. AI as a platform primitive. Twelve capabilities, one shared runtime, every app. OEM-pluggable. Apache 2.0.

Run the native 284B-A13B DeepSeek-V4-Flash-0731 LLM locally on one laptop CPU: pure C, 8 GB RAM minimum, no GPU, best TPOT 0.892 s/token, re

Introducing Muse Glimmer: open-weight 30B agentic multimodal model that runs on your device (Meta). Interactive local agent lab + guide. Apa

The first native Swift inference engine for Gemma 4 on Apple Silicon / iOS

A local-first macOS app to catalog, organize, and clone the open-source repos you actually use. No account, no cloud.

Relic is the open-source, end-to-end encrypted clipboard manager. Everything you ever copy, indexed by local AI, synced across Windows, macO

🧠 One LLM, split across a Mac (Apple MPS) + a Windows PC (NVIDIA CUDA) — heterogeneous pipeline inference over a framework-neutral wire, bit

Run GPT-OSS-120B on a 16 GB Mac. Streams mixture-of-experts weights from SSD so only the 2 GiB trunk stays resident. Swift + Metal, no depen

A local-first second brain for scientists, researchers, coders, and nerds.

Pi agent for Android — sideload the APK and run a Pi coding agent on your phone. Single-APK, on-device Termux runtime, Claude Pro/Max OAuth,

web-ai-sdk: TypeScript SDK for the Web AI surface (Prompt, Writer, Rewriter, Proofreader, Translator, Summarizer, Language Detector, WebMCP)

涛声 TaoSheng：用一部安卓手机全天收音 → 转写 → 认人 → AI 整理成待办与记忆。无需硬件、无需账号，数据只在你手机里。

Qwen3.8-27B on one laptop CPU: up to 2.52 token/s, 8 GB tested, no runtime accuracy loss. Native OpenAI-compatible API with function tools;

The best model under 200B at near 10 token/s exact batch throughput on a single laptop CPU, with an automatic 8 GB RAM path. Native C, no GP

Offline AI narration studio for Android: turn scripts into natural speech and clone your voice, all on-device. No cloud, no account.

CubicLM is a unified cross-platform AI workspace with local GPU acceleration (GGUF, LiteRT-LM). Supports on-device image generation, 23+ clo

On-device streaming speech-to-text for macOS, built on Qwen3-ASR via MLX

Native macOS image generator for FLUX.2 Klein — fully on-device on Apple Silicon via MLX. No Python, no ComfyUI, no server.

Private on-device voice assistant — STT, LLM, TTS fully local. Android + desktop from one core, built on Tether QVAC SDK.

P2P semantic matching for on-device AI agents. No server, no cloud.

Fault injection framework for on-device AI. Pure Dart core (sate_core) + Flutter package (sate_ai). Android, iOS, Web, and CLI targets.

A free, fully local, minimal-setup voice dictation app for macOS - built specifically for developers.

Use many on device and cloud models with Apple's Foundation Models framework in iOS and macOS with a full chat experience.

Intents is a native macOS workbench for evaluating Apple's on-device Foundation Models.

Tiny, Apache-2.0 wake-word detection you train yourself and run on-device in Python, the browser, and on mobile.

The local-first AI knowledge workspace — an infinite canvas for research, learning, and creation (Tauri 2 + Vue 3)

SDK for building on-device AI applications on Arm with reusable building blocks across inference runtimes.

Faraday — the local private voice agent for your phone.

OnDevice Local AI Studio — run LLMs on iPhone offline. SwiftUI workbench with MLX, llama.cpp, whisper.cpp, RAG, and authenticated OpenAI/Ant

Framework to talk to AI models and intelligently route

Your own voice + text AI assistant, embedded with one script tag, running 100% in the visitor's browser.

Run stock llama.cpp with the stock Unsloth Qwen3.6-35B-A3B 4-bit on a 16 GB Mac.

🔥 Run large open language models on your phone. A C++20 GGUF inference engine that streams models larger than RAM from flash, paces itself b

AI agents and workflows for Kotlin Multiplatform, as small typed graphs: loops, parallel steps, streaming, save points and human approval. I

Native iOS DeepSeek Harness port: BYOK inference, on-device Agent tools, iSH sandbox, Cordis plugins, and trajectory.