Havuz

Thai + English voice typing for Mac. Offline speech-to-text that types Thai-spoken tech words in English. Push-to-talk dictation on Apple Si

Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimiz

Free, open-source Mac dictation built for accessibility. Press a key, speak, and it types in any app. Whisper and AI cleanup run fully on yo

Custom converter: open-weight Hugging Face LLMs/VLMs -> on-device LiteRT-LM (.litertlm), with one-command reproduction

A local-first second brain for scientists, researchers, coders, and nerds.

Fast WebGPU runtime for 1-bit (binary-weight) LLMs in the browser. Bit-exact, zero runtime dependencies.

Mobile-native agent SDK for building on-device AI agents with sandboxed execution, extensible tools, and x-app / x-agent / x-channel connect

🧠 One LLM, split across a Mac (Apple MPS) + a Windows PC (NVIDIA CUDA) — heterogeneous pipeline inference over a framework-neutral wire, bit

中英混著講，落下的是乾淨的繁體中文。macOS 選單列語音輸入，whisper.cpp 全程在本機跑，kubectl、Terraform 這類術語內建修正。

Translate and rewrite without switching apps. Free, open-source, on-device writing for Mac. No account or API key.

Your own voice + text AI assistant, embedded with one script tag, running 100% in the visitor's browser.

Fastest MoE/LLM inference runtime for consumer and edge Blackwell GPUs. SN74 on Gittensor.

Native macOS image generator for FLUX.2 Klein — fully on-device on Apple Silicon via MLX. No Python, no ComfyUI, no server.

Local, real-time system-audio captioner + translator for macOS — Whisper + a local LLM + a glass overlay. Fully offline.

Use many on device and cloud models with Apple's Foundation Models framework in iOS and macOS with a full chat experience.

Open Dungeon — the first easy-to-use, fully local AI roleplay app. Story and inline scene images generated 100% on your machine (Gemma 4 QAT

Swift SDK for running chat, vision and speech models on iPhone and Mac with Apple's Core AI. Model download and caching, FoundationModels in

An on-device LLM understands your entire life, then proactively offers to get your work done through computer use.

Downloadable models and conversion recipes for Apple's Core AI on iPhone and Mac. Chat, vision, speech and generative models with per-model

SiliconScope, Apple Silicon Mac’lerde sistem kaynaklarını ve özel hızlandırıcıları izleyen, ayrıca uzaktaki makineleri aynı panele ekleyebilen bir macOS monitörüdür.

Neden yükseliyor · 111 günde 966 yıldıza ulaşması ve son 28 günde 48 commit alması dikkat çekiyor; README’deki ANE ve memory-bandwidth ölçümleriyle uzaktaki makineleri tek panelde toplama özellikleri de ayırt edici bir kullanım vaadi sunuyor. Üç farklı yazar aktiviteye işaret etse de ekip genişliği sınırlı; yıldızlar tek başına benimseme veya kalite kanıtı değil.

A practical lab for exploring Apple's Core AI framework, model assets, specialization, and on-device inference.

Private, fully offline photo search for Android. Find photos with words in English, Arabic, French, Russian or Spanish, or with another phot

Unofficial .NET bindings for Google's LiteRT-LM — on-device LLM inference (Gemma) for Windows, Linux, Android, macOS & MAUI

A local-first macOS app to catalog, organize, and clone the open-source repos you actually use. No account, no cloud.

P2P semantic matching for on-device AI agents. No server, no cloud.

A ternary, zero-heap tiny language model that runs inside a $2 microcontroller — bit-exact Python <-> C99 <-> Cortex-M3 (QEMU) parity. Apach

Tiny, Apache-2.0 wake-word detection you train yourself and run on-device in Python, the browser, and on mobile.

edge-dit.cpp — a native C/C++ inference engine for Diffusion Transformers (DiT), designed for local and resource-constrained devices with au

Native Android TTS app with on-device neural voices and emotion-aware prosody — sister project to marmalade-tts (CLI).

600 KB WASM runtime for Cactus Compute's Needle AI tool-calling models, Needle 3, 2 and 1 from one build. Browser, Cloudflare Workers, Node.

web-ai-sdk: TypeScript SDK for the Web AI surface (Prompt, Writer, Rewriter, Proofreader, Translator, Summarizer, Language Detector, WebMCP)

Pi agent for Android — sideload the APK and run a Pi coding agent on your phone. Single-APK, on-device Termux runtime, Claude Pro/Max OAuth,

Generate images locally

Private on-device voice assistant — STT, LLM, TTS fully local. Android + desktop from one core, built on Tether QVAC SDK.

Reproducible on-device LLM benchmarks for Apple Silicon (iPhone 17 Pro, M4 Max): Apple Core AI, MLX, llama.cpp, LiteRT-LM and Core ML on the

Framework to talk to AI models and intelligently route

Android 16 fork. AI as a platform primitive. Twelve capabilities, one shared runtime, every app. OEM-pluggable. Apache 2.0.

A private Claude-Code-style coding agent for Apple Silicon — run chat, code, and local model workflows on-device. MLX-native, Ollama/OpenAI

Fast KV-cache quantization for Apple Silicon (MLX) — 43 research-adapted compression methods with Metal kernels

Hands-free on-device voice loop for macOS: Apple SFSpeechRecognizer + cloned-voice TTS, continuous listening, zero cloud. Originally built t

Android SDK and MCP server: 157 tools for calendar, contacts, SMS, files, camera, sensors, notifications and UI automation, for on-device LL

[Archived] AAOSP, predecessor to JibarOS. Early experiment in OS-level on-device AI (MCP + local LLM on Android 15). See JibarOS for the act

On-device shell command generator for macOS Tahoe. Uses Apple's 3B model with dynamic few-shot retrieval from 21k tldr examples.

The first native Swift inference engine for Gemma 4 on Apple Silicon / iOS

PokeClaw (PocketClaw) — first on-device AI that controls your Android phone. Gemma 4, no cloud, no API key. Poke is short for Pocket.

Turn your Android phone into an OpenAI-compatible LLM inference server - Fully local, private and Open Source

Free, open-source AI coding agent & multi-agent teams for macOS — runs 100% on-device via Ollama or LM Studio. Autovisor, an autonomous Supe

On-device, real-time multimodal AI with features similar to GPT-Live

100% offline voice dictation for macOS, Windows & Linux — Whisper & Parakeet on-device, no cloud, open source.

Private on-device AI chat for Android - runs any GGUF model locally via llama.cpp with ARM-optimised SIMD. Zero network permissions, encry