Havuz

Local-first memory layer for LLM apps and agents. Runs offline on Ollama, sentence-transformers and FAISS; OpenAI and Anthropic optional. Im

Ollama Model Test - Figure out the best model for the task

Durable local inference for Oh My Pi: NInfer + Qwen3.8 27B on one RTX 3090/4090/5090, with restart-resumable OpenAI Responses state.

System-wide, on-device AI autocomplete for macOS — Copilot-style suggestions in every text field, fully offline and private.

Autonomous AI-powered penetration testing platform. LLM-driven recon, vulnerability analysis, and exploit validation for internal & external

Self-hosted meeting transcription portal — speech-to-text, speaker diarization, LLM-corrected transcripts, structured summaries and Word min

Agentic Runtime

MCP server for Git with local Ollama — zero tokens for git operations

Hemmingway-1: a 27B model that writes the way a person writes. Open weights, free for non-commercial use (CC BY-NC 4.0); commercial use by a

Run AI models on Apple Silicon and Raspberry Pi

Bounded, inspectable LLM inference pipelines from declared YAML — runs offline against Ollama or any OpenAI-compatible local server, emittin

Vyact is an open-source, local-first personal AI workspace for llama.cpp, RAG, AI agents, document intelligence, and Google Workspace.

Community benchmark database for running LLMs on Apple Silicon Macs

Local-first CLI for benchmarking LLMs on real hardware — quality, speed, reliability, and a real multi-turn agent loop.

Can my GPU run this? Pick a GPU to get 3 fitting AI models, quantization, VRAM, speed ranges, and run commands. 한국어·English.

Translate books and documents with LLMs, featuring glossary extraction, review, and polishing pipelines.

A TypeScript proxy that intercepts Antigravity's Gemini API and routes to NVIDIA or OpenRouter — chat, tools, browser automation, all worki

An AI workforce on your desktop. Describe the work; a team of AI agents does it in the open and hands it back checked. Any model, any harnes

Native AI inference for PHP 8.3+ - run ONNX, GGUF (llama.cpp) and RubixML models directly in your PHP process via FFI. Chat, streaming, embe

Self-aware cognitive AI agent with a persistent soul: reads, modifies & verifies its own code, plans autonomously, dreams in idle time, reme

为 JAV 日语视频生成日文、中文或双语 SRT 字幕。支持本地音视频识别、时间轴对齐及 API 或本地模型翻译；网页界面操作，视频与音频留在本机。适用于 Windows + NVIDIA 显卡。

A decision library for running local LLMs on multi-GPU machines without NVLink: parallelism, communication, quantization, speculative decodi

Free, open-source AI coding agent for terminal and browser. A Claude Code / Cursor alternative that runs offline with Ollama or with your ow

Android SDK and MCP server: 157 tools for calendar, contacts, SMS, files, camera, sensors, notifications and UI automation, for on-device LL

A local-first Python personal AI assistant for reasoning, memory, voice, vision, automation, and device control.

The free, open source Cursor alternative. An AI code editor that runs on your own API key, your Claude Code or Codex plan, local models, or

Low-memory C++20 LLM inference runtime for quantized GGUF models on CPU — mmap-backed weights, paged KV cache, Q4/Q8 kernels, and reproducib

Offline emergency assistant: a local LLM and a 200 GB offline library on one Mac, with cited answers and no internet.

An LLM-powered social simulation and roleplaying engine where NPCs have their own lives too.

Native macOS workspace for Apple's container runtime. Browse, run, build and clean up Linux containers with live resource gauges, a built-in

A local AI agent built from scratch in Python with Ollama: conversation memory, system prompts, and multi-step tool calling.

Local LLM chat panel for ComfyUI — LM Studio & Ollama, multi-session, vision support, Guide Materials

Zero-config local LLM optimization for Ollama, LM Studio, and Apple Silicon MLX. Reduces TTFT by 40%, wall time for local agents by 46%, and

AI coding agent harness for any hardware, local or cloud (OpenAI-compatible engines). Tuned for AMD Strix Halo: Qwen3.8 125B on the iGPU, NP

Private, self-hosted document chat for attorneys: parse legal PDFs and query them with local open-source LLMs (Ollama) + verifiable page cit

Ollama-compatible LLM server on a tuned llama.cpp fork. Beats vllm by 40% on single stream decode, and by 20% on multi stream decode, and be

Your own AI workspace on your own machines: chat, agents, coding, knowledge bases (RAG) and fine-tuning with local models. Open source (AGPL

Compute-for-memory research lab for running larger LLMs on memory-constrained consumer GPUs. Official website exvram.pro

Free, open-source AI coding agent & multi-agent teams for macOS — runs 100% on-device via Ollama or LM Studio. Autovisor, an autonomous Supe

YouTube 直播实时 AI 翻译字幕，支持本地 Ollama，英中双向。首次配置，日常双击启动。AI captions for YouTube livestreams with local Ollama. English ↔ Chinese. Windows/NVIDIA p

Fully local AI voice backend for the M5Stack StackChan robot (whisper.cpp + Silero VAD + Ollama + Piper) - replaces the xiaozhi.me cloud, no

llama.cpp speculative decoding measured on one RTX 3090, Qwen3.6-35B-A3B UD-Q4_K_XL, commit 3737e4137. Published figures are re-derived from

Free, offline AI pronunciation trainer for English & Spanish. Repeat a phrase, get an instant grade and the words to fix. Your voice never l

NPU-first local LLM runtime for Snapdragon X Elite (Windows on ARM)

Apple’s on-device LLM, text-to-speech and speech recognition for Node.js and Python, with an OpenAI/Ollama-compatible server. macOS 26+ on A

Fast KV-cache quantization for Apple Silicon (MLX) — 43 research-adapted compression methods with Metal kernels

Qwen3.8-Flash-Next (180B MoE) on one 12-16 GB NVIDIA GPU, Linux or Windows. Own engine, own compression.

Impulse by Velocity: run AI models on your own computer, on Windows and Linux. Load any GGUF model and chat with web search, files, charts a

One AI workspace instead of a stack of AI tools: your models, agents, tools and computer in one app. Inglen (formerly Hearth).

Offline AI research assistant for Android. Answers from Wikipedia and other reference packs on the phone, with citations. Gemma 4 runs on th