Havuz

End-to-end pipeline for seeing how LLMs actually process your prompts. Capture attention across every layer, render heatmaps and cooking cur

A tiny language model that talks like a house cat named Miso.

This repo is a alternative solution for standard self-attention. It uses tree routing with learnable functions for cheaper self-attention wh

A fancy NVIDIA GPU monitor for the terminal. One Python file, no dependencies.

Building an Image-to-Video (I2V) Model from Scratch

Taiwanese Hokkien (Taigi) speech-to-text transcriber - MediaTek Breeze-ASR-26 with faster-whisper, tuned for RTX 3050 4GB low-VRAM GPUs. Gra

AI watermark removal built for Apple Silicon. SynthID-class pixel regeneration, visible vendor labels and provenance metadata, with every pi

[ICML 2026] NanoQuant: Efficient Sub-1-Bit Quantization of Large Language Models

Evaan — a fully local, offline-capable AI companion chatbot built with Python & Hugging Face Transformers, running on Qwen2.5-0.5B-Instruct

让 MinerU 在 AMD 显卡上以 vLLM + hybrid-auto-engine 满血运行！ 本项目是对官方文档中 AMD/ROCm 生态支持的有效补充。针对 MinerU 3.x 提供了一套完整的 ROCm 7.x + PyTorch 2.11.0 + vLLM 源码

Refusal removal as a loadable KV-cache graft — zero weight modification, no refusal-direction projection, fully reversible.

A Personalized Federated Learning (PFL-HCare) framework for IoT healthcare. Features MAML meta-learning, Differential Privacy (RDP), and gra

A curated collection of AI learning materials

A mental-model-first field guide to Audio AI — from raw waveforms to production voice systems. Covers ASR, TTS, audio classification, Transf

Official Implementation of LongLive-RAG: A general retrieval-augmented framework for long video generation.

PyTorch 기반 한국어 LLM 구현 및 학습 프로젝트

Tiny local text-to-24x24 pixel art model, trained on roughly 200K samples in 30 minutes on an RTX 5090.

🌹 Rose: Range-Of-Slice Equilibration PyTorch optimizer. Stateless optimization through range-normalized gradient updates.

The htop for LLM inference see exactly where every GB of VRAM goes and get measured quantization savings.

[Preprint] TBSM: Three-Body Scattering for Generative Modeling.

Scaler 2 Music Theory Tool 2026: Direct DAW Integration for Windows 10 and 11

GleamLM大语言模型全栈训练平台——核心代码用 PyTorch 从零实现，最低仅需 12GB 消费级显卡即可完整训练，另有一套工业代码与手写实现消费同一份数据逐层对照。模型训练支持CLI和可视化训练。

A practical lab for exploring Apple's Core AI framework, model assets, specialization, and on-device inference.

Open-source Environment toolkit of claw-like agents, support task/harness generation and evaluation

Learn Agentic AI, Deep Learning, Agentic Engineering, RAG and Multi-Agent Workflows.

Agentic AI platform transforming passive CCTV into proactive railway safety intelligence. Real-time behavioural detection (suicide risk, pic

Iris-3B pixel-space text-to-image on Apple Silicon GPUs: Metal-optimized engine, native macOS app, CLI, Python and local HTTP API

Inference engine for large language models on consumer GPUs, with deep optimization for older hardware

Streamline AI Workloads on Kubernetes: Universal Python SDK Guide 2026

🚀 Engram-PEFT: An unofficial implementation of DeepSeek Engram. Inject high-capacity conditional memory into LLMs via sparse retrieval PEFT

First open-source TurboQuant KV cache compression for LLM inference. Drop-in for HuggingFace. pip install turboquant.

Static reproducibility checks, experiment replay, and verification for ML pipelines.

Biologically-grounded adversarial training platform: cyclic Wake/Dream/Nightmare/Compress phases that accumulate model robustness without ca

Recomputation-free, context-independent KV caching for large language models

Reproducible OpenEnv-compatible reinforcement-learning environments for social-media integrity moderation.

Unofficial fairseq-free PyTorch implementation of UTMOS (v1, 2022), matching the original system.

One GPU. Full LLM workflow. Real benchmarks. No cloud required.

AI-powered deepfake detector that classifies uploaded face images and videos as Real or Fake with confidence scores. Full-stack app built wi

Unified KV-cache compression for LLM inference: 12 Python-native methods, guarded add-on composition and routing, analytical capacity simula

A comprehensive hands-on, AI-first Python curriculum with 80+ interactive Jupyter notebooks for AI Engineers from core basics to LLMs, RAG,

Train linear embedding adapters with triplet loss to align retrieval embeddings with your queries (RAG).

Lynn 原生 LLM 推理引擎 · W4A8/NVFP4 量化 · 自写 CUDA/Triton kernel · MoE · 投机解码 | Lynn-native LLM inference engine for NVIDIA Blackwell

STEER — AI4R (AI for Research) experiment framework for auto-research and autonomous research. Connect existing research projects and let an

Consumer-aware compression for embedding indexes and LLM KV caches — compress by the metric the downstream consumer actually uses. PCA-Matry

A modern, hands-on, self-paced course that takes you from your first line of Python to shipping a real AI-powered automation.

Pyramis-L3D: hierarchical sparse attention research prototype (code only; weights on Hugging Face)

Local text-to-speech: 28 voices, 10 languages, voice cloning, SDKs for Python, Swift, Go, Rust and TypeScript

🧠 One LLM, split across a Mac (Apple MPS) + a Windows PC (NVIDIA CUDA) — heterogeneous pipeline inference over a framework-neutral wire, bit

Tiny-MoE is a lightweight Mixture-of-Experts language model built entirely from scratch in native PyTorch and trained end-to-end on Kaggle u

PyTorch-native framework for fault-tolerant distributed training of foundation models on AI clusters