Trending repositories: local-ai
19 tracked repositories tagged with local-ai, ordered by stars. Use the topic filters below to narrow further.
19 of 19 repositories
ggml-org/llama.cpp
LLM inference in C/C++
AI summary: A highly optimized C/C++ inference engine for running large language models locally on consumer hardware.
135,875ai-mlC++MITdebpalash/VoiceStudio
VoiceStudio is the open-source, fully-local ElevenLabs alternative — voice cloning, voice design, video dubbing, dictation, transcription & audiobook creation in 646 languages.
AI summary: A local-first application for voice cloning, dubbing, dictation, and long-form audio generation across 646 languages.
115,464ai-mlPythonAGPL-3.0unslothai/unsloth
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.
AI summary: A local UI and framework for efficiently training and running large language models.
79,829ai-mlPythonApache-2.0jamiepine/voicebox
The open-source AI voice studio. Clone, dictate, create.
AI summary: A local, open-source AI voice generation platform built for real-time speech and global dictation.
60,929ai-mlPythonMITJustVugg/colibri
A hierarchical inference engine for frontier MoE models: hot experts on the GPU (CUDA, Vulkan), warm ones in RAM, cold ones streamed from NVMe. Written in C, runs on the hardware you already own.
AI summary: Local inference engine running massive mixture-of-experts models on consumer hardware by streaming experts from disk.
51,687ai-mlCApache-2.0Crosstalk-Solutions/project-nomad
Project NOMAD is an offline-first knowledge and education server. Wikipedia, thousands of books, courses, maps, and optional local AI, all running on hardware you own with no internet required.
AI summary: A self-contained, offline-first knowledge and education server packed with tools and local AI.
44,177infrastructureTypeScriptApache-2.0Zackriya-Solutions/meetily
Privacy-first AI meeting note taker for Windows, macOS and Linux. Free, open source (MIT). On-device Whisper/Parakeet transcription and speaker diarization, no meeting bot. Open-source alternative to Granola, Otter and Fireflies. https://meetily.ai
AI summary: A privacy-first, 100% local AI meeting assistant featuring live transcription, speaker diarization, and summarization.
32,777productivityRustMITFlashML-org/FreeToken
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
AI summary: An edge-native MoE serving engine for running frontier-scale AI models on personal hardware.
17,444ai-mlPythonApache-2.0eigent-ai/eigent
Eigent: The Open Source Cowork Desktop - Local and Free Alternative to Claude Cowork and Codex
AI summary: An open-source, local-first Cowork desktop application for building and managing multi-agent AI workflows.
15,850developer-toolsTypeScriptApache-2.0nearai/ironclaw
IronClaw is an Agent OS focused on privacy, security and extensibility
AI summary: A secure, privacy-focused Agent Operating System designed as an extensible personal AI assistant.
12,718securityRustApache-2.0OpenWhispr/openwhispr
Voice-to-text dictation app with local (Nvidia Parakeet/Whisper) and cloud models (BYOK). Privacy-first and available cross-platform.
AI summary: Cross-platform voice-to-text dictation application utilizing local Nvidia Parakeet and Whisper models.
11,765productivityJavaScriptMITMakazhanAlpamys/Soup
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
AI summary: A lightning-fast, C++ based LLM fine-tuning CLI that utilizes layer streaming.
10,604ai-mlPythonApache-2.0Orkas-AI/Orkas
Orkas is an open-source (MIT), local-first AI team for your desktop: a Commander turns your goal into to-dos and coordinates 16 built-in specialist agents plus Claude Code, Codex, OpenCode, OpenClaw and Hermes, with projects, scheduled automations and connectors. Free app for macOS & Windows; built-in models or your own keys.
AI summary: Local-first AI team application orchestrating specialized agents directly on your desktop.
9,433productivityJavaScriptMITvastsa/PI-Desktop
Local-first AI coding agent desktop: Electron + Rust host core + pi Agent Harness + user-installable plugins
AI summary: Local-first modular desktop workspace integrating AI agents, models, and plugins.
8,107developer-toolsTypeScriptLGPL-3.0leejet/stable-diffusion.cpp
Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,Minimax H3,...) inference in pure C/C++
AI summary: A pure C/C++ implementation for running Stable Diffusion and other diffusion models locally without Python dependencies.
8,078ai-mlC++MITOsmantic/ODS
ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI server.
AI summary: An automated deployment system that wires together Ollama, Open WebUI, and workflow tools to create a private AI server.
7,843ai-mlPythonApache-2.0zachlatta/freeflow
Free & fast alternative to Wispr Flow
AI summary: A free and open-source macOS dictation application providing fast, local AI transcription.
3,133productivitySwiftMIT0xSojalSec/airllm
Runs 405B LLMs on 8GB VRAM
AI summary: Run massive language models like 405B Llama 3.1 on consumer GPUs using layer-by-layer streaming without quantization.
3,103ai-mlJupyter NotebookApache-2.0youssofal/MTPLX
The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B model on 16 GB Macs. Native MTP speculative decoding on Apple Silicon, exact at any temperature. OpenAI and Anthropic compatible local server.
AI summary: A native Mac app and CLI tool for running local language models significantly faster utilizing multi-token prediction.
2,727ai-mlPythonApache-2.0