Trending repositories: local-ai

19 tracked repositories tagged with local-ai, ordered by stars. Use the topic filters below to narrow further.

Filter by topic

19 of 19 repositories

  • ggml-org/llama.cpp

    LLM inference in C/C++

    AI summary: A highly optimized C/C++ inference engine for running large language models locally on consumer hardware.

    135,875ai-mlC++MIT
  • debpalash/VoiceStudio

    VoiceStudio is the open-source, fully-local ElevenLabs alternative — voice cloning, voice design, video dubbing, dictation, transcription & audiobook creation in 646 languages.

    AI summary: A local-first application for voice cloning, dubbing, dictation, and long-form audio generation across 646 languages.

    115,464ai-mlPythonAGPL-3.0
  • unslothai/unsloth

    Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.

    AI summary: A local UI and framework for efficiently training and running large language models.

    79,829ai-mlPythonApache-2.0
  • jamiepine/voicebox

    The open-source AI voice studio. Clone, dictate, create.

    AI summary: A local, open-source AI voice generation platform built for real-time speech and global dictation.

    60,929ai-mlPythonMIT
  • JustVugg/colibri

    A hierarchical inference engine for frontier MoE models: hot experts on the GPU (CUDA, Vulkan), warm ones in RAM, cold ones streamed from NVMe. Written in C, runs on the hardware you already own.

    AI summary: Local inference engine running massive mixture-of-experts models on consumer hardware by streaming experts from disk.

    51,687ai-mlCApache-2.0
  • Crosstalk-Solutions/project-nomad

    Project NOMAD is an offline-first knowledge and education server. Wikipedia, thousands of books, courses, maps, and optional local AI, all running on hardware you own with no internet required.

    AI summary: A self-contained, offline-first knowledge and education server packed with tools and local AI.

    44,177infrastructureTypeScriptApache-2.0
  • Zackriya-Solutions/meetily

    Privacy-first AI meeting note taker for Windows, macOS and Linux. Free, open source (MIT). On-device Whisper/Parakeet transcription and speaker diarization, no meeting bot. Open-source alternative to Granola, Otter and Fireflies. https://meetily.ai

    AI summary: A privacy-first, 100% local AI meeting assistant featuring live transcription, speaker diarization, and summarization.

    32,777productivityRustMIT
  • FlashML-org/FreeToken

    FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.

    AI summary: An edge-native MoE serving engine for running frontier-scale AI models on personal hardware.

    17,444ai-mlPythonApache-2.0
  • eigent-ai/eigent

    Eigent: The Open Source Cowork Desktop - Local and Free Alternative to Claude Cowork and Codex

    AI summary: An open-source, local-first Cowork desktop application for building and managing multi-agent AI workflows.

    15,850developer-toolsTypeScriptApache-2.0
  • nearai/ironclaw

    IronClaw is an Agent OS focused on privacy, security and extensibility

    AI summary: A secure, privacy-focused Agent Operating System designed as an extensible personal AI assistant.

    12,718securityRustApache-2.0
  • OpenWhispr/openwhispr

    Voice-to-text dictation app with local (Nvidia Parakeet/Whisper) and cloud models (BYOK). Privacy-first and available cross-platform.

    AI summary: Cross-platform voice-to-text dictation application utilizing local Nvidia Parakeet and Whisper models.

    11,765productivityJavaScriptMIT
  • MakazhanAlpamys/Soup

    Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

    AI summary: A lightning-fast, C++ based LLM fine-tuning CLI that utilizes layer streaming.

    10,604ai-mlPythonApache-2.0
  • Orkas-AI/Orkas

    Orkas is an open-source (MIT), local-first AI team for your desktop: a Commander turns your goal into to-dos and coordinates 16 built-in specialist agents plus Claude Code, Codex, OpenCode, OpenClaw and Hermes, with projects, scheduled automations and connectors. Free app for macOS & Windows; built-in models or your own keys.

    AI summary: Local-first AI team application orchestrating specialized agents directly on your desktop.

    9,433productivityJavaScriptMIT
  • vastsa/PI-Desktop

    Local-first AI coding agent desktop: Electron + Rust host core + pi Agent Harness + user-installable plugins

    AI summary: Local-first modular desktop workspace integrating AI agents, models, and plugins.

    8,107developer-toolsTypeScriptLGPL-3.0
  • leejet/stable-diffusion.cpp

    Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,Minimax H3,...) inference in pure C/C++

    AI summary: A pure C/C++ implementation for running Stable Diffusion and other diffusion models locally without Python dependencies.

    8,078ai-mlC++MIT
  • Osmantic/ODS

    ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI server.

    AI summary: An automated deployment system that wires together Ollama, Open WebUI, and workflow tools to create a private AI server.

    7,843ai-mlPythonApache-2.0
  • zachlatta/freeflow

    Free & fast alternative to Wispr Flow

    AI summary: A free and open-source macOS dictation application providing fast, local AI transcription.

    3,133productivitySwiftMIT
  • 0xSojalSec/airllm

    Runs 405B LLMs on 8GB VRAM

    AI summary: Run massive language models like 405B Llama 3.1 on consumer GPUs using layer-by-layer streaming without quantization.

    3,103ai-mlJupyter NotebookApache-2.0
  • youssofal/MTPLX

    The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B model on 16 GB Macs. Native MTP speculative decoding on Apple Silicon, exact at any temperature. OpenAI and Anthropic compatible local server.

    AI summary: A native Mac app and CLI tool for running local language models significantly faster utilizing multi-token prediction.

    2,727ai-mlPythonApache-2.0