Trending repositories: local-inference
3 tracked repositories tagged with local-inference, ordered by stars. Use the topic filters below to narrow further.
3 of 3 repositories
cactus-compute/needle
14MB foundation model for tiny devices; phones, wearables, smart home, and robots.
AI summary: A 26M parameter Simple Attention Network optimized for function calling.
10,760ai-mlPythonApache-2.0arman-bd/guppylm
A ~9M parameter LLM that talks like a small fish.
AI summary: A tiny 9M parameter language model explicitly trained from scratch to talk exactly like a small fish.
3,443ai-mlPythondeer-flow/llm-space
A desktop app to prototype agent ideas, inspect every harness step, replay failures, and evaluate performance, all in one place. Local-first, cloud-ready for managed agents.
AI summary: A native desktop workspace for prototyping, orchestrating, and monitoring local AI agents and open-weight Large Language Models.
1,844ai-mlTypeScriptMIT