Trending repositories: llama-cpp

3 tracked repositories tagged with llama-cpp, ordered by stars. Use the topic filters below to narrow further.

Filter by topic

3 of 3 repositories

  • TheTom/turboquant_plus

    AI summary: Advanced KV cache compression techniques merged into major LLM inference engines.

    7,002ai-mlPythonApache-2.0

  • antoinezambelli/forge

    A Python framework for self-hosted LLM tool-calling and multi-step agentic workflows

    AI summary: A Python reliability layer for self-hosted LLM tool-calling and workflow constraint management.

    2,211developer-toolsPythonMIT

  • jamesob/local-llm

    Everything I know about running LLMs locally

    AI summary: A curated setup guide and wrapper scripts for running local language models.

    1,744ai-mlShell