Trending repositories: distributed-inference

1 tracked repository tagged with distributed-inference, ordered by stars. Use the topic filters below to narrow further.

Filter by topic

1 of 1 repository

  • Mesh-LLM/mesh-llm

    Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

    AI summary: Pools GPUs across multiple machines into a single OpenAI-compatible API for distributed LLM inference.

    3,060ai-mlRustApache-2.0