Trending repositories: vllm

3 tracked repositories tagged with vllm, ordered by stars. Use the topic filters below to narrow further.

Filter by topic

3 of 3 repositories

  • TheTom/turboquant_plus

    AI summary: Advanced KV cache compression techniques merged into major LLM inference engines.

    7,002ai-mlPythonApache-2.0

  • OpenBMB/UltraRAG

    A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

    AI summary: A highly-optimized toolkit for building retrieval-augmented generation systems.

    5,689ai-mlPythonApache-2.0

  • deepseek-ai/DeepSeek-OCR-2

    Visual Causal Flow

    AI summary: A state-of-the-art optical character recognition model featuring dynamic resolution and causal flow.

    3,236ai-mlPythonApache-2.0