Trending repositories: vram-optimization

1 tracked repository tagged with vram-optimization, ordered by stars. Use the topic filters below to narrow further.

Filter by topic

1 of 1 repository

  • 0xSojalSec/airllm

    Runs 405B LLMs on 8GB VRAM

    AI summary: Memory optimization framework that runs massive LLMs like Llama3.1 405B on low-VRAM GPUs.

    3,054ai-mlJupyter NotebookApache-2.0