Trending repositories: inference-engine
2 tracked repositories tagged with inference-engine, ordered by stars. Use the topic filters below to narrow further.
Filter by topic
2 of 2 repositories
antirez/ds4
DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm
AI summary: Lightweight native inference engine optimized for DeepSeek V4 Flash on consumer hardware.
20,836ai-mlCMITthu-pacman/chitu
High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
AI summary: A high-performance LLM inference engine supporting diverse GPUs and complex deployments.
3,155infrastructurePythonApache-2.0