Trending repositories: traffic-routing

1 of 1 repository

• NVIDIA-NeMo/Switchyard

  Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.

  AI summary: A fast Rust proxy and routing library for transparently translating and directing LLM traffic.

  2,831infrastructurePythonApache-2.0llm-proxyapi-translationtraffic-routingrust