llama-swap alternative in Rust — OpenAI-compatible GGUF runtime with VRAM-pressure eviction, context auto-fallback, and usage tracking.
rust model cuda switching openai-api llama-cpp local-llm llm-inference gguf model-swap llama-swap model-swapping
-
Updated
Jul 22, 2026 - Rust