vLLM large scale serving: DeepSeek 2.2k tok/s/h200 with wide-ep

⚓ IT    📅 2026-01-13    👤 surdeus    👁️ 9      

surdeus

Warning

This post was published 55 days ago. The information described in this article may have changed.
Comments 🏷️ IT_feed