SGLang 整合 Hugging Face Transformers 後端:大幅提升模型相容性與開發彈性★ 75
Hugging Face Blog·357 days ago·Release
SGLang (Structured Generation Language) is a high-performance LLM inference and serving framework developed by the LMSYS team, renowned for its efficient…