🔥 Trending today
Hugging Face TGI (Text Generation Inference) 正式支援 AWS Inferentia2 晶片★ 75
Hugging Face Blog864 days agoReleaseHugging Face has partnered with AWS to officially bring its widely popular open-source LLM inference optimization framework, Text Generation Inference (TGI)…
讓你的 Llama 生成速度飛起來：使用 AWS Inferentia2 進行加速★ 72
Hugging Face Blog950 days agoTutorialAs large language models (LLMs) such as Llama 2 become more widely adopted, achieving efficient and cost-effective inference in production environments has…