在 Intel Gaudi 上使用 TGI 加速大型語言模型（LLM）推理★ 75
Hugging Face Blog443 days agoReleaseHugging Face's official blog has announced that its widely adopted open-source large model inference framework, Text Generation Inference (TGI), now officially…
在 Intel Gaudi 2 上加速蛋白質語言模型 ProtST
Hugging Face Blog711 days agoTutorialThis article from the Hugging Face blog provides a detailed introduction to accelerating the advanced protein language model ProtST on Intel Gaudi 2 deep…
Intel Gaudi 支援更快的輔助生成（Assisted Generation），顯著提升 LLM 推理速度
Hugging Face Blog740 days agoReleaseHugging Face, in collaboration with Intel, has announced official support for "Assisted Generation" (also commonly known as Speculative Decoding) on Intel…
在 Intel® Gaudi® 2 AI 加速器上運行 Text-Generation Pipeline
Hugging Face Blog836 days agoReleaseWith the explosive growth of large language models (LLMs), the demand for high-performance, cost-effective AI hardware has increased significantly. Intel Gaudi…
在 Habana Gaudi2 加速器上實現大型語言模型快速推理：以 BLOOMZ 為例
Hugging Face Blog1,174 days agoTutorialThis article presents the results of a collaboration between Hugging Face and the Intel Habana team, focusing on how to leverage Intel's Habana Gaudi2 deep…