在 Intel Gaudi 上使用 TGI 加速大型語言模型（LLM）推理★ 75
Hugging Face Blog443 days agoReleaseHugging Face's official blog has announced that its widely adopted open-source large model inference framework, Text Generation Inference (TGI), now officially…
如何在 AWS 上部署與微調 DeepSeek 模型：Hugging Face 官方指南★ 85
Hugging Face Blog500 days agoTutorialAs DeepSeek-R1 swept through the AI landscape on the strength of its powerful reasoning capabilities, how to safely and efficiently deploy and fine-tune these…
Hugging Face TGI 宣布支援多後端引擎：整合 TensorRT-LLM 與 vLLM★ 85
Hugging Face Blog514 days agoReleaseText Generation Inference (TGI), Hugging Face's open-source LLM inference and deployment framework, has received a major architectural update, officially…
Ryght 攜手 Hugging Face 專家支援，賦能醫療與生命科學領域的 AI 轉型之旅
Hugging Face Blog789 days agoBusinessThis case study details how biomedical AI startup Ryght leveraged Hugging Face's Expert Support service to overcome the many challenges of deploying generative…
Hugging Face TGI 推出 Messages API：輕鬆將 OpenAI 應用無縫轉移至開源 LLM★ 80
Hugging Face Blog857 days agoReleaseHugging Face has announced official support for an OpenAI-compatible Messages API (i.e., the `/v1/chat/completions` endpoint) in its high-performance…
Hugging Face TGI (Text Generation Inference) 正式支援 AWS Inferentia2 晶片★ 75
Hugging Face Blog864 days agoReleaseHugging Face has partnered with AWS to officially bring its widely popular open-source LLM inference optimization framework, Text Generation Inference (TGI)…
告別冷啟動：Hugging Face 如何將 LoRA 推論速度提升 300%★ 85
Hugging Face Blog922 days agoReleaseIn real-world generative AI applications, fine-tuning for specific tasks or clients is a common requirement. However, deploying a full base model for every…
Hugging Face 的開源文本生成與 LLM 生態系全景指南★ 85
Hugging Face Blog1,063 days agoReleaseThis official Hugging Face blog post systematically maps out the complete ecosystem it has built around open-source large language models (LLMs). As…
使用 Hugging Face Inference Endpoints 輕鬆部署大型語言模型 (LLM)★ 75
Hugging Face Blog1,076 days agoTutorialThis official Hugging Face blog post introduces how to use their hosted service "Inference Endpoints" to deploy large language models (LLMs). With the rapid…
Hugging Face 案例研究：Writer 如何利用 Hugging Face 構建複雜的企業級生成式 AI 應用
Hugging Face Blog1,079 days agoBusinessThis case study takes an in-depth look at how Writer, an enterprise-grade generative AI platform, leverages the Hugging Face open-source ecosystem and…
Hugging Face 推出適用於 Amazon SageMaker 的 LLM 推理容器 (LLM Inference Container)★ 75
Hugging Face Blog1,110 days agoReleaseHugging Face and AWS have jointly announced the new "Hugging Face LLM Inference Container" — a brand-new deep learning container (DLC) purpose-built for Amazon…