Hugging Face TGI 推出 Messages API:輕鬆將 OpenAI 應用無縫轉移至開源 LLM
Original: From OpenAI to Open LLMs with Messages API on Hugging Face
Hugging Face has announced official support for an OpenAI-compatible Messages API (i.e., the `/v1/chat/completions` endpoint) in its…
Hugging Face 宣布其文字生成推論工具(TGI)正式支援與 OpenAI 相容的 Messages API。這意味著開發者可以使用現有的 OpenAI SDK,僅需更改 Base URL 和 API 金鑰,就能直接調用託管在 Hugging Face 上的開源大語言模型(如 Llama、Mistral 等)。TGI 會在後台自動處理繁瑣的聊天模板(Chat Templates)轉換,大幅降低了從閉源轉向開源模型的門檻。
Hugging Face has announced official support for an OpenAI-compatible Messages API (i.e., the `/v1/chat/completions` endpoint) in its high-performance open-source LLM inference and deployment tool, Text Generation Inference (TGI). This major update is designed to break down the barriers between closed-source and open-source ecosystems, allowing developers to seamlessly migrate applications that previously relied on the OpenAI API to open-source large language models (LLMs) at minimal cost.
Free shows the 3-line summary; Pro unlocks the full deep summary (~300 words) so you never have to click through.
See Pro plans →Want the original English / full article?
Read on Hugging Face Blog →Summaries are AI-generated; the original article is authoritative.