Hugging Face BlogJun 16, 2025, 12:00 AMimportant 75

Groq 正式加入 Hugging Face 推理提供商(Inference Providers)支援極速開源模型推理

Original: Groq on Hugging Face Inference Providers 🔥

Hugging Face announced a deep partnership with Groq, a chip company focused on ultra-fast AI inference, formally bringing Groq into the…

Hugging Face 正式將 Groq 納入其「推理提供商(Inference Providers)」生態系。開發者現在可以直接在 Hugging Face Hub 上,選擇由 Groq 的 LPU 晶片驅動的 API 來運行熱門開源模型(如 Llama 3 和 Mistral)。這項整合不僅簡化了高吞吐量、低延遲應用的開發流程,也為開源模型生態注入了更強大的硬體支援。

Hugging Face announced a deep partnership with Groq, a chip company focused on ultra-fast AI inference, formally bringing Groq into the Hugging Face "Inference Providers" program. This collaboration means that millions of developers active on the Hugging Face platform can now directly leverage Groq's LPU (Language Processing Unit) hardware to run and test a variety of mainstream open-source large language models (LLMs) on the platform, such as Meta's Llama series and Mistral.

Full summary

Free shows the 3-line summary; Pro unlocks the full deep summary (~300 words) so you never have to click through.

See Pro plans →

Want the original English / full article?

Read on Hugging Face Blog →

Summaries are AI-generated; the original article is authoritative.