併發請求下的 Prefill 與 Decode：優化 LLM 推論效能的關鍵技術★ 82
Hugging Face Blog428 days agoTutorialWhen deploying large language models (LLMs), maintaining low latency and high throughput under high concurrency (concurrent requests) is one of the greatest…
17 個理由告訴你：為什麼 Gradio 不僅僅是另一個 UI 函式庫★ 75
Hugging Face Blog429 days agoCommentaryHugging Face's official blog published an article taking a deep dive into why Gradio is not just another simple UI library, but the most advantageous…
Cohere 正式加入 Hugging Face 推論提供商 (Inference Providers) 陣營 🔥★ 75
Hugging Face Blog429 days agoReleaseHugging Face's official blog announced that Cohere, the well-known enterprise AI research and development company, has officially joined Hugging Face's…
介紹 HELMET：全面評估長文本語言模型（Long-context LLMs）的新一代基準測試★ 80
Hugging Face Blog429 days agoRelease### Background and Pain Points: Moving Beyond the Overly Simple "Needle in a Haystack" Test In recent years, the context window length supported by large…
OpenAI 推出全新主力模型 GPT 4.1：效能與實用性的新平衡★ 85
TLDR AI (Buttondown)429 days agoReleaseOpenAI has officially released its new flagship model GPT 4.1, positioned as the next-generation "workhorse" designed to give developers and enterprises the…
Hugging Face 與 Protect AI 合作半週年成果：已掃描超過 400 萬個模型，守護開源 AI 安全★ 75
Hugging Face Blog431 days agoReleaseAs open-source AI models have grown explosively, Hugging Face has become the central hub for developers worldwide to access and share models. However…
Hugging Face 收購 Pollen Robotics，將開始銷售開源機器人硬體★ 85
Hugging Face Blog431 days agoBusinessHugging Face, the world's largest open-source AI community platform, has been actively expanding into embodied AI and robotics in recent years. This…
AINews：今天沒什麼大事，推薦關注 SF Compute 與 GPU 新興雲端服務討論
TLDR AI (Buttondown)433 days agoCommentaryAfter a week that was expected to potentially be turbulent but turned out to be quite calm, the latest issue of AINews briefly declares that "nothing major…
Visual Salamandra 7B 發布：巴塞隆納超級電腦中心推出開源多模態大模型，主打多語言與視覺理解★ 70
Hugging Face Blog433 days agoReleaseThe Language Technologies department (BSC-LT) of the Barcelona Supercomputing Center (BSC) recently released a new open-source multimodal model on Hugging Face…
【AINews】平靜中的暗潮：OpenAI 記憶更新與 GPT-4.1 洩露、xAI 正式推出 Grok 3 API★ 75
TLDR AI (Buttondown)433 days agoReleaseAlthough AINews characterized these two days as "a calm day," in reality, tech giants and the open-source community remained full of undercurrents. First, on…
Google 發表 Agent2Agent (A2A) 協定：攜手 Anthropic MCP 打造跨 Agent 協同新標準★ 85
TLDR AI (Buttondown)434 days agoReleaseAt the 2025 Google Cloud Next conference, Google dropped two bombshells regarding the AI Agent ecosystem. The CEOs of Google and Google DeepMind jointly…
DeepCoder：Together 與 Agentica 推出達到 o3-mini 水準的 14B 完全開源程式碼推理模型★ 85
TLDR AI (Buttondown)435 days agoReleaseAfter DeepSeek R1 set off a wave of open-source reasoning models, the open-source community saw many projects attempting to replicate its path to success…
Hugging Face 與 Cloudflare 聯手合作，透過 FastRTC 打造無縫的即時語音與視訊體驗★ 75
Hugging Face Blog436 days agoNew ToolHugging Face and internet infrastructure giant Cloudflare have announced a new partnership aimed at simplifying the development process for real-time voice and…
Hugging Face 推出阿拉伯語 LLM 評估新標準：引入阿拉伯語指令遵循（IFEval）與更新 AraGen
Hugging Face Blog437 days agoReleaseHugging Face recently announced a major upgrade to its Arabic Large Language Model (LLM) leaderboard, aiming to provide a more credible and comprehensive…
Llama 4 正式登場！Meta 於 Hugging Face 釋出 Maverick 與 Scout 兩款全新模型★ 95
Hugging Face Blog440 days agoReleaseMeta's open-source Llama model family has reached a major milestone with the official release of two brand-new Llama 4 models on the Hugging Face platform…
Gradio 邁向 100 萬用戶的旅程！Hugging Face 慶祝開源 AI 介面庫的重要里程碑
Hugging Face Blog441 days agoCommentaryGradio, the open-source machine learning web interface building tool, has officially reached the significant milestone of one million users (developers)…
Hugging Face 經典 NLP 課程正式轉型為 LLM 課程：迎向大語言模型時代的全面升級★ 85
Hugging Face Blog442 days agoTutorialHugging Face's "NLP Course" has long been a must-read classic for developers and researchers worldwide looking to enter the fields of Transformers and natural…
效率化請求佇列：優化 LLM 推論效能的關鍵策略★ 75
Hugging Face Blog442 days agoTutorial### The Unique Challenges and Memory Bottlenecks of LLM Inference Traditional web services primarily handle concurrent requests through multi-threading or…
在 Intel Gaudi 上使用 TGI 加速大型語言模型（LLM）推理★ 75
Hugging Face Blog448 days agoReleaseHugging Face's official blog has announced that its widely adopted open-source large model inference framework, Text Generation Inference (TGI), now officially…
Hugging Face 發布 Open R1 第四次更新：開源推理模型訓練的最新進展與最佳化★ 85
Hugging Face Blog449 days agoReleaseHugging Face's Open R1 project aims to fully open-source and replicate the training pipeline of DeepSeek-R1's reasoning model. In the latest fourth update…
使用 Sentence Transformers 訓練與微調 Reranker 重排模型教學★ 80
Hugging Face Blog450 days agoTutorialWhen building RAG (Retrieval-Augmented Generation) systems, relying solely on vector embeddings for semantic search is often not precise enough. To improve…
Gradio 推出全新 Dataframe 元件：效能與互動體驗全面升級！★ 75
Hugging Face Blog452 days agoReleaseIn machine learning and AI application development, Gradio has long been the go-to tool for developers looking to quickly build web interfaces. However…
Hugging Face Inference Endpoints 推出全新分析儀表板，全面提升模型監控與 MLOps 體驗
Hugging Face Blog455 days agoReleaseHugging Face recently announced a major upgrade to its hosted model deployment service, "Inference Endpoints," introducing a brand-new and far more modern…
xAI 與 Vercel 攜手合作，為開發者提供無縫的 Grok 模型開發體驗★ 75
Vercel Changelog455 days agoReleaseVercel announced on March 20, 2025, a strategic partnership with xAI, the AI research company founded by Elon Musk. The core mission of this collaboration is…
Open R1：如何在本機使用 LM Studio 運行 OlympicCoder 進行程式開發★ 75
Hugging Face Blog456 days agoTutorialHugging Face has recently released an updated practical guide for the Open R1 project, walking developers through how to locally deploy and run "OlympicCoder"…
Hugging Face 針對白宮 AI 行動計畫徵求意見稿（RFI）提出政策回應：力挺開源與開放科學
Hugging Face Blog457 days agoOpinionIn March 2025, Hugging Face submitted a formal policy response to the White House's Request for Information (RFI) on the AI Action Plan. As the world's largest…
NVIDIA 於 GTC 2025 為實體 AI 開發者帶來重大發表：推出全新開源模型與資料集★ 85
Hugging Face Blog458 days agoReleaseAt NVIDIA GTC 2025, NVIDIA unveiled a remarkable set of new open-source models and datasets for the field of "Physical AI" — also known as embodied…
Hugging Face 正式整合 Xet 技術：超大型模型與資料集 Git 版本控制迎來全新升級★ 80
Hugging Face Blog458 days agoRelease### Background and Pain Points: The Limitations of Git LFS Hugging Face Hub, as the world's largest AI model and dataset hosting platform, has long relied on…
Google 推出全新 Gemma 3：支援多模態、多語言與長文本的開源大語言模型★ 90
Hugging Face Blog464 days agoReleaseGoogle has officially launched Gemma 3, the next generation of its open-source large language model series — a major technical leap forward from Gemma 2. Gemma…
Open R1 第三次更新：Hugging Face 釋出開源推理模型與 GRPO 訓練優化細節★ 85
Hugging Face Blog464 days agoReleaseSince its launch, Hugging Face's Open R1 project has been dedicated to replicating the reasoning capabilities of DeepSeek-R1 in a fully open-source manner. In…