在 Google Cloud Vertex AI 上部署 Meta Llama 3.1 405B 旗艦開源模型★ 75
Hugging Face Blog664 days agoReleaseMeta's Llama 3.1 405B is one of the most powerful open-source large language models available today, but its massive parameter count (405 billion) poses…
GGML 基礎入門介紹：讓大語言模型在消費級硬體上高效運行的關鍵技術★ 80
Hugging Face Blog670 days agoTutorialGGML is a lightweight, zero-dependency C/C++ tensor library developed by Georgi Gerganov. It was originally designed to enable efficient local inference of the…
Hugging Face 統一工具調用（Tool Use）標準：簡化開源 LLM Agent 開發流程★ 85
Hugging Face Blog671 days agoRelease### Background and Pain Points In AI agent development, "tool use" (also known as function calling) is the core capability that allows large language models…
如何將 AI 整合至你的企業：Vercel 的實戰指南與架構建議★ 75
Vercel Changelog677 days agoTutorialAs generative AI develops rapidly, many enterprises are trying to move AI from the "proof of concept (PoC)" stage into actual production environments. Vercel…
Hugging Face 聯手 NVIDIA NIM 推出無伺服器推論服務 (Serverless Inference)★ 82
Hugging Face Blog685 days agoReleaseHugging Face and NVIDIA announced a major partnership in late July 2024, officially launching a serverless inference service powered by NVIDIA NIM (NVIDIA…
Replicate Intelligence #8：Llama 3.1 頂級開源模型上線、全新安全分類器與模型搜尋 API★ 75
Replicate Blog688 days agoReleaseReplicate has published its eighth issue of technical intelligence (Replicate Intelligence #8), bringing three major updates for developers: 1. **Top…
Meta 推出 Llama 3.1：405B、70B 與 8B 旗艦開源模型，支援多語言與 128K 超長上下文★ 95
Hugging Face Blog691 days agoReleaseMeta's Llama 3.1 represents a major milestone in the open-source AI landscape. The most notable model is the 405B (405 billion parameter) version — the first…
使用 API 運行 Meta Llama 3.1 405B：Replicate 雲端部署指南★ 85
Replicate Blog691 days agoReleaseOn July 23, 2024, Meta officially released the highly anticipated Llama 3.1 405B — one of the most powerful open-source large language models in the world…
TGI Multi-LoRA：部署一次即可同時提供 30 個微調模型服務★ 80
Hugging Face Blog696 days agoReleaseThe Hugging Face official blog has introduced a major update to its open-source text generation inference engine, Text Generation Inference (TGI): the…
如何利用 distilabel 打造 Argilla 2.0 專屬聊天機器人★ 75
Hugging Face Blog698 days agoTutorialIn the AI field, quickly building a chatbot that can accurately answer questions about a specific domain or newly released software has always been a major…
Hugging Face 宣布與 KerasHub 深度整合：輕鬆在 Hugging Face Hub 上分享與載入 Keras 3 模型★ 75
Hugging Face Blog704 days agoReleaseHugging Face officially announced a deep integration with KerasHub — the new unified library for natural language processing (NLP) and computer vision (CV) in…
Hugging Face 的 Transformers Code Agent 刷新 GAIA 基準測試紀錄 🏅★ 80
Hugging Face Blog713 days agoReleaseThe Hugging Face team published a blog post announcing that their Code Agent, developed using the `transformers` library, achieved a breakthrough score on the…
Replicate Intelligence #3：Garden State Llama、實用 LLM 指南與即時影像生成
Replicate Blog737 days agoCommentaryThis issue of Replicate Intelligence #3 brings curated content on three core themes for developers and AI enthusiasts: 1. **Garden State Llama**: This is a…
Hugging Face 推出 NPC-Playground：結合 Gigax 與 Cubzh 的 3D 智慧 NPC 互動沙盒★ 75
Hugging Face Blog739 days agoReleaseHugging Face has announced the launch of "NPC-Playground," a 3D interactive sandbox environment designed to showcase and test non-player characters (NPCs)…
Replicate Intelligence #1：動手實作 Llama 3、開源智慧眼鏡與透過字典學習控制語言模型★ 75
Replicate Blog751 days agoCommentaryThis Replicate technical digest (Intelligence #1) compiles three of the most talked-about technical breakthroughs and open-source projects in the AI community…
Meta 推出 CyberSecEval 2：評估大語言模型網路安全風險與防護能力的全面性框架★ 75
Hugging Face Blog751 days agoReleaseAs large language models (LLMs) become increasingly prevalent in software development and automated workflows, their "dual-use" risks in the cybersecurity…
在 Hugging Face 上輕鬆將模型部署至 AWS Inferentia2 晶片★ 75
Hugging Face Blog753 days agoReleaseHugging Face has announced official support for AWS Inferentia2 (Inf2) instances within its hosted Inference Endpoints service. This update gives developers…
從雲端到開發者：Hugging Face 與微軟深化合作，加速開源 AI 部署★ 75
Hugging Face Blog754 days agoBusinessDuring Microsoft Build 2024, Hugging Face announced a further strategic collaboration with Microsoft, aimed at providing developers with a more seamless…
Hugging Face 深度整合 AMD Instinct MI300X GPU：開箱即用的開源 AI 效能優化★ 75
Hugging Face Blog754 days agoReleaseWith the explosive growth of generative AI, demand for high-performance GPUs has reached an unprecedented level. To break hardware monopolies and reduce AI…
在地端構建 AI：Hugging Face 聯手戴爾推出 Dell Enterprise Hub★ 75
Hugging Face Blog754 days agoReleaseHugging Face and Dell Technologies have announced the launch of the "Dell Enterprise Hub," a new solution designed for enterprise on-premise AI deployment. As…
使用 Intel Gaudi 2 與 Intel Xeon 建構高性價比的企業級 RAG 應用★ 70
Hugging Face Blog766 days agoTutorialAs enterprise demand for Retrieval-Augmented Generation (RAG) technology surges, how to maintain high performance while controlling hardware costs has become…
Hugging Face 聯手 Artificial Analysis 推出 LLM 效能與成本排行榜★ 75
Hugging Face Blog772 days agoNew ToolHugging Face has announced a partnership with the independent AI performance analytics firm Artificial Analysis, officially integrating its "LLM Performance…
使用結構化生成提升 Prompt 一致性與輸出評估★ 75
Hugging Face Blog775 days agoTutorialWhen developing applications based on large language models (LLMs) — such as AI agents, RAG systems, or automated workflows — one of the biggest challenges…
Hugging Face 推出 Open Medical-LLM 排行榜：標準化評估醫療保健領域的大型語言模型★ 75
Hugging Face Blog786 days agoReleaseHugging Face has announced the official launch of the "Open Medical-LLM Leaderboard" in collaboration with researchers from Open Life Science AI and the…
使用 API 運行 Meta Llama 3：Replicate 雲端部署指南★ 75
Replicate Blog787 days agoNew ToolMeta officially released the highly anticipated open-source large language model Llama 3 on April 18, 2024, in two sizes: 8B (8 billion parameters) and 70B (70…
歡迎 Llama 3：Meta 全新開源大型語言模型正式登陸 Hugging Face★ 95
Hugging Face Blog787 days agoReleaseMeta officially released Llama 3, the next generation of its open-source large language models, on April 18, 2024. The initial release includes two parameter…
Ryght 攜手 Hugging Face 專家支援，賦能醫療與生命科學領域的 AI 轉型之旅
Hugging Face Blog789 days agoBusinessThis case study details how biomedical AI startup Ryght leveraged Hugging Face's Expert Support service to overcome the many challenges of deploying generative…
推出 LiveCodeBench 排行榜：全面且無污染的程式碼大語言模型評估★ 75
Hugging Face Blog789 days agoReleaseAs code large language models (Code LLMs) develop rapidly, fairly and accurately evaluating their capabilities has become a major challenge. Traditional…
使用 Hugging Face Dataset Viewer API 與 Motherduck DuckDB-NSQL-7B 實現自然語言轉 SQL (Text2SQL)★ 75
Hugging Face Blog801 days agoTutorialThis tutorial article details how to build an efficient natural language to SQL (Text2SQL) query system using tools from the Hugging Face ecosystem and a…
Hugging Face 聯手 Cloudflare：為開發者帶來無伺服器 GPU 推理服務★ 75
Hugging Face Blog803 days agoReleaseHugging Face and internet infrastructure giant Cloudflare have announced a major partnership that officially brings serverless GPU inference services to…