使用結構化生成提升 Prompt 一致性與輸出評估★ 75
Hugging Face Blog775 days agoTutorialWhen developing applications based on large language models (LLMs) — such as AI agents, RAG systems, or automated workflows — one of the biggest challenges…
Hugging Face 推出 Open Medical-LLM 排行榜：標準化評估醫療保健領域的大型語言模型★ 75
Hugging Face Blog786 days agoReleaseHugging Face has announced the official launch of the "Open Medical-LLM Leaderboard" in collaboration with researchers from Open Life Science AI and the…
歡迎 Llama 3：Meta 全新開源大型語言模型正式登陸 Hugging Face★ 95
Hugging Face Blog787 days agoReleaseMeta officially released Llama 3, the next generation of its open-source large language models, on April 18, 2024. The initial release includes two parameter…
Ryght 攜手 Hugging Face 專家支援，賦能醫療與生命科學領域的 AI 轉型之旅
Hugging Face Blog789 days agoBusinessThis case study details how biomedical AI startup Ryght leveraged Hugging Face's Expert Support service to overcome the many challenges of deploying generative…
推出 LiveCodeBench 排行榜：全面且無污染的程式碼大語言模型評估★ 75
Hugging Face Blog789 days agoReleaseAs code large language models (Code LLMs) develop rapidly, fairly and accurately evaluating their capabilities has become a major challenge. Traditional…
使用 Hugging Face Dataset Viewer API 與 Motherduck DuckDB-NSQL-7B 實現自然語言轉 SQL (Text2SQL)★ 75
Hugging Face Blog801 days agoTutorialThis tutorial article details how to build an efficient natural language to SQL (Text2SQL) query system using tools from the Hugging Face ecosystem and a…
Hugging Face 聯手 Cloudflare：為開發者帶來無伺服器 GPU 推理服務★ 75
Hugging Face Blog803 days agoReleaseHugging Face and internet infrastructure giant Cloudflare have announced a major partnership that officially brings serverless GPU inference services to…
介紹 Chatbot Guardrails Arena：評估大語言模型安全防護網的全新競技場★ 75
Hugging Face Blog815 days agoReleaseAs large language models (LLMs) have been widely adopted across industries, ensuring AI systems remain safe and compliant while preventing harmful outputs has…
GaLore：在消費級硬體上訓練大型語言模型的突破性技術★ 85
Hugging Face Blog816 days agoReleaseAs the parameter counts of large language models (LLMs) have skyrocketed, the hardware requirements for training and fine-tuning these models have risen…
Hugging Face 推出 Red-Teaming 抗性排行榜：評估 LLM 抵禦惡意越獄與對抗性攻擊的能力★ 75
Hugging Face Blog842 days agoRelease### Background: The Shortcomings of Static Safety Evaluations As large language models (LLMs) are widely adopted across industries, AI safety has become an…
開源合成數據：如何幫你省錢、省時並減少碳排放★ 75
Hugging Face Blog849 days agoOpinionThis article takes an in-depth look at the critical role of "synthetic data" in the open-source ecosystem, and explains how it helps enterprises and developers…
Hugging Face 推出 NPHardEval 排行榜：透過計算複雜度與動態更新揭示大型語言模型的推理能力★ 75
Hugging Face Blog863 days agoReleaseHugging Face has announced the launch of the new **NPHardEval** leaderboard — a benchmark specifically designed to evaluate the reasoning capabilities of large…
Hugging Face TGI (Text Generation Inference) 正式支援 AWS Inferentia2 晶片★ 75
Hugging Face Blog864 days agoReleaseHugging Face has partnered with AWS to officially bring its widely popular open-source LLM inference optimization framework, Text Generation Inference (TGI)…
Hugging Face 推出「企業情境排行榜」：專為真實世界應用設計的 LLM 評測基準★ 75
Hugging Face Blog865 days agoReleaseHugging Face has partnered with Patronus AI — a startup focused on LLM evaluation and defense — to officially launch the **Enterprise Scenarios Leaderboard**…
Hugging Face 推出「幻覺排行榜」，開源量化評估大型語言模型的幻覺率★ 75
Hugging Face Blog867 days agoReleaseWhile large language models (LLMs) have demonstrated remarkable generative capabilities across many domains, "hallucination" — where a model confidently…
Hugging Face 推出 AI Secure LLM 安全排行榜：基於 DecodingTrust 框架深度評估大模型信任度★ 75
Hugging Face Blog870 days agoRelease### Introduction: Capability Is Not Safety — A New Benchmark for LLM Safety Evaluation As large language models (LLMs) are adopted more deeply across…
使用開源 LLM 作為 LangChain Agent：Hugging Face 實作指南★ 80
Hugging Face Blog872 days agoTutorialThis official Hugging Face blog post provides a detailed guide on how to use open-source large language models (LLMs) as intelligent agents within LangChain…
使用 Unsloth 與 🤗 TRL 讓 LLM 微調速度提升 2 倍★ 80
Hugging Face Blog886 days agoReleaseHugging Face's official blog announced a partnership with the Unsloth team to integrate Unsloth's efficient fine-tuning technology directly into Hugging Face's…
2023 年：開源大語言模型（Open LLMs）爆發之年★ 75
Hugging Face Blog909 days agoCommentaryLooking back on 2023, the most notable trend in the AI landscape was the explosive growth of open-source large language models (Open LLMs). In this annual…
Replicate 完成由 a16z 領投的 4,000 萬美元 B 輪融資，加速企業基於開源 AI 進行開發★ 75
Replicate Blog922 days agoBusinessAI infrastructure startup Replicate announced the successful completion of a $40 million Series B funding round. This round was led by prominent Silicon Valley…
告別冷啟動：Hugging Face 如何將 LoRA 推論速度提升 300%★ 85
Hugging Face Blog922 days agoReleaseIn real-world generative AI applications, fine-tuning for specific tasks or clients is a common requirement. However, deploying a full base model for every…
Optimum-NVIDIA：只需一行程式碼，即可解鎖極速 LLM 推理★ 80
Hugging Face Blog922 days agoReleaseHugging Face announced the launch of a new open-source library called "Optimum-NVIDIA," the result of a deep collaboration with NVIDIA, aimed at seamlessly…
讓你的 Llama 生成速度飛起來：使用 AWS Inferentia2 進行加速★ 72
Hugging Face Blog950 days agoTutorialAs large language models (LLMs) such as Llama 2 become more widely adopted, achieving efficient and cost-effective inference in production environments has…
比較大語言模型性能：深入探討使用 LoRA 微調 RoBERTa、Llama 2 與 Mistral 進行災難推特分析★ 75
Hugging Face Blog950 days agoTutorialThis Hugging Face blog post takes an in-depth look at how to use LoRA (Low-Rank Adaptation) to fine-tune three models of different architectures and scales for…
使用 Llama 2 與 Grammar 進行結構化資訊萃取 (Jet-setting with Llama 2 + Grammars)★ 75
Replicate Blog979 days agoTutorialIn practical natural language processing (NLP) applications, converting unstructured text (such as emails or conversation logs) into structured data (such as…
Chat Templates：終結默默蠶食模型效能的隱形殺手★ 85
Hugging Face Blog985 days agoReleaseAs large language models (LLMs) shift toward conversational (Chat/Instruct) applications, correctly formatting and feeding a user's conversation history —…
Llama 2 在 Amazon SageMaker 上的部署效能基準測試
Hugging Face Blog992 days agoTutorialThis Hugging Face blog post presents detailed performance benchmarks for deploying Meta's open-source large language models — Llama 2 (covering 7B, 13B, and…
Hugging Face 為 PRO 訂閱者推出專屬推理服務：更高速率、支援大型開源模型★ 70
Hugging Face Blog996 days agoReleaseThe Hugging Face official blog has announced a new "Inference for PROs" upgraded service for PRO subscribers (at $9 per month). This service is designed to…
使用 PyTorch FSDP 高效微調 Llama 2 70B：解決 CPU 記憶體不足的實務指南★ 72
Hugging Face Blog1,005 days agoTutorialWhen fine-tuning massively large open-source models like Llama 2 70B — with its 70 billion parameters — developers frequently encounter a bottleneck that goes…
Replicate 大幅優化微調模型冷啟動時間，現在只需不到一秒即可完成載入★ 75
Replicate Blog1,012 days agoReleaseAI cloud hosting platform Replicate has announced a major technical breakthrough for fine-tuned models: the "cold boot" time for fine-tuned models has been…