Replicate Intelligence #5：超強開源程式碼模型 DeepSeek-Coder-V2、AI 搜尋突破與 Discord 客服機器人
Replicate Blog728 days agoReleaseReplicate published their technical newsletter "Replicate Intelligence #5," with this issue focusing on major breakthroughs and real-world applications in the…
Hugging Face「Data Is Better Together」社群數據協作計劃：回顧與展望
Hugging Face Blog729 days agoRelease### Background In the current development of large language models (LLMs), high-quality alignment data (such as the preference data required for RLHF and DPO)…
邁向多模態：Prezi 如何利用 Hugging Face Hub 與專家支持計畫加速其機器學習路線圖
Hugging Face Blog730 days agoBusinessIn this case study, Prezi — the well-known company behind the non-linear presentation software of the same name — shares how it is embracing the "multimodal…
BigCodeBench：下一代 Code LLM 評測基準 HumanEval 的繼承者★ 80
Hugging Face Blog731 days agoReleaseAs large language models (LLMs) have made tremendous strides in code generation, the long-standing industry gold standard — the HumanEval benchmark — has…
Replicate Intelligence #4：探索 GPT 模型中的概念、瀏覽器即時語音轉文字與 H100 GPU 即將上線
Replicate Blog735 days agoReleaseReplicate has published its technical newsletter, Replicate Intelligence #4, summarizing recent major developments in the AI field as well as the latest…
從 DeepSpeed 到 FSDP 再切換回來：使用 Hugging Face Accelerate 實現無縫分散式訓練★ 75
Hugging Face Blog736 days agoTutorialIn the era of large language models (LLMs), the VRAM of a single GPU is often insufficient to hold models with tens of billions of parameters. To overcome this…
NVIDIA H100 GPU 即將登陸 Replicate：支援更快速的模型推理與訓練
Replicate Blog737 days agoReleaseThe official blog of Replicate, the popular AI model hosting and deployment platform, has announced that NVIDIA H100 Tensor Core GPUs will soon be officially…
Hugging Face 推出 RLOO 演算法：降低記憶體消耗，讓強化學習重回 RLHF 主流★ 80
Hugging Face Blog737 days agoReleaseIn recent years, methods such as Direct Preference Optimization (DPO) have become mainstream for large language model (LLM) alignment, as they eliminate the…
Diffusers 正式支援 Stable Diffusion 3：更強大的圖像生成與記憶體優化★ 80
Hugging Face Blog737 days agoReleaseHugging Face's official blog announced that its diffusers library now officially supports Stable Diffusion 3 (SD3), the latest release from Stability AI. SD3…
Hugging Face 推出適用於 Amazon SageMaker 的 Embedding 容器，大幅提升向量生成效能★ 75
Hugging Face Blog742 days agoReleaseHugging Face has announced the launch of a new Hugging Face Embedding container (Deep Learning Container, DLC) designed specifically for Amazon SageMaker. This…
Hugging Face 重塑 Transformers 文件結構：解決「混亂」的全新設計
Hugging Face Blog742 days agoReleaseHugging Face's official blog published an article titled "Making sense of this mess," announcing a comprehensive redesign of the official documentation for its…
Replicate Intelligence #3：Garden State Llama、實用 LLM 指南與即時影像生成
Replicate Blog742 days agoCommentaryThis issue of Replicate Intelligence #3 brings curated content on three core themes for developers and AI enthusiasts: 1. **Garden State Llama**: This is a…
Hugging Face 聯合 Artificial Analysis 推出「文字生成圖片」排行榜與競技場★ 75
Hugging Face Blog743 days agoNew ToolHugging Face has partnered with independent AI evaluation organization Artificial Analysis to officially launch the "Text to Image Leaderboard & Arena." This…
Hugging Face 推出 NPC-Playground：結合 Gigax 與 Cubzh 的 3D 智慧 NPC 互動沙盒★ 75
Hugging Face Blog744 days agoReleaseHugging Face has announced the launch of "NPC-Playground," a 3D interactive sandbox environment designed to showcase and test non-player characters (NPCs)…
Intel Gaudi 支援更快的輔助生成（Assisted Generation），顯著提升 LLM 推理速度
Hugging Face Blog745 days agoReleaseHugging Face, in collaboration with Intel, has announced official support for "Assisted Generation" (also commonly known as Speculative Decoding) on Intel…
Hugging Face 發布 Spaces 平台安全更新：部分用戶 Secrets 恐遭外洩，已主動重置 Token★ 85
Hugging Face Blog749 days agoIncidentHugging Face officially released a major security update announcement on May 31, 2024. The company stated that its security team had detected signs of…
Replicate Intelligence #2：更快的圖像生成、AI 驅動的世界模擬器與 AI 資料集複雜度洞察★ 75
Replicate Blog749 days agoCommentaryReplicate's technical newsletter, Replicate Intelligence #2, takes a deep dive into three of the most hotly discussed trends in the open-source AI community…
評測 Text Generation Inference (TGI)：如何量化與優化大語言模型推理性能★ 75
Hugging Face Blog751 days agoTutorialThis official Hugging Face blog post takes an in-depth look at how to benchmark Text Generation Inference (TGI), Hugging Face's open-source LLM inference and…
使用 Sentence Transformers 訓練與微調嵌入模型 (Embedding Models)★ 80
Hugging Face Blog752 days agoReleaseThe official Hugging Face blog introduces a major update to the Sentence Transformers library (v3.0), centered on the launch of the new…
Meta 推出 CyberSecEval 2：評估大語言模型網路安全風險與防護能力的全面性框架★ 75
Hugging Face Blog756 days agoReleaseAs large language models (LLMs) become increasingly prevalent in software development and automated workflows, their "dual-use" risks in the cybersecurity…
阿布達比 TII 發表 Falcon 2 11B：搭載 5 兆 Token 訓練的預訓練語言與視覺語言模型★ 75
Hugging Face Blog756 days agoReleaseThe Technology Innovation Institute (TII) of Abu Dhabi has officially released a new open-source model family on Hugging Face — Falcon 2 11B. This model, with…
Replicate Intelligence #1：動手實作 Llama 3、開源智慧眼鏡與透過字典學習控制語言模型★ 75
Replicate Blog756 days agoCommentaryThis Replicate technical digest (Intelligence #1) compiles three of the most talked-about technical breakthroughs and open-source projects in the AI community…
Replicate 揭露共享網路安全漏洞：已修復多租戶隔離缺陷，未發現用戶數據洩漏★ 75
Replicate Blog757 days agoIncidentAI model hosting platform Replicate published a security advisory on May 23, 2024, disclosing a "Shared Network Vulnerability" affecting its multi-tenant…
在 Hugging Face 上輕鬆將模型部署至 AWS Inferentia2 晶片★ 75
Hugging Face Blog758 days agoReleaseHugging Face has announced official support for AWS Inferentia2 (Inf2) instances within its hosted Inference Endpoints service. This update gives developers…
從雲端到開發者：Hugging Face 與微軟深化合作，加速開源 AI 部署★ 75
Hugging Face Blog759 days agoBusinessDuring Microsoft Build 2024, Hugging Face announced a further strategic collaboration with Microsoft, aimed at providing developers with a more seamless…
在地端構建 AI：Hugging Face 聯手戴爾推出 Dell Enterprise Hub★ 75
Hugging Face Blog759 days agoReleaseHugging Face and Dell Technologies have announced the launch of the "Dell Enterprise Hub," a new solution designed for enterprise on-premise AI deployment. As…
Hugging Face 深度整合 AMD Instinct MI300X GPU：開箱即用的開源 AI 效能優化★ 75
Hugging Face Blog759 days agoReleaseWith the explosive growth of generative AI, demand for high-performance GPUs has reached an unprecedented level. To break hardware monopolies and reduce AI…
Hugging Face 推出 Spaces 開發者模式（Dev Mode）：支援 VS Code 與 SSH 的無縫開發體驗★ 75
Hugging Face Blog759 days agoReleaseHugging Face has officially announced the launch of the new "Spaces Dev Mode," an important feature designed to improve AI application development efficiency…
解鎖更長的文本生成：深入探討 Key-Value (KV) 快取量化技術★ 80
Hugging Face Blog764 days agoTutorialDuring the inference process of large language models (LLMs), the self-attention mechanism needs to store the Key and Value vectors of historical tokens (i.e…
Hugging Face 推出 Open Arabic LLM 排行榜，加速阿拉伯語大語言模型評測與發展
Hugging Face Blog766 days agoReleaseHugging Face has announced the launch of the "Open Arabic LLM Leaderboard," an important initiative aimed at advancing Arabic natural language processing (NLP)…