GMKtec Announces EVO-X3 Mini PC, Teases 192GB Ryzen AI MAX+ 495 "Strix Halo" Monster★ 78
r/LocalLLaMA top day7 days agoHardwareGMKtec has announced its EVO-X3 mini PC with upgraded I/O, including OCuLink and Wi-Fi 7. More importantly for local AI enthusiasts, the company teased a future model powered by AMD's flagship "Strix Halo" Ryzen AI MAX+ 495 APU. This upcoming monster will support up to 192GB of LPDDR5X memory, offering a highly anticipated, cost-effective alternative to Apple Silicon for running large local LLMs.
End of an Era for Budget LLM Rigs: User's X99 Motherboard Dies
r/LocalLLaMA top day7 days agoHardwareA popular Reddit post on r/LocalLLaMA highlights a user's X99 motherboard finally dying. The Intel X99 platform, paired with cheap recycled Xeon CPUs, has long been a legendary budget choice for running local LLMs with multiple GPUs. The post triggered a wave of nostalgic "F" comments, marking the gradual end of these classic DIY budget rigs.
Clustering 3x Jetson Nano Orin Supers for Distributed AI
r/LocalLLaMA top day7 days agoTutorialA developer has shared a practical guide on clustering three NVIDIA Jetson Nano Orin Super boards, leveraging their Ampere CUDA cores and unified memory. This project is part of 'smolcluster,' an initiative to make distributed AI training and inference accessible using everyday hardware like Macs, Raspberry Pis, and Jetsons. The series aims to explore whether heterogeneous clusters (mixing different hardware architectures) can effectively run local LLMs.
Nvidia is proposing a beast of a CPU system for Windows PCs
Hacker News (AI keywords)8 days agoHardwareBased only on the title, Nvidia appears to be proposing a high-end CPU system for Windows PCs. That could signal deeper ambitions beyond GPUs and AI accelerators into the core PC platform. However, no article text is available, so the architecture, specs, partners, timing, and product positioning remain unconfirmed.
Jensen Huang Calls Marvell the Next Trillion-Dollar Company at Computex
INSIDE 硬塞 AI12 days agoHardwareAt Computex, Marvell argued that connectivity is becoming a key bottleneck for AI infrastructure as systems scale. NVIDIA CEO Jensen Huang appeared at the event and described Marvell as the next trillion-dollar company. The presentation highlighted Marvell's AI connectivity stack, reflecting growing industry attention on the links supporting large-scale AI systems.
AI 搶佔晶圓產能！高頻寬記憶體（HBM）擠壓效應正推升消費性電子與平價手機價格★ 75
Simon Willison's Weblog22 days agoBusinessWell-known tech blogger Simon Willison recently shared and recommended an article by David Oks that provides an in-depth analysis of how the AI boom is…
三星半導體員工達成協議：今年可望獲得平均 34 萬美元的巨額獎金
The Verge AI23 days agoBusinessAccording to the latest reports from foreign media, South Korean tech giant Samsung Electronics has reached a preliminary settlement agreement with employees…
川普政府斥資 20 億美元入股 9 家量子運算公司，IBM 獲 10 億建立美國首座量子晶片代工廠★ 75
INSIDE 硬塞 AI23 days agoBusinessThe U.S. government recently announced that it will allocate $2 billion under the CHIPS and Science Act to directly invest in and fund nine domestic quantum…
AI 進入推論時代！AMD 蘇姿丰看好 CPU 市場年增 35%，架構將趨向「1:1」★ 75
INSIDE 硬塞 AI23 days agoOpinionAMD CEO Lisa Su recently shared her latest views on the AI hardware market, pointing out that the AI industry is approaching a critical inflection point…
Build Adafruit projects right from Firefox
Hacker News (AI keywords)23 days agoHardwareFirefox is promoting a browser-based workflow for Adafruit users through Web Serial. The page says users can connect, code, and control compatible hardware devices from supported web tools without a separate desktop app. It points toward CircuitPython workflows and open web tooling, but it does not describe any AI model, benchmark, or generative AI feature.
神秘 AI 新創 Hark 完成 7 億美元 A 輪融資，打造「通用」AI 介面與專屬硬體★ 75
TechCrunch AI24 days agoBusinessThe mysterious AI startup Hark has announced the successful completion of a Series A funding round totaling $700 million (approximately NT$22 billion), capital…
黃仁勳預測 Nvidia 的下一個「全新」2000 億美元市場：用於 AI Agent 的 CPU★ 85
TechCrunch AI24 days agoBusinessNvidia CEO Jensen Huang has recently put forward a major market prediction, stating that Nvidia has its sights set on a brand-new market worth as much as $200…
Cerebras 迎來 600 億美元 IPO：起步緩慢，隨後一飛沖天★ 85
Latent Space29 days agoBusinessAI chip design unicorn Cerebras Systems officially entered its long-awaited initial public offering (IPO) at a valuation of $60 billion. This company…
Import AI 444：LLM 社會學、華為用 AI 寫作業系統核心、晶片設計基準測試 ChipBench★ 75
Import AI (Jack Clark)125 days agoCommentaryThis edition of Import AI (Issue 444), written by Jack Clark, delves into the latest breakthroughs in artificial intelligence across three domains: social…
探討全球算力格局的轉變：Hugging Face 剖析 AI 基礎設施的未來★ 75
Hugging Face Blog228 days agoOpinionAgainst the backdrop of explosive global growth in artificial intelligence, compute has become the core resource that determines technological competitiveness…
在 Intel Gaudi 上使用 TGI 加速大型語言模型（LLM）推理★ 75
Hugging Face Blog443 days agoReleaseHugging Face's official blog has announced that its widely adopted open-source large model inference framework, Text Generation Inference (TGI), now officially…
介紹 AMD 第 5 代 EPYC™ 處理器：Hugging Face 攜手 AMD 釋放 CPU 的 AI 推論潛能★ 75
Hugging Face Blog612 days agoReleaseAMD has officially launched its 5th-generation EPYC processor, codenamed "Turin," and Hugging Face has promptly published a blog post detailing the deep…
Hugging Face 深度整合 AMD Instinct MI300X GPU：開箱即用的開源 AI 效能優化★ 75
Hugging Face Blog754 days agoReleaseWith the explosive growth of generative AI, demand for high-performance GPUs has reached an unprecedented level. To break hardware monopolies and reduce AI…
使用 Intel Gaudi 2 與 Intel Xeon 建構高性價比的企業級 RAG 應用★ 70
Hugging Face Blog766 days agoTutorialAs enterprise demand for Retrieval-Augmented Generation (RAG) technology surges, how to maintain high performance while controlling hardware costs has become…
AMD 舉辦 Pervasive AI 開發者大賽！攜手 Hugging Face 推廣多元硬體 AI 應用
Hugging Face Blog851 days agoBusinessAMD and Hugging Face have jointly announced the "AMD Pervasive AI Developer Contest," a global competition designed to inspire developers worldwide to build…
在 Habana Gaudi2 加速器上實現大型語言模型快速推理：以 BLOOMZ 為例
Hugging Face Blog1,174 days agoTutorialThis article presents the results of a collaboration between Hugging Face and the Intel Habana team, focusing on how to leverage Intel's Habana Gaudi2 deep…
訓練與推論速度大對決：Habana Gaudi®2 效能超越 Nvidia A100 80GB
Hugging Face Blog1,278 days agoCommentaryAs large language models (LLMs) and generative AI exploded in popularity, demand for computing power surged dramatically, leaving Nvidia GPUs (such as the…