Clustering 3x Jetson Nano Orin Supers for Distributed AI
r/LocalLLaMA top day7 days agoTutorialA developer has shared a practical guide on clustering three NVIDIA Jetson Nano Orin Super boards, leveraging their Ampere CUDA cores and unified memory. This project is part of 'smolcluster,' an initiative to make distributed AI training and inference accessible using everyday hardware like Macs, Raspberry Pis, and Jetsons. The series aims to explore whether heterogeneous clusters (mixing different hardware architectures) can effectively run local LLMs.
Nvidia is proposing a beast of a CPU system for Windows PCs
Hacker News (AI keywords)8 days agoHardwareBased only on the title, Nvidia appears to be proposing a high-end CPU system for Windows PCs. That could signal deeper ambitions beyond GPUs and AI accelerators into the core PC platform. However, no article text is available, so the architecture, specs, partners, timing, and product positioning remain unconfirmed.
Is Silicon Valley ready to put robots in people’s homes? Hello Robot is.
TechCrunch AI10 days agoHardwareHello Robot has released Stretch 4, the fourth generation of its home assistance robot. The company is taking a cautious, deployment-first approach, using a wheeled base, telescoping arm, sensors, and human-in-the-loop control rather than promising a general-purpose humanoid. TechCrunch frames Stretch as a practical bet on real household data, assistive use cases, and safer hardware for people with mobility challenges.
Tohoku University Breakthrough: Secondary Phase Engineering Solves Solid-State Magnesium Battery Bottleneck
INSIDE 硬塞 AI19 days agoHardwareResearchers at Tohoku University have developed a novel magnesium-tin (Mg-Sn) alloy anode for solid-state magnesium batteries. By utilizing "secondary phase engineering," they turned detrimental interfacial reactions into an advantage. This breakthrough extends the battery's cycle life by over 400 times, achieving stable operation for more than 1,300 hours.
Huawei Challenges TSMC with "τ Scaling Law" Aiming for Equivalent 1.4nm Chips by 2031★ 75
INSIDE 硬塞 AI20 days agoHardwareTo bypass US semiconductor equipment sanctions, Huawei has introduced the "τ (Tau) scaling law." Instead of physical transistor shrinking, this approach focuses on reducing signal propagation delay via design-level innovations like logic folding. Huawei aims to achieve performance equivalent to a 1.4nm node by 2031, challenging TSMC's lithography-centric dominance.
三星半導體員工達成協議：今年可望獲得平均 34 萬美元的巨額獎金
The Verge AI23 days agoBusinessAccording to the latest reports from foreign media, South Korean tech giant Samsung Electronics has reached a preliminary settlement agreement with employees…
川普政府斥資 20 億美元入股 9 家量子運算公司，IBM 獲 10 億建立美國首座量子晶片代工廠★ 75
INSIDE 硬塞 AI23 days agoBusinessThe U.S. government recently announced that it will allocate $2 billion under the CHIPS and Science Act to directly invest in and fund nine domestic quantum…
AI 進入推論時代！AMD 蘇姿丰看好 CPU 市場年增 35%，架構將趨向「1:1」★ 75
INSIDE 硬塞 AI23 days agoOpinionAMD CEO Lisa Su recently shared her latest views on the AI hardware market, pointing out that the AI industry is approaching a critical inflection point…
神秘 AI 新創 Hark 完成 7 億美元 A 輪融資，打造「通用」AI 介面與專屬硬體★ 75
TechCrunch AI24 days agoBusinessThe mysterious AI startup Hark has announced the successful completion of a Series A funding round totaling $700 million (approximately NT$22 billion), capital…
黃仁勳預測 Nvidia 的下一個「全新」2000 億美元市場：用於 AI Agent 的 CPU★ 85
TechCrunch AI24 days agoBusinessNvidia CEO Jensen Huang has recently put forward a major market prediction, stating that Nvidia has its sights set on a brand-new market worth as much as $200…
Cerebras 迎來 600 億美元 IPO：起步緩慢，隨後一飛沖天★ 85
Latent Space29 days agoBusinessAI chip design unicorn Cerebras Systems officially entered its long-awaited initial public offering (IPO) at a valuation of $60 billion. This company…
Import AI 444：LLM 社會學、華為用 AI 寫作業系統核心、晶片設計基準測試 ChipBench★ 75
Import AI (Jack Clark)125 days agoCommentaryThis edition of Import AI (Issue 444), written by Jack Clark, delves into the latest breakthroughs in artificial intelligence across three domains: social…
探討全球算力格局的轉變：Hugging Face 剖析 AI 基礎設施的未來★ 75
Hugging Face Blog228 days agoOpinionAgainst the backdrop of explosive global growth in artificial intelligence, compute has become the core resource that determines technological competitiveness…
在 Intel Gaudi 上使用 TGI 加速大型語言模型（LLM）推理★ 75
Hugging Face Blog443 days agoReleaseHugging Face's official blog has announced that its widely adopted open-source large model inference framework, Text Generation Inference (TGI), now officially…
介紹 AMD 第 5 代 EPYC™ 處理器：Hugging Face 攜手 AMD 釋放 CPU 的 AI 推論潛能★ 75
Hugging Face Blog612 days agoReleaseAMD has officially launched its 5th-generation EPYC processor, codenamed "Turin," and Hugging Face has promptly published a blog post detailing the deep…
Hugging Face 深度整合 AMD Instinct MI300X GPU：開箱即用的開源 AI 效能優化★ 75
Hugging Face Blog754 days agoReleaseWith the explosive growth of generative AI, demand for high-performance GPUs has reached an unprecedented level. To break hardware monopolies and reduce AI…
使用 Intel Gaudi 2 與 Intel Xeon 建構高性價比的企業級 RAG 應用★ 70
Hugging Face Blog766 days agoTutorialAs enterprise demand for Retrieval-Augmented Generation (RAG) technology surges, how to maintain high performance while controlling hardware costs has become…
AMD 舉辦 Pervasive AI 開發者大賽！攜手 Hugging Face 推廣多元硬體 AI 應用
Hugging Face Blog851 days agoBusinessAMD and Hugging Face have jointly announced the "AMD Pervasive AI Developer Contest," a global competition designed to inspire developers worldwide to build…
在 Habana Gaudi2 加速器上實現大型語言模型快速推理：以 BLOOMZ 為例
Hugging Face Blog1,174 days agoTutorialThis article presents the results of a collaboration between Hugging Face and the Intel Habana team, focusing on how to leverage Intel's Habana Gaudi2 deep…
訓練與推論速度大對決：Habana Gaudi®2 效能超越 Nvidia A100 80GB
Hugging Face Blog1,278 days agoCommentaryAs large language models (LLMs) and generative AI exploded in popularity, demand for computing power surged dramatically, leaving Nvidia GPUs (such as the…