🔥 Trending today
Furiosa AI inference chip could be a game changer for local LLMs
r/LocalLLaMA top day4 days agoHardwareA r/LocalLLaMA post discusses Furiosa AI’s RNGD inference chip, citing TSMC 5nm, Hynix HBM3, 48GB VRAM, 1.5TB/s bandwidth, and 180W TDP. The author argues it could matter for local LLM users if Furiosa opens its programming interface and works with llama.cpp on a GGML backend. The post later clarifies Furiosa is not selling to consumers; this is a wish and market commentary, not a launch.
Intel: Upcoming AI chip will be cheaper, run cooler than Nvidia and AMD options
Ars Technica AI13 days agoHardwareIntel says its upcoming Crescent Island AI chip will be cheaper and run cooler than Nvidia and AMD alternatives. The disclosed details are limited: Crescent Island is air-cooled and uses LPDDR5 memory. The provided text does not include pricing, performance benchmarks, launch timing, power figures, or the specific competing chips used for comparison.