ggml-webgpu improves prefill speeds for k-quants in llama.cpp PR
r/LocalLLaMA top day5 days agoBenchmarkllama.cpp PR #24225 improves ggml-webgpu matrix multiplication performance for k-quants and refactors matmul paths for Q4/Q5/Q8 and k-quants. In pp512 tests on an M2 Pro, reported speedups range from about 1.33x to 3.78x across Q2_K, Q3_K, Q4_K, Q5_K, and Q6_K. The largest gains appear on Q3_K models, including Qwen and Gemma examples.
如何在 Chrome 擴充功能中使用 Transformers.js 運行本地 AI 模型★ 75
Hugging Face Blog52 days agoTutorialAs browser-side computing power continues to improve, deploying AI models directly on the user's local device has become a popular trend. Hugging Face has…
Transformers.js v4 正式上架 NPM！網頁端 WebGPU AI 迎來重大效能升級★ 85
Hugging Face Blog125 days agoReleaseHugging Face officially published Transformers.js v4 on NPM, marking a major milestone for running local AI models within the JavaScript ecosystem…
Hugging Face 發表 Transformers.js v3：支援 WebGPU、新增多款模型與任務，瀏覽器端 AI 效能迎來百倍提升★ 85
Hugging Face Blog600 days agoReleaseHugging Face has officially launched Transformers.js v3, the most significant update to this web-based machine learning library since its release…
Replicate Intelligence #4：探索 GPT 模型中的概念、瀏覽器即時語音轉文字與 H100 GPU 即將上線
Replicate Blog730 days agoReleaseReplicate has published its technical newsletter, Replicate Intelligence #4, summarizing recent major developments in the AI field as well as the latest…
使用 Next.js 與 Vercel 顛覆網頁端影片編輯體驗
Vercel Changelog816 days agoOpinionThis official Vercel blog post explores in depth how to use Next.js and the Vercel platform to revolutionize the traditional web-based video editing…
使用 Transformers.js 開發機器學習驅動的網頁遊戲★ 75
Hugging Face Blog1,075 days agoTutorialThis official Hugging Face blog post explores in depth how to use the Transformers.js library to run machine learning (ML) models directly in the browser…