Apple Announced a New On-Device Inference Engine for Apple Silicon
r/LocalLLaMA top day5 days agoReleaseApple announced CoreAI at WWDC, which the post frames as a possible future replacement for CoreML and an alternative to MLX, llama.cpp, and torch for optimized on-device inference. Models still need conversion through Python scripts, and current supported models appear mostly from mid-2025. No performance data is available yet; the author expects it may trail MLX on GPU, but Apple’s 20B on-device foundation model claim suggests larger app-bundled models could become possible.
Apple Core AI Framework★ 76
Hacker News (AI keywords)6 days agoReleaseApple’s Core AI framework is positioned as a developer stack for deploying AI models directly inside apps on Apple silicon. The documentation describes Swift APIs, `.aimodel` assets, model specialization, caching, Xcode profiling, and debugging tools. It appears aimed at developers building low-latency, privacy-conscious on-device inference workflows, though the documentation is marked as preliminary beta information.
Magenta RealTime 2: An Open, Locally Runnable Real-Time Music Model★ 74
Hacker News (AI keywords)9 days agoReleaseMagenta RealTime 2 is an open-weights live music model designed for interactive performance rather than offline prompt-to-song generation. It supports real-time control through MIDI, audio, and text, and can run as standalone apps, DAW plugins, or embedded music software. Google Magenta also released a Python library, C++ MLX inference engine, models, and example applications for musicians and developers.
Hugging Face 推出 transformers-to-mlx：讓 Apple Silicon 運行 AI 模型更簡單的重大整合★ 80
Hugging Face Blog59 days agoReleaseThis article from the official Hugging Face blog, titled "The PR you would have opened yourself," focuses on the introduction of a brand-new technical…
WWDC 24：使用 Core ML 在 Apple 裝置上運行 Mistral 7B 模型★ 75
Hugging Face Blog692 days agoTutorialFollowing Apple's major Core ML updates announced at WWDC 24, Hugging Face published a practical guide detailing how to convert the popular open-source large…
在 Mac 上使用 Latent Consistency Model (LCM) 實現一秒快速生成圖片教學
Replicate Blog963 days agoTutorialThis technical guide from Replicate provides detailed instructions on how to locally deploy and run Latent Consistency Models (LCMs) on Macs equipped with…
Stable Diffusion XL 登陸 Mac：利用先進 Core ML 量化技術實現高效本地運行★ 72
Hugging Face Blog1,053 days agoReleaseSince the release of Stable Diffusion XL (SDXL), its exceptional image generation quality has attracted widespread attention. However, its massive 1.3 billion…
在 iPhone、iPad 和 Mac 上使用 Core ML 實現更快的 Stable Diffusion★ 75
Hugging Face Blog1,095 days agoTutorialIn the era of rapidly advancing generative AI, deploying large deep learning models to users' personal devices (edge devices) has long been a major challenge…
在 Apple Silicon 上使用 Core ML 執行 Stable Diffusion★ 75
Hugging Face Blog1,291 days agoReleaseIn late 2022, Apple and Hugging Face jointly announced that Stable Diffusion had officially gained support for Apple Silicon's Core ML framework. This update…
在 M1 Mac 的 GPU 上本地運行 Stable Diffusion
Replicate Blog1,383 days agoTutorialWith the open-sourcing of Stable Diffusion, running powerful AI image generation models locally has become a real possibility. This guide published by…