Omi Med STT v1: Open-Weight Medical ASR Fine-Tuned from Parakeet 0.6B★ 72
r/LocalLLaMA top day5 days agoReleaseOmi Health’s founder says he fine-tuned NVIDIA Parakeet TDT 0.6B v2 for clinical speech and released Omi Med STT v1 under CC-BY-4.0. The runtime supports Mac, Windows, and Linux, auto-selecting MLX, NeMo, or GGUF/parakeet.cpp backends. In the author’s held-out medical benchmark, it reports 2.37% medical-WER and 145× realtime on local A10 compute.
Budgets for API Keys on Vercel AI Gateway
Vercel Changelog5 days agoReleaseVercel has added per-API-key budget controls to its AI Gateway product, enabling developers to set hard spending limits on individual keys. Once a key hits its budget threshold, the gateway automatically blocks further requests, preventing unexpected cost overruns. This is especially useful for multi-tenant apps, team cost allocation, and isolating dev/test environments from production spending.
Apple’s WWDC AI demos looked more real after $250M false ad settlement
TechCrunch AI6 days agoCommentaryTechCrunch notes that Apple’s WWDC 2026 AI demos felt more concrete and realistic, often showing people holding iPhones in use-case scenarios. The framing matters after Apple’s $250 million settlement over allegedly misleading Siri and Apple Intelligence advertising. The piece focuses less on model breakthroughs and more on Apple’s shift toward demos that look deliverable, usable, and legally safer.
Apple is using AI to fix Safari’s extension problem
The Verge AI6 days agoReleaseApple is trying to address Safari’s weaker extension ecosystem with AI. Safari has long lagged behind rival browsers in extension availability, partly because of Apple’s stricter development requirements. In a demo shared by Apple, the company showed users effectively “vibe coding” their own Safari extensions, though the excerpt does not detail model support, review flow, or release timing.
Quick note on recent QAT issues
r/LocalLLaMA top day6 days agoCommentaryThe post argues that recent Google QAT quantization has several implementation problems, including token embeddings being quantized to q6k instead of using a pure mode. It also claims llama-quantize has a hardcoded parameter that mismatches some optimized groups, and that 32-block groups are misaligned. The author recommends Unsloth UD Q4_K_XL as a temporary option and says they are working on a patch.
Apple plays catch-up at WWDC
TechCrunch AI6 days agoCommentaryApple spent much of its WWDC keynote on fixes, performance improvements, and long-requested features before unveiling an upgraded AI-powered Siri. The sequencing suggests Apple wants users to see AI as one piece of a larger software-improvement effort. TechCrunch frames the event as Apple playing catch-up, rather than leading with AI as the sole headline.
Apple bets cheaper AI will woo small developers
TechCrunch AI6 days agoBusinessApple is trying to make AI experimentation cheaper for smaller developers. According to TechCrunch, developers with fewer than 2 million first-time App Store downloads will have cloud API costs waived. The report frames this as a way to attract smaller teams as AI development and experimentation become increasingly expensive.
llama.cpp PR adds MTP support for Gemma-4 E2B and E4B assistants
r/LocalLLaMA top day6 days agoReleaseThe Reddit post links to ggml-org/llama.cpp Pull Request #24282, which adds MTP support for Gemma-4 E2B and E4B assistants. The submitter frames it as useful for tiny Gemma models on phones, low-end machines, Raspberry Pi, or similarly constrained devices. The post does not include benchmarks, merge status, or setup instructions, so it should be treated as a development signal rather than a finished release.
Introducing FrontierCode★ 78
Hacker News (AI keywords)6 days agoBenchmarkCognition launched FrontierCode, a coding benchmark focused on mergeability rather than only functional correctness. It evaluates correctness, tests, scope discipline, style, and repository-specific quality standards. Built with open-source maintainers and extensive quality control, it shows current frontier models still struggle: Claude Opus 4.8 scores 13.4% on the hardest Diamond subset, ahead of GPT-5.5 and Gemini 3.1 Pro.
Say hi to Siri AI: Apple announces more conversational voice assistant★ 76
Ars Technica AI6 days agoReleaseApple announced “Siri AI,” a more conversational version of its voice assistant planned for this fall. The update is tied to a two-tier AI model overhaul powered in part by Google technology. The move signals Apple’s attempt to close the gap with modern AI assistants while preserving its system-level integration and privacy-focused positioning.
Was BitNet a dead end? What happened to ternary LLMs?
r/LocalLLaMA top day6 days agoCommentaryA r/LocalLLaMA user questions whether BitNet and ternary LLMs were a dead end after earlier promise around efficient low-bit models. The post notes that the largest ternary model appears to remain around 2B parameters. It asks why frontier open-weight AI labs are not visibly pursuing the approach, but provides no technical evidence or definitive answer.
Apple just taught your iPhone to finish your sentences, photos, and workflows
TechCrunch AI6 days agoReleaseApple is bringing new AI-powered features to Safari, Shortcuts, and Passwords apps. The framing suggests AI will be embedded into everyday iPhone tasks, including writing, photo-related actions, and workflow automation. The provided source text does not include details on exact capabilities, device support, privacy design, or rollout timing, so the practical impact remains unclear.
Apple Core AI Framework★ 76
Hacker News (AI keywords)6 days agoReleaseApple’s Core AI framework is positioned as a developer stack for deploying AI models directly inside apps on Apple silicon. The documentation describes Swift APIs, `.aimodel` assets, model specialization, caching, Xcode profiling, and debugging tools. It appears aimed at developers building low-latency, privacy-conscious on-device inference workflows, though the documentation is marked as preliminary beta information.
Apple will let you build workflows using AI in its new Shortcuts app
TechCrunch AI6 days agoReleaseApple is upgrading the Shortcuts app in iOS 27 with AI-powered workflow creation. Users will be able to describe what they want in natural language, and Apple Intelligence will assemble the needed system and app actions. The feature is meant to make Shortcuts more approachable for non-technical users, with the updated app expected to roll out with iOS 27 this fall.
Apple’s Image Playground doesn’t suck anymore
TechCrunch AI6 days agoReleaseApple announced improvements to Image Playground at WWDC 2026, positioning the iPhone’s built-in AI image generator as a more capable tool. The update emphasizes natural-language photo transformations, multi-person image use, flexible output dimensions, and integrations across lock screens, iMessage backgrounds, and contact posters. TechCrunch has not tested it yet, but the presentation suggests Apple Intelligence apps may become more practical.
Apple’s Photos app is getting new AI editing features
TechCrunch AI6 days agoReleaseTechCrunch reports that Apple’s Photos app is getting new AI editing features. The highlighted addition is a spatial feature called Reframe, which will let users use AI to adjust perspectives. The article does not provide details on supported devices, rollout timing, model architecture, or whether the feature depends on Apple Intelligence.
For the 2nd time in weeks, Microsoft packages laced with credential stealer★ 72
Ars Technica AI6 days agoIncidentArs Technica reports a second Microsoft-package security incident in weeks, involving 73 packages laced with a credential stealer. The supplied summary says the malware runs as soon as the packages are opened by an AI agent and can self-replicate. The case highlights a growing software supply-chain risk: AI agents that inspect or operate on code may become execution triggers for malicious packages.
Apple gives Siri its own dedicated app
TechCrunch AI6 days agoNew ToolTechCrunch reports that Siri is finally getting its own dedicated app. The provided text does not include details about features, launch timing, supported devices, or AI capabilities. The move could signal a more prominent product surface for Siri, but the available source text is too limited to confirm broader strategy or functionality.
Apple is fixing bill splitting with its new Siri in Camera feature
TechCrunch AI6 days agoReleaseApple is working on a Siri in Camera feature aimed at simplifying bill splitting after meals. Users can point an iPhone at a restaurant bill, select what they ordered, and split the tab using Apple Cash. The provided source does not specify launch timing, regional availability, language support, or how the feature handles taxes, tips, or complex shared orders.
Siri AI
Hacker News (AI keywords)6 days agoReleaseApple’s Apple Intelligence page presents Siri AI as a more capable assistant with natural conversations, personal context, cross-app actions, and a dedicated app. It also highlights Visual Intelligence across iPhone, iPad, Mac, and Apple Vision Pro, plus AI photo and image tools. Since the HN item provides only the title, this should be treated as a product preview rather than a technical deep dive.
Apple’s long-awaited AI Siri overhaul is finally here★ 72
TechCrunch AI6 days agoReleaseTechCrunch reports that Apple’s long-awaited AI overhaul of Siri has arrived. The idea behind the new “Siri AI” is to shift Siri beyond a voice-controlled assistant into an AI companion that can do more. The provided article text does not specify concrete features, supported devices, rollout timing, or technical details.
Amazon is launching AI-generated custom merch
The Verge AI6 days agoNew ToolAmazon is expanding print-on-demand with AI-generated designs made through Alexa for Shopping. Shoppers can enter text prompts to create images, then print them on blank products such as T-shirts, water bottles, and hoodies. They can also share a design link so others can buy the same custom item on Amazon.
Full Reverse Engineering of the TI-84 Plus Operating System
Hacker News (AI keywords)6 days agoHardwareThis Hacker News item links to an article titled “Full Reverse Engineering of the TI-84 Plus Operating System.” Based on the provided material, the reliable takeaway is that it concerns reverse engineering the OS of Texas Instruments’ TI-84 Plus graphing calculator. The original text was not provided, so specific claims about methods, findings, code, memory layout, or security implications cannot be verified here.
Apple announces Siri AI and its next generation of Apple Intelligence★ 72
The Verge AI6 days agoReleaseApple revealed a new round of AI features at WWDC, centered on a smarter and more personalized Siri. The announcement comes two years after Apple first outlined Apple Intelligence and a more capable Siri that The Verge says never fully materialized. Apple describes Siri AI as an entirely new version of Siri, with stronger conversational ability and broader capabilities.
LocalLLaMA post urges users not to join SpaceX, OpenAI, Anthropic IPOs
r/LocalLLaMA top day6 days agoOpinionA popular r/LocalLLaMA post urges local LLM supporters not to invest in IPOs tied to SpaceX, OpenAI, or Anthropic. The author argues that frontier labs drive up demand and prices for GPUs, RAM, SSDs, HDDs, and NAS hardware, making local inference harder. The post also questions AI company valuations, but its claims are mostly opinion and speculation without cited evidence.
WWDC 2026: Everything announced on Siri, iOS 27, Apple Intelligence and more
TechCrunch AI6 days agoReleaseApple’s WWDC 2026 kicked off at Apple Park with expected announcements around Siri, iOS 27, Apple Intelligence, and developer demos. The event is notable as Tim Cook’s last WWDC as CEO before John Ternus takes over on September 1. Early updates include Liquid Glass opt-in adjustments, iOS 27 support back to iPhone 11, and claimed speed gains for Photos, AirDrop, and multitasking.
I bundled a fully local LLM inside my Unity game
r/LocalLLaMA top day6 days agoReleaseA developer shared a Unity game, Simulation Simulator, that bundles a local LLM with no internet, cloud service, or API key required. The game is a campfire chat simulator about DMT, simulation theory, and a monitor-headed friend, with five endings driven by natural AI interaction. The author sees this as a path toward richer NPCs, while noting local TTS and translation are still too slow for smooth gameplay.
Xiaomi Claims 1,000+ TPS on a 1T Model Using a Standard 8-GPU Server★ 72
r/LocalLLaMA top day6 days agoBenchmarkXiaomi announced MiMo-V2.5-Pro-UltraSpeed with TileRT, claiming over 1,000 tokens/s decode speed on a 1-trillion-parameter MoE model. The company says it runs on a single standard 8-GPU commodity node, not wafer-scale or SRAM-heavy specialized hardware. The claimed stack combines FP4 MoE expert quantization, DFlash speculative decoding, and TileRT low-latency inference kernels, but independent validation is still needed.
Amazon now lets you design custom merch using AI
TechCrunch AI6 days agoNew ToolAmazon has added an AI-powered custom merchandise feature to its Shopping app. Users can generate designs with Alexa and apply them to products such as T-shirts, hoodies, and tumblers. The report does not provide details on pricing, availability, design limits, rights management, or whether the feature supports commercial use.
OpenEnv coordination expands to HF, PyTorch, Unsloth, Modal, and more
r/LocalLLaMA top day6 days agoNew ToolOpenEnv is a tool for creating agentic execution environments such as terminals, browsers, or other systems an agent can interact with. The project will now be coordinated by a committee including Meta-PyTorch, Reflection, Unsloth, Modal, Prime Intellect, Nvidia, Mercor, Fleet AI, and Hugging Face. The post also lists many AI organizations supporting or adopting OpenEnv, positioning it as infrastructure for open-source agent training.