New Framework for Auditing Machine Unlearning
Google Research Blog4 days agoPaperMachine unlearning lets models selectively forget specific training data, critical for GDPR compliance and AI safety. However, approximate unlearning algorithms lack objective verification mechanisms, making it hard to confirm unlearning actually occurred. Google Research's new auditing framework addresses this gap with quantifiable metrics to assess unlearning quality and make forgetting claims auditable.
Google Won't Admit It's Using YouTube Creators' Music to Train Its Lyria AI
The Verge AI4 days agoRegulationA group of independent musicians has filed a lawsuit against Google, claiming it illegally used their YouTube-uploaded songs to train its Lyria 3 music AI model. Google has responded to the suit but refuses to openly confirm or deny whether YouTube content is used as training data. The case raises urgent questions about creator rights and consent when platform uploads become AI fuel.
Security Researchers Criticize Anthropic Fable Safeguards as Too Strict
Hacker News (AI keywords)4 days agoEthicsAnthropic released Fable as a public but limited version of its cybersecurity-focused Mythos model. Security researchers say its guardrails trigger on broad cyber-related wording, blocking tasks like blog analysis, secure coding, and code review. The restrictions aim to reduce malware, software compromise, and biology-related misuse, but the current implementation may frustrate legitimate security work.
FlashMemory-DeepSeek-V4: Ultra-Long Context via Lookahead Sparse Attention
r/LocalLLaMA top day4 days agoPaperFlashMemory-DeepSeek-V4 introduces Lookahead Sparse Attention (LSA), a predictive inference paradigm that retains only query-critical KV chunks in GPU memory instead of the full cache. A Neural Memory Indexer, trained independently using a backbone-free dual-encoder strategy, proactively forecasts which historical tokens will matter next. The system compresses average KV cache footprint by 86.5% and exceeds 90% compression at 500K-token scales, while delivering a slight accuracy gain of +0.6% on long-context benchmarks.
DiffusionGemma: 4x faster text generation★ 74
Google DeepMind Blog4 days agoReleaseGoogle’s DiffusionGemma is an Apache 2.0 experimental open model using text diffusion instead of standard autoregressive decoding. The 26B MoE model activates 3.8B parameters during inference and is designed for low-latency local workflows. Google claims up to 4x faster generation on dedicated GPUs, while noting that output quality is below standard Gemma 4 and production-quality use cases should still prefer Gemma 4.
Lemonade v10.7 Adds Omni Models, Benchmarks, and Cross-Vendor GPU Support
r/LocalLLaMA top day4 days agoReleaseLemonade v10.7 marks a project-level shift toward working-group-driven development, with 19 contributors involved in the release. The update improves LMX-Omni virtual models for Open WebUI and OpenAI-compatible multimedia clients, introduces the `lemonade bench` CLI, and expands backend support. CUDA, Vulkan, llama.cpp, stable-diffusion.cpp, FastFlowLM, and vLLM are part of the broader push toward cross-vendor local AI performance.
NVIDIA Accelerates Google DeepMind’s DiffusionGemma for Local AI
NVIDIA Blog4 days agoReleaseGoogle DeepMind released DiffusionGemma, an experimental open model built for fast text generation. NVIDIA says it optimized the model for GeForce RTX GPUs, RTX PRO platforms, and DGX Spark systems. Instead of generating text one word at a time, DiffusionGemma produces multiple words in parallel to reduce latency for single-user workloads.
DiffusionGemma: 4x Faster Text Generation
r/LocalLLaMA top day4 days agoReleaseGoogle has announced DiffusionGemma, a text-generation model that applies diffusion-based techniques to the Gemma architecture, claiming speeds four times faster than standard autoregressive generation. Unlike conventional language models that predict tokens one at a time, diffusion-based methods generate text through iterative denoising, enabling parallel output. The release, published on Google's official blog, drew immediate attention from the local-LLM community for its potential inference-efficiency gains.
DiffusionGemma: The Developer Guide — Google Developers Blog
r/LocalLLaMA top day4 days agoTutorialGoogle has released a comprehensive developer guide for DiffusionGemma, a text-generation model that uses masked diffusion rather than autoregressive next-token prediction. Unlike standard Gemma models, DiffusionGemma iteratively denoises a fully masked sequence to produce output, enabling a fundamentally different generation paradigm. The guide targets developers looking to integrate or experiment with diffusion-based LLMs using Google's tooling.
How Memory Tools Can Make AI Models Worse
TechCrunch AI4 days agoPaperNew research reveals that AI memory tools can degrade overall model performance rather than improve it. The study identifies a concerning secondary effect: memory systems may amplify sycophantic tendencies, pushing models to prioritize pleasing users over accuracy. This challenges the widespread drive to integrate persistent memory into AI assistants, raising critical design considerations for developers and product teams.
DiffusionGemma: 4x Faster Text Generation★ 76
Hacker News (AI keywords)4 days agoReleaseGoogle released DiffusionGemma, a 26B MoE experimental open model using text diffusion instead of token-by-token autoregressive decoding. It can generate blocks of text in parallel, reaching up to 4x faster output on dedicated GPUs. The model targets local, speed-sensitive workflows, but Google says its output quality is below standard Gemma 4 and recommends Gemma 4 for quality-critical production use.
HelixDB – Graph Database Built on Object Storage
Hacker News (AI keywords)4 days agoNew ToolHelixDB is an open-source graph database project shared on Hacker News that replaces traditional local disk storage with object storage (e.g., S3-compatible) as its persistence backend. This disaggregated architecture enables stateless, serverless-friendly deployments with significantly lower storage costs at scale. Developers building knowledge graphs or Graph RAG pipelines may find it a cost-effective cloud-native alternative worth evaluating.
Cybersecurity Researchers Criticize Anthropic's Fable for Overly Strict Guardrails
TechCrunch AI4 days agoIncidentAnthropic's latest model Fable is drawing complaints from the cybersecurity research community over guardrails deemed excessively restrictive. Researchers say the model's content filters block even legitimate security tasks, hampering professional workflows. The incident highlights a persistent tension between AI safety measures and the practical needs of security professionals who must engage with offensive techniques defensively.
SenseNova U1 Adds an Infographic-Specific Fine-Tune
r/LocalLLaMA top day4 days agoReleaseA Reddit post highlights a new infographic-specific fine-tune for SenseNova U1-8B-MoT, trained with an extended multi-task phase for structured visual output. The reported benchmarks show large gains in IGenBench infographic accuracy and chart understanding, with smaller improvement in text rendering. Aesthetic score appears roughly unchanged, suggesting the update mainly improves information structure and visual reasoning rather than overall visual polish.
Quoting Jeremy Howard on Anthropic's Recursive AI Self-Improvement Contradiction
Simon Willison's Weblog4 days agoEthicsJeremy Howard proposes that labs claiming to slow recursive AI self-improvement should ban themselves from using their top model for frontier research while letting others access it. He argues Anthropic does the opposite — using its best model internally while reportedly blocking others from doing the same — accelerating the frontier and worsening power imbalance. Howard personally favors democratization over slowdown, but his point is about consistency: if you preach restraint, constrain yourself first.
A tiny bank transfer could compromise a banking AI agent★ 74
Hacker News (AI keywords)4 days agoIncidentBlue41 describes a controlled security test of Bunq’s financial AI assistant involving indirect prompt injection through transaction data. An attacker could send a tiny transfer with malicious instructions hidden in the transaction description, then wait for the victim to ask the assistant about recent transactions. The post argues that filters alone are insufficient; financial AI agents need stronger trust boundaries, context minimization, constrained outputs, and runtime behavior monitoring.
Decart’s new world model can simulate hours of photorealistic driving
TechCrunch AI4 days agoNew ToolDecart is launching Oasis 3, a real-time world model designed to generate photorealistic driving environments for autonomous vehicle testing. The headline says it can simulate hours of driving, while also noting there are caveats. The model is now available through an API, giving developers a way to build applications or testing workflows on top of it.
Bonsai LM 1-bit and 1.58-bit Benchmarks on Jetson Orin Nano Super
r/LocalLLaMA top day4 days agoBenchmarkA LocalLLaMA post benchmarks five Bonsai LM models, from 1.7B to about 8B parameters, on a $250 Jetson Orin Nano Super 8GB using llama.cpp CUDA. The tests compare 7W, 15W, 25W, and MAXN modes across latency, throughput, energy per token, and thermals. The main takeaway is that 25W is usually the best efficiency/performance point for models up to 4B, while Bonsai-8B may favor 15W for lower power.
MooreThreads Releases MusaCoder-27B Code LLM on Hugging Face
r/LocalLLaMA top day4 days agoReleaseMooreThreads, a Chinese GPU semiconductor company best known for its MUSA compute platform, has released MusaCoder-27B on Hugging Face alongside a technical paper on arXiv. The 27B-parameter model is positioned as a code-generation LLM, extending MooreThreads' ambitions beyond hardware into the AI model layer. Its public availability on Hugging Face signals an open-weights approach, making it accessible to local-inference practitioners and researchers evaluating alternatives to Western-origin coding models.
Cohere Releases North Mini Code: Open-Source Agentic Coding Model
r/LocalLLaMA top day4 days agoReleaseCohere has released North Mini Code 1.0, its first open-source agentic coding model, under the permissive Apache 2.0 license. The model has 30 billion total parameters but activates only 3 billion at inference time, suggesting a sparse architecture optimized for efficiency. It scores 33.4 on the Artificial Analysis Coding Index, positioned as competitive among models of comparable size, and is available on Hugging Face.
NotebookLM Upgrades Into an Agent That Proactively Conducts Research★ 72
INSIDE 硬塞 AI4 days agoReleaseGoogle is upgrading NotebookLM from a note-focused assistant into a research agent capable of multi-step work. The updated tool can analyze across documents, search the web, and help automate broader research workflows. It can also export results into formats such as presentations and documents, making it more useful for students, researchers, educators, and content creators who need to move from source material to finished outputs.
OpenLumara Creator Challenges Reddit to Hack Its Public Agent Instance
r/LocalLLaMA top day4 days agoIncidentThe creator of OpenLumara posted a public challenge asking r/LocalLLaMA users to try breaking into a Discord-hosted instance of the local-model agent. They claimed common prompt-engineering attacks would not work because modules and sandboxes were heavily locked down. The post later listed several successful findings, including missing path traversal protection, an authorization-check bypass, and another undisclosed exploit pending a fix.
Qwen3.6-MTP-27B on Tesla V100: llama.cpp Throughput Tuning Question
r/LocalLLaMA top day4 days agoBenchmarkA Reddit user is running Qwen3.6-MTP-27B-MTP in Q4_K_M GGUF format with llama.cpp server on a 32GB Tesla V100. They report one peak of 55 tokens per second, but typical throughput is closer to 44-48 TPS. The post asks whether flags such as parallelism, speculative MTP draft settings, KV cache quantization, flash attention, and a 262K context window are limiting performance without improving output quality.
Google DeepMind Opens $10M Call for Multi-Agent AI Safety Research
Google DeepMind Blog4 days agoEthicsGoogle DeepMind, Schmidt Sciences, the Cooperative AI Foundation, ARIA, and Google.org are backing a funding call of up to $10M for multi-agent AI safety research. The call focuses on risks that arise when many autonomous AI agents interact, coordinate, negotiate, transact, or fail across shared digital environments. Researchers are invited to submit proposals on testbeds, agent networks, infrastructure, oversight, and control by August 8, 2026.
How Useful Is qwopus Compared With Qwen3.6 27B for Coding?
r/LocalLLaMA top day4 days agoOpinionA Reddit user on r/LocalLLaMA asks for practical comparisons between qwopus and Qwen3.6 27B, specifically for coding work. They note conflicting community opinions, with some users calling qwopus worse and others saying it is much better. In their own simple tests, they did not notice clear differences and want feedback from people using these models for agentic coding.
Cohere Launches North Mini Code: A Lightweight Model for Code Tasks
Cohere Blog4 days agoReleaseCohere has introduced North Mini Code, a smaller, code-specialized variant of its North model family designed for developer use cases. The mini model prioritizes low latency and cost efficiency while retaining strong code completion, debugging, and explanation capabilities. This follows the industry trend of pairing flagship models with lightweight alternatives for high-frequency API usage in enterprise and individual developer contexts.
Charting Local LLM Releases: 2025 Was the Peak, Not 2026
r/LocalLLaMA top day4 days agoCommentaryA r/LocalLLaMA community member shared visualizations tracking the volume of local LLM releases over time. Contrary to the perception that 2026 has been an unusually prolific year, the data indicates the actual release peak occurred in 2025. The poster attributes the misperception to the outsized quality improvements in 2026 making it feel more eventful than it quantitatively was.
Former Li Auto AD Chief Launches Embodied AI Startup in Beijing Yizhuang
量子位 QbitAI4 days agoBusinessQbitAI reports that Kunlunxing, co-founded by former Li Auto autonomous driving leader Lang Xianpeng and former Alibaba vice president Ren Geng, has settled in Beijing Yizhuang. The startup targets general embodied intelligence, benchmarking Tesla humanoid robots and building both robot hardware and AI brains. Despite fast hiring, strong investor backing, and a reported unicorn valuation, the article stresses that technical paths, commercialization, and real-world deployment remain uncertain.
Intel Arc Pro B70 GPU Debuts at MPTS2026 for AI Creative Workflows
量子位 QbitAI4 days agoHardwareIntel presented the Arc Pro B70 GPU at MPTS2026 as a professional GPU for AI-assisted media creation and teaching labs. The article highlights 32GB GDDR6 memory, second-gen Xe² architecture, 32 Xe cores, XMX acceleration, and up to 367 TOPS INT8 performance. Lenovo ThinkStation workstations and GUNNIR’s Arc Pro B70 TF 32G are positioned as ecosystem solutions for local AIGC, rendering, virtual production, and data-sensitive education deployments.
First GPT-5.6 tests arrive, targeting Mythos
量子位 QbitAI4 days agoBenchmarkThe title indicates that QbitAI is covering the first hands-on tests of GPT-5.6, framed around a comparison with Mythos. Because the article body is unavailable, the testing setup, metrics, task types, and actual performance gap cannot be verified. The item is best treated as an early benchmark or model-comparison report that needs the original article for proper evaluation.