Google filed a lawsuit against an alleged Chinese cybercrime network called Outsider Enterprise, claiming it used Gemini to help build scam websites at scale. The operation reportedly sent millions of messages and targeted hundreds of thousands of smartphone users with phishing pages impersonating mobile carriers and other services. The case highlights how generative AI can lower the cost of cybercrime while raising pressure on AI providers to police misuse.
Blue41 describes a controlled security test of Bunq’s financial AI assistant involving indirect prompt injection through transaction data. An attacker could send a tiny transfer with malicious instructions hidden in the transaction description, then wait for the victim to ask the assistant about recent transactions. The post argues that filters alone are insufficient; financial AI agents need stronger trust boundaries, context minimization, constrained outputs, and runtime behavior monitoring.