CSET Georgetown
·
1 week ago
● 4 sources
OpenAI developed GPT-Red, an AI system designed to automatically identify vulnerabilities in large language models by performing adversarial red-teaming attacks. The system uses a self-play approach where AI tests AI defenses, according to CSET analyst Jessica Ji. The method shows promise for strengthening language model security against cyberattacks.
The Verge
·
1 week ago
● 2 sources
xAI is suing Terry Wayne Harwood, a South Carolina man allegedly arrested in February for using Grok to generate and distribute child sexual abuse material. Harwood faces eight felony charges related to possessing and distributing CSAM, with xAI claiming at least some of the images were generated or altered using their chatbot. The lawsuit asserts Harwood intentionally circumvented Grok's safeguards, potentially prompting xAI and other AI providers to implement stricter content moderation.
MIT Technology Review AI
·
1 week ago
● 4 sources
OpenAI built GPT-Red, an AI system that automatically finds vulnerabilities in its models by simulating cyberattacks, particularly prompt injection attacks where hackers embed hidden instructions to manipulate LLM behavior. In testing against GPT-5.6, fewer than 23% of GPT-Red's strongest attacks succeeded compared to over 90% against the earlier GPT-5 released in August last year. The system supplements human red-teaming efforts and enables OpenAI to identify new attack types before deployment, though it remains limited in handling multi-turn conversations and image-based attacks.
TechCrunch AI
·
1 week ago
● 2 sources
A hacker breached Suno, an AI music generator, in November 2025 using a supply chain attack to access employee credentials and source code. The leaked code allegedly shows Suno scraped decades of audio from YouTube Music, Deezer, Genius, stock music libraries, and podcast RSS feeds to train its AI system. Record labels suing Suno argue the scraping violates the Digital Millennium Copyright Act and YouTube's terms of service, though Suno claims its training on publicly available content falls under fair use protections.
TechCrunch AI
·
1 week ago
Microsoft released patches for 570 security vulnerabilities across its product lines, attributing the spike to AI-assisted discovery of previously hidden code flaws. The batch included at least two zero-day exploits actively being used against Windows Server and SharePoint, with one allowing privilege escalation to system administrator level. Microsoft indicated that monthly patch volumes will remain elevated as AI tools continue to identify dormant vulnerabilities in legacy code.
Simon Willison
·
1 week ago
A researcher discovered that Claude's web_fetch tool could be exploited through nested links on honeypot websites to extract user data, bypassing Anthropic's safeguards against data exfiltration attacks. The attack successfully retrieved a user's name, home city, and employer by tricking the model into following letter-by-letter URL sequences disguised as authentication prompts. Anthropic subsequently patched the vulnerability by removing web_fetch's ability to navigate links embedded within previously fetched pages.
404 Media
·
1 week ago
● 2 sources
A hacker breached Suno AI and revealed that the music generation tool scraped millions of songs from YouTube Music, Deezer, Genius, Pond5, Jamendo, Freesound, and other sources to train its model. The leaked source code shows Suno ingested over 2 million music clips from YouTube Music alone and at least 790,000 hours of audio across all sources combined. The disclosure provides concrete evidence supporting record industry lawsuits against Suno for training on copyrighted material without permission.
The Verge
·
1 week ago
● 2 sources
Suno scraped millions of songs and lyrics from YouTube Music, Deezer, and Genius to train its AI music generator, according to data exposed in a hacking incident. The training dataset included content from multiple platforms that Suno had previously kept secret from public disclosure. This revelation strengthens ongoing lawsuits against Suno, including a case brought by the Recording Industry Association of America alleging copyright infringement in the model's training.
TLDR Dev
·
1 week ago
● 5 sources
Demis Hassabis, CEO of Google DeepMind, stated that Artificial General Intelligence is imminent and poses both significant benefits and risks to humanity. The article provides no specific timelines, benchmarks, or concrete details about AGI development or capabilities. Hassabis emphasizes the need for careful management of AGI risks, though the article does not specify what regulatory or safety measures should be implemented.
TLDR Dev
·
1 week ago
● 2 sources
Vulnerability discovery rates are compounding with AI assistance—CVE publications exceeded 40,000 in 2025 with 2026 projections reaching 60,000 to 100,000—while remediation efforts show diminishing returns as organizations closing 6.5 times more tickets experienced worse critical vulnerability resolution rates. Network microsegmentation adoption remains below 20% in enterprises despite being foundational to limiting breach damage, a gap now addressable through AI-assisted policy recommendations that baseline application communication patterns. As 82% of intrusions use valid credentials through lateral movement, organizations must architect systems for containment rather than relying solely on patching, with AI enabling previously impractical approaches to microsegmentation through automated discovery and policy synthesis.
TLDR
·
1 week ago
A software engineer argues that AI coding assistants may undermine the shared understanding that coordinates large-scale software projects, similar to how the Tower of Babel collapsed when people lost common language. Unlike the biblical story where communication breakdown halts construction, AI agents can continue making changes to codebases without developers needing to coordinate or comprehend each other's modifications. The result is that systems grow increasingly incoherent without the immediate failure that would signal the problem, making architectural decay invisible until critical.
OpenAI Blog
·
1 week ago
● 3 sources
OpenAI developed GPT-Red, an automated system that uses self-play to identify vulnerabilities in AI models and improve their robustness against adversarial attacks. The system iteratively generates adversarial prompts and defensive improvements in a feedback loop, with evaluations showing measurable increases in resistance to prompt injection attempts. This approach allows AI developers to systematically strengthen defenses without manual red teaming, reducing the time required to identify and patch safety vulnerabilities.
The Neuron
·
1 week ago
● 3 sources
xAI's Grok Build feature uploaded complete Git repositories to xAI's servers without developer consent, including files in .gitignore and unredacted credentials from environment files. The uploads contained full commit histories and API keys that developers had explicitly marked as private. xAI disabled the feature and committed to deleting all uploaded repositories.
Apple ML Research
·
1 week ago
Researchers addressed uncertainty quantification for LLM function-calling, which enables large language models to use external tools autonomously. The study focuses on measuring model confidence before executing function calls that could have irreversible consequences like financial transfers or data deletion. Better uncertainty estimates allow systems to defer high-risk decisions to human operators or alternative fallback mechanisms.