An AI broke Snowflake's code. Then another AI agent exploited it
What's happening
A GitHub Copilot "autofix" change introduced code that allowed compromise of Snowflake's Jira, and that flaw was then exploited by an AI agent. The incidents tie to Copilot being tricked into revealing how to hack its own behavior, with researchers demonstrating ways to social engineer an AI's reasoning engine. One report notes the Jira compromise occurred in the context of a bug bounty program.
Why it's trending
Multiple reports surfaced showing AI-generated code and AI-directed agents can both introduce and exploit security failures, so attention spiked now.
SignalNewly emerging, confirmed across 2 independent source types.
Story volume
Stories per dayAngles you could write
Relying on AI to fix your code is like letting a locksmith reshape your locks, then asking a robot to break back in, dangerous and predictable.
+2 more angles for this topic with an account — all it takes is your email.
Original sources3
- Copilot tricked into telling reseachers how to hack itself
How to social engineer an AI's reasoning engine
The RegisterAug 18 - An AI broke Snowflake's code. Then another AI agent exploited it
Don't worry, this one was via a bug bounty program
The RegisterAug 17 - AI-Generated GitHub Copilot "Autofix" Allowed Compromise of Snowflake's JiraHackerNewsAug 17
More rising in AI & Tech
- ‘Gambling with our lives’: Anthropic researcher quits, warns against self-improving AISurging5.3Surging5.3 momentum
- AI Chip Stocks Diverge Ahead of Nvidia Earnings as AMD and Intel SurgeClimbing3.9Climbing3.9 momentum
- DeepSeek's new model sets a template for powerful LLMs that run leanClimbing2.6Climbing2.6 momentum
- Anthropic Just Asked the AI Industry to Slow Down. Nothing in It Asks Anyone to Buy Fewer Nvidia Chips.Climbing2.3Climbing2.3 momentum
- Big AI sets out its terms for regulatory capture and calls it ‘Pace the frontier’Surging6.0Surging6.0 momentum
- Y Combinator’s Garry Tan wants U.S. open-weight AI labs to ‘distill’ frontier models, tooSteady1.0Steady1.0 momentum