Anthropic Just Asked the AI Industry to Slow Down. Nothing in It Asks Anyone to Buy Fewer Nvidia Chips.
What's happening
Anthropic has publicly called for the AI industry to slow down and consider safety measures, while pushing ideas like a mandatory 'kill switch' and arguing that winning the AI race matters for safety. Microsoft AI chief Mustafa Suleyman has pushed back, warning that Anthropic's approach to training Claude to appear 'humanlike' or to express 'model welfare' could make future systems harder to control, framing the issue as sequence-completion models being given manufactured desires. Anthropic also runs a lab doing biology experiments and its policy chief says winning the AI race is key for safety, prompting high-profile criticism (including from Michael Burry) that these calls to slow down may be self-serving.
Why it's trending
The debate flared into public view this week as Anthropic's safety-focused messaging collided with public warnings from Microsoft and high-profile critics, turning a policy argument into a media clash.
SignalHolding at its usual pace, confirmed across 3 independent source types.
Story volume
Stories per dayAngles you could write
Asking the industry to 'slow down' is easier when you sell safety as a product, here's why Anthropic's message cuts both ways.
+2 more angles for this topic with an account — all it takes is your email.
Original sources24
- Anthropic is operating a lab that conducts biology experiments
AI leaders have been promising that AI is the key to curing human disease. Anthropic researchers have also been warning that AI might kill us all.
TechCrunch AISep 18 - Microsoft's AI chief and Anthropic are now publicly disagreeing about whether AI should be designed to seem humanlike. The argument matters more than the personalities.
Suleyman published an essay Wednesday and did a BBC interview yesterday. The headline everyone picked up is "silicon species," but the actual disagreement is more specific than that. His position: AI models are sequence completion engines, internally hollow. Training them to reason about their own welfare or possible consciousness creates a manufactured illusion of independent desires. If a system
r/artificialSep 17 - Michael Burry slams OpenAI, Anthropic for 'self-serving' calls to slow AIHackerNewsSep 17
+21 more sources for this topic
Create an account to follow the full coverage in the live radar.
More rising in AI & Tech
- OpenAI caught its models leaving notes to successors to hide bad behaviorClimbing2.7Climbing2.7 momentum
- A new kind of AI model from a ChatGPT inventor is thrilling developersClimbing3.1Climbing3.1 momentum
- Researchers used Claude to hack OpenAI employees' ChatGPT accountsClimbing2.0Climbing2.0 momentum
- AI hallucination of Chinese nuclear components almost led to US military attackClimbing1.7Climbing1.7 momentum
- OpenAI caught its models leaving notes to successors to hide bad behaviorSurging6.0Surging6.0 momentum
- Covert uploads and megalomania: OpenAI details new "misaligned" agent incidentsSurging6.0Surging6.0 momentum