You are connecting from Lake Geneva Public Library, please login or register to take advantage of your institution's Ground News Plan.
Published 11 hours ago • loading... • Updated 3 hours ago
Anthropic Urges AI Labs to Pause Frontier Development
The company said a coordinated pause would need multiple major labs to verify compliance before advanced systems can improve themselves faster than safeguards can adapt.
On Thursday, Anthropic released a report urging frontier AI labs to establish a coordinated, verifiable mechanism to slow or pause development if systems begin 'recursive self-improvement,' where AI autonomously enhances its own capabilities.
Internal data showed Claude, the company's AI model, authored more than 80% of merged code and resolved over 800 bugs in April, illustrating how AI is rapidly automating engineering work.
While acknowledging potential benefits for science, executives warned that full recursive self-improvement might 'increase the risks of humans losing control over AI systems,' necessitating alignment research to keep pace with advances.
Coordination among multiple well-resourced labs is required for a meaningful pause, as Anthropic noted that a unilateral slowdown risks letting less cautious actors advance, potentially leaving everyone less safe.
The firm plans to convene discussions with policymakers, researchers, and competing firms in coming months to explore coordination mechanisms, despite criticism that such warnings are a marketing tactic to slow competition.
Company stated that AI's ability to perform autonomous tasks has been doubling approximately every four months and is moving to the point where technology can evolve without human intervention
Newshour discusses Anthropic co-founder Jack Clark’s call for a coordinated AI ‘brake pedal’ and potential slowdown as systems near recursive self-improvement.