Jacob Coxon, a researcher at Anthropic, has left the company due to concerns about the risks posed by advanced AI systems that could improve themselves. In his departure, Coxon warned about the dangers of rapid AI development without adequate safeguards.

Coxon has called for pacing agreements between AI research laboratories as a way to manage the risks associated with increasingly powerful AI systems. His departure highlights ongoing debates within the AI research community about the appropriate speed and safety measures for developing advanced AI.