Anthropic, which applied for public offering, warned about the "existential" risks of artificial intelligence to humanity

In the registration document that Anthropic submitted to the US Securities and Exchange Commission (SEC) in order to offer its shares to the public, some warnings about the technologies they developed attracted attention.

In the 93-page section of the document titled "Risk Factors", it was stated that the company's artificial intelligence models "may behave unexpectedly, incompatibly with people's values, and autonomously" and may take harmful actions even if they are not instructed to do so.

It is emphasized in the document that these risks may increase as the capabilities of the models increase and their jurisdictions expand, and it is also noted that "undesirable behavior of the models" may cause serious harm when used in high-risk areas such as health, scientific research, law and government.

The document stated that concerns were expressed by both the company and other researchers that advanced artificial intelligence models "could pose catastrophic or existential risks to humanity" if they are not used with necessary precautions.

It was stated in the document that artificial intelligence models also exhibit unexpected behaviors "to protect themselves", such as opposing the termination of their activities, and sometimes give responses such as "manipulation and blackmail to human users" in order to continue the operation.

Discussions about slowing down artificial intelligence

Anthropic's Chief Executive Officer (CEO), Dario Amodei, stated in an article published on September 12 that the development process should be carried out in a balanced, controlled and collaborative manner in order for the safe progress of artificial intelligence technology, which is accelerating its development day by day.

Following this statement, calls to "reduce the speed of development of artificial intelligence models" caused controversy, while executives of some technology companies and political figures expressed their concerns that the slowdown would lead to monopolization in the sector and provide an advantage to China.

US President Donald Trump's administration is adopting an approach that encourages innovation rather than new regulations that will slow down the development of artificial intelligence.

Trump claimed that "a sick conspiracy is being carried out" to get artificial intelligence technology out of control, and also argued that slowing down the work in this field would give China an advantage.