Anthropic employee resigns, company report highlights AI's bioweapon risk

After Jacob Coxon, who worked at the artificial intelligence company Anthropic, resigned from the company with the warning that artificial intelligence could turn into superhuman systems in the future, a remarkable report was published by the company.

In the report published while Coxon's statements were on the agenda, it was stated that cases were detected in which Anthropic's artificial intelligence models were used in a way that could help develop biological weapons.

BIOLOGICAL WEAPON RISK

In the report published by Anthropic on the misuse of artificial intelligence models, it was emphasized that one of the most serious risks is "biological misuse". The report noted concerns that advanced artificial intelligence models could achieve capabilities that could make existing pathogens more dangerous or help develop new pathogens.

The company reported that this year it blocked some activities of scientists who were conducting research that could help develop biological weapons using artificial intelligence models, including Claude. Anthropic did not disclose the names, countries, or biological agents of the researchers in question.

"IT IS AN EXTREMELY NICE SITUATION"

Jacob Klein, Anthropic's head of threat intelligence, said it's not always clear whether bioprobes are malicious or not.

"You don't see someone like in the comics saying, 'Hey, I want to build a bioweapon that will kill everyone.' It's extremely subtle," Klein said. he said.

The company pointed out that legitimate biological research can also contribute to the development of dangerous pathogens. It was stated that studies such as vaccine development can produce beneficial results, but the same techniques can also be used to make pathogens more dangerous.

RESEARCHERS' ACTIVITIES WERE BLOCKED

The report stated that a researcher working in an unsupported region used Claude to plan experiments on the adaptation of bird flu to mammals. In another case, it was stated that a state-supported researcher tried to redesign toxins in a computer environment.

Anthropic said it detected users trying to bypass access restrictions and "obscure the purpose of their research to evade our security measures." The company banned accounts linked to these activities.

In another case in May, a scientist reportedly asked Claude to help him apply for funding to conduct experiments on the chikungunya virus, which can cause severe pain and other symptoms lasting for months.

Anthropic found the case alarming as it found that part of the research was planned to be done at a military research institute.

"What we don't know is whether this research was conducted for use as a weapon. But it is concerning that a military institution is conducting gain-of-function research," Klein said. he said.

OTHER THREATS ARE ALSO INCLUDED IN ANTHROPIC'S REPORT

Anthropic's report for the last eight months also included cases where artificial intelligence was misused for different purposes besides biological weapons.

The report stated that actors suspected of having ties to the Chinese and Iranian governments are using artificial intelligence models to spy on dissidents and diaspora communities.

It has been alleged that Russian state media also used Claude to produce online propaganda under the guise of independent reporting. These activities included the spread of fabricated claims about the elections in Moldova.

Anthropic also disclosed that it had identified cases where Claude was used to work on software for the design and development of conventional weapons, including firearms, missiles, armed drones and bombs. The report detailed three cases from China, two from Russia and one from Yemen.

ATTENTION-DRAWING RESIGNATION FROM ANTHROPIC EMPLOYEE

Anthropic employee Jacob Coxon's statements about the future of artificial intelligence were also on the agenda.

Coxon announced his resignation from the company, arguing that artificial intelligence "could become superhuman systems that can gain real power and resources."

Coxon's post was viewed millions of times and had a wide impact.