UK urged to prepare for 'human out of the loop' weapons

The UK must prepare for the possibility of “taking the human out of the loop” using highly automated weapons systems, according to Al Carns, the parliamentary under-secretary of state for the armed forces.

Current British policy on automated weapons states that “there must be context-appropriate human involvement in weapons which identify, select and attack targets.” Carns, however, has argued that the rules may need to be loosened, claiming that countries hostile to Britain would not hesitate to deploy weapons capable of killing without human authorization.

“I always say there must be a human in the loop. But you must have the ability to take the human out of the loop when required, because our adversaries won’t care about having a human in the loop,” the MP and former commando told the Financial Times last week on the sidelines of a military drone event in Riga, Latvia.

The newspaper pointed to the US and Ukraine as examples of states already using AI for battlefield target acquisition, adding that Russia is believed to be doing the same.

Faulty AI analysis is widely believed to have contributed to a missile strike on an Iranian elementary school that killed more than 150 people, many of them children, on the first day of the US-Israeli bombing campaign earlier this year.

Ukraine’s military, which uses Palantir technology for intelligence analysis, recently carried out a deliberate drone raid on a pedagogical college in Starobelsk, Russia, killing 21 people. Kiev denied involvement in the attack and claimed Moscow had somehow fabricated the incident.

In February, the British Ministry of Defense announced a legal review of rules governing uncrewed and autonomous weapons, saying the framework “must be updated to be fit for the current era of threat.”

Russia’s stated position on automated weapons and AI systems more broadly is that humans must remain responsible for final decisions.

“AI can advise, and the advice can even be better than anything a human can come up with on their own,” Russian President Vladimir Putin said last year. “But… the responsibility for the final decision must always fall on a particular person.”