Elon Musk of Tesla and Mustafa Suleyman of Google are among the top tech industry pioneers urging the United Nations to ban killer robots. In an open letter signed by AI specialists from around the globe, the industry experts urged the UN to take steps to curtail the development and use of fully autonomous weapons such as drones, tanks, and machine guns.
Calling it the “third revolution in warfare,” the signatories caution of an upcoming killer robot arms race that could have devastating consequences. “Lethal autonomous weapons will permit armed conflict to be fought at a scale greater than ever, and at timescales faster than humans can comprehend,” the letter warns. “We do not have long to act. Once this Pandora’s box is opened, it will be hard to close.”
Specifically addressing attendees at the International Joint Conference on Artificial Intelligence (IJCAI) in Melbourne, the letter urges swift action to add “morally wrong” autonomous weapons systems to the list of weapons banned as part of the 1983 International Convention on Certain Conventional Weapons. Groups such as the Human Rights Watch want the UN to mandate that humans remain in control of weapons systems during combat, including the selection of targets, to ensure compliance with international law.
At a UN conference on the subject in 2015, the U.K. opposed a similar ban, claiming that they were not planning to develop any lethal autonomous systems. As the Guardian notes, however, there’s no real definition of what an “autonomous system” is. Some defense systems already in use, such as the U.S. Phalanx anti-missile cannon, are not only computer-controlled and radar-guided, but also programmed to respond automatically to incoming threats.
“The U.S. is farther along in this field than any other nation. Most advanced militaries are pursuing ever-greater autonomy in weapons,” said Stephen Goose, co-founder of the Campaign to Stop Killer Robots. “Killer robots would come in all sizes and shapes, including deadly miniaturized versions that could attack in huge swarms, and would operate from the air, from the ground, from the sea, and underwater.”
Elon Musk has been particularly outspoken on the dangers of artificial intelligence, and has referred to research on the subject as “summoning a demon.” Even the wealthy elites at the economic forum in Davos have worried about the rise of the machines.
Warfare has been around as long as humans have, and will undoubtedly continue in the future. The dilemma facing world leaders now is what form it will take, and who (or what) will wage it.
San Francisco startup Dimensional advertised for people to walk robot dogs through city streets. The New York Times reported that the job could include carrying a roughly 33-pound robot back to the office if it overheated. A lift home is an awkward requirement for a labor-saving machine.
Keeping the hardware running is only one challenge. Anthropic's robotics tests found that language models mostly failed when controlling joints directly, but did better when directing trained controllers. Giving an AI agent a body doesn't teach it to handle ordinary household objects.
Soon, a mattress protector may be more than a bed cover. Australian medtech company Sleeptite and researchers at RMIT University have received a US patent for FlexiSense, a smart bedding technology that tracks body position and posture to help caregivers identify when older residents may be at risk of falling.
The technology is being developed for Sleeptite’s in-bed monitoring system, REMi, and was recently on display at The MedTech Conference in Boston. A peer-reviewed study in Flexible and Printed Electronics says the sensors can also be made at scale without sacrificing performance or durability.
AI companies spend enormous amounts of time convincing us their technology is safe and secure. But what happens when those same companies become targets of increasingly sophisticated AI-powered attacks? Anthropic, the company behind Claude, is now facing that question. According to a Washington Post report, cybersecurity startup Cathedral discovered vulnerabilities that let its researchers access sensitive information in Anthropic's internal systems.
The researchers used AI agents to identify potential entry points in less than 12 hours. Interestingly, they didn't need to crack Claude itself. Instead, they exploited weaknesses in third-party business applications that Anthropic uses for everyday operations. Anthropic's security testing program disclosed the findings, which allows outside researchers to identify and report vulnerabilities.