Article Image

Microsoft ‘holoportation’ lets you share a room with a faraway friend

Imagine talking to a friend halfway across the world and feeling like you're in the same room. A Microsoft Hololens demo promises just that. It's not perfect, but it's an impressive early use of 3D cameras and augmented reality.

Whether you need to inform Obi-Wan he’s your only hope, or just want to hang out with loved ones who are far, far away, who hasn’t dreamed of a future involving holograms? Microsoft’s “holoportation” demo shows that it’s possible — if you’ve got a couple of HoloLenses and a couple of rooms surrounded by 3D cameras anyway.

Shahram Izadi, principle research manager at Microsoft Research (Cambridge UK), hangs out with a co-worker in hologram form in a recently released video, and then with his daughter.

It’s not a perfect re-creation: you can tell that you’re looking at a hologram because of occasional glitches and an overall low polygon count. But it’s not hard to imagine this being more intimate than a Skype chat.

“Imagine being able to teleport to any place, with anyone, at any time,” said Izadi in the video. “That’s what holoportation is all about.”

The setup isn’t simple. A HoloLens is required to see the holograms in realtime, and a room surrounded by 3D cameras is necessary to create them. And however good the technology becomes, there’s one barrier to this feeling deeply immersive: the HoloLens itself.

You can’t see other people using this tech unless you’re wearing a HoloLens, and you can’t make eye contact with people who are wearing the augmented reality device. To see another person’s holographic face, they need to take off their headset — which means they can’t see you.

In the video Izadi Interacts with his daughter Lilly, who is not wearing a HoloLens. His daughter cannot see him, and at one point almost walks straight through him because of this.

So there’s a design problem here that headsets can’t readily solve. But it’s still a remarkable example of what sort of tech we’ll have access to in the future, and it’s particularly cool to see the recorded  conversation played back, and even shrunk.

“It’s almost like walking into a living memory, that I can see from another perspective,” said Izadi.

We’re excited to see how this all develops, and will do all we can to keep you informed.

San Francisco startup Dimensional advertised for people to walk robot dogs through city streets. The New York Times reported that the job could include carrying a roughly 33-pound robot back to the office if it overheated. A lift home is an awkward requirement for a labor-saving machine.

Keeping the hardware running is only one challenge. Anthropic's robotics tests found that language models mostly failed when controlling joints directly, but did better when directing trained controllers. Giving an AI agent a body doesn't teach it to handle ordinary household objects.

Soon, a mattress protector may be more than a bed cover. Australian medtech company Sleeptite and researchers at RMIT University have received a US patent for FlexiSense, a smart bedding technology that tracks body position and posture to help caregivers identify when older residents may be at risk of falling.

The technology is being developed for Sleeptite’s in-bed monitoring system, REMi, and was recently on display at The MedTech Conference in Boston. A peer-reviewed study in Flexible and Printed Electronics says the sensors can also be made at scale without sacrificing performance or durability.

AI companies spend enormous amounts of time convincing us their technology is safe and secure. But what happens when those same companies become targets of increasingly sophisticated AI-powered attacks? Anthropic, the company behind Claude, is now facing that question. According to a Washington Post report, cybersecurity startup Cathedral discovered vulnerabilities that let its researchers access sensitive information in Anthropic's internal systems.

The researchers used AI agents to identify potential entry points in less than 12 hours. Interestingly, they didn't need to crack Claude itself. Instead, they exploited weaknesses in third-party business applications that Anthropic uses for everyday operations. Anthropic's security testing program disclosed the findings, which allows outside researchers to identify and report vulnerabilities.