Google Glass may not have been the smash hit that Google would have wanted, but that doesn’t mean that the company isn’t working on building better augmented and virtual reality technology. In fact, Google was just awarded a patent for a way to track facial expressions through eye-tracking cameras, something that could be significantly helpful in creating immersive VR experiences.
The patent is called “Classifying Facial Expressions Using Eye-Tracking Cameras,” and essentially has to do with using a machine learning algorithm, coupled with eye-tracking sensors, to infer the expressions that users have on their faces. The patent goes on to describe users being able to interact with each other in a virtual world through avatars, which would look like the user, and, with this tech, have their facial expressions, too.
As the patent notes, because of the fact that virtual reality headsets tend to obscure the user’s face, it can be difficult to tell what the user’s facial expression is when they’re wearing one. A machine learning algorithm, however, could be trained to learn expressions related to anger, happiness, surprise, and so on. It could also be trained to identify things like the brow lowering, lip raising, and more.
The tech certainly could make augmented and virtual reality more immersive. Virtual reality has started becoming increasingly common with headsets like the HTC Vive, Oculus Rift, and with platforms like Google Daydream. Virtual reality as a whole, however, is seen as still being in its infancy and is likely to go through a ton of development over the next decade or so. One of its biggest problems is that it’s still not quite as immersive as it could be, whether due to low-resolution graphics, slower performance, or that users still aren’t really visually represented in virtual reality experiences just yet. Google’s new tech could especially help the last issue by ensuring that users are visually represented in games and experiences in a way that’s accurate and detailed.
Of course, just because Google has filed a patent that doesn’t mean that it’ll put it to use. The likes of Google and Apple routinely file patents for tech they never use.
Two new highly requested iCloud plugins just got added to ChatGPT, giving people who rely on Apple’s Mail and Calendar services a way to search emails, check appointments, and manage their schedules directly through the chatbot.
The integration is rolling out to all ChatGPT plans, including the free tier. You can access it on the web, desktop, and iOS.
Google Play is borrowing one of the Nintendo Switch’s most useful little tricks. A new Sidekick tool called Playbacks captures a short clip after something interesting has already happened, sparing players from running a screen recorder throughout an entire game.
Playbacks is part of Google Play Store v53.8 and keeps saved clips on the phone. Google first announced it earlier this month, but the new Play Store update marks its arrival for players. Anyone who has watched a perfect win vanish because the record button came too late already understands the appeal.
Samsung’s scandal over its Game Optimizing Service, or GOS, has returned with a bill attached. South Korea’s Fair Trade Commission has tentatively fined the company 20.1 billion won, or about $15.1 million, over gaming claims made for the Galaxy S21, Galaxy S22, and Tab S8.
The regulator says Samsung promoted the devices as gaming powerhouses without disclosing that GOS placed preset CPU and GPU limits on certain demanding games. Samsung disputes that conclusion, calling GOS a legitimate way to manage heat.