Article Image

MIT researchers develop eye-tracking program for your smartphone

Researchers at MIT and the University of Georgia have developed a program that uses your smartphone's front-facing camera to track eye movement. By the end of the year, the team hopes to have it ready for commercial purposes.

According to a new paper, researchers at the University of Georgia and the Massachusetts Institute of Technology’s Computer Science and Artificial Intelligence Laboratory have developed a piece of software capable of turning almost any smartphone into an eye-tracking device.

Inspired by what MIT graduate student Aditya Khosla calls a “chicken-and-egg loop,” regarding eye-tracking applications for smartphones, researchers teamed up to bring together the information needed to develop such a program. In speaking to MIT News, Khosla said:

“Since few people have the external devices, there’s no big incentive to develop applications for them. Since there are no applications, there’s no incentive for people to buy the devices. We thought we should break this circle and try to make an eye tracker that works on a single mobile device, using just your front-facing camera.”

In order to create such a program, the team of engineers and researchers first needed data, the key ingredient in creating the brain of the program, a machine learning algorithm.

To do this, the researchers sought out strength in numbers with a little crowdsourcing from Amazon’s Mechanical Turk program. Previous research in this area was limited to only 50 or so subjects, who were asked to come into a lab to complete the tests.

Khosla and his team far exceeded previous research by sampling the eye movements of 1,500 mobile users, all of whom participated with the help of GazeCapture, a custom iOS application that combined on-screen animations with use of the front-facing camera.

The data captured from 800 of the 1,500 subjects was used to create iTracker, the first iteration of the eye-tracking system, which had a margin of error of only 1.5 centimeters. Since then, the researchers have analyzed the remaining 700 subjects and further improved the margin of error, shrinking it down to just 1 centimeter.

The team is hopeful that further testing will be able to reduce that even more, down to a margin of error of a half-centimeter, the key number that will make the program commercially viable in the eyes of Khosla.

As for the practical applications for such technology, it can be used for almost anything more conventional eye-tracking methods are used for, from helping doctor’s discover and keep tabs on various illnesses, to market research and analytics. The key difference here is that this new method of tracking is far less invasive and exorbitantly less expensive than alternative options, making it easier than ever to capture larger quantities of data.

Below is the paper in its entirety:

It’ll be interesting to see what the future holds. The team behind it will be presenting the paper on June 28 at the Computer Vision and Pattern Recognition conference in Las Vegas.

Two new highly requested iCloud plugins just got added to ChatGPT, giving people who rely on Apple’s Mail and Calendar services a way to search emails, check appointments, and manage their schedules directly through the chatbot.

The integration is rolling out to all ChatGPT plans, including the free tier. You can access it on the web, desktop, and iOS.

Google Play is borrowing one of the Nintendo Switch’s most useful little tricks. A new Sidekick tool called Playbacks captures a short clip after something interesting has already happened, sparing players from running a screen recorder throughout an entire game.

Playbacks is part of Google Play Store v53.8 and keeps saved clips on the phone. Google first announced it earlier this month, but the new Play Store update marks its arrival for players. Anyone who has watched a perfect win vanish because the record button came too late already understands the appeal.

Samsung’s scandal over its Game Optimizing Service, or GOS, has returned with a bill attached. South Korea’s Fair Trade Commission has tentatively fined the company 20.1 billion won, or about $15.1 million, over gaming claims made for the Galaxy S21, Galaxy S22, and Tab S8.

The regulator says Samsung promoted the devices as gaming powerhouses without disclosing that GOS placed preset CPU and GPU limits on certain demanding games. Samsung disputes that conclusion, calling GOS a legitimate way to manage heat.