For the occasional email that you may have to tap out on your tablet or smartphone, it doesn’t make sense to tote a whole physical keyboard in your bag. But then again, you can’t stand the virtual keyboard on your device because it covers up half your screen, making it difficult to see what you’re writing. So what options do you have?
Fujitsu has been working on a way to use your tablet or smartphone’s front-facing camera to track your fingers so that you can type on any flat surface. TechCrunch spotted a demo of this prototype mobile typing technology at the company’s booth at Mobile World Congress in Spain earlier this week.
From what TechCrunch saw, the invisible keyboard is mostly driven by software that runs on a “generic Fujitsu Windows 8 tablet.” There is no fancy setup to make this technology work: the tablet just needs to be propped up in front of your hands, and your hands need to be brightly lit with a lamp so the slate’s camera can pick up on your fingers. It’s able to interpret what you want to type based on where your fingers are in relation to the keyboard layout and track their movements.
While the software is smart enough to figure out what you’re tapping, it can’t really detect the movements of hands with darker skin tones yet. That’s why the prototype at MWC 2013 was setup for lighter skin tones, which meant the tablet ignored the taps of users with darker skin colors even though the software could detect their typing. In Ubergizmo‘s opinion, darker skin tones can be more difficult for the camera to track than lighter skin colors, so hopefully the Japanese company can overcome this technical huddle.
Clearly, Fujitsu still has some work to do with the software before it is ready to be included into its smartphones and tablets – especially if those devices are expected to sell outside of Japan. But without the tactile feedback of a physical or even on-screen keyboard, will this gesture-based keyboard technology be any different from the lame laser projection keyboards you can get from the mall? What do you think?
TechCrunch.
[UPDATE 3:30PM 3/1/2013: Added photo credits, and rephrased the second-to-last paragraph to include Ubergizmo’s opinion on why the technology has trouble detecting darker skin tones at the moment.]
Related Posts
I used an Android tablet for 4 weeks, they still lag behind iPad in a number of ways
The best Android phones remain some of the most-anticipated mobiles each year, yet historically, iPad has remained the dominant tablet force. I’ve just come off of a month of testing the OnePlus Pad Go 2, which should be a tempting iPad alternative due to its price and size (a 12-inch screen for a cost that's comparable to the base-level 10-inch iPad), but that time just reminded me how far Android lags behind iPadOS.
I found an iPad browser that finally puts a desktop-like experience on Apple’s tablet
As a result, you won’t find Safari alternatives that can really stand out. On the desktop side for Mac, there’s no such rule. As a result, you can find terrific options such as Perplexity Comet, Dia, and ChatGPT Atlas, aside from the big names such as Chrome, Edge, and Firefox.
The Kindle Scribe Colorsoft gets a splash of color with new Fig variant
Amazon has now confirmed that the "Fig" variant of the Kindle Scribe Colorsoft will go on sale on January 28. Hardware-wise, it will be identical to the Graphite model, with the only differences being the new back-panel finish and the color-matched bezel and pen.