Samsung’s Latest AI Project Is an Imaginary Keyboard for Your Phone

The typing experience on smartphones has gotten vastly better over the years, but typing with your thumbs will never be as fast as using a real keyboard. Samsung thinks it’s onto something with its latest Android feature, which it calls SelfieType. At CES, the company is demoing this AI-powered system that lets you type on an imaginary keyboard.

SelfieType comes from Samsung’s C-Lab program, a sort of internal incubator that develops quirky technologies that may eventually find their way into real products. Samsung’s decision to announce SelfieType suggests that it’s relatively confident in its capabilities. I say “relatively” because Samsung does have a history of rolling out products and features before they’re ready. The Galaxy Fold is just the latest example.

When you fire up SelfieType (assuming you ever get the opportunity), the phone activates the front-facing camera and begins watching your hands. SelfieType doesn’t rely on depth sensors or IR dot projectors to follow your fingers — it uses AI to map where each finger moves, allowing you to “mime” typing on a keyboard that doesn’t exist. As you tap the tabletop, the phone translates those presses to the on-screen keyboard. And like magic, you get the text on your screen.

The whole idea harkens back to the laser projector keyboard accessories that were all the rage about a decade ago. You can still buy one for about $30, but you shouldn’t. They’re slower and less accurate than any modern touchscreen keyboard. Plus, that’s another accessory to tote around. SelfieType at least has the advantage of being built into the device. In the video below, Samsung shows SelfieType working on several devices including a regular phone, a Galaxy Fold, and a tablet.

It’s possible SelfieType will work better than you’d expect — we’ve seen neural networks do some very impressive things That said, it seems like typing on an invisible keyboard would be difficult even with perfect AI mapping. You will likely have to keep your hands in place, tied to a virtual home row that you can’t see or feel. On a phone, you can see the keyboard as you type, and haptics can provide some semblance of tactility.

For now, SelfieType is just a demo. Samsung has made any promises about including it in future devices. Although, it could probably do so with a software update if it decides it’s ready for prime time.

Continue reading

Protect Your Online Privacy With the 5 Best VPNs

Investing in a VPN is a smart choice right now, but the options are vast. To help narrow things down a bit, we've rounded up five of our very favorite consumer services.

EKWB Launches Peltier Cooler Powered by Intel Cryo Cooling Technology

Intel and EKWB have jointly announced a new waterblock that integrates a Peltier cooler.

Look Up: You Can See All the Planets in Our Solar System Tonight

You've probably seen diagrams of the solar system that place the planets in nice, orderly lines, but the truth is they're often on the other side of the sun from Earth. We happen to be going through a period during which all the planets are visible. You just have to know where and when to look.

How Apple Is Collecting Your Data in macOS Big Sur

Apple's new Big Sur has been accused of some serious privacy violations and unfriendly user-access controls. The situation is a bit more nuanced.