Samsung’s Latest AI Project Is an Imaginary Keyboard for Your Phone

The typing experience on smartphones has gotten vastly better over the years, but typing with your thumbs will never be as fast as using a real keyboard. Samsung thinks it’s onto something with its latest Android feature, which it calls SelfieType. At CES, the company is demoing this AI-powered system that lets you type on an imaginary keyboard.

SelfieType comes from Samsung’s C-Lab program, a sort of internal incubator that develops quirky technologies that may eventually find their way into real products. Samsung’s decision to announce SelfieType suggests that it’s relatively confident in its capabilities. I say “relatively” because Samsung does have a history of rolling out products and features before they’re ready. The Galaxy Fold is just the latest example.

When you fire up SelfieType (assuming you ever get the opportunity), the phone activates the front-facing camera and begins watching your hands. SelfieType doesn’t rely on depth sensors or IR dot projectors to follow your fingers — it uses AI to map where each finger moves, allowing you to “mime” typing on a keyboard that doesn’t exist. As you tap the tabletop, the phone translates those presses to the on-screen keyboard. And like magic, you get the text on your screen.

The whole idea harkens back to the laser projector keyboard accessories that were all the rage about a decade ago. You can still buy one for about $30, but you shouldn’t. They’re slower and less accurate than any modern touchscreen keyboard. Plus, that’s another accessory to tote around. SelfieType at least has the advantage of being built into the device. In the video below, Samsung shows SelfieType working on several devices including a regular phone, a Galaxy Fold, and a tablet.

It’s possible SelfieType will work better than you’d expect — we’ve seen neural networks do some very impressive things That said, it seems like typing on an invisible keyboard would be difficult even with perfect AI mapping. You will likely have to keep your hands in place, tied to a virtual home row that you can’t see or feel. On a phone, you can see the keyboard as you type, and haptics can provide some semblance of tactility.

For now, SelfieType is just a demo. Samsung has made any promises about including it in future devices. Although, it could probably do so with a software update if it decides it’s ready for prime time.

Continue reading

CD Projekt Red Denies Any Plan to Offer Refunds for Cyberpunk 2077

Turns out, CD Projekt Red didn't actually mean for you to think you could get a refund for Cyberpunk 2077.

Breakthrough Listen Project Scans 60 Million Stars, Finds Zero Aliens

Scientists with the Breakthrough Listen project took up the mantle of the Search for Extraterrestrial Intelligence (SETI) several years ago, continuing the decades-long search for ET. The project has just released its largest survey to date, consisting of more than 60 million stars...and no aliens.

Far Beyond the Stars: Improving Motion, Image Quality in the DS9 Upscale Project

It's been nine months since Joel Hruska's last Star Trek: Deep Space Nine Upscale Project update. The new encode method he debuts here offers better motion and improved image quality relative to what was possible last year.

Deep Space Nine Project Update: Why MakeMKV-Derived Files Don’t Work

The question of why a MakeMKV source doesn't work has come up again and again, so we decided to investigate it.