Google has invested heavily in artificial intelligence to power products like Google Photos and Google Assistant. These applications are impressive in their own right, but they’re not exactly “fun.” Google has just rolled out a new AI experiment that is geared entirely toward fun. The new Mirror Move experiment can identify your pose and match it to more than 80,000 images of other people to show you someone in a similar stance. Why? So you can make GIFs, of course.
While this specific Google experiment doesn’t have a practical use, it’s a tour de force of technology buzzwords. Mirror Move utilizes AI, machine learning, neural networks, augmented reality, and more. You can try it right now as long as your computer has a webcam. Just head over to the Move Mirror site linked above and grant the page access to your camera to get started.
Mirror Move works best if you stand far enough away from your computer that all your joints are in the frame. It’s also limited to a single person at a time. As you move, the AI scans your body and estimates where your joints are. It then matches your poses to a catalog of 80,000 photos of people. So, your live camera feed is on one side of the screen, and Mirror Move populates the other with matching pictures in real time. You can even create a GIF of this process to share on the internet.
This is all just for fun, but the technology behind Mirror Move could have many applications. Google calls it PoseNet, and you can learn more about the details in a Medium post from earlier this year. Like many Google technologies, PoseNet is powered by a convolutional neural network. The camera feed gets piped into the network, which identifies people and maps 17 tracking points on the image. The network matches those points to its catalog of 80,000 images, and you get the output.
PoseNet works in both single-person and multiple person detection modes. There’s a separate demo that shows how well this works, but all you get is the 17-point detection wireframe. Mirror Move is an implementation of the single-person version because it’s faster and the image library consists of individual people.
PoseNet could eventually find use in games, fitness tracking, and even interactive art installations. This is not a tool for recognizing who people are, so it’s less of a privacy concern than tools that can recognize and remember faces.
CES 2018 in Photos: What We Remember Most
CES is always an overwhelming cacophony of sights and sounds, but a few images always stand out. Here are a few of our favorites from this year's show.
Google Hired Photographers To Help Train the AI-Powered ‘Clips’ Camera
Google unveiled this device in October 2017, but it's still not available. It's expected to go on sale soon, and now Google has detailed how it tuned the camera's neural network to understand what is a significant moment.
How to Create Your Own Private Photo Sharing Cloud
If you want to be able to get at your photos from anywhere, and share them with others, without the cost or potential privacy issues of keeping them in a public cloud, here are some ways to DIY your own private photo sharing cloud.
Mobile Photography Workflow: Pushing the Envelope With Lightroom and Pixel
It's been easy to dismiss smartphone photography as being only for casual shooters. But that's changing quickly. We take a look at what you can accomplish with a Pixel 2, Pixelbook, and Lightroom.