DeepMind Builds AI That Reconstructs 3D Objects From a Single Photo

DeepMind Builds AI That Reconstructs 3D Objects From a Single Photo

Google’s DeepMind unit has been involved in some of the company’s coolest AI breakthroughs in recent years, from outsmarting human Go players to developing more realistic speech synthesis. Now, DeepMind is looking to improve the way machines understand and model 3D spaces. DeepMind AI researchers have created a neural network that can predict what a space will look like after seeing one or more images of it, even if only parts of the room are visible.

At the core of this project is the aim to make neural networks easier to train. Usually, you have to get humans to label the data you use to train a neural network. After feeding the data in, the nodes in the network calculate weights and feed-forward into more nodes. At the end, the system output should match what you put in. Of course, it won’t at first, so you need to adjust the network until it’s trained. DeepMind’s new generative query network (GQN) can learn from unlabeled inputs and apply its knowledge to new situations.

The team generated 3D virtual spaces from vectors, and then created single-frame images of them for the system to analyze. The GQN is actually two neural networks — there’s a network that learns from the images and a second one that generates new perspectives. The team simulated a virtual robot arm, a block-like table, and a simple maze.

After training the GQN on millions of images, the system can create accurate representations of an object or room with just a single still image. It’s similar to the way your brain works. If you see a wall in the middle of a room, you’d probably imagine what the other side looks like and about where it’s located in comparison with other objects you can see.

The GQN uses limited data to reconstruct the entire room.
The GQN uses limited data to reconstruct the entire room.

DeepMind believes this sort of technology could be vital in areas like self-driving cars, where the system might not have all available information about upcoming road conditions. However, maybe it can predict with a high degree of accuracy based on what it does know.

The images shown to the GQN are very simple compared with the real world, and it still took months to get the network up to speed on current hardware. It may take another few generations of processing improvements before such a system can come close to understanding and predicting the layout of a complex real-world situation.

Continue reading

Huawei’s Phone Deal With AT&T Reportedly Killed On Account of Politics

The upcoming (and unannounced) deal with AT&T to sell the new Mate 10 series was supposed to be the start of Huawei's push into North America, but the deal has reportedly fallen apart at the last minute after AT&T got cold feet, and some sources point to a political cause.

Razer Phone Gets Netflix HDR and Dolby 5.1 Sound

The company has announced a deal with Netflix that brings HDR and Dolby Digital Plus 5.1 sound to the Razer Phone.

Vivo Demos First Smartphone With In-Display Fingerprint Sensor

At CES, Chinese smartphone maker Vivo is on hand to show off the first ever phone with a fingerprint reader inside the display.

CES 2018 in Photos: What We Remember Most

CES is always an overwhelming cacophony of sights and sounds, but a few images always stand out. Here are a few of our favorites from this year's show.