DeepMind Builds AI That Reconstructs 3D Objects From a Single Photo
Google’s DeepMind unit has been involved in some of the company’s coolest AI breakthroughs in recent years, from outsmarting human Go players to developing more realistic speech synthesis. Now, DeepMind is looking to improve the way machines understand and model 3D spaces. DeepMind AI researchers have created a neural network that can predict what a space will look like after seeing one or more images of it, even if only parts of the room are visible.
At the core of this project is the aim to make neural networks easier to train. Usually, you have to get humans to label the data you use to train a neural network. After feeding the data in, the nodes in the network calculate weights and feed-forward into more nodes. At the end, the system output should match what you put in. Of course, it won’t at first, so you need to adjust the network until it’s trained. DeepMind’s new generative query network (GQN) can learn from unlabeled inputs and apply its knowledge to new situations.
The team generated 3D virtual spaces from vectors, and then created single-frame images of them for the system to analyze. The GQN is actually two neural networks — there’s a network that learns from the images and a second one that generates new perspectives. The team simulated a virtual robot arm, a block-like table, and a simple maze.
After training the GQN on millions of images, the system can create accurate representations of an object or room with just a single still image. It’s similar to the way your brain works. If you see a wall in the middle of a room, you’d probably imagine what the other side looks like and about where it’s located in comparison with other objects you can see.
DeepMind believes this sort of technology could be vital in areas like self-driving cars, where the system might not have all available information about upcoming road conditions. However, maybe it can predict with a high degree of accuracy based on what it does know.
The images shown to the GQN are very simple compared with the real world, and it still took months to get the network up to speed on current hardware. It may take another few generations of processing improvements before such a system can come close to understanding and predicting the layout of a complex real-world situation.
Continue reading
DeepMind AI Breakthrough Allows Prediction of More Than 200 Million Protein Structures
DeepMind has announced that has generated structures for all 200+ million proteins in the centralized UniProt database. This is a big deal for basic biological research as well as for efforts to tackle some of the most important scientific conundrums of our time.
DeepMind Builds AI That Codes as Well as the Average Human Programmer
In an apparent effort to put themselves out of a job, DeepMind researchers have created an AI that can write code, and it performs surprisingly well in programming challenges.
DeepMind’s Psychlab Heralds Dawn of Artificial General Intelligence
A toolkit for assessing artificial intelligence with the same psychological tests that we use for assessing human cognitive abilities is proof of the breakneck speed at which AI is progressing.
DeepMind AI Challenges Pro StarCraft II Players, Wins Almost Every Match
After just 18 months, DeepMind has an AI that beats the world's best StarCraft II players, and it's not even close.