DeepMind Builds AI That Reconstructs 3D Objects From a Single Photo

Google’s DeepMind unit has been involved in some of the company’s coolest AI breakthroughs in recent years, from outsmarting human Go players to developing more realistic speech synthesis. Now, DeepMind is looking to improve the way machines understand and model 3D spaces. DeepMind AI researchers have created a neural network that can predict what a space will look like after seeing one or more images of it, even if only parts of the room are visible.

At the core of this project is the aim to make neural networks easier to train. Usually, you have to get humans to label the data you use to train a neural network. After feeding the data in, the nodes in the network calculate weights and feed-forward into more nodes. At the end, the system output should match what you put in. Of course, it won’t at first, so you need to adjust the network until it’s trained. DeepMind’s new generative query network (GQN) can learn from unlabeled inputs and apply its knowledge to new situations.

The team generated 3D virtual spaces from vectors, and then created single-frame images of them for the system to analyze. The GQN is actually two neural networks — there’s a network that learns from the images and a second one that generates new perspectives. The team simulated a virtual robot arm, a block-like table, and a simple maze.

After training the GQN on millions of images, the system can create accurate representations of an object or room with just a single still image. It’s similar to the way your brain works. If you see a wall in the middle of a room, you’d probably imagine what the other side looks like and about where it’s located in comparison with other objects you can see.

DeepMind believes this sort of technology could be vital in areas like self-driving cars, where the system might not have all available information about upcoming road conditions. However, maybe it can predict with a high degree of accuracy based on what it does know.

The images shown to the GQN are very simple compared with the real world, and it still took months to get the network up to speed on current hardware. It may take another few generations of processing improvements before such a system can come close to understanding and predicting the layout of a complex real-world situation.

Continue reading

Harvard Astronomer Still Believes Interstellar Object Was Alien Technology

Scientists have classified 'Oumuamua variously as an asteroid or a comet, but Avi Loeb, the chair of Harvard's Department of Astronomy, believes it was really alien — a piece of alien technology we mistook for a naturally occurring space rock.

MIT Robot Sees Hidden Objects with Radio Waves

Creating robots that see the world like humans has been a challenge. While computer vision has come a long way, these systems are still easy to fool. So, why not give robots superhuman perception to compensate?

Mysterious Space Object Could Be Record-Breaking Comet

The outer solar system is littered with big chunks of rock and ice, but rarely do their orbits bring them close enough to Earth for us to get a good look. And then there's 2014 UN271, an approaching object that astronomers believe to be a huge comet on a million-year orbit around the sun.

Most Interstellar Objects Might Evaporate Between Stars

In 2017, astronomers around the world turned their attention to a small point of light zipping through the solar system. The object, known as 'Oumuamua, was the very first interstellar object ever discovered. We have since spotted a second, suggesting that visitors from afar might be common. However, a new analysis claims that almost all the potential visitors drifting between stars evaporate long before they could get here.