DeepMind Builds AI That Codes as Well as the Average Human Programmer

DeepMind Builds AI That Codes as Well as the Average Human Programmer

While machine learning has advanced by leaps and bounds, it’s hard to create an AI that’s good at more than one thing. So, a machine could be trained with data to handle one class of programming challenges, but it would fail when given a different problem to tackle. So, the team decided to skip all the training on algorithms and code structure, instead treating it more like a translation problem.

Programming challenges usually include a description of the task, and the resulting code submitted by a human participant is technically just an expression of the description. The AI works in two phases: It takes the description and converts it to an internal representation. Then, it uses that representation to generate functional code based on the data it was shown in training. And there was a lot of data.

DeepMind fed the AI 700GB of code on GitHub, complete with the comments that explain the code. As Ars Technica points out, that’s a huge amount of text data. With the essence of programming internalized, DeepMind set up its own programming contests and fed the results into the AI to fine-tune the model’s performance. The team says this is an order of magnitude more training data than past coding machines have gotten, and that made all the difference.

DeepMind Builds AI That Codes as Well as the Average Human Programmer

The researchers found that AlphaCode was able to generate a huge number of potential answers to a coding problem, but about 40 percent of them would run through all the available system memory or fail to reach the answer in a reasonable amount of time. The data needs to be filtered to find the one percent of solutions that are actually good code. DeepMind found that clusters of similar code indicated better answers, whereas the wrong ones were randomly distributed. By focusing on those answers, AlphaCode was able to correctly answer about one-third of coding challenges. It turns out a lot of human programmers are little better, so AlphaCode placed in the top 54 percent. It’s not about to take jobs from DeepMind engineers, but give it time.

Continue reading

NASA Begins Building Orion Spacecraft that Will Return Humans to Moon
NASA Begins Building Orion Spacecraft that Will Return Humans to Moon

NASA's primary Orion contractor Lockheed Martin has just started work on one very important project: the first welds of the Orion capsule that will return humans to the moon.

Epic’s New MetaHuman Creator Generates Digital Characters that Avoid the Uncanny Valley
Epic’s New MetaHuman Creator Generates Digital Characters that Avoid the Uncanny Valley

The company's new MetaHuman engine promises to deliver photorealistic digital characters in a snap, and you can check out a demo right now.

New Xiaomi Phone Has a Secondary Display in the Camera Hump
New Xiaomi Phone Has a Secondary Display in the Camera Hump

Chinese mobile giant Xiaomi is set to announce a new device called the Mi 11 Ultra, and the device has leaked early. It's got a giant camera module that supports up to 120x zoom, and there's even an extra screen. Yes, a screen in the camera hump. Because why not, I guess?

IBM Built an AI Capable of Holding Its Own Against Humans in a Debate
IBM Built an AI Capable of Holding Its Own Against Humans in a Debate

IBM's Project Debater isn't sweeping humans off the debate stage just yet, but it's getting better at competing with them.