Taking a photo in poor lighting can often result in something too pixelated and noisy to be useful. Advanced software processing on some phones and cameras can fix moderate noise, but a new project from Nvidia, MIT, and Aalto University uses AI to correct for extreme levels of noise. Even if the “Noise2Noise” system has never seen an image before, it can de-noise it to get something very close to the original.
Noise2Noise is a neural network, which means you need to train it with lots of data. The team used 50,000 images from the ImageNet database, which contains clear, high-resolution images. Of course, the network needs to see noisy images in order to understand how to de-noise them. So, the team artificially added noise to the images and used those to train the algorithm.
Nvidia contributed a bank of Tesla P100 GPUs to run the network training with the cuDNN-accelerated TensorFlow deep learning framework. The network was adjusted until it was able to take out the noise and deliver something close to the original dataset image. The true test is how the network handles new images that it hasn’t seen before. The team reports that Noise2Noise can remove artifacts and noise with a high degree of accuracy.
Researchers point to several possible applications for Noise2Noise. Low-light photography is probably the one that would make the biggest immediate impact on your life. You could run your noisy photos through Noise2Noise and end up with something that looks much nicer. Astrophotography often involves very long exposures, and that leads to high noise. The same process could be applied here to make images of space clearer. MRI images suffer from similar noise issues, and the team tested Noise2Noise as a way to clean them up.
Many camera and smartphone manufacturers have their own processing algorithms that strip noise out of RAW images before showing you the final jpeg. For the most part, they don’t rely on the same technology as Noise2Noise. The only one that’s close is Google, which has leveraged its machine learning technology in the Pixel camera to do similar noise reduction work. However, it’s nowhere near as extreme. Noise2Noise can resolve detail from an almost unrecognizably pixelated image. The final product does look a bit unnaturally smooth, but that’s an issue even with less powerful image processing.
The researchers are presenting their work at the International Conference on Machine Learning in Stockholm, Sweden. It’s still just a computer science curiosity at the moment, but image processing is big business. A practical application could be a big hit.
ET Deals: $50 off Bose QC35 Noise-Cancelling Headphones, $250 off Dell XPS 13 with New i7-8550u
Need some nice noise-cancelling headphones? What about a set of dumbbells for your new training regimen? With the Labor Day weekend upon us, there are loads of deals from all over the internet popping up. See the summer season off right, and treat yourself to something great.
New Google Patch Reduces Spectre Performance Impact to ‘Noise’
When Spectre Variant 2 patches rolled out this year, some servers, particularly those with older Intel CPUs, saw performance declines. Google is working with MS to make sure we get that performance back.
ET Deals: Sony WH1000XM3 Wireless Noise-Cancelling Headphones for $300
If you've ever tried to work or relax in a noisy environment, you know how frustrating that experience is. Invest in a nice pair of noise-cancelling headphones, and you can effectively block out the day-to-day distractions. And with this limited time deal on the PCMag Shop, you can snag a premium noise-cancelling headset from Sony at a hefty discount.
ET Deals: Apple AirPods w/ Wireless Charging Case $179, Kingston A400 480GB SSD $44, Sony Wireless Noise-Canceling Headphones $99
Kicking things off for today is an inexpensive Kingston 480GB SSD for just $44.99. If you still haven't made the jump from a hard drive to an SSD, now is the perfect time.