MIT Taught Self-Driving Cars to See Around Corners with Shadows
We’re inching ever-closer to a world where cars can drive themselves. The most advanced autonomous vehicles in testing by companies like Alphabet’s Waymo can drive in many situations as well as a human, but the hope is to make cars better than human drivers. Ideally, a self-driving car would be able to use all its processing might to avoid an accident, but to do that, they need data. Researchers from MIT have developed a system that could help cars prevent collisions by, essentially, looking around corners. They call it ShadowCam.
Several teams have developed systems that can give AI-powered vehicles hints about what’s around the next bend in the road. For example, Stanford scientists created a system using lasers that could detect objects around corners. The new MIT system is simpler because it just looks for subtle changes in light and shadow on the ground that indicate another vehicle is approaching.
This work comes from MIT’s famous Computer Science and Artificial Intelligence Laboratory (CSAIL). The team thinks this approach to monitoring the environment around a vehicle could be the equivalent of x-ray vision for cars. Whereas the LIDAR used for object mapping in current self-driving cars has high resolution and collects more data than a visible light camera, it can only objects that are directly visible. A shadow, however, might be enough to trim as much as half a second off the car’s reactions. That could be the difference between a major accident and a near miss.
ShadowCam uses a sequence of four video frames from a camera pointed at the region just ahead of the car. The AI maps changes in light intensity over time, and specific changes can indicate another vehicle is approaching from an unseen area. This is known as Direct Sparse Odometry, a way to estimate motion by analyzing the geometry of a sequential image — it’s the same technique NASA uses on Mars rovers. The system classifies each image as stationary or dynamic (moving). If it thinks the shadow points to a moving object, the AI driving the car can make changes to its path or reduce speed.
The researchers tested this system with a specially rigged “autonomous wheelchair” that navigated hallways. ShadowCam was able to detect when a person was about to walk out in front of the wheelchair with about 70 percent accuracy. With a self-driving car in a parking garage, the researchers were able to tune ShadowCam to detect approaching vehicles 0.72 seconds sooner than lidar with an accuracy of about 86 percent. However, the system has been calibrated specifically for the lighting in those situations. The next step is to enable ShadowCam in varying light and situations.
Continue reading
Protect Your Online Privacy With the 5 Best VPNs
Investing in a VPN is a smart choice right now, but the options are vast. To help narrow things down a bit, we've rounded up five of our very favorite consumer services.
RISC-V Tiptoes Towards Mainstream With SiFive Dev Board, High-Performance CPU
RISC V continues to make inroads across the market, this time with a cheaper and more fully-featured test motherboard.
The PlayStation 5 Will Only Be Available Online for Launch Day
The PlayStation 5 isn't going to be available in stores on launch day, and if you want to pick up an M.2 SSD to expand its storage, you'll have some time to figure out that purchase.
ARMing for War: New Cortex-A78C Will Challenge x86 in the Laptop Market
ARM took another step towards challenging x86 in its own right with the debut of the Cortex-A78C this week. The new chip packs up to eight "big" CPU cores and up to an 8MB L3 cache.