MIT Taught Self-Driving Cars to See Around Corners with Shadows

We’re inching ever-closer to a world where cars can drive themselves. The most advanced autonomous vehicles in testing by companies like Alphabet’s Waymo can drive in many situations as well as a human, but the hope is to make cars better than human drivers. Ideally, a self-driving car would be able to use all its processing might to avoid an accident, but to do that, they need data. Researchers from MIT have developed a system that could help cars prevent collisions by, essentially, looking around corners. They call it ShadowCam.

Several teams have developed systems that can give AI-powered vehicles hints about what’s around the next bend in the road. For example, Stanford scientists created a system using lasers that could detect objects around corners. The new MIT system is simpler because it just looks for subtle changes in light and shadow on the ground that indicate another vehicle is approaching.

This work comes from MIT’s famous Computer Science and Artificial Intelligence Laboratory (CSAIL). The team thinks this approach to monitoring the environment around a vehicle could be the equivalent of x-ray vision for cars. Whereas the LIDAR used for object mapping in current self-driving cars has high resolution and collects more data than a visible light camera, it can only objects that are directly visible. A shadow, however, might be enough to trim as much as half a second off the car’s reactions. That could be the difference between a major accident and a near miss.

ShadowCam uses a sequence of four video frames from a camera pointed at the region just ahead of the car. The AI maps changes in light intensity over time, and specific changes can indicate another vehicle is approaching from an unseen area. This is known as Direct Sparse Odometry, a way to estimate motion by analyzing the geometry of a sequential image — it’s the same technique NASA uses on Mars rovers. The system classifies each image as stationary or dynamic (moving). If it thinks the shadow points to a moving object, the AI driving the car can make changes to its path or reduce speed.

The researchers tested this system with a specially rigged “autonomous wheelchair” that navigated hallways. ShadowCam was able to detect when a person was about to walk out in front of the wheelchair with about 70 percent accuracy. With a self-driving car in a parking garage, the researchers were able to tune ShadowCam to detect approaching vehicles 0.72 seconds sooner than lidar with an accuracy of about 86 percent. However, the system has been calibrated specifically for the lighting in those situations. The next step is to enable ShadowCam in varying light and situations.

Continue reading

Astronomers Find Supermassive Black Hole Wandering Around Distant Galaxy

Can a supermassive black hole have wanderlust? That's something astronomers have been wondering about for years, and a new study from the Harvard and Smithsonian Center for Astrophysics might have arrived at an answer: yep.

Astronomers Detect Moon-Forming Disc Around an Alien Planet

There are more than 4,000 confirmed exoplanets, but just a few have been directly imaged. A young gas giant called PDS 70c is one of them, and now astronomers have spotted something new.

Russian Troops Reportedly Irradiated After Bumbling Around in Chernobyl Exclusion Zone

Russia took the facility on the first day of the invasion, and as many feared, there are now reports that a large number of Russian troops have been taken to medical facilities with radiation poisoning.

Disturbing Robotic Slime Can Move Around Inside the Body, Pick Up Objects

The appropriately named "magnetic slime robot" doesn't need any internal electronics — it's a combination of several different materials, allowing it to be controlled with external magnetic fields. The result is a wriggling, brown blob that could one day scoop harmful objects out of the human digestive tract.