MIT Robot Sees Hidden Objects with Radio Waves

MIT Robot Sees Hidden Objects with Radio Waves

Creating robots that see the world like humans has been a challenge for scientists. While computer vision has come a long way, these systems are still easy to fool. So, why not give robots superhuman perception to compensate? MIT’s Fadel Adib created a robot that uses radar waves to find its target, allowing it to see through walls.

The robot, known as RF-Grasp, has traditional cameras for object recognition. The camera is mounted to the bot’s mechanical grasper, giving it a good view of anything the hand might be trying to pick up. However, what if the target is in a box or under something else? Radio waves can pass through the obstacle, and RF-Grasp can use the reflected signal to spot its target.

To accomplish this, Adib and his team used radio frequency tags, not unlike the ones used to identify pets or open secure doors. The reader sends out RF pings, which power and modulate the tag’s circuits. The reflected signal can provide data, but in this case, it’s being used to track the physical location of the tag.

For the purposes of testing RF-Grasp, the team deployed a small, focused RF reader next to the robot. The reader scans for RF tags in its field of view, and then feeds that data into the robot’s computer vision algorithm. So, when told to pick up an object it cannot see, RF-Grasp relies on the RF pings to seek out the target. When it’s uncovered the object, the robot is smart enough to give more weight to the camera feed in its algorithms. The team says merging data from the camera and RF reader into the bot’s decision-making was the most challenging part.

Compared with robots that only have visual data, RF-Grasp was much more efficient in laboratory tests involving picking and sorting objects. It has the ability to remove clutter from the environment to find its target, guided by RF data that tells it where to dig. For example, it can remove packing material from a box to find something at the bottom. Other robots just don’t have this extra layer of guidance.

This technology could lead to robots that can find objects no matter where they’re hidden. Lost your keys? Just fire up the RF-Grasp Mk V and it’ll figure out which pocket of which coat they’re in. A more realistic application is in the warehouse industry. Robots like Boston Dynamics’ Stretch can pick up and move heavy boxes, but only if they’re visible and regularly shaped. A robot with RF sensing could sort through a messy shelf to find specific objects, not unlike a human. We could be one step closer to eliminating human labor in these environments.

Continue reading

AT&T More Than Doubles Hidden Fee to Make $800 Million More Per Year
AT&T More Than Doubles Hidden Fee to Make $800 Million More Per Year

The carrier has more than doubled its "Administrative fee" from $0.76 to $1.99. That may be a piddling sum in the grand scheme of things, but remember that AT&T has 64.5 million cellular customers.

The Nintendo Switch Has a Hidden VR Mode
The Nintendo Switch Has a Hidden VR Mode

The Switch has a hidden VR mode that seems to functionally work, but will Nintendo ever use it?

Secrets of PlayStation Classic: Sony’s Hidden Menu, Support for More Games
Secrets of PlayStation Classic: Sony’s Hidden Menu, Support for More Games

The PlayStation Classic has a hidden menu with a load of tweaking options if you have the right keyboard. Sony, meanwhile, tested a number of the games enthusiasts were hoping for most, even if it didn't ship them.

Samsung Is Developing Cameras Hidden Under Phone Display
Samsung Is Developing Cameras Hidden Under Phone Display

A new report from Korea's Yonhap News Agency says that Samsung is aiming to have phones in the next few years with full, uninterrupted displays and cameras hidden underneath the screen.