VR-Controlled Robot Wins Competition by Completing 10 Tasks Under 6 Minutes

VR-Controlled Robot Wins Competition by Completing 10 Tasks Under 6 Minutes

XPrize, an organization known for its incentivized tech challenges, hosted a $10 million competition on Saturday inviting robotics companies from around the world to show off their telepresence technology. Seventeen teams demonstrated their own takes on the “Avatar robot,” a device that allows remote individuals to communicate and operate in a location other than their own. At the end of the day, the Autonomous Intelligent Systems group from Germany’s University of Bonn took home a $5 million prize for NimbRo, a robot controlled via virtual reality (VR) headset and exoskeletal arms.

NimbRo itself is made up of a humanoid robotic torso with two Panda arms, each capable of carrying approximately 6.6 pounds. The “head” consists of a tablet and two cameras mounted between the shoulders, the latter of which streams 4K video to the operator at 45 hertz. The torso is mounted on a holonomic platform with four omnidirectional wheels, which enable NimbRo to move at a maximum of 1.5 meters per second.

The operator provides their physical and verbal inputs from a separate location. An HTC Vive Pro headset tracks the operator’s eye movements, while two SenseGlove exoskeleton haptic interaction devices capture even the slightest hand movements, allowing NimbRo’s finger joints to move in tandem with the operator’s. The operator’s movement data (as well as the visuals captured on NimbRo’s cameras) is transmitted through a single Ethernet and power tether at one gigabit per second. As the operator moves, so does NimbRo, bringing the remote operator “to life” in a physical space they wouldn’t otherwise be able to occupy.

NimbRo didn’t just have to demonstrate its physical capabilities on Saturday—it also had to be relatively intuitive, since a judge was operating it instead of someone from the Autonomous Intelligent Systems team. In front of more than 2,000 virtual and in-person audience members, NimbRo performed all ten task challenges in just under six minutes, cutting the second-place team’s time nearly in half. Task challenges included interacting with a human, using an electric drill to unscrew a metal panel, and obtaining select items from a storage area. NimbRo even did a little dance after completing the last task.

“NimbRo’s work demonstrates the remarkable potential of avatar technology to transcend time and distance and help address urgent human challenges, from health care access to disaster relief,” said XPrize CEO Anousheh Ansari in a statement.

Continue reading

A 15-Minute Smartphone COVID Test Is Coming to the US
A 15-Minute Smartphone COVID Test Is Coming to the US

The Department of Defence and Department of Health and Human Services have awarded $230 million to an Australian biotech firm Ellume to produce a 15-minute COVID test that sends results directly to your phone.

WATCH: Perseverance Lands on Mars Today in ‘7 Minutes of Terror’
WATCH: Perseverance Lands on Mars Today in ‘7 Minutes of Terror’

It's almost time for Perseverance to join Curiosity on the surface of Mars. Here's how to watch the landing.

Tesla Angers Customers With Last-Minute Solar Roof Price Increases
Tesla Angers Customers With Last-Minute Solar Roof Price Increases

While Tesla isn't commenting on the reason for the price increase, changes to its website suggest this is thanks to the cost of installing on complicated roofs.

Flying Car Makes 35-Minute Test Flight Between Cities
Flying Car Makes 35-Minute Test Flight Between Cities

A hybrid aircraft known as the AirCar has just completed its first successful flight between two airports. It's still a prototype, but it only looks a little bit ridiculous.