VR-Controlled Robot Wins Competition by Completing 10 Tasks Under 6 Minutes

VR-Controlled Robot Wins Competition by Completing 10 Tasks Under 6 Minutes

XPrize, an organization known for its incentivized tech challenges, hosted a $10 million competition on Saturday inviting robotics companies from around the world to show off their telepresence technology. Seventeen teams demonstrated their own takes on the “Avatar robot,” a device that allows remote individuals to communicate and operate in a location other than their own. At the end of the day, the Autonomous Intelligent Systems group from Germany’s University of Bonn took home a $5 million prize for NimbRo, a robot controlled via virtual reality (VR) headset and exoskeletal arms.

NimbRo itself is made up of a humanoid robotic torso with two Panda arms, each capable of carrying approximately 6.6 pounds. The “head” consists of a tablet and two cameras mounted between the shoulders, the latter of which streams 4K video to the operator at 45 hertz. The torso is mounted on a holonomic platform with four omnidirectional wheels, which enable NimbRo to move at a maximum of 1.5 meters per second.

The operator provides their physical and verbal inputs from a separate location. An HTC Vive Pro headset tracks the operator’s eye movements, while two SenseGlove exoskeleton haptic interaction devices capture even the slightest hand movements, allowing NimbRo’s finger joints to move in tandem with the operator’s. The operator’s movement data (as well as the visuals captured on NimbRo’s cameras) is transmitted through a single Ethernet and power tether at one gigabit per second. As the operator moves, so does NimbRo, bringing the remote operator “to life” in a physical space they wouldn’t otherwise be able to occupy.

NimbRo didn’t just have to demonstrate its physical capabilities on Saturday—it also had to be relatively intuitive, since a judge was operating it instead of someone from the Autonomous Intelligent Systems team. In front of more than 2,000 virtual and in-person audience members, NimbRo performed all ten task challenges in just under six minutes, cutting the second-place team’s time nearly in half. Task challenges included interacting with a human, using an electric drill to unscrew a metal panel, and obtaining select items from a storage area. NimbRo even did a little dance after completing the last task.

“NimbRo’s work demonstrates the remarkable potential of avatar technology to transcend time and distance and help address urgent human challenges, from health care access to disaster relief,” said XPrize CEO Anousheh Ansari in a statement.

Continue reading

NASA Probe Stows Huge Asteroid Sample for Return to Earth
NASA Probe Stows Huge Asteroid Sample for Return to Earth

Following the recent successful touch and go operation, NASA has reported a sizeable sample of the asteroid has now been locked away in the probe's sample return container.

Voyager 2 Probe Talks to Upgraded NASA Network After 8 Months of Silence
Voyager 2 Probe Talks to Upgraded NASA Network After 8 Months of Silence

NASA just said "hello" to Voyager 2, and the probe said it back.

Massachusetts Passes Robust Automotive Right-to-Repair Law
Massachusetts Passes Robust Automotive Right-to-Repair Law

Right to repair advocates scored a major victory this week with the passage of Question 1 in Massachusetts. Hailed as the most advanced right to repair law in the land, Question 1 requires that automakers create an open data platform for sharing diagnostic and repair information with independent shops and vehicle owners.

New MIT AI Designs Robots On Its Own
New MIT AI Designs Robots On Its Own

The team believes RoboGrammar could point researchers in new directions, leading to more efficient and inventive designs.