Researchers Are Studying Mice in VR With a Tiny, Raspberry Pi-Powered Headset

Dr. Chris Schaffer and Dr. Nozomi Nishimura, two professors of biomedical engineering at one of New York’s most prestigious universities, have created a VR setup that allows them to study rodents’ reactions to virtual experiences. Though the exact purpose of this research appears to be under wraps, the duo says it’s a neuroscience project, which is on par with the Schaffer-Nishimura Lab’s typical area of study.
The setup is humbly powered by a Raspberry Pi 4, chosen for its accessibility and single-board simplicity. The Raspberry Pi runs the free and open-source video game engine Godot, which Schaffer and Nishimura used to create virtual scenes. Because your average VR headset is obviously far too large for a mouse’s tiny face, the researchers 3D printed custom display eyepieces and a case to keep the physical components together. Each eyepiece contains a 240×210 circular display and a Fresnel lens positioned 15 millimeters from the mouse’s face to provide an immersive 140-degree vertical and 230-degree horizontal field of view.

To make the experience interactive, the researchers set up a spherical styrofoam treadmill that allows the mouse to move in any direction. As the mouse locomotes on the treadmill, the sphere’s movement is captured by optical sensors and an Arduino Due, which converts the movement data to something the Raspberry Pi can use to create camera changes in the virtual scene. The result is a VR world that moves in accordance with the mouse’s steps in the real world.
The virtual scenes themselves seem to vary. One is a virtual cliff avoidance scene, which involves a checkerboard landscape with false drop-offs. The researchers’ GitHub page also mentions “looming stimuli” of various sizes and the physical movement response to gratings of various spatial wavelengths.
GitHub doesn’t mention anything about biological sensors, meaning it’s unlikely Schaffer and Nishimura are testing the cardiovascular or hormonal responses to what potentially sound like fight-or-flight inputs above. A tweet from Matt Isaacson, a postdoc working in the Schaffer-Nishimura Lab, only states the project relates to “mouse neuroscience/behavior” along with a brief video of the VR setup in action. As for now, it looks like we’ll have to wait to find out what exactly these tech-savvy mice are getting up to.
Continue reading

Apple’s Mixed Reality Headset to Cost $3K, Could Include 8K Displays
Rumors of an Apple-designed AR/VR product have rumbled around for years now, with nary a launch to show for it. New data, however, shed more information on the hardware than we've seen before.

Microsoft Wins $21.9 Billion Contract to Supply AR Headsets to the US Army
Microsoft has signed a 10-year, $21.9 billion contract with the US Army to provide augmented reality technology based on its HoloLens devices.

Valve Appears to Have a Standalone VR Headset in the Works
The prototype is suspected to be able to operate without a companion device or tracking boxes—perfect for a type of gaming that's never been exactly spontaneous.

HTC Announces Smaller, Lighter Vive Flow VR Headset
The lightweight headset is styled more like a pair of glasses, making it easier to pop them on to watch some Netflix or play a simple game. However, you're going to need an external power source, and the Flow headset isn't cheap at $500.