Human Robotic Systems (HRS): Robonaut 2 Technologies Element

The development will eventually lead to a robotic system moving and working safely in the same space as Astronauts on ISS.&nbsp;</p><p>The second work area under this project element will be to use body-tracking input devices (i.e. Microsoft Xbox Kinect and accelerometer gloves) to immerse an operator in an accurate virtual model of the robot&rsquo;s environment, capture the intent of the operator, and safely execute mobility and manipulation tasks suitable for platforms such as Robonaut 2.

Initially, the operator&rsquo;s head position will be tracked in order to render an appropriate point of view in the virtual environment. Next, model-based recognizers will be developed and trained to detect gestures by the human operator and trigger autonomous behaviors on the robotic system. Initial efforts will use the Kinect sensor, with additional potential investigations into other similar or complementary sensors.</p><p>In FY14, development will focus on further extending our natural user interface system to address the concurrent operation of manipulation and mobility aspects of hybrid robotic systems such as Robonaut 2 with legs (ground only in FY14) or an ATHLETE robot driving while manipulating a payload.</p>