Humanoid Robonaut "sees" with two AVT Prosilica GC2450C GigE Cameras
March 9, 2011 - Built in partnership with General Motors (GM) and the Oceaneering Space Systems of Houston, NASA’s Robonaut (R2) is the second generation of highly dexterous humanoid robot designed to work alongside humans and execute simple, repetitive or dangerous tasks on Earth or on board the International Space Station (ISS).
R2: The New Generation
Developed in 1997 the first generation of Robonaut (R1) was a human-like robotic assistant capable of performing simple maintenance tasks. Its successor, R2, is a fully modular, highly dexterous 300 pound robot that consists of a head and a torso with two arms and two hands. R2’s many technological improvements include an improved range of sensors that features two Prosilica GC2450 color cameras from Allied Vision Technologies and an Infra-Red Time-of-Flight (TOF) camera. Capable of speeds more than four times faster than R1, R2 features a total of 350 sensors (for tactile, force, position, range-finding and vision sensing) and 38 power PC processors enabling it to perform functions such as object recognition and manipulation.
R2 is also able to react to its surroundings and operate semi-autonomously.
Other technological improvements include optimized overlapping dual arm dexterous workspace, series elastic joint technology, extended finger and thumb travel, miniaturized 6-axis load cells, redundant force sensing, ultra-high speed joint controllers and extreme neck travel. Capable of 42 degrees of freedom (including 24 in its hands and fingers alone) R2’s dexterity allows it to use the same tools as astronauts removing the need for robot specific tools.
Real-Time Vision Recognition
R2’s vision equipment is housed inside his helmet. The system uses color, pixel intensity and texture based segmentation as well as advanced pattern recognition techniques to extract the necessary information. To simplify the procedure the system focuses on certain areas of the image using Region of Interests (ROI). ROI is a function that allows a certain portion of the available pixels to be read out from the camera resulting in a much faster frame rate and less data to be processed. In addition, the TOF sensor data allows the background to be removed in order to focus on the object of interest (tools, boxes, etc…) Built-in classification techniques within the software are used to perform 3D and pattern-recognition functions in real-time to allow R2 to compute feasible trajectories and decide where to place its hands to execute a set of pre-determined tasks, such as opening boxes autonomously.
The software used by the system is MVtec’s Halcon 9.0. MVtec is an AVT software partner.
R2 underwent a series of rigorous tests prior to its launch on space shuttle Discovery on 24th February 2011. During stage 1 R2 will initially be hard-mounted and stationed in the Destiny laboratory on board the ISS where it will be monitored while executing tasks and operations similar to those performed on Earth.
If successful R2 could move on to stage 2 of the mission and become mobile to perform station maintenance tasks such as vacuuming or cleaning filters. The ultimate goal is to send R2 outside the ISS to perform dangerous EVA (Extra-vehicular activity) tasks during stage 3. There are no plans to return R2 to Earth.
MORE CASE STUDIES
Micro-Epsilon's displacement measurement sensors to be used in European telescope project
The European Southern Observatory based in Garching, Germany, is relying on displacement measurement systems from Micro-Epsilon for a project to...
Magic Software's Magic xpi brings Industry 4.0 to Swiss manufacturer
Assa Abloy AG, the Swiss global leader in locking systems and security technology, has put the Magic xpi Integration Platform at the heart of the...
Westermo helps Electricity North West upgrade to Ethernet/IP communications network
The modernised, `non-operations’ network provides reliability and bandwidth helping the company to better monitor and control the supply of...
Advanticsys helps Welsh high school enhance wireless building management efficiency
Advanticsys wireless solution supporting M-Bus and Modbus RTU / TCP was chosen by the School and Cardiff Council due to the non-intrusive nature of...
Citelum and Paradox Engineering work to make Siracusa, Italy a 'Smart City'
Citelum’s project was designed to achieve four main targets: energy efficiency, city beautification, remote control and management of lighting...
On Robot to announce expansion into US market at Automate 2017
Officially launching to the North American market at Automate 2017 in April, On Robot’s two-finger RG2 grippers—available in both single and...
EU Horizon 2020 launches RobMoSys robotics software project
RobMoSys (Composable Models and Software for Robotics) is an €8 million Innovation Action involving 9 partners from 5 countries and will be...
Solving Food Manufacturing Labor Shortages Through Robotic Automation
By Maria Ferrante, PMMI
PMMI had a chance to speak about new technologies and trends in automation with Don Wickstrum, president and owner of...
Microscan partners with Lakewood Automation to demonstrate MicroHAWK capabilities at Advanced...
MicroHAWK, in combination with the browser-based WebLink user interface, allows users to adjust reader settings remotely and to monitor results in...
Festo to showcase Industry 4.0 manufacturing advancements at Manufacturing in America
At the March 22-23 event, Festo and Siemens will demonstrate the Multi-Carrier System, a mass customization transport solution. Festo will provide...