Advanced Humanoid Robotic Hand Technologies

robotics automation and control

Advanced Humanoid Robotic Hand Technologies (MSC-TOPS-102)

Cutting-edge systems for humanoid robotics

Overview

NASA and General Motors, two organizations at the forefront of robotics, have developed the Robonaut 2 (R2) a state-of-the-art, dexterous, humanoid robot capable of performing tasks in an automated fashion (or via teleoperation). The technology developed throughout the project represents the cutting edge of autonomous, humanoid robotics. These technologies are available for licensing, both in a modular fashion or as an integrated system, to enhance your robotic products. Please see the Related Links section below for information on additional R2 robotics technologies, including those related to arms, interface/control, and sensor systems. R2s hand and forearm assembly, the topic of this flyer, is designed to approximate closely the capabilities of the human hand. The assembly is a completely self-contained unit featuring high dexterity, fine force control, and advanced sensing that enables the grasping and actuation of a broad array of tools. Relocation of components (e.g., motors, avionics) to the forearm makes room for increased sensing in the fingers and palm, where it is needed most.

The Technology

The R2 hand and forearm assembly represents the cutting edge of humanoid robotics technologies. The highly modular design provides significant improvements over prior humanoid robotic hands, especially in the areas of strength, speed, sensing, and ability to approximate human grasps. Hand, Finger, and Wrist Assembly Design: The robotic humanoid lower arm design (U.S. Patent No. 9,505,134) includes novel robotic finger (U.S. Patent No. 8,562,049), thumb (U.S. Patent No. 8,424,941), and wrist (U.S. Patent No. 8,498,741) assemblies. Actuation & Control System: A novel finger actuation system (U.S. Patent No. 8,467,903) comprised of an actuator, tendon, conduit, tension sensor (U.S. Patent No. 8,371,177), and terminator is perhaps the primary enabling technology for R2s compact, high performance robotic hand. The actuation system is packaged in the wrist (U.S. Patent No. 8,401,700) and reduces the number of actuators, providing significant space savings. Control systems include methods for tensioning (U.S. Patent Nos. 8,412,376, 8,618,762, & 8,056,423) and controlling torque (U.S. Patent No. 8,565,918) of the tendon-driven robotic fingers. The finger actuation control system (U.S. Patent No. 8,489,239) can operate using force- or position-based control laws. Tactile System: R2s hands feature an innovative tactile system that grant the robot a sense of touch (e.g., measurement of external contact forces, shear force, and slippage of objects held in the hand) an important requirement for robots designed to perform complex tasks in an automated fashion. The tactile system is enabled by novel six degree of freedom (DoF) force torque sensors (U.S. Patent No. 7,784,363), three of which are integrated into the fingers (at the proximal, medial, and distal phalanges) and two in the thumb (medial and distal phalanges). A calibration system (U.S. Patent No. 8,265,792) ensures the sensors maintain high accuracy throughout operation. Autonomous Grasping: A novel grasp assist device (U.S. Patent No. 9,878,452 & 9,067,319) enables reliable, autonomous interaction with a broad range of objects (e.g., tools). A particle filter-based contact state estimation device (U.S. Patent No. 8,280,837) performs object localization and characterization.

The R2 hand and forearm assembly, including avionics.

Benefits

High dexterity: R2's hands are highly dexterous, enabling the robot to perform ergonomically challenging tasks.
Modularity: The R2 hand and forearm assembly is designed in a modular fashion, enabling rapid replacement of components and sub-assemblies.
High strength: The unique design enables the assembly to achieve the compact form factor of a human hand while retaining the strength required to work with human tools.
Self-contained: The dexterous hand plus forearm is a completely self-contained unit with all motors and avionics packaged inside the forearm, reducing the number of conductors required for power and communication.
Speed: R2's fingers have a top speed of more than 200 mm/sec.

Applications

Industrial manufacturing & maintenance
Space exploration
Personal assistance & caregiving
Emergency services & operations in hazardous environments
Repetitive task automation

Download Fact Sheet as a PDF

Ask a Question

Apply to License

Technology Details

Category robotics automation and control

Reference Number MSC-TOPS-102

Case Number(s) MSC-24685-1 MSC-24688-1 MSC-24930-1 MSC-25219-1 MSC-24689-1 MSC-24734-1 MSC-24735-1 MSC-24737-1 MSC-24740-1 MSC-24740-2 MSC-24751-1 MSC-24753-1 MSC-24817-1 MSC-25056-1 MSC-26375-1 MSC-24571-1 MSC-24570-1 MSC-24686-1 MSC-24739-1 MSC-24742-1 MSC-24755-1 MSC-25121-1 MSC-24926-1 MSC-25053-1

Papers

Tags:

robotics humanoid robotics robotic hand Robonaut tactile system autonomous grasping hand finger wrist actuation robotic control load cell contact estimation

Similar Results

Advanced Humanoid Robotic Interface & Control

Technologies for Safe Workspace Control of Humanoid Robots: Safety is critical in scenarios where humans (e.g., factory workers or astronauts) are working in proximity to, or interacting with, R2. Methods for applying workspace limitations in velocity-controlled robotic mechanisms (U.S. Patent No. 8,676,382) and force or impedance-controlled robots (U.S. Patent No. 8,483,877) help to ensure such safety. Autonomous Control Systems for Humanoid Robotics: A multiple priority operation space impedance control system (U.S. Patent No. 8,170,718) provides arm control, including programmable Cartesian stiffness. An interactive robot control architecture (U.S. Patent Nos. 8,364,314, and 8,260,460, and 8,706,299), including a simple GUI, provides an interactive development and work environment that integrates sensor data and feedback generated by R2. An additional system selects and controls appropriate manipulators to perform grasping operations (U.S. Patent No. 8,483,882). Humanoid Robotic Health Management System: A diagnostics, prognostics, and health management system for human robotics (U.S. Patent No. 8,369,992) operates at all hardware and software levels of the robotic system, enabling system-wide observability, controllability, maintainability, scalability, and extensibility. Electromagnetic Motor Braking: Electromagnetic fail-safe brakes (U.S. Patent No. 8,067,909) allow for selective, reliable braking of robotic motors (e.g., brushless DC motors) to ensure safe and effective operation. Highly Durable Connector Pin: To address the high failure rate of connectors in robotic systems with flexible members, a highly durable connector pin (U.S. Patent No. 8,033,876) was developed. The pin increases durability of connectors that are frequently flexed a condition that causes deformation and compromises connectivity.

Advanced Robotic Sensing Technologies

Visual Perception System: Key to enabling humanoid robotics to perform dexterous tasks, R2s visual perception system (U.S. Patent No. 8,244,402) comprised of machine vision cameras, processors, and novel algorithms allows robots to find, track, and measure objects automatically in their field of view. Tendon Tension Sensor: Unique tendon tensions sensors (U.S. Patent Nos. 8,371,177 & 8,056,423) are embedded in R2s palms to enable granular force control of the fingers via a redundant network of tendons. R2s tendons are coupled to, and used to actuate, the robots finger joints. Thus, tendon tension measurements provided by the sensor allow for the external loads experienced by its robotic fingers to be derived. Tactile System: R2s hands feature an innovative tactile system that grant the robot a sense of touch (e.g., measurement of external contact forces, shear force, and slippage of objects held in the hand) an important requirement for robots designed to perform complex tasks in an automated fashion. The tactile system is enabled by novel six degree of freedom (DoF) force torque sensors (U.S. Patent No. 7,784,363), which are integrated into the fingers at each phalange (14 per hand). A calibration system (U.S. Patent No. 8,265,792) ensures the sensors maintain high accuracy throughout operation. Contact State Estimation: A contact state estimation sensor (U.S. Patent No. 8,280,837), based on the use of a particle filter, enables R2 to perceive the location, orientation, and shape of objects when in contact with the robots hands (i.e., tracks hand-object state). The contact state estimation system leverages a novel motion model, which characterizes the motion of a robotic hand as it moves relative to an object of interest. Series Elastic Actuator (SEA) Sensing: R2s SEAs achieve fine torque sensing at each of its joints without sacrificing strength or payload capacity. The robot uses two 19-bit absolute angular position sensors, calibrated using a novel technique (U.S. Patent No. 8,250,901), to measure the deflection of each spring in real time.

Advanced Humanoid Robotic Arm Technologies

R2 uses brushless DC motors, harmonic drive gear reductions, and electromagnetic failsafe brakes as the building blocks for the powerful, torque-dense actuators in its human-scale, 5 DoF upper arms. Moreover, the use of series elastic actuators and novel tension sensing & control systems represent some of the most innovative technologies present in the humanoid robotic arms of R2. Series Elastic Actuators (SEAs): R2s SEAs achieve fine torque sensing at each of its joints without sacrificing strength or payload capacity. Such capabilities are enabled through the development of several advanced technologies. Specifically, novel planar torsion springs (U.S. Patent No. 8,176,809) are integrated into each rotary series elastic actuator (U.S. Patent No. 8,291,788), while two absolute angular position sensors, calibrated using a novel technique (U.S. Patent No 8,250,901), measure the deflection of each spring. Force and Impedance Control Systems (U.S. Patent No. 8,525,460): These systems use position sensor signals for sending position data to an embedded processor that determines the positional orientation of the load relative to a motor shaft and its related torque on a string. A FPGA-based controller (U.S. Patent No. 8,442,684) provides a high-speed (10 KHz) control loop for the electric motor and gear reduction assembly present in R2 joints. Tension Sensing & Control of Tendon-Based Robotic Manipulators: NASA has also developed technologies to provide tension sensing & control of humanoid robotic arms. First, a tendon tension sensor (U.S. Patent No. 8,371,177) measures strain on tendons (strings) employed in robotic arms. A novel calibration system (U.S. Patent No. 8,412,378) calibrates the tendon tension sensors. Finally, joint space impedance control systems (U.S. Patent Nos. 8,170,718 & 8,060,250) provide closed-loop control of joint torques or joint impedances without inducing dynamic coupling between joints, as well as programmable Cartesian arm stiffness.

Robonaut 2: Medical Opportunities

R2's unique systems allow the robot to be used in many telemedicine applications and in many medical scenarios. For example, R2 can assist a surgeon and the surgical team before, during, and after a procedure with multiple tasks. The robot has the vision, dexterity, and the ability to perform tasks tirelessly 24 hours a day, seven days a week. R2 can work safely around humans, so it can be integrated into a dynamic hospital environment. The R2 technology capabilities in telemedicine are being explored through partnerships with medical institutions. After a quick medical procedure training, a R2 teleoperator was able to guide the robot and perform an ultrasound scan on a medical mannequin. Humans at the controls were able to guide the robot to perform the task correctly and efficiently by using R2's dexterity to apply the appropriate level of force and were able to track their progress using the robot's vision system. The technology was also used to experiment using a syringe and an intubation procedure with a mannequin to demonstrate R2's telemedicine capabilities. R2 is well suited to be used by physicians to conduct medical procedures on humans in remote locations.

Robonaut 2 Technologies

While robotic technologies are already being used in several industries like logistics and distribution, R2 allows for much more complex and delicate operations that require a more sophisticated level of interaction. In terms of handling inventory, R2's dexterity would allow it to handle a multitude of items, including delicate ones. In addition, it can perform in close proximity to humans, allowing for the use of robotics in areas where it's not currently safe or practical. R2 is equipped to navigate obstacles, fixed or moving and has the capability of handling frequent, random, and unexpected movement of people, products, or equipment as well as items that vary in shape, weight, and fragility. The robot encompasses four elemental systems. Hands: R2's unprecedented dexterity in its hands allows it to use many of the same tools that astronauts and industry workers currently use, significantly reducing the need for specialized tools to perform multiple tasks. Arms: R2's arms are soft at multiple levels and they have redundant force sensing. R2 can safely work side-by-side with humans. Sensing and Perception: R2 shares senses similar to humans like the ability to touch and see. Interface and Control: R2 can function autonomously or it can be controlled by direct teleoperation. When functioning autonomously, R2 understands what to do and how to do it based on sensory input, carrying out tasks in real time.