Computer Vision Lends Precision to Robotic Grappling

ARC ANGEL is an active robotic system like ARGOS; however, its electric motor is not mounted overhead to a runway and bridge system, but instead is mounted to the test subject’s backpack-like PLSS where the motor(s) supplies real-time actuation torque off-loading to the upper arms via cabling. If a test subject picks-up a hammer, the system will react immediately to offload the weight of the hammer relative to the programmed environment. The ARC ANGEL system is comprised of an electric motor(s), soft goods, electronics hardware, firmware, and software. To provide a smoothly operating arm offloading analog and optimize system performance, engineers at JSC coded software that leverages kinematic algorithms and closed-loop architecture for motor control, along with custom computer language scripts to ingest sensor data. This allows ARC ANGEL’s subsystems to be seamlessly integrated and accurately simulate one to zero G environments. During operation, compact tension sensors and inertial measurement units detect arm weight and motion and provide a closed-loop control system that feeds data to a single-board computer and requisite firmware for processing. A custom graphical user interface was also developed in-house to provide controls for inputting desired arm offload values. Additionally, ARC ANGEL features its own power supply that provides power to its subcomponents without external cables. This allows the ability to function independently from ARGOS and further lends itself to potential terrestrial applications. This work directly correlates to active exosuit development that is being implemented for rehabilitation and/or assistive medical devices. ARC ANGEL is essentially providing a desired assistance (offload) while maintaining a subject’s full range of motion. The system hardware and software can be modified to custom-fit an individual without a spacesuit and toward limb-assisted movement – not just arm offloading. ARC ANGEL may already meet a higher physical demand and robustness given that it is engineered to perform in challenging environments with greater loads. ARC ANGEL is at a technology readiness level (TRL) 5 (component and/or breadboard validation in laboratory environment) and is now available for patent licensing. Please note that NASA does not manufacture products itself for commercial sale.

Flashpose is the combination of software written in C and FPGA firmware written in VHDL. It is designed to run under the Linux OS environment in an embedded system or within a custom development application on a Linux workstation. The algorithm is based on the classic Iterative Closest Point (ICP) algorithm originally proposed by Besl and McKay. Basically, the algorithm takes in a range image from a three-dimensional imager, filters and thresholds the image, and converts it to a point cloud in the Cartesian coordinate system. It then minimizes the distances between the point cloud and a model of the target at the origin of the Cartesian frame by manipulating point cloud rotation and translation. This procedure is repeated a number of times for a single image until a predefined mean square error metric is met; at this point the process repeats for a new image. The rotation and translation operations performed on the point cloud represent an estimate of relative attitude and position, otherwise known as pose. In addition to 6 degree of freedom (DOF) pose estimation, Flashpose also provides a range and bearing estimate relative to the sensor reference frame. This estimate is based on a simple algorithm that generates a configurable histogram of range information, and analyzes characteristics of the histogram to produce the range and bearing estimate. This can be generated quickly and provides valuable information for seeding the Flashpose ICP algorithm as well as external optical pose algorithms and relative attitude Kalman filters.

Initially developed as a close quarters inspection tool capable of accessing hard to reach, tight, or visibly restricted, areas of satellites, the VIPIR system can be used to remotely inspect inaccessible locations such as behind a sheet of thermal blanketing material, into a satellites plumbing, or perhaps even deep inside the otherwise unreachable crevasses of a spacecraft bus. The VIPIR system incorporates a number of subassemblies for incredible operational freedom and capabilities for imaging and dissemination of componentry. VIPIR’s Video Borescope Assembly (VBA) is a flexible snake-camera capable of multidirectional articulations, making steering and control simple and intuitive for an operator. The VBA also includes at least one imaging sensor and lighting to see in dark, confined spaces. Real-time, high-resolution visual information can be fed back to an operator for live analysis. A reel system extends and retracts the VBA with the use of a spool, and includes position indicators for deployment tracking. The Tendon Management System (TMS), not unlike human tendons, utilizes pulleys and tensioners to articulate the VBA in the confined spaces. A seal system ensures the VBA is free of contamination. VIPIR underwent space-based testing on the ISS during the Robotic Refueling Phase 2 (RRM-2) mission designed to showcase and test several NASA advanced robotic satellite servicing technologies. During this mission, VIPIR demonstrated state-of-the-art near and midrange inspection capabilities. NASA’s VIPIR system is available for licensing to industry, and may be desirable to companies focused on satellite servicing, on-orbit assembly, and other applications requiring detailed inspection of assets in space.

The traditional scissor spring design for hand controllers has been improved upon with a circumferential spring controller mechanism that facilitates easy customization, enhanced durability, and optimum controller feedback. These advantages are partially facilitated by locating the spring to the outside of the mechanism which allows for easier spring replacement to adjust the deflection force or for maintenance. The new mechanism is comprised of two rounded blades, or cams, that pivot forward and back under operation and meet to form a circle. An expansion spring is looped around the blade perimeter and resides in a channel, providing the restoring force that returns the control stick to a neutral position. Due to the use of a longer circumferential spring, the proportion of spring expansion is smaller for a given distance of deflection, so the forces associated with the deflection remain on a more linear portion of the force deflection curve. The Circumferential Scissor Spring for Controllers is at technology readiness level (TRL) 8 (actual system completed and flight qualified through test and demonstration) and is available for patent licensing. Please note that NASA does not manufacture products itself for commercial sale.

An approach to mitigating the creation of additional orbital debris is to remove the sources of future medium debris by actively removing large spent objects from congested orbits. NASA has introduced the ADRV, an efficient and effective solution to remove large debris from LEO such as spent rocket bodies and non-functional satellites. The concept yields a single use, low-cost, lightweight, high mass fraction vehicle that enables the specific removal of large orbital debris (1000 - 4000 kg mass, 200 - 2000 km altitude, and 20 98-degree inclination). The ADRV performs rendezvous, approach, and capture of non-cooperative tumbling debris objects, maneuvering of the mated vehicle, and controlled, targeted reposition or deorbit of the mated vehicle. Due to its small form factor, up to eight ADRVs can be launched in a single payload, enabling high impact orbital debris removal missions within the same inclination group. Three key technologies were developed to enable the ADRV: - 1) The spacecraft control system (SCS) is a guidance, navigation, and control system that provides vehicle control during all phases of a mission; - (2) The debris object characterization system (DOCS) characterizes movement and capture of non-cooperative targets; and - (3) The capture and release system (CARS) allows the vehicle to capture and mate with orbital debris targets. These technologies can improve the current state-of-the-art capabilities of automated rendezvous and docking technology significantly for debris objects with tumbling rates up to 25 degrees per second. This approach leverages decades of spaceflight experience while automating key mission areas to reduce cost and improve the likelihood of success.