Real-Time 3D Shape Rendering

Sensors
Real-Time 3D Shape Rendering (DRC-TOPS-15)
Ultra-fast algorithms enable smart structures with unparalleled self-monitoring capabilities
Overview
Researchers at NASA's Armstrong Flight Research Center have developed an innovative method for rendering the bending shape of an optical fiber cable in real time. Unlike current methods used to calculate shape rendering, which are complex and time-intensive and which may have lag time, this technology's streamlined algorithms require no post-processing. Armstrong's system scans at a rate of 100 times per second, providing instantaneous three-dimensional (3D) shape rendering. The sensors, along with NASA's sophisticated algorithms, can be used to calculate a variety of critical parameters including shape, stress, temperature, pressure, strength, and operational load. The sensing system can be used for aerospace, civil structures, oil and gas drilling, renewable energy, and much more.

The Technology
This technology measures differential strain through a unique computational method, offering real-time 3D shape rendering. Embedding sensors into the optical fiber and then attaching the fiber to a structure allows strain information to be collected and shape deformation determined. Once the strain data is correlated into displacement data, the shape and movement of the optical fiber, and therefore the attached structure, can be displayed in real time. How It Works To obtain the curvature and torsion, innovators embedded three optical fibers with sensors either with fiber Bragg gratings (FBGs) or other methods of obtaining strain through optical fiber. The strain of each fiber is measured through Armstrong's patent-pending strain algorithm and fiber optic strain sensor (FOSS) hardware, which interrogates the fiber at a rate of 100 samples per second. Armstrong innovators have also patented a method to mitigate signal loss due to polarization-induced fading (PIF), a common problem seen in multi-sensor fiber optic sensing systems. This ensures that signals from all sensors can be optimally retrieved, increasing the system's accuracy and reliability. Why It Is Better The most significant benefit of Armstrong's 3D shape rendering technology is its unparalleled speed. Its sophisticated algorithms enable real-time shape rendering without any lag time whatsoever. This capability is especially valuable for applications where a direct line of sight is impossible or impractical (as in an aircraft wing or underground pipelines) and where real-time structural health monitoring is critical. The small and lightweight system uses virtually weightless fiber optics and minimal hardware. Furthermore, the sensors can be placed at 1/4-inch intervals, enabling much more precise, high-resolution measurements than ever before. For the first time ever, real-time strain measurements can be used to determine the shape of an aircraft's wing, monitor the structural integrity of buildings and pipelines, or ensure precise placement of the tiniest catheters, to name just a few potential applications.
catheter, robotic arm, fiber optics
Benefits
  • Real-time shape rendering: Armstrong's method of processing data from fiber optic sensors is much faster than other methods, allowing real-time visualization of 3D shape.
  • No lag time: Unlike existing shape rendering methods, no post-processing is required.
  • Lightweight: This technology can be used without adding significant weight or size to a structure, which is particularly important.

Applications
  • Medical: Procedures involving endoscopes, catheters, or robotic surgery
  • Oil and gas: Sophisticated industrial borescope usage in drilling and exploration
  • Aeronautics: Structural monitoring for complex bending modes of in-flight aircraft
  • Renewable energy: Structural monitoring for wind energy turbines
  • Robotics: Precise position monitoring and control of robotic arms and tools
  • Automotive: Structural monitoring
  • Nautical: Pinpoint location of buoys or instrument packages
Technology Details

Sensors
DRC-TOPS-15
DRC-011-015B
8,970,845
Similar Results
Ikhana aircraft, wind turbine
Lightweight Fiber Optic Sensors for Real-Time Monitoring of Structural Health
How It Works The FOSS technology employs efficient, real-time, data driven algorithms for interpreting strain data. The fiber Bragg grating sensors respond to strain due to stress or pressure on the substrate. The sensors feed these strain measurements into the systems algorithms to determine shape, stress, temperature, pressure, strength, and operational load in real time. Why It Is Better Conventional strain gauges are heavy, bulky, spaced at distant intervals (which leads to lower resolution imaging), and unable to provide real-time measurements. Armstrong's system is virtually weightless, and thousands of sensors can be placed at quarter-inch intervals along an optical fiber the size of a human hair. Because these sensors can be placed at such close intervals and in previously inaccessible regions (for example, within bolted joints, embedded in a composite structure), the high-resolution strain measurements are more precise than ever before. The fiber optic sensors are non-intrusive and easy to install—thousands of sensors can be installed in less time than conventional strain sensors and the system is capable of processing information at the unprecedented rate of 100 samples per second. This critical, real-time monitoring capability enables an immediate and informed response in the event of an emergency and allows for precise, controlled monitoring to help avoid such scenarios. For more information about the full portfolio of FOSS technologies, see DRC-TOPS-37 or visit https://technology-afrc.ndc.nasa.gov/featurestory/fiber-optic-sensing
Shape Sensing Innovations Dramatically Improve Structural Design Tools
Armstrong's technologies provide a convenient way to calculate distributed deformed orientation angles—that is, roll, pitch, and yaw—as well as determine the deformed shape of an object in 3D space. Developed to facilitate monitoring and control of flexible aircraft designs when used in conjunction with Armstrong's multi-patented FOSS technology, these new tools improve shape-sensing accuracy for highly deformable structures such as bridges, wind turbines, robotic instruments, and much more. These tools also can be integrated into commercial fiber optic sensing systems. How It Works Researchers developed a technology that uses curved displacement transfer functions to determine 3D shape and calculate the operational load of a structure. It works by dividing the structure into multiple small domains, whose junctures match sensing stations, so that data is collected in a piecewise, nonlinear fashion. The innovation calculates structural stiffness (bending and torsion) and operational loads (bending moments, shear loads, and torques) in near real time. The method tracks rotations and orientation by employing quaternion mathematical operations, a faster process than rotation matrices used in previous shape-sensing algorithms. The result is an algorithm that can track multiple angles—displacement, twist, and rotation—at the same time to enable curvilinear shaping sensing. Armstrong researchers have validated the method on the large-scale passive aeroelastic tailored (PAT) wing. Why It Is Better These new technologies advance the ability of fiber optic sensing systems to determine the shape and operational loads of nonlinear flexible surfaces. They can improve the structural integrity of a range of large structures—from buildings and bridges to ocean vessels and aircraft. These innovations reliably provide highly accurate critical information in real time, enabling corrective action to avert disasters. For more information about the full portfolio of FOSS technologies, see DRC-TOPS-37 or visit https://technology-afrc.ndc.nasa.gov/featurestory/fiber-optic-sensing
skyscrapers, fiber optics, dam, jet
Fiber Optic Sensing Technologies
The FOSS technology revolutionizes fiber optic sensing by using its innovative algorithms to calculate a range of useful parameters—any and all of which can be monitored simultaneously and in real time. FOSS also couples these cutting-edge algorithms with a high-speed, low-cost processing platform and interrogator to create a single, robust, stand-alone instrumentation system. The system distributes thousands of sensors in a vast network—much like the human body's nervous system—that provides valuable information. How It Works Fiber Bragg grating (FBG) sensors are embedded in an optical fiber at intervals as small as 0.25 inches, which is then attached to or integrated into the structure. An innovative, low-cost, temperature-tuned distributed feedback (DFB) laser with no moving parts interrogates the FBG sensors as they respond to changes in optical wavelength resulting from stress or pressure on the structure, sending the data to a processing system. Unique algorithms correlate optical response to displacement data, calculating the shape and movement of the optical fiber (and, by extension, the structure) in real time, without affecting the structure's intrinsic properties. The system uses these data to calculate additional parameters, displaying parameters such as 2D and 3D shape/position, temperature, liquid level, stiffness, strength, pressure, stress, and operational loads. Why It Is Better FOSS monitors strain, stresses, structural instabilities, temperature distributions, and a plethora of other engineering measurements in real time with a single instrumentation system weighing less than 10 pounds. FOSS can also discern between liquid and gas states in a tank or other container, providing accurate measurements at 0.25-inch intervals. Adaptive spatial resolution features enable faster signal processing and precision measurement only when and where it is needed, saving time and resources. As a result, FOSS lends itself well to long-term bandwidth-limited monitoring of structures that experience few variations but could be vulnerable as anomalies occur (e.g., a bridge stressed by strong wind gusts or an earthquake). As a single example of the value FOSS can provide, consider oil and gas drilling applications. The FOSS technology could be incorporated into specialized drill heads to sense drill direction as well as temperature and pressure. Because FOSS accurately determines the drill shape, users can position the drill head exactly as needed. Temperature and pressure indicate the health of the drill. This type of strain and temperature monitoring could also be applied to sophisticated industrial bore scope usage in drilling and exploration. For more information about the full portfolio of FOSS technologies, see visit https://technology-afrc.ndc.nasa.gov/featurestory/fiber-optic-sensing
Collage of applications for this technology--bridges, buildings, oil rigs, cargo, and robotics
Adaptive Spatial Resolution Enables Focused Fiber Optic Sensing
This technology can be applied to most optical frequency domain reflectometry (OFDR) fiber optic strain sensing systems. It is particularly well suited to Armstrong's FOSS technology, which uses efficient algorithms to determine from strain data in real time a variety of critical parameters, including twist and other structural shape deformations, temperature, pressure, liquid level, and operational loads. How It Works This technology enables smart-sensing techniques that adjust parameters as needed in real time so that only the necessary amount of data is acquired—no more, no less. Traditional signal processing in fiber optic strain sensing systems is based on fast Fourier transform (FFT), which has two key limitations. First, FFT requires having analysis sections that are equal in length along the whole fiber. Second, if high resolution is required along one portion of the fiber, FFT processes the whole fiber at that resolution. Armstrong's adaptive spatial resolution innovation makes it possible to efficiently break up the length of the fiber into analysis sections that vary in length. It also allows the user to measure data from only a portion of the fiber. If high resolution is required along one section of fiber, only that portion is processed at high resolution, and the rest of the fiber can be processed at the lower resolution. Why It Is Better To quantify this innovation's advantages, this new adaptive method requires only a small fraction of the calculations needed to provide additional resolution compared to FFT (i.e., thousands versus millions of additional calculations). This innovation provides faster signal processing and precision measurement only where it is needed, saving time and resources. The technology also lends itself well to long-term bandwidth-limited monitoring systems that experience few variations but could be vulnerable as anomalies occur. More importantly, Armstrong's adaptive algorithm enhances safety, because it automatically adjusts the resolution of sensing based on real-time data. For example, when strain on a wing increases during flight, the software automatically increases the resolution on the strained part of the fiber. Similarly, as bridges and wind turbine blades undergo stress during big storms, this algorithm could automatically adjust the spatial resolution to collect more data and quickly identify potentially catastrophic failures. This innovation greatly improves the flexibility of fiber optic strain sensing systems, which provide valuable time and cost savings to a range of applications. For more information about the full portfolio of FOSS technologies, see DRC-TOPS-37 or visit https://technology-afrc.ndc.nasa.gov/featurestory/fiber-optic-sensing
Medical instrument
Highly Accurate Position Detection and Shape Sensing with Fiber Optics
NASA's novel method was developed to more accurately measure the position and shape of optical fibers. Multi-core optical fibers contain multiple light-guiding cores arranged symmetrically. Sensors, such as FBGs, are embedded into each of the cores (Figure 1). Such an arrangement allows for the measurement of strain in each core of the fiber at specific axial locations along the fiber. When a multi-core fiber is subjected to bending, the strain imposed in each core relative to one another is used to provide position information (Figure 2). In the past, shape-sensing measurements using optical fibers estimated bending at sequential points along the fiber, and the resulting measurement had many discontinuities and errors. The combination of these errors resulted in a very poor indication of actual fiber position in three-dimensional space. NASA's patent-pending algorithms and apparatus incorporate not only fiber bending measurements, but fiber twisting measurements as well, to eliminate previous sources of error. The uniqueness of the algorithm is in how the curvature, bend-direction, and twisting information of the fiber are all brought together to obtain a highly accurate 3-D location and shape characterization. The new methods have been demonstrated to significantly improve the accuracy of multi-core fiber optic shape sensors.
Stay up to date, follow NASA's Technology Transfer Program on:
facebook twitter linkedin youtube
Facebook Logo X Logo Linkedin Logo Youtube Logo