Apparatus and Method for Biofeedback Training
health medicine and biotechnology
Apparatus and Method for Biofeedback Training (LAR-TOPS-289)
Virtual reality / Augmented reality / Mixed reality implementation of method and apparatus for performance optimization through perturbation of task virtual elements
Overview
The technology combines virtual reality (VR) with a real environment. The VR provides sensory feedback. If performance is not optimal, the environment is disruptive. If optimal, the environment is stable / normal. The system is to provide feedback to train for self-regulation (e.g. relax on command) when performing tasks. Brainwave activity modulates augmented reality (AR), then once the action is taken, then VR takes over. Mental training is made objective by physiological measures.
The Technology
Measured values of physiological signals may be associated with physiological states and may be used to define the presence of such states. For example, in a physiological state of anxiety, adrenaline diverts blood from the body surface to the core of the body in response to a perceived danger. As warm blood is withdrawn from the surface of the skin, the skin temperature drops. Similarly, in a physiological state of stress, perspiration generally increases making the skin more conductive to the passage of an electrical current, thereby increasing the galvanic skin response.
It is well known in the field of performance psychology that the peak performance of a task, such as, for example, putting in golf, foul shooting in basketball, serving in tennis, marksmanship in archery or on a gunnery range, shooting pool, or throwing darts, requires the presence of a physiological state, comprising one or more optimal measured values of physiological signals, coincident with the physical performance of the task. The presence of such an optimal physiological state in athletics is colloquially referred to as being in the zone.
The technology provides:
an apparatus and method of performance-enhancing biofeedback training that has intuitive and motivational appeal to the trainee, by tightly embedding the biofeedback training in the actual task whose performance is to be improved; and,
an apparatus and method of performance-enhancing biofeedback training that is operational in real-time, precisely at the moment when a task or exercise, such as an athletic or military maneuver, is required to be performed.
The feedback behavior of the physical environment provided by the present invention has the added benefit of providing aids to visualization that the trainee can use in the real-world skill performance setting.
Benefits
- Employs advanced technology (Virtual Reality / Augmented Reality / Mixed Reality) in training regimen
- Incorporates physiological monitoring for objective measurement / comparison
Applications
- Simulations and video games
- Police / military training
Technology Details
health medicine and biotechnology
LAR-TOPS-289
LAR-19302-1
Similar Results
Biocybernetic VR/AR Training System for De-Escalating Conflict
NASA’s biocybernetic system is a cutting-edge technology designed to cultivate emotional regulation skills. It leverages the concept of biocybernetic adaptation, where the trainee engages with virtual entities, such as characters in VR/AR/MR environments, whose behavior dynamically responds to the trainee's physiological signals. This responsive system provides real-time feedback, incentivizing the trainee to attain a calmer physiological state.
The key components of this VR innovation include:
· Head-mounted display hardware
· Physiological monitoring hardware, tracking heart rate, breathing, sweat, breath, and brain waves
· Software, powered by the Biocybernetic Loop (BL) Engine, integrating physiological data into the VR simulation
· Character response avatars
· Integration of the trainee's biofeedback data with the VR environment
This technology relies on two functional elements working in unison to adapt the behavior and appearance of VR/AR/MR characters. Inference of the trainee's emotional state from physiological signals requires the implementation of advanced machine learning and modeling techniques. A pattern comparator stores templates of physiological patterns and continually assesses the proximity of the trainee's real-time physiological activity to the desired patterns.
The pattern comparator calculates a closeness score in relation to one or more reference patterns, transmitting this data to the VR/AR/MR environment components. Consequently, the level of threat or cooperation presented by virtual characters is dynamically adjusted in response to the closeness score, creating an immersive and adaptive training experience.
Reconfigurable Image Generator and Database Generation System
The system, the Reconfigurable Image Generator (RIG), consists of software and a hardware configuration, and a Synthetic Environment Database Generation System (RIG-DBGS). This innovative Image Generator (IG) uses Commercial-Off-The-Shelf (COTS) technologies and is capable of supporting virtually any display system. The DBGS software leverages high-fidelity real-world data, including aerial imagery, elevation datasets, and vector data. Through a combination of COTS tools and in-house created applications, the semi-automated system can process large amounts of data in days rather than weeks or months, a disadvantage of manual database generation. A major benefit of the RIG technology is that existing simulation users can leverage their investment in existing real-time 3D databases (such as OpenFlight) as part of the RIG system.
Game and Simulation Control
The technology is constructed to allow modulation of player inputs to a video game
or simulation from a user interface device based on the players psychophysiological
state. The invention exploits current wireless motion-sensing technologies to utilize
physiological signals for input modulation. These include, but are not limited to, heart
rate, muscle tension, and brain wave activity.
The current capability has been successfully prototyped using the Nintendo Wii
console and wireless Wii remote. The experience of electronic game play may also
be enhanced by introducing a multiplayer component in which various players
collaboratively pursue the goals of the game. The device can also enhance multiplayer
experiences such as a video game tournament, in which the skill set required in
competitive game play is increased by allowing players to interact with the game, and
compete with one another, on a psychophysiological level. This system is compatible
with the Nintendo Wii, and prototypes have been designed and are being developed
to extend this capability to the PlayStation Move, Xbox Kinect, and other
similar game platforms.
ZONE (Zeroing Out Negative Effects)
The system uses perturbation feedback to help the athlete get into the zone through an original method of ZONE. The method allows a trainee to learn physiological self-regulation in order to modify the difficulty of the performance task and/or environment in which training is conducted. For example, better concentration leads to a variety of easier conditions on a training putting green.
The technology incorporates software and hardware to provide real-time feedback to the athlete about how close his or her arousal and emotive responses are to an optimal state required to successfully perform the athletic task. This innovation presents the capability to extend current sports training and psychological practices of guided imagery visualization and cognitive reinforcement learning by systematically providing
demonstrable and relevant feedback through the use of closed-loop, cybernetic feedback principles that provide immediate reinforcement of pyschophysiological self-regulation and translate into better skill-based performance.
Functional Near-Infrared Spectroscopy (fNIRS) Cognitive Brain Monitor
Functional near-infrared spectroscopy (fNIRS) is an emerging hemodynamic neuroimaging brain-computer interface (BCI) technology that indirectly measures neuronal activity in the brain's cortex via neuro-vascular coupling. fNIRS works by quantifying hemoglobin-concentration changes in the brain based on optical intensity measurements, measuring the same hemodynamic changes as functional magnetic resonance imaging (fMRI). With enough probes in enough locations, fNIRS can detect these hemodynamic activations across the subject's entire head, thus allowing the determination of cognitive state through the use of pattern classification. fNIRS systems offer low-power, low-cost, highly mobile alternatives for real-time monitoring in safety-critical situations.
Glenn's specific contribution to this field is the algorithms capable of removing motion artifacts (environment- or equipment-induced errors) from the device's head-worn optical sensors. In other words, Glenn's adaptive filter can determine the presence of a potential motion artifact based on a phase shift in the data measured; identify the artifact by examining the correlation between the phase shift and changes in hemoglobin concentration; and finally remove the artifact using Kalman filtering whenever changes in hemoglobin level and changes in the phase shift are not correlated. Glenn's breakthrough allows the advantages of fNIRS to be used for non-invasive real-time brain monitoring applications in motion-filled environments that could potentially save lives.
