MR Ebers, KM Steele, JN Kutz (2024) “Discrepancy Modeling Framework: Learning missing physics, modeling systematic residuals, and disambiguating between deterministic and random effects”

Journal Article in SIAM Journal on Applied Dynamical Systems

Physics-based and first-principles models pervade the engineering and physical sciences, allowing for the ability to model the dynamics of complex systems with a prescribed accuracy. The approximations used in deriving governing equations often result in discrepancies between the model and sensor-based measurements of the system, revealing the approximate nature of the equations and/or the signal-to-noise ratio of the sensor itself. In modern dynamical systems, such discrepancies between model and measurement can lead to poor quantification, often undermining the ability to produce accurate and precise control algorithms.

Top panel: An approximate dynamical model f(·) provides estimates of system behavior used for both reconstruction and forecasting (shaded region), x(t). However, true behavior x0(t) (without observation noise) deviates from these estimates. The goal of discrepancy modeling is to learn a discrepancy model that recovers the missing physics and augments the approximate dynamics to improve system characterization, ˜x(t). Bottom panel: There are two approaches for building a discrepancy model to estimate missing physics: (i) modeling systematic state-space residual between the approximate state space, x(t), and true state space, x0(t), and (ii) learning the deterministic dynamical error between the true dynamics, x˙ 0(t) = f(x0(t)) + g(x0(t)), and the approximate dynamics, x˙ (t) = f(x(t)). In real-world systems, the true system behavior is noisily observed, yk = x0(tk) + N(μ, σ), model-measurement mismatch contains both deterministic and random effects; measurements yk = y(kΔt) denote a continuous dynamical system’s full state noisily observed at discrete time points.

Aim: Introduce a discrepancy modeling framework to identify the missing physics and resolve the model-measurement mismatch with two distinct approaches: (i) by learning a model for the evolution of systematic state-space residual, and (ii) by discovering a model for the deterministic dynamical error. Regardless of approach, a common suite of data-driven model discovery methods can be used.

Method: Specifically, we use four fundamentally different methods to demonstrate the mathematical implementations of discrepancy modeling: (i) the sparse identification of nonlinear dynamics (SINDy), (ii) dynamic mode decomposition (DMD), (iii) Gaussian process regression (GPR), and (iv) neural networks (NN). The choice of method depends on one’s intent (e.g., mechanistic interpretability) for discrepancy modeling, sensor measurement characteristics (e.g., quantity, quality, resolution), and constraints imposed by practical applications (e.g., state- or dynamical-space operability).

Results: We demonstrate the utility and suitability for both discrepancy modeling approaches using the suite of data-driven modeling methods on three continuous dynamical systems under varying signal-to-noise ratios. Finally, we emphasize structural shortcomings of each discrepancy modeling approach depending on error type.

Interpretation: In summary, if the true dynamics are unknown (i.e., an imperfect model), one should learn a discrepancy model of the missing physics in the dynamical space. Yet, if the true dynamics are known yet model-measurement mismatch still exists, one should learn a discrepancy model in the state space.

AM Spomer, BC Conner, MH Schwartz, ZF Lerner, KM Steele (2023) “Audiovisual biofeedback amplifies plantarflexor adaptation during walking among children with cerebral palsy”

Journal Article in Journal of NeuroEngineering and Rehabilitation

Biofeedback is a promising noninvasive strategy to enhance gait training among individuals with cerebral palsy (CP). Commonly, biofeedback systems are designed to guide movement correction using audio, visual, or sensorimotor (i.e., tactile or proprioceptive) cues, each of which has demonstrated measurable success in CP.

Figure 1. Experimental Protocol. Audiovisual (AV) biofeedback on soleus activity was provided for the more-affected limb alongside an auto-adjusting target score. Sensorimotor (SM) biofeedback was provided for the more-affected limb using an untethered ankle exoskeleton designed to impart a resistive ankle torque through stance, proportional to baseline values. Participants completed three data collection visits (pre-acclimation, post-acclimation, and follow-up), during which they walked with both biofeedback systems independently and in combination. Trials were pseudo-randomized within and between visits to ensure that feedback modalities were presented to each participant in a different order and control for fatigue and learning effects. Each trial was 10 min long and separated into baseline, feedback, and washout phases. All data analysis was performed for early (strides 1–30), mid (strides 91–110), and late (strides 181–210) feedback phases and washout (strides 1–30). Mean soleus activity for individual strides (purple dots) was normalized to baseline activity. Between the pre-acclimation and post-acclimation visits, participants completed four, 20-min acclimation sessions where they received additional practice with both systems

Aim: The aim of this study is to evaluate how the modality of biofeedback may influence user response which has significant implications if systems are to be consistently adopted into clinical care.

Method: In this study, we evaluated the extent to which adolescents with CP (7M/1F; 14 [12.5,15.5] years) adapted their gait patterns during treadmill walking (6 min/modality) with audiovisual (AV), sensorimotor (SM), and combined AV + SM biofeedback before and after four acclimation sessions (20 min/session) and at a two-week follow-up. Both biofeedback systems were designed to target plantarflexor activity on the more-affected limb, as these muscles are commonly impaired in CP and impact walking function. SM biofeedback was administered using a resistive ankle exoskeleton and AV biofeedback displayed soleus activity from electromyography recordings during gait. At every visit, we measured the time-course response to each biofeedback modality to understand how the rate and magnitude of gait adaptation differed between modalities and following acclimation.

Results: Participants significantly increased soleus activity from baseline using AV + SM (42.8% [15.1, 59.6]), AV (28.5% [19.2, 58.5]), and SM (10.3% [3.2, 15.2]) biofeedback, but the rate of soleus adaptation was faster using AV + SM biofeedback than either modality alone. Further, SM-only biofeedback produced small initial increases in plantarflexor activity, but these responses were transient within and across sessions (p > 0.11). Following multi-session acclimation and at the two-week follow-up, responses to AV and AV + SM biofeedback were maintained.

Interpretation: This study demonstrated that AV biofeedback was critical to increase plantarflexor engagement during walking, but that combining AV and SM modalities further amplified the rate of gait adaptation. Beyond improving our understanding of how individuals may differentially prioritize distinct forms of afferent information, outcomes from this study may inform the design and selection of biofeedback systems for use in clinical care.

ME Hoffman, KM Steele, JE Froehlich, KN Winfree, HA Feldner (2023) “Off to the park: a geospatial investigation of adapted ride-on car usage”

Journal Article in Disability & Rehabilitation: Assistive Technology:

The accessibility of the built environment is an important factor to consider when providing a mobility device to a young child and their family to use in the community.

Figure 8. The accessibility scores for the sidewalks near each Participant’s (P5, P10, P17) home on the left and the drive path of the participant on the right. Participants generally avoided driving on streets that were not accessible.

Aim: To quantify the driving patterns of children using an adapted ride-on car in their home and community environment over the course of a year using an integrated datalogger.

Method: Fourteen children (2.5 ± 1.45 years old, 8 male: 6 female) used adapted ride-on cars outside and inside of their homes over the course of a year. We tracked their device use metrics with a custom datalogger and geospatial data. To measure environmental accessibility, we used the AccessScore from Project Sidewalk, an open-source accessibility mapping initiative, and the Walk Score, a measure of neighborhood pedestrian-friendliness.

Results: More play sessions took place indoors, within the participants’ homes. However, when the adapted ride-on cars were used outside the home, children engaged in longer play sessions, actively drove for a larger portion of the session, and covered greater distances. Most children tended to drive their ROCs in close proximity to their homes. Most notably, we found that children drove more in pedestrian-friendly neighborhoods and when in proximity to accessible paths.

Interpretation: The accessibility of the built environment is paramount when providing any form of mobility device to a child. Providing an accessible place for a child to move, play, and explore is critical in helping a child and family adopt the mobility device into their daily life.

MR Ebers, MC Rosenberg, JN Kutz, KM Steele (2023) “A machine learning approach to quantify individual gait responses to ankle exoskeletons”

Journal Article in Journal of Biomechanics:

Physiological and biomechanical responses to mechanical assistance from wearable technology are highly variable, especially for clinical populations; tools to predict how users respond to different types of exoskeleton assistance may optimize the prescription process and uncover underlying mechanisms driving locomotor changes in the context of personalized wearable/assistive technology.

Aim: The purpose of this study was to determine if a discrepancy modeling framework could quantify individual-specific gait responses to ankle exoskeletons.

Method: We employ a machine learning technique — neural network based discrepancy modeling — on gait data from 12 non-disabled adults to capture within-participant differences in walking dynamics without vs. with a bilateral passive elastic ankle exoskeletons applying 5 N-m/deg of torque. We fit three models: Nominal gait (no exo), Exo, and Discrepancy. Then, post-fitting, we extend the Nominal by the Discrepancy Model (Augmented). We hypothesize that if Augmented (Nom+Discrep) can capture similar amount of variability as the Exo model, then it can be inferred that the discrepancy model accurately captures how a user will respond to an exoskeleton — without direct information about that user’s physiology or motor coordination.

Results:While joint kinematics during Exo gait were well predicted using the Nominal model (median 𝑅2 = 0.863 − 0.939), the Augmented model significantly increased variance accounted for (𝑝 < 0.042, median 𝑅2 = 0.928 − 0.963). For EMG, the Augmented model (median 𝑅2 = 0.665 −
0.788) accounted for significantly more variance than the Nominal model (median 𝑅2 = 0.516 − 0.664). Minimal kinematic variance was left unexplained by the Exo model (median 𝑅2 = 0.954 − 0.978), but only accounted for 72.4%–81.5% of the median variance in EMG during Exo gait across all individuals.

Interpretation:Discrepancy modeling successfully quantified individuals’ exoskeleton responses without requiring knowledge about physiological structure or motor control. However, additional measurement modalities and/or improved resolution are needed to characterize Exo gait, as the discrepancy may not comprehensively capture response due to unexplained variance in Exo gait.

AM Spomer, RZ Yan, MH Schwartz, KM Steele (2023) “Motor control complexity can be dynamically simplified during gait pattern exploration using motor control-based biofeedback”

Journal Article in Journal of Neurophysiology

Understanding how the central nervous system coordinates diverse motor outputs has been a topic of extensive investigation. Although it is generally accepted that a small set of synergies underlies many common activities, such as walking, whether synergies are equally robust across a broader array of gait patterns or can be flexibly modified remains unclear.

Schematic of the custom biofeedback system. A) Motor control biofeedback used to encourage pattern exploration. B) Individuals significantly modified motor control complexity using biofeedback. C) Distal gait mechanics were associated with changes in control complexity.Aim: The aim of this study was to characterize the robustness of synergies to changing biomechanical constraints during walking. Specifically, we evaluated the extent to which nondisabled individuals could modulate both synergy structure and complexity while using motor control biofeedback to drive broad gait pattern exploration.

Methods: We evaluated the extent to which synergies changed as nondisabled adults (n = 14) explored gait patterns using custom biofeedback. Secondarily, we used Bayesian additive regression trees to identify factors that were associated with synergy modulation.

Results: Participants explored 41.1 ± 8.0 gait patterns using biofeedback, during which synergy recruitment changed depending on the type and magnitude of gait pattern modification. Specifically, a consistent set of synergies was recruited to accommodate small deviations from baseline, but additional synergies emerged for larger gait changes. Synergy complexity was similarly modulated; complexity decreased for 82.6% of the attempted gait patterns, but distal gait mechanics were strongly associated with these changes. In particular, greater ankle dorsiflexion moments and knee flexion through stance, as well as greater knee extension moments at initial contact, corresponded to a reduction in synergy complexity.

Interpretation: Taken together, these results suggest that the central nervous system preferentially adopts a low-dimensional, largely invariant control strategy but can modify that strategy to produce diverse gait patterns. Beyond improving understanding of how synergies are recruited during gait, study outcomes may also help identify parameters that can be targeted with interventions to alter synergies and improve motor control after neurological injury.

New & Noteworthy: We used a motor control-based biofeedback system and machine learning to characterize the extent to which nondisabled adults can modulate synergies during gait pattern exploration. Results revealed that a small library of synergies underlies an array of gait patterns but that recruitment from this library changes as a function of the imposed biomechanical constraints. Our findings enhance understanding of the neural control of gait and may inform biofeedback strategies to improve synergy recruitment after neurological injury.