MR Ebers, JP Williams, KM Steele, JN Kutz (2024) “Leveraging arbitrary mobile sensor trajectories with shallow recurrent decoder networks for full-state reconstruction,”

Journal Article in IEEE Access

Sensing is a fundamental task for the monitoring, forecasting, and control of complex systems. In many applications, a limited number of sensors are available and must move with the dynamics. Currently, optimal path planning, like Kalman filter estimation, is required to enable sparse mobile sensing for state estimation. However, we show that arbitrary mobile sensor trajectories can be used. By adapting the Shallow REcurrent Decoder (SHRED) network with mobile sensors, their time-history can be used to encode global information of the measured high-dimensional state space.

Summary figure of a shallow recurrent decoder network (SHRED) leveraging mobile sensors to reconstruct full state-space estimates from sparse dynamical trajectories. (Left) Sensor trajectory history encodes global information of the spatio-temporal dynamics of the sparsely measured system. In this work, we evaluate three challenging datasets, including forced isotropic turbulence, global sea-surface temperature, and human biomechanics. (Middle) The mobile SHRED architecture can (i) embed the multiscale physics of a system into a compact and low-dimensional latent space, and (ii) provide a mapping from the sparse mobile sensors to a full state estimate. (Right) The high-dimensional and complex system states can be reconstructed, provided training data for the dynamical trajectory of the sensor(s) is available.Aim: We leverage sparse mobile sensor trajectories for full-state estimation, agnostic to sensor path.

Methods: Using modern deep learning architectures, we show that a sequence-to-vector model, such as an LSTM (long, short-term memory) network, with a decoder network, dynamic trajectory information can be mapped to full state-space estimates.

Results: We demonstrate that by leveraging mobile sensor trajectories with shallow recurrent decoder networks, we can train the network (i) to accurately reconstruct the full state space using arbitrary dynamical trajectories of the sensors, (ii) the architecture reduces the variance of the mean-squared error of the reconstruction error in comparison with immobile sensors, and (iii) the architecture also allows for rapid generalization (parameterization of dynamics) for data outside the training set. Moreover, the path of the sensor can be chosen arbitrarily, provided training data for the spatial trajectory of the sensor is available.

Interpretation: The time-history of mobile sensors can be used to encode global information of the measured high-dimensional state space.

Introducing Dr. Charlotte DeVol Caskey!

Congratulations to Dr. Charlotte DeVol Caskey on earning her Doctorate in Mechanical Engineering! Dr. Caskey’s PhD thesis dissertation was titled Effects of Spinal Stimulation on Neuromechanics of Gait for Children with Cerebral Palsy. Congratulations and best of luck as you move forward as a Postdoc in the Human Neuromechanics Laboratory at the University of Florida in Gainesville!

Megan Ebers Presents at 2024 WiDS Puget Sound Conference

On May 14, 2024, Steele Lab members Dr. Megan Ebers, Mackenzie Pitts, and Dr. Kat Steele attended the Women in Data Science (WiDS) Puget Sound conference hosted at Seattle University. WiDS aims to inspire and educate data scientists worldwide, regardless of gender, and to support women in the field.

Among the speakers at the conference, postdoctoral scholar Dr. Megan Ebers gave a presentation titled Data Expansion to Improve Accuracy and Availability of Digital Biomarkers for Human Health and Performance.”

A professional woman standing confidently in front of a projector screen, delivering a presentation.

MC Rosenberg, JL Proctor, KM Steele (2024) “Quantifying changes in individual-specific template-based representations of center-of-mass dynamics during walking with ankle exoskeletons using Hybrid-SINDy”

Journal Article in Scientific Reports

Ankle exoskeletons alter whole-body walking mechanics, energetics, and stability by altering center-of-mass (CoM) motion. Controlling the dynamics governing CoM motion is, therefore, critical for maintaining efficient and stable gait. However, how CoM dynamics change with ankle exoskeletons is unknown, and how to optimally model individual-specific CoM dynamics, especially in individuals with neurological injuries, remains a challenge.

Depictions of walking conditions, phase variables, and example template state variables. (A) Two-dimensional depictions of template model applied to human walking without and with ankle exoskeletons (left). The phase portrait (right) defined a phase variable, , used to cluster kinematically similar measurements for model fitting. Colors denote gait phases corresponding to first and second double-limb support, single-limb support, and swing of the right leg. (B) Stride-averaged global CoM position, velocity, and acceleration for an exemplary unimpaired adult in the anterior–posterior, vertical, and mediolateral directions. The three exoskeleton conditions are shown in panels (B) and (C): shoes-only (solid lines), zero-stiffness exoskeletons (K0; dashed lines), and stiff exoskeletons (KH; dotted lines). (C) Template position and velocity states used to fit the template signatures were defined by sagittal- and frontal-plane leg angles, and leg length.Aim: Evaluate individual-specific changes in CoM dynamics in unimpaired adults and one individual with post-stroke hemiparesis while walking in shoes-only and with zero-stiffness and high-stiffness passive ankle exoskeletons.

Methods: To identify optimal sets of physically interpretable mechanisms describing CoM dynamics, termed template signatures, we leveraged hybrid sparse identification of nonlinear dynamics (Hybrid-SINDy), an equation-free data-driven method for inferring sparse hybrid dynamics from a library of candidate functional forms.

Results: In unimpaired adults, Hybrid-SINDy automatically identified spring-loaded inverted pendulum-like template signatures, which did not change with exoskeletons (p > 0.16), except for small changes in leg resting length (p < 0.001). Conversely, post-stroke paretic-leg rotary stiffness mechanisms increased by 37–50% with zero-stiffness exoskeletons.

Interpretation: While unimpaired CoM dynamics appear robust to passive ankle exoskeletons, how neurological injuries alter exoskeleton impacts on CoM dynamics merits further investigation. Our findings support Hybrid-SINDy’s potential to discover mechanisms describing individual-specific CoM dynamics with assistive devices.

UW Data Science Seminar with Megan Ebers

Title slide from the UW eScience Data Science seminar that says "Mobile sensing with shallow recurrent decoder networks. Megan R. Ebers"

Steele lab member and postdoctoral scholar, Megan Ebers, was featured in the Winter 2024 UW Data Science Seminar series. You can watch her full presentation on “Mobile sensing with shallow recurrent decoder networks” linked HERE on UW eScience Institute’s YouTube channel.

Abstract: Sensing is a fundamental task for the monitoring, forecasting, and control of complex systems. In many applications, a limited number of sensors are available and must move with the dynamics, such as with wearable technology or ocean monitoring buoys. In these dynamic systems, the sensors’ time history encodes a significant amount of information that can be extracted for critical tasks. We show that by leveraging the time-history of a sparse set of sensors, we can encode global information of the measured high-dimensional system using shallow recurrent decoder networks. This paradigm has important applications for technical challenges in climate modeling, natural disaster evaluation, and personalized health monitoring; we focus especially on how this paradigm has the potential to transform the way we monitor and manage movement-related health outcomes.

Bio: Megan Ebers is a postdoctoral scholar in applied mathematics with UW’s NSF AI Institute in Dynamic Systems. In her PhD research, she developed and applied machine learning methods for dynamics systems to understand and enable human mobility. Her postdoctoral research focuses on data-driven and reduced-order methods for complex systems, so as to continue her work in human-centered research challenges, as well as to extend her research to a broader set of technical challenges, including turbulent flow modeling, natural disaster monitoring, and acoustic object detection.