wearable sensors

MR Ebers, JP Williams, KM Steele, JN Kutz (2024) “Leveraging arbitrary mobile sensor trajectories with shallow recurrent decoder networks for full-state reconstruction,”

Katie Landwehr JournalArticle, Publications , ,

Journal Article in IEEE Access

Sensing is a fundamental task for the monitoring, forecasting, and control of complex systems. In many applications, a limited number of sensors are available and must move with the dynamics. Currently, optimal path planning, like Kalman filter estimation, is required to enable sparse mobile sensing for state estimation. However, we show that arbitrary mobile sensor trajectories can be used. By adapting the Shallow REcurrent Decoder (SHRED) network with mobile sensors, their time-history can be used to encode global information of the measured high-dimensional state space.

Summary figure of a shallow recurrent decoder network (SHRED) leveraging mobile sensors to reconstruct full state-space estimates from sparse dynamical trajectories. (Left) Sensor trajectory history encodes global information of the spatio-temporal dynamics of the sparsely measured system. In this work, we evaluate three challenging datasets, including forced isotropic turbulence, global sea-surface temperature, and human biomechanics. (Middle) The mobile SHRED architecture can (i) embed the multiscale physics of a system into a compact and low-dimensional latent space, and (ii) provide a mapping from the sparse mobile sensors to a full state estimate. (Right) The high-dimensional and complex system states can be reconstructed, provided training data for the dynamical trajectory of the sensor(s) is available.Aim: We leverage sparse mobile sensor trajectories for full-state estimation, agnostic to sensor path.

Methods: Using modern deep learning architectures, we show that a sequence-to-vector model, such as an LSTM (long, short-term memory) network, with a decoder network, dynamic trajectory information can be mapped to full state-space estimates.

Results: We demonstrate that by leveraging mobile sensor trajectories with shallow recurrent decoder networks, we can train the network (i) to accurately reconstruct the full state space using arbitrary dynamical trajectories of the sensors, (ii) the architecture reduces the variance of the mean-squared error of the reconstruction error in comparison with immobile sensors, and (iii) the architecture also allows for rapid generalization (parameterization of dynamics) for data outside the training set. Moreover, the path of the sensor can be chosen arbitrarily, provided training data for the spatial trajectory of the sensor is available.

Interpretation: The time-history of mobile sensors can be used to encode global information of the measured high-dimensional state space.

Megan Ebers Presents at 2024 WiDS Puget Sound Conference

Katie Landwehr News, Presentation , , ,

On May 14, 2024, Steele Lab members Dr. Megan Ebers, Mackenzie Pitts, and Dr. Kat Steele attended the Women in Data Science (WiDS) Puget Sound conference hosted at Seattle University. WiDS aims to inspire and educate data scientists worldwide, regardless of gender, and to support women in the field.

Among the speakers at the conference, postdoctoral scholar Dr. Megan Ebers gave a presentation titled “Data Expansion to Improve Accuracy and Availability of Digital Biomarkers for Human Health and Performance.”

A professional woman standing confidently in front of a projector screen, delivering a presentation.

UW Data Science Seminar with Megan Ebers

Katie Landwehr News, Presentation , ,
Title slide from the UW eScience Data Science seminar that says "Mobile sensing with shallow recurrent decoder networks. Megan R. Ebers"

Steele lab member and postdoctoral scholar, Megan Ebers, was featured in the Winter 2024 UW Data Science Seminar series. You can watch her full presentation on “Mobile sensing with shallow recurrent decoder networks” linked HERE on UW eScience Institute’s YouTube channel.

Abstract: Sensing is a fundamental task for the monitoring, forecasting, and control of complex systems. In many applications, a limited number of sensors are available and must move with the dynamics, such as with wearable technology or ocean monitoring buoys. In these dynamic systems, the sensors’ time history encodes a significant amount of information that can be extracted for critical tasks. We show that by leveraging the time-history of a sparse set of sensors, we can encode global information of the measured high-dimensional system using shallow recurrent decoder networks. This paradigm has important applications for technical challenges in climate modeling, natural disaster evaluation, and personalized health monitoring; we focus especially on how this paradigm has the potential to transform the way we monitor and manage movement-related health outcomes.

Bio: Megan Ebers is a postdoctoral scholar in applied mathematics with UW’s NSF AI Institute in Dynamic Systems. In her PhD research, she developed and applied machine learning methods for dynamics systems to understand and enable human mobility. Her postdoctoral research focuses on data-driven and reduced-order methods for complex systems, so as to continue her work in human-centered research challenges, as well as to extend her research to a broader set of technical challenges, including turbulent flow modeling, natural disaster monitoring, and acoustic object detection.

HA Feldner, C Papazian, KM Peters, CJ Cruetzfeldt, KM Steele (2021) “Clinical Use of Surface Electromyography to Track Acute Upper Extremity Muscle Recovery after Stroke: A Descriptive Case Study of a Single Patient”

Elijah JournalArticle, News, Publications , , , ,

Journal Article in Applied System Innovation:

This work highlights the potential of wearable technologoies to monitor muscle activity changes during stroke recovery in acute clinical settings and their importance for motivation and understanding of progression from the survivor’s point of view: ‘I was hopeful that it would show signs of things that are occurring when I couldn’t physically feel it…if you had other scientific evidence that things were happening, even beyond their notion that it would, it gives you a lot of hope. You just have to be patient, and it’s harder to take when someone tells you, but easier to understand if someone actually shows you’.

Left image depicts arm with pads placed over muscle with right pictures depicting similar image

Aim: Describe the use of wireless sEMG sensors to examine changes in muscle activity during acute and subacute phases of stroke recovery, and understand the participant’s perceptions of sEMG monitoring.

Method: Muscle activity was tracked by five wireless sEMG sensors beginning three days post-stroke and continued through discharge from inpatient rehabilitation. Activity logs were completed each session, and a semi-structured interview occurred at the final session with three- and eight-month follow-up sessions.

Results: The longitudinal monitoring of muscle and movement recovery in the clinic and community was feasible using sEMG sensors. The participant and medical team felt monitoring was unobtrusive, interesting, and motivating for recovery, but desired greater in-session feedback to inform rehabilitation.

Interpretation: This work highlights that barriers in equipment and signal quality still exist, but capitalizing on wearable sensing technology in the clinic holds promise for enabling personalized stroke recovery.

B Nguyen, N Baicoianu, D Howell, KM Peters, KM Steele (2020) “Accuracy and repeatability of smartphone sensors for measuring shank-to-vertical angle” Prosthetics & Orthotics International

Dr. Steele HuskySTEPS, JournalArticle, Orthoses, UbiquitousRehabilitation , , , , , ,

Journal Article in Prosthetics & Orthotics International

Example of how the smartphone app was used for this research. The top images show a black smartphone attached with a running arm band to the side or front of the shank - the two positions tested in this research. The middle figure shows the placement of the reflective markers for 3D motion analysis to evaluate the accuracy of the smartphone measurements. Markers were placed on the lateral epicondyle of the knee, lateral maleolus of the ankle, tibial tuberosity, and the distal tibia. Blacklight was used to mark the position of each marker and hide the position from the clinicians. The bottom panel shows screenshots from the app. The first screen is used to align the device and has arrows at the top and bottom that remind the clinician which anatomical landmarks should be used to align the device while displaying the shank-to-vertical angle in real time. The second screenshot shows an example of the calculated shank-to-vertical angle while someone was walking. The average is shown with a bold black line, with all other trials shown in blue and excluded trials (e.g., when someone was stopping or turning) that deviated more than one standard deviation from other trials are shown in red. There is also text below the graph that provides summary measures, like shank-to-vertical angle in mid stand and cadence (steps/min). The results can be exported as a picture or sent via e-mail using the app.
A) Smartphone positioning on the front or side of the shank. B) Reflective markers on the the tibial tuberosity (TT) – distal tibia (DT) and lateral epicondyle (LE) – lateral malleolus (LM) were used to compare the accuracy of the smartphone to traditional motion capture. UV markings were used to keep placement of these markers constant while blinding clinicians. C) Sample screenshots of the mobile application, including the set-up screen and results automatically produced after a walking trial.

Background

Assessments of human movement are clinically important. However, accurate measurements are often unavailable due to the need for expensive equipment or intensive processing. For orthotists and therapists, shank-to-vertical angle (SVA) is one critical measure used to assess gait and guide prescriptions. Smartphone-based sensors may provide a widely-available platform to expand access to quantitative assessments.

Objectives

Assess accuracy and repeatability of smartphone-based measurement of SVA compared to marker-based 3D motion analysis.

Method

Four licensed clinicians (two physical therapists and two orthotists) measured SVA during gait with a smartphone attached to the anterior or lateral shank surface of unimpaired adults.  We compared SVA calculated from the smartphone’s inertial measurement unit to marker-based measurements. Each clinician completed three sessions/day on two days with each participant to assess repeatability.

Results

Average absolute differences in SVA measured with a smartphone versus marker-based 3D motion analysis during gait were 0.67 ± 0.25° and 4.89 ± 0.72°, with anterior or lateral smartphone positions, respectively. The inter- and intra-day repeatability of SVA were within 2° for both smartphone positions.

Conclusions

Smartphone sensors can be used to measure SVA with high accuracy and repeatability during unimpaired gait, providing a widely-available tool for quantitative gait assessments.

Try it out!

The app for monitoring shank-to-vertical angle is available for you to download and use on either Android or iOS smartphone. Please complete THIS SURVEY which will then send you an e-mail with instructions for installation and use. This app is not an FDA approved medical device and should be used appropriately.