Capturing Autobiographical Memory Formation in Real World Spaces Using Multimodal Recordings

This observational study aims to develop and validate novel methodologies for integrating multimodal data streams with invasive neural recordings in individuals with implanted neurostimulation devices (e.g., NeuroPace RNS) undergoing treatment for epilepsy. The study focuses on understanding the neural mechanisms underlying autobiographical memory (AM) formation and retrieval in real-world settings. By leveraging real-time, ecologically valid data collection, this research seeks to bridge the gap between controlled laboratory-based memory studies and naturalistic memory processes.

Study Design and Data Collection Participants with implanted neurostimulation devices will use a smartphone-based application (CAPTURE) to log real-world experiences while wearing additional sensors to record behavioral, physiological, and environmental data.

The study integrates multiple data modalities, including:

• Neural recordings from implanted neurostimulation devices
• Wearable sensor data, including:
• Audio-visual recordings
• GPS location tracking
• Accelerometry for movement analysis
• Autonomic physiology measurements (e.g., heart rate, skin conductance)
• Eye-tracking data

By synchronizing these data streams, researchers will establish a high-fidelity representation of autobiographical memory encoding and retrieval processes in daily life.

Analytic Methods and Data Integration

This study aims to develop computational frameworks for real-time data alignment and analysis. The primary methodological goals include:

• Temporal synchronization of multimodal data with neural recordings
• Automated feature extraction from behavioral and physiological data
• Neural signal processing techniques to identify patterns of activity associated with memory formation and retrieval
• Development of machine learning models to predict successful memory encoding and recall based on neural and behavioral signals
• These analytic advancements will enable researchers to assess memory-related brain activity in naturalistic environments, providing insights into the neural correlates of real-world autobiographical memory.

Potential Impact:

The findings from this study have significant implications for neuroscience, cognitive psychology, and clinical applications. By establishing methods for naturalistic neural recording and analysis, this research paves the way for neuromodulation-based memory enhancement therapies for individuals with memory disorders, including those with epilepsy, traumatic brain injury, and neurodegenerative diseases. The study also advances real-world cognitive neuroscience, enabling a deeper understanding of how the brain supports memory outside of laboratory settings.

Inclusion criteria

• 18 years of age or older
• healthy to minor cognitive impairment

Exclusion criteria

• younger than 18 years of age
• more than minor cognitive impairment