XR-BASED PLATFORM FOR NEURO-COGNITIVE-MOTOR-AFFECTIVE ASSESSMENTS

Smart overview of the Invention

The XR-based platform for neuro-cognitive-motor-affective assessments introduces an innovative method utilizing extended reality (XR) to conduct comprehensive neuropsychological tests. This approach integrates cognitive, motor, sensory, and affective domains through immersive virtual environments. The system projects a series of virtual objects in three dimensions, enabling the assessment of executive functions while simultaneously monitoring various motor skills using an array of sensors. These sensors capture data related to hand movements, head orientation, eye tracking, gait, and postural stability to provide a detailed neurocognitive and motor profile of the individual.

Background

Traditional neuropsychological tests often lack ecological validity, meaning they do not accurately reflect real-world executive function capabilities. Extended reality (XR), which includes augmented reality (AR), mixed reality (MR), and virtual reality (VR), offers a solution by creating more realistic testing environments. Previous methods like the Virtual Errands Test (VET) attempted to replicate real-world conditions but fell short due to their limited ability to distinguish between healthy individuals and those with clinical conditions. The XR platform aims to overcome these limitations by providing a more immersive experience that closely mimics real-life interactions.

Embodiments

The system incorporates two VR-based methods: the DOME-CTT, which uses a large-scale dome-shaped screen for an immersive experience, and the HMD-CTT, which employs a portable head-mounted display. These methods adapt the Color Trails Test (CTT) and Trail Making Test (TMT) for VR environments, assessing sustained and divided attention through tasks that require tracing sequences of numbered targets. The VR versions demonstrated moderate construct validity compared to traditional tests and showed high test-retest reliability and discriminant validity across different age groups.

Results

The VR-based assessments provided insights into cognitive-motor interactions by capturing spatiotemporal characteristics of upper-limb movements. Results indicated that VR completion times were generally longer than those of traditional tests, with performance declining with age. The data revealed delayed and erratic hand movements in tasks requiring divided attention, reflecting the greater executive function demands compared to sustained attention tasks. These findings underscore the platform's ability to offer a more nuanced understanding of cognitive processes in ways that traditional methods cannot.

Innovative Approach

The XR platform enhances ecological validity by integrating cognitive-sensory-motor interactions into its assessments, allowing for a more accurate measurement of cognitive functions as they relate to everyday activities. The use of quantitative three-dimensional kinematic data enables precise tracking of motion in space, improving the ability to define and differentiate performance levels. The platform's innovative method introduces new interactions and techniques for assessing cognitive-motor-affect domains in extended reality, offering significant advancements over existing neuropsychological testing methodologies.