Through the lens of artificial intelligence: A novel study of spherical video-based virtual reality usage in autism and neurotypical participants

Abstract

The current study explores the use of computer vision and artificial intelligence (AI) methods for analyzing 360-degree spherical video-based virtual reality (SVVR) data. The study aimed to explore the potential of AI, computer vision, and machine learning methods (including entropy analysis, Markov chain analysis, and sequential pattern mining), in extracting salient information from SVVR video data. The research questions focused on differences and distinguishing characteristics of autistic and neurotypical usage characteristics in terms of behavior sequences, object associations, and common patterns, and the extent to which the predictability and variability of findings might distinguish the two participant groups and provide provisional insights into the dynamics of their usage behaviors. Findings from entropy analysis suggest the neurotypical group showed greater homogeneity and predictability, and the autistic group displayed significant heterogeneity and variability in behavior. Results from the Markov Chains analysis revealed distinct engagement patterns, with autistic participants exhibiting a wide range of transition probabilities, suggesting varied SVVR engagement strategies, and with the neurotypical group demonstrating more predictable behaviors. Sequential pattern mining results indicated that the autistic group engaged with a broader spectrum of classes within the SVVR environment, hinting at their attraction to a diverse set of stimuli. This research provides a preliminary foundation for future studies in this area, as well as practical implications for designing effective SVVR learning interventions for autistic individuals.