Detailed Record



DualStream: Spatially Sharing Selves and Surroundings using Mobile Devices and Augmented Reality


Abstract In-person human interaction relies on our spatial perception of each other and our surroundings. Current remote communication tools partially address each of these aspects. Video calls convey real user representations but without spatial interactions. Augmented and Virtual Reality (AR/VR) experiences are immersive and spatial but often use virtual environments and characters instead of real-life representations. Bridging these gaps, we introduce DualStream, a system for synchronous mobile AR remote communication that captures, streams, and displays spatial representations of users and their surroundings. DualStream supports transitions between user and environment representations with different levels of visuospatial fidelity, as well as the creation of persistent shared spaces using environment snapshots. We demonstrate how DualStream can enable spatial communication in real-world contexts, and support the creation of blended spaces for collaboration. A formative evaluation of DualStream revealed that users valued the ability to interact spatially and move between representations, and could see DualStream fitting into their own remote communication practices in the near future. Drawing from these findings, we discuss new opportunities for designing more widely accessible spatial communication tools, centered around the mobile phone.
Authors Rishi Vanukuru ORCID , Suibi Che–Chuan Weng , Clement Zheng ORCID , Torin Hopkins , Amy Banić University of Wyoming , Mark D. Gross ORCID , Ellen Yi–Luen
Journal Info Not listed | 2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)
Publication Date 10/16/2023
ISSN Not listed
TypeKeyword Image article
Open Access closed Closed Access
DOI https://doi.org/10.1109/ismar59233.2023.00028
KeywordsKeyword Image Immersive Simulations (Score: 0.543777) , Virtual Environments (Score: 0.539612) , User Experience (Score: 0.53862) , Multi-touch Sensing (Score: 0.525236) , Mobile Interaction (Score: 0.5244)