Interactive Perception & Graphics for a Universally Accessible Metaverse
Ruofei Du
University of Virginia CS Fall 2023 Distinguished Speakers, Charlottesville, Virginia, USA.
ThingShare: Ad-Hoc Digital Copies of Physical Objects for Sharing Things in Video Meetings
In video meetings, individuals may wish to share various physical objects with remote participants, such as physical documents, design prototypes, and personal belongings. However, our formative study discovered that this poses several challenges, including difficulties in referencing a remote user's physical objects, the limited visibility of the object, and the friction of properly framing and orienting an object to the camera. To address these challenges, we propose ThingShare, a video-conferencing system designed to facilitate the sharing of physical objects during remote meetings. With ThingShare, users can quickly create digital copies of physical objects in the video feeds, which can then be magnified on a separate panel for focused viewing, overlaid on the user’s video feed for sharing in context, and stored in the object drawer for reviews. Our user study demonstrated that ThingShare made initiating object-centric conversations more efficient and provided a more stable and comprehensive view of shared objects.
Publications
Experiencing Thing2Reality: Transforming 2D Content Into Conditioned Multiviews and 3D Gaussian Objects for XR Communication
Adjunct Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (UIST), 2024.
Keywords: extended reality, augmented communication, image-to-3D, remote collaboration, spatial referencing, co-presence
ThingShare: Ad-Hoc Digital Copies of Physical Objects for Sharing Things in Video Meetings
Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI), 2023.
Keywords: video-mediated communication, object-centered meetings, online meeting, collaborative work, augmented communication, XR interaction
Videos
Talks
Interactive Perception & Graphics for a Universally Accessible Metaverse
Ruofei Du
Invited Talk at UCLA by Prof. Yang Zhang , Remote Talk.
Interactive Graphics for a Universally Accessible Metaverse
Ruofei Du
Invited Talk at ECL Seminar Series by Dr. Alaeddin Nassani , Remote Talk.
Interactive Graphics for a Universally Accessible Metaverse
Ruofei Du
Invited Talk at UICC 2023 sponsored by University of Iowa ACM Student Chapter, Iowa City, Iowa.
Interactive Graphics for a Universally Accessible Metaverse
Ruofei Du
Invited Talk at Empathic Computing Lab , Remote Talk.
pdf |