CHI 2016 Demo Video

UIST 2015 Introductory Video


Gaming Experience (in Oculus Rift DK2)

We present VRSurus, a smart device designed to recognize the puppeteer's gestures and render tactile feedback to enhance the interactivity of physical puppets in virtual reality (VR). VRSurus is wireless, self-contained, and small enough to be mounted upon any physical puppets. Using machine-learning techniques, VRSurus is able to recognize three gestures: swiping, shaking and thrusting. Actuators ({em e.g.,} solenoids, servos and vibration motors) assist with the puppetry visible to the audience and provide tactile feedback on the puppeteer's forearm. As a proof of concept, we implemented a tangible serious VR game using VRSurus that aimed at inspiring children to protect the environment and demonstrated it at the ACM UIST 2015 Student Innovation Contest. Our 3D models, circuitry and the source code are publicly available at www.vrsurus.com at https://github.com/ruofeidu/ninjaterp.

Selected Comments from CHI'16, UIST'15 and WebGL communities

R1: This paper reports on a gesture recognition system for puppetry. Motion sensors embedded in a 'hat', allow for detection of hand gestures of the animator/player. This is used for control of a virtual character.I think this is a neat system and there are a number of ways this could be extended.
R2: I like the idea of immersive VR puppets controlled by real ones and interactions between virtual and real puppet. The paper seems well-written and I would weakly argue to accept it as the concept alone may inspire other researchers even though the individual parts of this work are not new and could be improved.
R3: It is well-written, the authors show varied and good technical skills and they seem enthusiastic about VRSaurus. I also really appreciate that they made everything open access. Therefore, I am leaning towards accepting this paper.
Lynn Marentette(K12 Tech Specialist at NUITEQ): Oculus Elephant!
Harry van der Veen(K12 Touch Software): That looks cool!
SEA3D: Wow beautiful work.

Paper

On CHI'16 Extended Abstracts: 33rd Annual ACM Conference on Human Factors in Computing Systems Proceedings. (8 pages)

Poster

Presented on CHI'16 Extended Abstracts: 33rd Annual ACM Conference on Human Factors in Computing Systems Proceedings

VRSurus Presentation Photo

Demo

4th place on the ACM UIST 2015 Student Innovation Contest
(3 votes away from the Best Awards)

BibTeX

@inproceedings{
    du2016vrsurus,
    title={{VRSurus: Enhancing Interactivity and Tangibility of Puppets in Virtual Reality}},
    author={Du, Ruofei and He, Liang},
    booktitle={CHI EA '16 Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems},
    pages={8},
    year={2016},
    url={http://vrsurus.com},
    doi={10.1145/2851581.2892290},
    publisher={ACM}
}

Citation

Du, R., He, L. (2016, May). VRSurus: Enhancing Interactivity and Tangibility of Puppets in Virtual Reality. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI 16), 8 pages. ACM.