3D embodied Mixed Reality Immersive Design: A Study in Interactive Dance

3D [Embodied] is a mixed reality performance involving a virtual world as a platform to explore 3D immersive spatial virtual and physical displays. Combining real time geometry perspective transformation of the peripheral projected space and skeleton tracking from the dance performer, 3D [Embodied] experiences spatial augmented reality. Both video and audio rendering are generated in real time.

Choreography by Yacov Sharir, sound design by Bruce Pennycook and technical support by Sebastian Kox (oneseconds.com), Yago de Quay and Marta Ferraz. Austin, 2013.

Nomination for Best Video Design 2013 by the Austin Critics Table Awards.

Design, Motion Tracking and Visuals (until 3:33 and after 3:50) by João Beira (https://vimeo.com/joaobeira)
Bio Sensors and Visuals (from 2:34-3:46) by Marta Ferraz (http://utaustinportugal.org/people/ma…)
Choreography by Yacov Sharir (http://www.digitalcultures.org/Symp/Y…)
Sound Design by Bruce Pennycook (http://pennycook.music.utexas.edu/)
Technical Support and Visual Effects (from 2:34-3:46) by Yago de Quay (www.yagodequay.com)

3D explores the idea of virtual reality applied to physical space, spatial augmented reality, establishing a real time dialogue between 3D geometry and perspective grids calculations with body movement. Dance and interactive media establish a unique environment of virtual and physical immersion.