Video corresponding to the paper: “General-Purpose Telepresence with Head-Worn Optical See-Through Displays and Projector-Based Lighting.” by Maimone A., Yang, X., Dierk, N., State, A., Dou, M., and Fuchs, H. to appear in IEEE Virtual Reality 2013 (Orlando, FL, USA, March 16-23, 2013)

In the video, a system is demonstrated that is able to adapt to a wide variety of telepresence scenarios. By combining Kinect-based 3D scanning with optical see-through HMDs, we are able to precisely control which parts of the scene are real and which are virtual or remote objects. For example, the remote participant can appear *inside* the local environment (e.g., seated at a table) and the local user can move his head to look around him as if he were actually seated there, sharing the same table. The remote user’s environment can also appear to *extend* beyond the local environment, as if the two spaces were adjoined, or the local user can become totally *immersed* in the remote environment. Projector-based lighting control is used to illuminate only local objects that are not occluded by remote objects, allowing those virtual objects to appear opaque. Kinect-based depth sensing also supports occlusion of virtual objects by real objects — only parts of virtual objects closer than real objects are drawn. Video prepared by Andrew Maimone.