Research
Active Research
| Desktop 3D Telepresence |
Desktop 3D TelepresenceBringing Telepresence to Every Desk — developing systems for real-time 3D telepresence using commodity RGBD cameras. |
| Egocentric Body Pose Tracking |
Egocentric Body Pose TrackingMobile, egocentric human body motion reconstruction using eyeglasses-mounted cameras and body-worn inertial sensors. |
| Eye Tracking with 3D Pupil Loc |
Eye Tracking with 3D Pupil Localization3D pupil localization and gaze tracking based on anatomical eye models and neural refraction correction for AR/VR displays. |
| Holographic Near-Eye Display |
Holographic Near-Eye DisplayComputing high-quality phase-only holograms for near-eye holographic displays with applications in AR eyeglasses. |
| Novel View Rendering using Neu |
Novel View Rendering using Neural NetworksLearning generalizable radiance fields for human performance rendering and novel view synthesis. |
Past Research
![]() |
Dynamic Focus Augmented Reality DisplayAddresses fundamental limitations of near eye displays including limited field of view, low angular resolution, and fixed accommodative state. Proposes hybrid hardware using see-through deformable membrane mirrors to provide wide FOV and accommodative cues, addressing Vergence-Accommodation Conflict. |
![]() |
Immersive Learning from 3D ReconstructionInvestigates 3D reconstruction of room-sized dynamic scenes with higher quality and fidelity. Enables immersive learning of rare situations through post-event, annotated virtual reality experiences for emergency medical procedures. |
![]() |
Low Latency DisplayDeveloping low latency tracking and display system for ultra-low latency, optical see-through augmented reality head mounted displays. Runs at high frame rate and performs in-display corrections. |
| Pinlight Display |
Pinlight DisplayNovel optical see-through augmented reality display offering wide field of view and compact eyeglasses form factor. Prototype demonstrates 110° diagonal field of view. |
![]() |
Office of the FutureUnified application of computer vision and computer graphics combining panoramic image display, tiled display systems, image-based modeling, and immersive environments for 3D tele-immersion capabilities. |
![]() |
3D Telepresence for Medical ConsultationDevelops permanent, portable, handheld 3D telepresence technologies for remote medical consultations. Addresses real time acquisition, novel view generation, network variability, and 3D depth cues. |
![]() |
Wall-to-Wall TelepresenceEnabled visualization of large 3D models on multi-screen 2D display for telepresence. Experimented with reconstructed models and dense datasets. |
![]() |
Multi-view TeleconferencingTwo-site teleconferencing system supporting multiple people per site while maintaining gaze awareness. Provides unique views of remote sites to each local participant. |
![]() |
Ultrasound/Medical Augmented RealityDevelops system allowing physicians to see inside patients using augmented reality. Combines ultrasound echography, laparoscopic range imaging, video see-through HMD, and graphics. |
Pixel-Planes & PixelFlowExplores computer architectures for 3D graphics since 1980. Focuses on image-based rendering with goal of high-performance graphics engine using images as principal rendering primitive. |
![]() |
3D Laparoscopic VisualizationThree-dimensional visualization system for laparoscopic surgical procedures. Uses 3D visualization, depth extraction, six degree-of-freedom tracking to display merged real and synthetic images. |
Wide-Area TrackingDevelops wide-area systems for 6D tracking of heads, limbs, and hand-held devices. Provides precise position and orientation information for head-mounted displays. |
![]() |
Image-Based RenderingInvestigates alternative approach representing complex 3D environments with image sets containing depth information. Develops algorithms to produce new images from viewpoints not in original image set. |
![]() |
TelecollaborationMulti-site, multi-disciplinary project developing distributed collaborative design environment. Includes shared virtual environment software, collaborative VR, and interaction tools. |










