Active Research

Desktop 3D Telepresence

Desktop 3D Telepresence

Bringing Telepresence to Every Desk — developing systems for real-time 3D telepresence using commodity RGBD cameras.

Egocentric Body Pose Tracking

Egocentric Body Pose Tracking

Mobile, egocentric human body motion reconstruction using eyeglasses-mounted cameras and body-worn inertial sensors.

Eye Tracking with 3D Pupil Loc

Eye Tracking with 3D Pupil Localization

3D pupil localization and gaze tracking based on anatomical eye models and neural refraction correction for AR/VR displays.

Holographic Near-Eye Display

Holographic Near-Eye Display

Computing high-quality phase-only holograms for near-eye holographic displays with applications in AR eyeglasses.

Novel View Rendering using Neu

Novel View Rendering using Neural Networks

Learning generalizable radiance fields for human performance rendering and novel view synthesis.

Past Research

Dynamic Focus Augmented Reality Display

Dynamic Focus Augmented Reality Display

Addresses fundamental limitations of near eye displays including limited field of view, low angular resolution, and fixed accommodative state. Proposes hybrid hardware using see-through deformable membrane mirrors to provide wide FOV and accommodative cues, addressing Vergence-Accommodation Conflict.

Immersive Learning from 3D Reconstruction

Immersive Learning from 3D Reconstruction

Investigates 3D reconstruction of room-sized dynamic scenes with higher quality and fidelity. Enables immersive learning of rare situations through post-event, annotated virtual reality experiences for emergency medical procedures.

Low Latency Display

Low Latency Display

Developing low latency tracking and display system for ultra-low latency, optical see-through augmented reality head mounted displays. Runs at high frame rate and performs in-display corrections.

Pinlight Display

Pinlight Display

Novel optical see-through augmented reality display offering wide field of view and compact eyeglasses form factor. Prototype demonstrates 110° diagonal field of view.

Office of the Future

Office of the Future

Unified application of computer vision and computer graphics combining panoramic image display, tiled display systems, image-based modeling, and immersive environments for 3D tele-immersion capabilities.

3D Telepresence for Medical Consultation

3D Telepresence for Medical Consultation

Develops permanent, portable, handheld 3D telepresence technologies for remote medical consultations. Addresses real time acquisition, novel view generation, network variability, and 3D depth cues.

Wall-to-Wall Telepresence

Wall-to-Wall Telepresence

Enabled visualization of large 3D models on multi-screen 2D display for telepresence. Experimented with reconstructed models and dense datasets.

Multi-view Teleconferencing

Multi-view Teleconferencing

Two-site teleconferencing system supporting multiple people per site while maintaining gaze awareness. Provides unique views of remote sites to each local participant.

Ultrasound/Medical Augmented Reality

Ultrasound/Medical Augmented Reality

Develops system allowing physicians to see inside patients using augmented reality. Combines ultrasound echography, laparoscopic range imaging, video see-through HMD, and graphics.

Pixel-Planes & PixelFlow

Pixel-Planes & PixelFlow

Explores computer architectures for 3D graphics since 1980. Focuses on image-based rendering with goal of high-performance graphics engine using images as principal rendering primitive.

3D Laparoscopic Visualization

3D Laparoscopic Visualization

Three-dimensional visualization system for laparoscopic surgical procedures. Uses 3D visualization, depth extraction, six degree-of-freedom tracking to display merged real and synthetic images.

Wide-Area Tracking

Wide-Area Tracking

Develops wide-area systems for 6D tracking of heads, limbs, and hand-held devices. Provides precise position and orientation information for head-mounted displays.

Image-Based Rendering

Image-Based Rendering

Investigates alternative approach representing complex 3D environments with image sets containing depth information. Develops algorithms to produce new images from viewpoints not in original image set.

Telecollaboration

Telecollaboration

Multi-site, multi-disciplinary project developing distributed collaborative design environment. Includes shared virtual environment software, collaborative VR, and interaction tools.