Our group's research focuses on innovating within the areas required to achieve accurate and realistic 3D video communications, including: high-speed, high-resolution 3D measurement and imaging; 3D geometry, 3D video encoding and compression; virtual reality (VR) and augmented reality (AR) systems; computer graphics; human computer interaction; and multimedia on mobile devices. Our innovations are helping transform how we communicate with one another every day. They also have the potential to realize many additional applications, such as those within telepresence, telemedicine, the digital arts, homeland security, and remote surgery.


 

High-accuracy, high-speed 3D range video encoding and streaming

Mashable direct link: https://mashable.com/2018/01/29/holostream-3d-holographic-video-chat

Our innovative platform for high-quality, low-bandwidth 3D video communications can capture, compress, transmit, and visualize 3D video data in real-time across both wired and wireless networks. Internet connections of 1-2 gigabit per second (Gbps) are typically needed to transmit 3D video data (along with color texture information) in real-time to another user. Utilizing our 3D range video encoding techniques, however, we can transmit the same information at rates around 5-15 megabit per second (Mbps) while still maintaining high-quality 3D reconstructions. Further, we have shown that our encoding methods are efficient enough to enable the wireless delivery of 3D video to and from today's mobile devices.

Reconstructed 3D geometry with and without color texture mapping

 

High-speed, high-resolution 3D shape measurement (imaging)

High-quality, real-time 3D video capture of Prof. Bell using a custom built structured light scanner.
Left: reconstructed 3D geometry.
Right: reconstructed 3D geometry with color texture mapping.