A new method called PackUV compresses massive 3D video data into everyday video formats, potentially bringing immersive video experiences closer to home televisions and computers.
PROVIDENCE, R.I. [Brown University] - New research by Brown University computer scientists may be a key step in bringing volumetric video - video that can be viewed from virtually any perspective in a 3D scene - to computers and smart televisions.
The research introduces a new way of processing video called PackUV, which improves the capture of 3D action and makes the final product readily streamable, storable and compatible with the video codecs that currently power most video on the internet.
"With volumetric video, you can basically explore a scene from any vantage point you want," said Aashish Rai, a computer science graduate student at Brown who led the work. "It captures three dimensions of space, plus time, making it a 4D video. With our work, we basically convert this entire 4D scene into a normal video that you can stream over the internet and share with friends."
Rai, who works in the Interactive 3D Vision and Learning Lab at Brown led by Assistant Professor Srinath Sridhar, will present the work in June at the IEEE/CVF Conference on Computer Vision and Pattern Recognition.
