Portal de Periódicos da CAPES

GPU-accelerated depth codec for real-time, high-quality light field reconstruction

2018; Association for Computing Machinery; Volume: 1; Issue: 1 Linguagem: Inglês

10.1145/3203193

2577-6193

Babis Koniaris, Maggie Kosek, David Sinclair, Kenny Mitchell,

Image Enhancement Techniques

Pre-calculated depth information is essential for efficient light field video rendering, due to the prohibitive cost of depth estimation from color when real-time performance is desired. Standard state-of-the-art video codecs fail to satisfy such performance requirements when the amount of data to be decoded becomes too large. In this paper, we propose a depth image and video codec based on block compression, that exploits typical characteristics of depth streams, drawing inspiration from S3TC texture compression and geometric wavelets. Our codec offers very fast hardware-accelerated decoding that also allows partial extraction for view-dependent decoding. We demonstrate the effectiveness of our codec in a number of multi-view 360 degree video datasets, with quantitative analysis of storage cost, reconstruction quality and decoding performance.