TY - GEN
T1 - Foveated video coding for real-time streaming applications
AU - Wiedemann, Oliver
AU - Hosu, Vlad
AU - Lin, Hanhe
AU - Saupe, Dietmar
N1 - Funding Information:
ACKNOWLEDGMENT Funded by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) – Project-ID 251654672 – TRR 161 (Project A05).
Publisher Copyright:
© 2020 IEEE.
PY - 2020/6/23
Y1 - 2020/6/23
N2 - Video streaming under real-time constraints is an increasingly widespread application. Many recent video encoders are unsuitable for this scenario due to theoretical limitations or run time requirements. In this paper, we present a framework for the perceptual evaluation of foveated video coding schemes. Foveation describes the process of adapting a visual stimulus according to the acuity of the human eye. In contrast to traditional region-of-interest coding, where certain areas are statically encoded at a higher quality, we utilize feedback from an eye-tracker to spatially steer the bit allocation scheme in real-time. We evaluate the performance of an H.264 based foveated coding scheme in a lab environment by comparing the bitrates at the point of just noticeable distortion (JND). Furthermore, we identify perceptually optimal codec parameterizations. In our trials, we achieve an average bitrate savings of 63.24% at the JND in comparison to the unfoveated baseline.
AB - Video streaming under real-time constraints is an increasingly widespread application. Many recent video encoders are unsuitable for this scenario due to theoretical limitations or run time requirements. In this paper, we present a framework for the perceptual evaluation of foveated video coding schemes. Foveation describes the process of adapting a visual stimulus according to the acuity of the human eye. In contrast to traditional region-of-interest coding, where certain areas are statically encoded at a higher quality, we utilize feedback from an eye-tracker to spatially steer the bit allocation scheme in real-time. We evaluate the performance of an H.264 based foveated coding scheme in a lab environment by comparing the bitrates at the point of just noticeable distortion (JND). Furthermore, we identify perceptually optimal codec parameterizations. In our trials, we achieve an average bitrate savings of 63.24% at the JND in comparison to the unfoveated baseline.
UR - http://www.scopus.com/inward/record.url?scp=85087733784&partnerID=8YFLogxK
U2 - 10.1109/QoMEX48832.2020.9123080
DO - 10.1109/QoMEX48832.2020.9123080
M3 - Conference contribution
AN - SCOPUS:85087733784
SN - 978-1-7281-5966-9
T3 - 2020 12th International Conference on Quality of Multimedia Experience, QoMEX 2020
BT - 2020 12th International Conference on Quality of Multimedia Experience (QoMEX 2020)
PB - IEEE
T2 - 12th International Conference on Quality of Multimedia Experience, QoMEX 2020
Y2 - 26 May 2020 through 28 May 2020
ER -