Foveated video coding for real-time streaming applications

Oliver Wiedemann, Vlad Hosu, Hanhe Lin, Dietmar Saupe

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

Video streaming under real-time constraints is an increasingly widespread application. Many recent video encoders are unsuitable for this scenario due to theoretical limitations or run time requirements. In this paper, we present a framework for the perceptual evaluation of foveated video coding schemes. Foveation describes the process of adapting a visual stimulus according to the acuity of the human eye. In contrast to traditional region-of-interest coding, where certain areas are statically encoded at a higher quality, we utilize feedback from an eye-tracker to spatially steer the bit allocation scheme in real-time. We evaluate the performance of an H.264 based foveated coding scheme in a lab environment by comparing the bitrates at the point of just noticeable distortion (JND). Furthermore, we identify perceptually optimal codec parameterizations. In our trials, we achieve an average bitrate savings of 63.24% at the JND in comparison to the unfoveated baseline.

Original languageEnglish
Title of host publication2020 12th International Conference on Quality of Multimedia Experience (QoMEX 2020)
PublisherIEEE
Number of pages6
ISBN (Electronic)978-1-7281-5965-2
ISBN (Print)978-1-7281-5966-9
DOIs
Publication statusPublished - 23 Jun 2020
Event12th International Conference on Quality of Multimedia Experience, QoMEX 2020 - Athlone, Ireland
Duration: 26 May 202028 May 2020

Publication series

Name2020 12th International Conference on Quality of Multimedia Experience, QoMEX 2020
PublisherIEEE
ISSN (Print)2372-7179
ISSN (Electronic)2472-7814

Conference

Conference12th International Conference on Quality of Multimedia Experience, QoMEX 2020
Country/TerritoryIreland
CityAthlone
Period26/05/2028/05/20

ASJC Scopus subject areas

  • Safety, Risk, Reliability and Quality
  • Media Technology

Fingerprint

Dive into the research topics of 'Foveated video coding for real-time streaming applications'. Together they form a unique fingerprint.

Cite this