Visual quality assessment for motion compensated frame interpolation

Hui Men, Hanhe Lin, Vlad Hosu, Daniel Maurer, Andés Bruhn, Dietmar Saupe

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

Current benchmarks for optical flow algorithms evaluate the estimation quality by comparing their predicted flow field with the ground truth, and additionally may compare interpolated frames, based on these predictions, with the correct frames from the actual image sequences. For the latter comparisons, objective measures such as mean square errors are applied. However, for applications like image interpolation, the expected user's quality of experience cannot be fully deduced from such simple quality measures. Therefore, we conducted a subjective quality assessment study by crowdsourcing for the interpolated images provided in one of the optical flow benchmarks, the Middlebury benchmark. We used paired comparisons with forced choice and reconstructed absolute quality scale values according to Thurstone's model using the classical least squares method. The results give rise to a re-ranking of 141 participating algorithms w.r.t. visual quality of interpolated frames mostly based on optical flow estimation. Our re-ranking result shows the necessity of visual quality assessment as another evaluation metric for optical flow and frame interpolation benchmarks.

Original languageEnglish
Title of host publication2019 11th International Conference on Quality of Multimedia Experience (QoMEX 2019)
PublisherIEEE
ISBN (Electronic)978-1-5386-8212-8
ISBN (Print)978-1-5386-8213-5
DOIs
Publication statusPublished - 24 Jun 2019
Event11th International Conference on Quality of Multimedia Experience - Berlin, Germany
Duration: 5 Jun 20197 Jun 2019

Publication series

Name2019 11th International Conference on Quality of Multimedia Experience, QoMEX 2019
PublisherIEEE
ISSN (Print)2372-7179
ISSN (Electronic)2472-7814

Conference

Conference11th International Conference on Quality of Multimedia Experience
Abbreviated titleQoMEX 2019
Country/TerritoryGermany
CityBerlin
Period5/06/197/06/19

Keywords

  • Frame interpolation
  • Optical flow
  • Visual quality assessment

Fingerprint

Dive into the research topics of 'Visual quality assessment for motion compensated frame interpolation'. Together they form a unique fingerprint.

Cite this