论文标题

令人困惑的图像质量评估:迈向更好的增强现实体验

Confusing Image Quality Assessment: Towards Better Augmented Reality Experience

论文作者

Duan, Huiyu, Min, Xiongkuo, Zhu, Yucheng, Zhai, Guangtao, Yang, Xiaokang, Callet, Patrick Le

论文摘要

随着多媒体技术的发展,增强现实(AR)已成为一个有希望的下一代移动平台。 AR的主要价值是促进数字内容和现实世界环境的融合,但是,关于这种融合将如何影响这两个组件的体验质量(QOE)的研究。为了实现AR的更好的Qoe,其两层彼此影响,首先评估其感知质量很重要。在本文中,我们将AR技术视为虚拟场景和真实场景的叠加,并将视觉混乱作为基本理论。首先提出了一个更普遍的问题,它正在评估叠加图像的感知质量,即令人困惑的图像质量评估。建立了令人困惑的图像质量评估(CFIQA)数据库,其中包括600张参考图像和300个通过成对混合参考图像生成的扭曲图像。然后,进行了主观质量感知研究和客观模型评估实验,以更好地了解人类如何看待混乱的图像。还提出了一个客观称为CFIQA的目标度量,以更好地评估令人困惑的图像质量。此外,根据CFIQA研究,进一步进行了一项扩展的ARIQA研究。我们建立了一个ARIQA数据库,以更好地模拟真实的AR应用程序方案,其中包含20个AR参考图像,20个背景(BG)参考图像和560个从AR和BG参考产生的扭曲图像以及相应收集的主观质量评级。我们还设计了三种类型的全参考(FR)IQA指标,以研究设计相应的IQA算法时是否应该考虑视觉混乱。最终提出了ARIQA指标,以更好地评估AR图像的感知质量。

With the development of multimedia technology, Augmented Reality (AR) has become a promising next-generation mobile platform. The primary value of AR is to promote the fusion of digital contents and real-world environments, however, studies on how this fusion will influence the Quality of Experience (QoE) of these two components are lacking. To achieve better QoE of AR, whose two layers are influenced by each other, it is important to evaluate its perceptual quality first. In this paper, we consider AR technology as the superimposition of virtual scenes and real scenes, and introduce visual confusion as its basic theory. A more general problem is first proposed, which is evaluating the perceptual quality of superimposed images, i.e., confusing image quality assessment. A ConFusing Image Quality Assessment (CFIQA) database is established, which includes 600 reference images and 300 distorted images generated by mixing reference images in pairs. Then a subjective quality perception study and an objective model evaluation experiment are conducted towards attaining a better understanding of how humans perceive the confusing images. An objective metric termed CFIQA is also proposed to better evaluate the confusing image quality. Moreover, an extended ARIQA study is further conducted based on the CFIQA study. We establish an ARIQA database to better simulate the real AR application scenarios, which contains 20 AR reference images, 20 background (BG) reference images, and 560 distorted images generated from AR and BG references, as well as the correspondingly collected subjective quality ratings. We also design three types of full-reference (FR) IQA metrics to study whether we should consider the visual confusion when designing corresponding IQA algorithms. An ARIQA metric is finally proposed for better evaluating the perceptual quality of AR images.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源