论文标题
使用PocoFormer的偏振颜色图像降解
Polarized Color Image Denoising using Pocoformer
论文作者
论文摘要
偏光颜色摄影在一个快照中提供视觉纹理和对象表面信息。但是,与常规颜色成像相比,定向偏振阵列的使用会导致极低的光子计数和SNR。因此,该特征实质上导致令人不愉快的嘈杂图像并破坏极化分析性能。这是一个挑战,对于以下事实,传统图像处理管道的挑战是,隐含在渠道中施加的物理约束过于复杂。为了解决这个问题,我们提出了一种基于学习的方法,以同时恢复清洁信号和精确的极化信息。捕获了配对的原始短期嘈杂和长期暴露参考图像的真实世界两极化的颜色图像数据集,以支持基于学习的管道。此外,我们采用视觉变压器的开发,并提出了一个混合变压器模型,用于偏光颜色图像denoising,即PocoFormer,以更好地恢复性能。大量的实验证明了所提出的方法的有效性和影响结果的关键因素。
Polarized color photography provides both visual textures and object surficial information in one single snapshot. However, the use of the directional polarizing filter array causes extremely lower photon count and SNR compared to conventional color imaging. Thus, the feature essentially leads to unpleasant noisy images and destroys polarization analysis performance. It is a challenge for traditional image processing pipelines owing to the fact that the physical constraints exerted implicitly in the channels are excessively complicated. To address this issue, we propose a learning-based approach to simultaneously restore clean signals and precise polarization information. A real-world polarized color image dataset of paired raw short-exposed noisy and long-exposed reference images are captured to support the learning-based pipeline. Moreover, we embrace the development of vision Transformer and propose a hybrid transformer model for the Polarized Color image denoising, namely PoCoformer, for a better restoration performance. Abundant experiments demonstrate the effectiveness of proposed method and key factors that affect results are analyzed.