论文标题
HMFLOW:小型和快速移动对象的混合匹配光流网络
HMFlow: Hybrid Matching Optical Flow Network for Small and Fast-Moving Objects
论文作者
论文摘要
在光流估计任务中,粗到1(C2F)翘曲策略被广泛用于处理大型位移问题并提供效率和速度。但是,受第一张图像和扭曲的第二张图像之间的较小搜索范围的限制,当前的粗到最佳光流网络无法捕获小小的和快速移动的对象,这些对象消失在粗分辨率水平上。为了解决这个问题,我们引入了轻巧但有效的全局匹配组件(GMC),以获取全球匹配功能。我们通过将GMC无缝地集成到现有的粗到精细网络中来提出一个新的混合匹配光流网络(HMFLOW)。除了保持高精度和小型尺寸外,我们提出的HMFLOW还可以应用全局匹配功能,以指导网络发现与本地匹配功能不匹配的小型和快速移动的对象。我们还构建了一个新的数据集,称为小型和快速移动的椅子(SFCHAILS)进行评估。实验结果表明,我们提出的网络实现了相当大的性能,尤其是在具有小型和快速对象的区域。
In optical flow estimation task, coarse-to-fine (C2F) warping strategy is widely used to deal with the large displacement problem and provides efficiency and speed. However, limited by the small search range between the first images and warped second images, current coarse-to-fine optical flow networks fail to capture small and fast-moving objects which disappear at coarse resolution levels. To address this problem, we introduce a lightweight but effective Global Matching Component (GMC) to grab global matching features. We propose a new Hybrid Matching Optical Flow Network (HMFlow) by integrating GMC into existing coarse-to-fine networks seamlessly. Besides keeping in high accuracy and small model size, our proposed HMFlow can apply global matching features to guide the network to discover the small and fast-moving objects mismatched by local matching features. We also build a new dataset, named Small and Fast-Moving Chairs (SFChairs), for evaluation. The experimental results show that our proposed network achieves considerable performance, especially at regions with small and fast-moving objects.