论文标题
支气管糖:基于视觉的支气管镜姿势估计数据和模型配置的分析
BronchoPose: an analysis of data and model configuration for vision-based bronchoscopy pose estimation
论文作者
论文摘要
基于视觉的支气管镜检查(VB)模型需要使用视频支气管镜检查的框架对虚拟肺模型进行注册,以在活检过程中提供有效的指导。可以通过跟踪支气管镜摄像机的位置和方向或通过校准虚拟肺模型中模拟的姿势(位置和方向)来实现注册。神经网络和时间图像处理的最新进展为指导支气管镜检查提供了新的机会。但是,缺乏比较实验条件阻碍了这种进步。 在本文中,我们共享一个新颖的合成数据集,允许对方法进行公平的比较。此外,本文研究了几种神经网络体系结构,以学习不同级别的主题个性化级别的时间信息。为了改善定向测量,我们还提出了一个标准化的比较框架和一个新颖的相机方向学习指标。数据集中的结果表明,所提出的指标和体系结构以及标准化条件可为视频支气管镜检查中当前最新的摄像头姿势估计提供显着改进。
Vision-based bronchoscopy (VB) models require the registration of the virtual lung model with the frames from the video bronchoscopy to provide effective guidance during the biopsy. The registration can be achieved by either tracking the position and orientation of the bronchoscopy camera or by calibrating its deviation from the pose (position and orientation) simulated in the virtual lung model. Recent advances in neural networks and temporal image processing have provided new opportunities for guided bronchoscopy. However, such progress has been hindered by the lack of comparative experimental conditions. In the present paper, we share a novel synthetic dataset allowing for a fair comparison of methods. Moreover, this paper investigates several neural network architectures for the learning of temporal information at different levels of subject personalization. In order to improve orientation measurement, we also present a standardized comparison framework and a novel metric for camera orientation learning. Results on the dataset show that the proposed metric and architectures, as well as the standardized conditions, provide notable improvements to current state-of-the-art camera pose estimation in video bronchoscopy.