论文标题

从通用点设置数据中学习通用的非刚性多模式生物医学图像登记

Learning Generalized Non-Rigid Multimodal Biomedical Image Registration from Generic Point Set Data

论文作者

Baum, Zachary MC, Ungi, Tamas, Schlenger, Christopher, Hu, Yipeng, Barratt, Dean C

论文摘要

自由点变压器(FPT)已作为数据驱动的,非刚性点设置的注册方法,使用深神经网络。由于FPT不基于点附近或对应关系假设约束,因此可以通过根据倒角距离最小化无监督的损失来简单训练它。这使得fpt可以适应现实世界的医学成像应用,在这些应用程序上可能无法获得地面变形,或者在只有在要对齐的点集中只有不同程度的完整性的情况下。为了测试FPT及其对培训数据集的依赖性的通信发现能力的限制,这项工作探讨了FPT从精心策划的非医学数据集到医学成像数据集的普遍性。首先,我们在ModelNet40数据集上训练FPT,以证明其有效性和FPT优于迭代和基于学习的点设置注册方法的出色注册性能。其次,我们证明了缺少数据的刚性和非刚性注册和鲁棒性的表现。最后,我们通过在没有额外的训练的情况下注册了重建的脊柱和通用脊柱模型的徒手超声扫描,强调了对模型网训练的FPT的有趣概括性,从而在13位患者的情况下,地面真相曲率的平均差异为1.3度。

Free Point Transformer (FPT) has been proposed as a data-driven, non-rigid point set registration approach using deep neural networks. As FPT does not assume constraints based on point vicinity or correspondence, it may be trained simply and in a flexible manner by minimizing an unsupervised loss based on the Chamfer Distance. This makes FPT amenable to real-world medical imaging applications where ground-truth deformations may be infeasible to obtain, or in scenarios where only a varying degree of completeness in the point sets to be aligned is available. To test the limit of the correspondence finding ability of FPT and its dependency on training data sets, this work explores the generalizability of the FPT from well-curated non-medical data sets to medical imaging data sets. First, we train FPT on the ModelNet40 dataset to demonstrate its effectiveness and the superior registration performance of FPT over iterative and learning-based point set registration methods. Second, we demonstrate superior performance in rigid and non-rigid registration and robustness to missing data. Last, we highlight the interesting generalizability of the ModelNet-trained FPT by registering reconstructed freehand ultrasound scans of the spine and generic spine models without additional training, whereby the average difference to the ground truth curvatures is 1.3 degrees, across 13 patients.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源