论文标题
基于3D启动的Transmorph:脑肿瘤中的术前和术后多对比度MRI登记
3D Inception-Based TransMorph: Pre- and Post-operative Multi-contrast MRI Registration in Brain Tumors
论文作者
论文摘要
可变形图像注册是医疗图像分析中的关键任务。脑肿瘤序列注册挑战(BRATS-REG)旨在建立对患有成人大脑弥漫性高级神经胶质瘤的同一患者的术前和随访扫描之间的对应,并打算解决具有重大组织外观变化的纵向数据的挑战性任务。在这项工作中,我们根据成立和跨多个模型提出了一个两阶段的级联网络。每位患者的数据集由天然前对比(T1),对比增强的T1加权(T1-CE),T2加权(T2)和流体衰减反转恢复(TLAIR)。 Inception模型用于将4个图像模式融合在一起并提取最相关的信息。然后,对TransMorph架构的一种变体进行了调整以生成位移字段。损耗函数由标准图像相似度度量,扩散正常化程序以及添加的边缘图相似度度量组成,以克服强度依赖性并增强正确的边界变形。我们观察到,成立模块的添加大大提高了网络的性能。此外,在训练前进行初始仿射注册,该模型在术前和术后MRI之间的里程碑式误差测量中的准确性提高了。我们观察到,使用最初的仿射注册数据集的最佳模型由启动和跨多头架构组成,具有最佳性能,中值绝对误差为2.91(初始错误= 7.8)。在Brats-Reg挑战的最终测试阶段,我们在模型提交时获得了第六名。
Deformable image registration is a key task in medical image analysis. The Brain Tumor Sequence Registration challenge (BraTS-Reg) aims at establishing correspondences between pre-operative and follow-up scans of the same patient diagnosed with an adult brain diffuse high-grade glioma and intends to address the challenging task of registering longitudinal data with major tissue appearance changes. In this work, we proposed a two-stage cascaded network based on the Inception and TransMorph models. The dataset for each patient was comprised of a native pre-contrast (T1), a contrast-enhanced T1-weighted (T1-CE), a T2-weighted (T2), and a Fluid Attenuated Inversion Recovery (FLAIR). The Inception model was used to fuse the 4 image modalities together and extract the most relevant information. Then, a variant of the TransMorph architecture was adapted to generate the displacement fields. The Loss function was composed of a standard image similarity measure, a diffusion regularizer, and an edge-map similarity measure added to overcome intensity dependence and reinforce correct boundary deformation. We observed that the addition of the Inception module substantially increased the performance of the network. Additionally, performing an initial affine registration before training the model showed improved accuracy in the landmark error measurements between pre and post-operative MRIs. We observed that our best model composed of the Inception and TransMorph architectures while using an initially affine registered dataset had the best performance with a median absolute error of 2.91 (initial error = 7.8). We achieved 6th place at the time of model submission in the final testing phase of the BraTS-Reg challenge.