论文标题

双尺度平均教师网络,用于胸部CT体积的半监督感染细分covid-19

Dual Multi-scale Mean Teacher Network for Semi-supervised Infection Segmentation in Chest CT Volume for COVID-19

论文作者

Wang, Liansheng, Wang, Jiacheng, Zhu, Lei, Fu, Huazhu, Li, Ping, Cheng, Gary, Feng, Zhipeng, Li, Shuo, Heng, Pheng-Ann

论文摘要

来自计算机断层扫描(CT)数据的自动检测肺部感染在对抗COVID-19中起重要作用。但是,开发AI系统仍然存在一些挑战。 1)大多数当前的COVID-19感染分割方法主要依赖于2D CT图像,而2D CT图像缺少3D顺序约束。 2)现有的3D CT分割方法着眼于单尺度表示,这些表示无法实现3D体积的多级接受场大小。 3)紧急闯入Covid-19,因此很难注释足够的CT量来训练深层模型。为了解决这些问题,我们首先构建了一个多维注意卷积神经网络(MDA-CNN),以沿输入特征图的不同维度汇总多尺度信息,并对来自不同CNN层的多个预测进行监督。其次,我们将此MDA-CNN作为基本网络分配给新颖的多尺度平均教师网络(DM $ {^2} $ t-net),用于通过利用未标记的数据并探索多尺度信息的半监督COVID-COVID-COVID-19 COVID-19肺部感染细分。我们的DM $ {^2} $ t-net鼓励来自学生和教师网络的不同CNN层的多个预测,对于计算未标记数据的多尺度一致性损失是一致的,然后将其添加到来自MDA-CNN多个预测的标记数据的监督损失中。第三,我们收集两个COVID-19分段数据集来评估我们的方法。实验结果表明,我们的网络始终优于比较的最新方法。

Automated detecting lung infections from computed tomography (CT) data plays an important role for combating COVID-19. However, there are still some challenges for developing AI system. 1) Most current COVID-19 infection segmentation methods mainly relied on 2D CT images, which lack 3D sequential constraint. 2) Existing 3D CT segmentation methods focus on single-scale representations, which do not achieve the multiple level receptive field sizes on 3D volume. 3) The emergent breaking out of COVID-19 makes it hard to annotate sufficient CT volumes for training deep model. To address these issues, we first build a multiple dimensional-attention convolutional neural network (MDA-CNN) to aggregate multi-scale information along different dimension of input feature maps and impose supervision on multiple predictions from different CNN layers. Second, we assign this MDA-CNN as a basic network into a novel dual multi-scale mean teacher network (DM${^2}$T-Net) for semi-supervised COVID-19 lung infection segmentation on CT volumes by leveraging unlabeled data and exploring the multi-scale information. Our DM${^2}$T-Net encourages multiple predictions at different CNN layers from the student and teacher networks to be consistent for computing a multi-scale consistency loss on unlabeled data, which is then added to the supervised loss on the labeled data from multiple predictions of MDA-CNN. Third, we collect two COVID-19 segmentation datasets to evaluate our method. The experimental results show that our network consistently outperforms the compared state-of-the-art methods.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源