论文标题
SAG-GAN:半监督注意力引导的gan,用于医学图像的数据增强
SAG-GAN: Semi-Supervised Attention-Guided GANs for Data Augmentation on Medical Images
论文作者
论文摘要
最近,深度学习方法,尤其是卷积神经网络(CNN),导致了计算机视觉范围的巨大突破。此外,大规模注释的数据集是成功培训程序的重要关键。但是,将此类数据集进入医疗领域是一个巨大的挑战。为此,我们提出了一种数据增强方法,用于使用周期一致性生成对抗网络(GAN)生成合成的医学图像。我们添加了半监督的注意模块,以生成具有令人信服的细节的图像。我们将肿瘤图像和正常图像视为两个域。提出的基于gan的模型可以从正常图像中产生肿瘤图像,进而可以从肿瘤图像中产生正常图像。此外,我们表明,生成的医学图像可用于改善用于医疗图像分类的RESNET18的性能。我们的模型应用于三个有限的肿瘤MRI图像数据集。我们首先在有限的数据集上生成MRI图像,然后训练了三种流行的分类模型,以获取用于肿瘤分类的最佳模型。最后,我们使用真实的图像使用经典数据增强方法和合成图像进行分类模型来训练分类模型。那些训练有素的模型之间的分类结果表明,所提出的SAG-GAN数据增强方法可以提高准确性并与经典数据增强方法进行比较。我们认为,提出的数据增强方法可以应用于其他医学图像域,并提高计算机辅助诊断的准确性。
Recently deep learning methods, in particular, convolutional neural networks (CNNs), have led to a massive breakthrough in the range of computer vision. Also, the large-scale annotated dataset is the essential key to a successful training procedure. However, it is a huge challenge to get such datasets in the medical domain. Towards this, we present a data augmentation method for generating synthetic medical images using cycle-consistency Generative Adversarial Networks (GANs). We add semi-supervised attention modules to generate images with convincing details. We treat tumor images and normal images as two domains. The proposed GANs-based model can generate a tumor image from a normal image, and in turn, it can also generate a normal image from a tumor image. Furthermore, we show that generated medical images can be used for improving the performance of ResNet18 for medical image classification. Our model is applied to three limited datasets of tumor MRI images. We first generate MRI images on limited datasets, then we trained three popular classification models to get the best model for tumor classification. Finally, we train the classification model using real images with classic data augmentation methods and classification models using synthetic images. The classification results between those trained models showed that the proposed SAG-GAN data augmentation method can boost Accuracy and AUC compare with classic data augmentation methods. We believe the proposed data augmentation method can apply to other medical image domains, and improve the accuracy of computer-assisted diagnosis.