论文标题
Cyclegan超声向伪解剖学显示的图像翻译
Image translation of Ultrasound to Pseudo Anatomical Display by CycleGAN
论文作者
论文摘要
超声是医学成像中第二大大量的模式。它具有成本效益,无害,便携式和在许多临床程序中常规实施。尽管如此,图像质量的特征是外观磨碎,SNR和斑点噪声差。特定于恶性肿瘤,边缘模糊且模糊。因此,非常需要改善超声图像质量。我们假设使用神经网络可以通过转化为更现实的显示,该显示模仿了整个组织的解剖学切割,可以实现这一点。为了实现此目标,最好的方法是使用一组配对的图像。但是,在我们的情况下,这实际上是不可能的。因此,使用循环生成的对抗网络(Cyclegan),以分别学习每个域特性并执行跨域循环一致性。用于训练的两个数据集该模型是“乳房超声图像”(BUSI)和在我们实验室获得的家禽乳腺组织样品的一组光学图像。生成的伪解剖图像可改善对病变的视觉歧视,并具有更清晰的边界定义和明显的对比度。为了评估解剖特征的保存,超声图像中的病变和生成的伪解剖图像均自动分割并进行比较。这种比较得出的良性肿瘤的中位骰子得分为0.91,恶性肿瘤的骰子得分为0.70。良性和恶性肿瘤的中位病变中心误差分别为0.58%和3.27%,良性和恶性肿瘤的中位面积误差指数分别为0.40%和4.34%。总之,这些产生的伪解剖图像以更直观的方式呈现,可以增强组织解剖结构,并有可能简化诊断并改善临床结果。
Ultrasound is the second most used modality in medical imaging. It is cost effective, hazardless, portable and implemented routinely in numerous clinical procedures. Nonetheless, image quality is characterized by granulated appearance, poor SNR and speckle noise. Specific for malignant tumors, the margins are blurred and indistinct. Thus, there is a great need for improving ultrasound image quality. We hypothesize that this can be achieved, using neural networks, by translation into a more realistic display which mimics an anatomical cut through the tissue. In order to achieve this goal, the preferable approach would be to use a set of paired images. However, this is practically impossible in our case. Therefore, Cycle Generative Adversarial Network (CycleGAN) was used, in order to learn each domain properties separately and enforce cross domain cycle consistency. The two datasets which were used for training the model were "Breast Ultrasound Images" (BUSI) and a set of optic images of poultry breast tissue samples acquired at our lab. The generated pseudo anatomical images provide improved visual discrimination of the lesions with clearer border definition and pronounced contrast. In order to evaluate the preservation of the anatomical features, the lesions in the ultrasonic images and the generated pseudo anatomical images were both automatically segmented and compared. This comparison yielded median dice score of 0.91 for the benign tumors and 0.70 for the malignant ones. The median lesion center error was 0.58% and 3.27% for the benign and malignancies respectively and the median area error index was 0.40% and 4.34% for the benign and malignancies respectively. In conclusion, these generated pseudo anatomical images, which are presented in a more intuitive way, enhance tissue anatomy and can potentially simplify the diagnosis and improve the clinical outcome.