论文标题
隐式神经表示生成细胞形状的生成建模
Implicit Neural Representations for Generative Modeling of Living Cell Shapes
论文作者
论文摘要
允许合成现实细胞形状的方法可以帮助生成训练数据集,以改善生物医学图像中的细胞跟踪和分割。细胞形状合成的深层生成模型需要对细胞形状的轻巧和柔性表示。但是,通常使用体素的表示不适合高分辨率形状合成,而多边形网格在建模拓扑变化(例如细胞生长或有丝分裂)时具有局限性。在这项工作中,我们建议使用符号距离功能(SDF)的级别集来表示细胞形状。我们将神经网络优化为3D+时域中任何点的SDF值的隐式神经表示。该模型以潜在代码为条件,从而允许合成新的和看不见的形状序列。我们在生长和分裂的秀丽隐杆线虫细胞上进行定量和质量验证方法,并具有生长的复杂丝虫突起的肺癌细胞。我们的结果表明,合成细胞的形状描述符类似于真实细胞的形状,并且我们的模型能够在3D+时间内生成复杂细胞形状的拓扑合理序列。
Methods allowing the synthesis of realistic cell shapes could help generate training data sets to improve cell tracking and segmentation in biomedical images. Deep generative models for cell shape synthesis require a light-weight and flexible representation of the cell shape. However, commonly used voxel-based representations are unsuitable for high-resolution shape synthesis, and polygon meshes have limitations when modeling topology changes such as cell growth or mitosis. In this work, we propose to use level sets of signed distance functions (SDFs) to represent cell shapes. We optimize a neural network as an implicit neural representation of the SDF value at any point in a 3D+time domain. The model is conditioned on a latent code, thus allowing the synthesis of new and unseen shape sequences. We validate our approach quantitatively and qualitatively on C. elegans cells that grow and divide, and lung cancer cells with growing complex filopodial protrusions. Our results show that shape descriptors of synthetic cells resemble those of real cells, and that our model is able to generate topologically plausible sequences of complex cell shapes in 3D+time.