We propose a cross-modality method that translates polarimetric images into bright-field. In the lung tissue histological analysis, immunohistochemical (IHC) staining of tissues is widely used to specify particular cellular events especially in precision medicine. In this work, we measured hematoxylin and eosin (HE) stained slices by Mueller matrix (MM) microscopy and then fed polarimetric data into a well-designed generative adversarial network (GAN). The network can generate images that are equivalent to the IHC stained from bright-field microscopy. This will assist pathologists with the real IHC staining procedure and pathological diagnosis. Instead of preparing specimens from scratch, we collected already existing specimens, i.e., the adjacent HE and IHC stained slices from the same tissue volume. We adopted the CycleGAN to learn the translation between unaligned images from two domains. We used a U-Net based generator and a PixelGAN based discriminator in the model. The efficacy of this method was demonstrated on smooth muscle actin (SMA) staining in lung tissue. The results are evaluated by three image quality assessment methods by comparing the generated and real staining images.
|