Improving pulmonary CT image generation with transformer-based generative adversarial networks

Yueying Tian; Xudong Han; Elif Ucurum; Chris Chatwin; Phil Birch; Rupert Young

doi:10.1117/12.3017971

7 June 2024 Improving pulmonary CT image generation with transformer-based generative adversarial networks

Yueying Tian, Xudong Han, Elif Ucurum, Chris Chatwin, Phil Birch, Rupert Young

Proceedings Volume 13040, Pattern Recognition and Prediction XXXV; 1304002 (2024) https://doi.org/10.1117/12.3017971
Event: SPIE Defense + Commercial Sensing, 2024, National Harbor, Maryland, United States

Abstract

Computed Tomography (CT) imaging serves as a crucial component in modern medical diagnostics by providing important information about internal structures of human bodies. Unfortunately, CT often faces the problem of data scarcity, due to radiation exposure, the need for skilled professionals and data privacy concerns. Therefore, generative models, such as Generative Adversarial Networks (GANs), have been widely applied to generating synthetic CT images, largely changing various aspects of medical image generation and analysis. However, directly applying GANs to CT image generation remains challenging. In particular, several representative GAN-based models, including Deep Convolutional GANs (DCGAN) and bigGANs, cannot directly generate large 3D volumes of CT scans. One important reason is that the consistency and dependency between CT scans are not appropriately handled by those GAN-based models. To model 3D CT scans, large volumes of CT images are treated in similar terms to time series. However, GAN models built up on Recurrent Neural Networks (RNNs) are not able to characterize long sequences of data due to training difficulties. In this paper, we propose Transformer-based GAN models to capture long sequences of CT scans. We conduct experiments on the LUNA16 pulmonary CT image dataset to verify the proposed methods. The empirical results demonstrate that the proposed models are able to successfully generate large CT volumes with hundreds of CT slices.

Conference Presentation

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Yueying Tian, Xudong Han, Elif Ucurum, Chris Chatwin, Phil Birch, and Rupert Young "Improving pulmonary CT image generation with transformer-based generative adversarial networks", Proc. SPIE 13040, Pattern Recognition and Prediction XXXV, 1304002 (7 June 2024); https://doi.org/10.1117/12.3017971

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available