Abstract
Multimodal medical datasets with incomplete observations present a barrier to large-scale neuroscience studies. Several works based on Generative Adversarial Networks (GAN) have been recently proposed to predict a set of medical images from a single modality (e.g., FLAIR MRI from T1 MRI). However, such frameworks are primarily designed to operate on images, limiting their generalizability to non-Euclidean geometric data such as brain graphs. While a growing number of connectomic studies has demonstrated the promise of including brain graphs for diagnosing neurological disorders, no geometric deep learning work was designed for multiple target brain graphs prediction from a source brain graph. Despite the momentum the field of graph generation has gained in the last two years, existing works have two critical drawbacks. First, the bulk of such works aims to learn one model for each target domain to generate from a source domain. Thus, they have a limited scalability in jointly predicting multiple target domains. Second, they merely consider the global topological scale of a graph (i.e., graph connectivity structure) and overlook the local topology at the node scale of a graph (e.g., how central a node is in the graph). To meet these challenges, we introduce MultiGraphGAN architecture, which not only predicts multiple brain graphs from a single brain graph but also preserves the topological structure of each target graph to predict. Its three core contributions lie in: (i) designing a graph adversarial auto-encoder for jointly predicting brain graphs from a single one, (ii) handling the mode collapse problem of GAN by clustering the encoded source graphs and proposing a cluster-specific decoder, (iii) introducing a topological loss to force the reconstruction of topologically sound target brain graphs. Our MultiGraphGAN significantly outperformed its variants thereby showing its great potential in multi-view brain graph generation from a single graph. Our code is available at https://github.com/basiralab/MultiGraphGAN.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Goodfellow, I., et al.: Generative adversarial nets. In: Advances in Neural Information Processing Systems, pp. 2672–2680 (2014)
Pan, Y., Liu, M., Lian, C., Xia, Y., Shen, D.: Disease-image specific generative adversarial network for brain disease diagnosis with incomplete multi-modal neuroimages. In: Shen, D., et al. (eds.) MICCAI 2019. LNCS, vol. 11766, pp. 137–145. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32248-9_16
Kofler, F., et al.: DiamondGAN: unified multi-modal generative adversarial networks for MRI sequences synthesis. In: Shen, D., et al. (eds.) MICCAI 2019. LNCS, vol. 11767, pp. 795–803. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32251-9_87
Wu, P.W., Lin, Y.J., Chang, C.H., Chang, E.Y., Liao, S.W.: Relgan: multi-domain image-to-image translation via relative attributes. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 5914–5922 (2019)
Cao, J., Mo, L., Zhang, Y., Jia, K., Shen, C., Tan, M.: Multi-marginal Wasserstein GAN. In: Advances in Neural Information Processing Systems, pp. 1774–1784 (2019)
Huang, P., et al.: CoCa-GAN: common-feature-learning-based context-aware generative adversarial network for glioma grading. In: Shen, D., et al. (eds.) MICCAI 2019. LNCS, vol. 11766, pp. 155–163. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32248-9_18
Bessadok, A., Mahjoub, M.A., Rekik, I.: Symmetric dual adversarial connectomic domain alignment for predicting isomorphic brain graph from a baseline graph. In: Shen, D., et al. (eds.) MICCAI 2019. LNCS, vol. 11767, pp. 465–474. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32251-9_51
Bessadok, A., Mahjoub, M.A., Rekik, I.: Hierarchical adversarial connectomic domain alignment for target brain graph prediction and classification from a source graph. In: Rekik, I., Adeli, E., Park, S.H. (eds.) PRIME 2019. LNCS, vol. 11843, pp. 105–114. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32281-6_11
Su, S.Y., Hajimirsadeghi, H., Mori, G.: Graph generation with variational recurrent neural network. arXiv preprint arXiv:1910.01743 (2019)
Liao, R., et al.: Efficient graph generation with graph recurrent attention networks. In: Advances in Neural Information Processing Systems, pp. 4257–4267 (2019)
Flam-Shepherd, D., Wu, T., Aspuru-Guzik, A.: Graph deconvolutional generation. arXiv preprint arXiv:2002.07087 (2020)
Bresson, X., Laurent, T.: A two-step graph convolutional decoder for molecule generation. arXiv preprint arXiv:1906.03412 (2019)
Zhang, Z., Cui, P., Zhu, W.: Deep learning on graphs: a survey. arXiv preprint arXiv:1812.04202 (2018)
Zhou, J., et al.: Graph neural networks: a review of methods and applications. arXiv preprint arXiv:1812.08434 (2018)
Fornito, A., Zalesky, A., Breakspear, M.: The connectomics of brain disorders. Nat. Rev. Neurosci. 16, 159–172 (2015)
Van den Heuvel, M.P., Sporns, O.: A cross-disorder connectome landscape of brain dysconnectivity. Nat. Rev. Neurosci. 20, 435–446 (2019)
Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907 (2016)
Wang, B., Ramazzotti, D., De Sano, L., Zhu, J., Pierson, E., Batzoglou, S.: SIMLR: a tool for large-scale single-cell analysis by multi-kernel learning. bioRxiv 118901 (2017)
Liu, J., et al.: Complex brain network analysis and its applications to brain disorders: a survey. Complexity 2017 (2017)
Joyce, K.E., Laurienti, P.J., Burdette, J.H., Hayasaka, S.: A new measure of centrality for brain networks. PloS One 5, e12200 (2010)
Freeman, L.C.: A set of measures of centrality based on betweenness. Sociometry 40, 35–41 (1977)
Beauchamp, M.A.: An improved index of centrality. Behav. Sci. 10, 161–163 (1965)
Bonacich, P.: Some unique properties of eigenvector centrality. Soc. Netw. 29, 555–564 (2007)
Mahjoub, I., Mahjoub, M.A., Rekik, I.: Brain multiplexes reveal morphological connectional biomarkers fingerprinting late brain dementia states. Sci. Rep. 8, 4103 (2018)
Ezzine, B.E., Rekik, I.: Learning-guided infinite network atlas selection for predicting longitudinal brain network evolution from a single observation. In: Shen, D., et al. (eds.) MICCAI 2019. LNCS, vol. 11765, pp. 796–805. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32245-8_88
Ghribi, O., Li, G., Lin, W., Shen, D., Rekik, I.: Progressive infant brain connectivity evolution prediction from neonatal MRI using bidirectionally supervised sample selection. In: Rekik, I., Adeli, E., Park, S.H. (eds.) PRIME 2019. LNCS, vol. 11843, pp. 63–72. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32281-6_7
Vohryzek, J., et al.: Dynamic spatiotemporal patterns of brain connectivity reorganize across development. Netw. Neurosci. 4, 115–133 (2020)
Acknowledgement
This project has been funded by the 2232 International Fellowship for Outstanding Researchers Program of TUBITAK (Project No: 118C288, http://basira-lab.com/reprime/) supporting I. Rekik. However, all scientific contributions made in this project are owned and approved solely by the authors.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Bessadok, A., Mahjoub, M.A., Rekik, I. (2020). Topology-Aware Generative Adversarial Network for Joint Prediction of Multiple Brain Graphs from a Single Brain Graph. In: Martel, A.L., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2020. MICCAI 2020. Lecture Notes in Computer Science(), vol 12267. Springer, Cham. https://doi.org/10.1007/978-3-030-59728-3_54
Download citation
DOI: https://doi.org/10.1007/978-3-030-59728-3_54
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-59727-6
Online ISBN: 978-3-030-59728-3
eBook Packages: Computer ScienceComputer Science (R0)
