Multi-Instance Deep Learning: Discover Discriminative Local Anatomies for Bodypart Recognition
- PMID: 26863652
- DOI: 10.1109/TMI.2016.2524985
Multi-Instance Deep Learning: Discover Discriminative Local Anatomies for Bodypart Recognition
Abstract
In general image recognition problems, discriminative information often lies in local image patches. For example, most human identity information exists in the image patches containing human faces. The same situation stays in medical images as well. "Bodypart identity" of a transversal slice-which bodypart the slice comes from-is often indicated by local image information, e.g., a cardiac slice and an aorta arch slice are only differentiated by the mediastinum region. In this work, we design a multi-stage deep learning framework for image classification and apply it on bodypart recognition. Specifically, the proposed framework aims at: 1) discover the local regions that are discriminative and non-informative to the image classification problem, and 2) learn a image-level classifier based on these local regions. We achieve these two tasks by the two stages of learning scheme, respectively. In the pre-train stage, a convolutional neural network (CNN) is learned in a multi-instance learning fashion to extract the most discriminative and and non-informative local patches from the training slices. In the boosting stage, the pre-learned CNN is further boosted by these local patches for image classification. The CNN learned by exploiting the discriminative local appearances becomes more accurate than those learned from global image context. The key hallmark of our method is that it automatically discovers the discriminative and non-informative local patches through multi-instance deep learning. Thus, no manual annotation is required. Our method is validated on a synthetic dataset and a large scale CT dataset. It achieves better performances than state-of-the-art approaches, including the standard deep CNN.
Similar articles
-
Bodypart Recognition Using Multi-stage Deep Learning.Inf Process Med Imaging. 2015;24:449-61. doi: 10.1007/978-3-319-19992-4_35. Inf Process Med Imaging. 2015. PMID: 26221694
-
Segmentation of lung parenchyma in CT images using CNN trained with the clustering algorithm generated dataset.Biomed Eng Online. 2019 Jan 3;18(1):2. doi: 10.1186/s12938-018-0619-9. Biomed Eng Online. 2019. PMID: 30602393 Free PMC article.
-
A novel end-to-end classifier using domain transferred deep convolutional neural networks for biomedical images.Comput Methods Programs Biomed. 2017 Mar;140:283-293. doi: 10.1016/j.cmpb.2016.12.019. Epub 2017 Jan 6. Comput Methods Programs Biomed. 2017. PMID: 28254085
-
Deep Learning Technique for Musculoskeletal Analysis.Adv Exp Med Biol. 2020;1213:165-176. doi: 10.1007/978-3-030-33128-3_11. Adv Exp Med Biol. 2020. PMID: 32030670 Review.
-
Multiple-Instance Learning for Medical Image and Video Analysis.IEEE Rev Biomed Eng. 2017;10:213-234. doi: 10.1109/RBME.2017.2651164. Epub 2017 Jan 10. IEEE Rev Biomed Eng. 2017. PMID: 28092576 Review.
Cited by
-
Predicting the effort required to manually mend auto-segmentations.medRxiv [Preprint]. 2024 Jun 13:2024.06.12.24308779. doi: 10.1101/2024.06.12.24308779. medRxiv. 2024. PMID: 38947045 Free PMC article. Preprint.
-
Automatic intracranial abnormality detection and localization in head CT scans by learning from free-text reports.Cell Rep Med. 2023 Sep 19;4(9):101164. doi: 10.1016/j.xcrm.2023.101164. Epub 2023 Aug 21. Cell Rep Med. 2023. PMID: 37652014 Free PMC article.
-
A Comprehensive Review on Machine Learning in Healthcare Industry: Classification, Restrictions, Opportunities and Challenges.Sensors (Basel). 2023 Apr 22;23(9):4178. doi: 10.3390/s23094178. Sensors (Basel). 2023. PMID: 37177382 Free PMC article. Review.
-
Deep learning-assisted diagnosis of chronic atrophic gastritis in endoscopy.Front Oncol. 2023 Mar 6;13:1122247. doi: 10.3389/fonc.2023.1122247. eCollection 2023. Front Oncol. 2023. PMID: 36950553 Free PMC article.
-
Deep Learning Body Region Classification of MRI and CT Examinations.J Digit Imaging. 2023 Aug;36(4):1291-1301. doi: 10.1007/s10278-022-00767-9. Epub 2023 Mar 9. J Digit Imaging. 2023. PMID: 36894697 Free PMC article.
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources
Medical