Content-based image retrieval system for HRCT lung images: assisting radiologists in self-learning and diagnosis of Interstitial Lung Diseases | Multimedia Tools and Applications Skip to main content

Advertisement

Springer Nature Link
Log in

Content-based image retrieval system for HRCT lung images: assisting radiologists in self-learning and diagnosis of Interstitial Lung Diseases

  • 1104: Content-Based Multimedia Indexing (CBMI 2018)
  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Content-based Image Retrieval (CBIR) is a technique that can exploit the wealth of the data stored in a repository and help radiologists in decision making by providing references to the image in hand. A CBIR system for High-Resolution Computed Tomography (HRCT) lung images depicting signs of Interstitial Lung Diseases (ILDs) can be built and used as a self-learning tool for budding radiologists. The study of a few lung image retrieval systems available in the literature identifies some important issues that need to be taken care of. In most of the works, the creation of the reference database involves painstaking manual activity, which is time-consuming and needs skilled labor. A lot of human interventions are required, particularly for the proper delineation of the region of interest (ROI) that represents pathology in each of the images in a database. In most cases, the size of the ROIs representing different disease findings are fixed (i.e., either a fixed size square or circle), which at times may not be a proper representation of the disease pattern and as a consequence, it might limit the system’s performance. Until date, a few learning-based approaches have been developed for content-based image retrieval of HRCT lung images, which either learn the similarity using a classifier or get trained through relevance feedback. For medical image analysis, the availability of labelled data for learning makes these learning-based retrieval systems meaningful as it enhances their performance in contrast to their simple distance-based counterpart. The objective of this paper is to develop a CBIR system for ILDs that is reliable and needs minimal human intervention. The paper evaluates the performance of three popular segmentation algorithms. It identifies the best for the effective and automated delineation of an arbitrary region of interest (AROI) depicting the sign of ILDs on HRCT images of the thorax in contrast to the manual delineation of fixed size ROI. This minimizes the manual effort for the creation and maintenance of the reference database, as well as the manual delineation of AROI during query formation. Moreover, AROI created through the automated clustering is found to have a better representation of disease patterns. Three recently proposed general-purpose learning based CBIR techniques are implemented and tested for retrieval of HRCT lung images depicting the sign of ILDs. The best method is suggested after careful evaluation of all the competing techniques.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19

Similar content being viewed by others

References

  1. Anthimopoulos M, Christodoulidis S, Christe A, Mougiakakou S (2014) Classification of interstitial lung disease patterns using local dct features and random forest. In: 2014 36th annual international conference of the ieee engineering in medicine and biology society. IEEE, pp 6040–6043

  2. Aziz ZA, Wells AU, Hansell DM, Bain GA, Copley SJ, Desai SR, Ellis SM, Gleeson FV, Grubnic S, Nicholson AG, et al. (2004) Hrct diagnosis of diffuse parenchymal lung disease: inter-observer variation. Thorax 59 (6):506–511

    Article  Google Scholar 

  3. Chen J-Y, Bouman CA, Dalton JC (1998) Similarity pyramids for browsing and organization of large image databases. Photonics West’98 Electronic Imaging, pp 563–575

  4. Comaniciu D, Meer P (2002) Mean shift: a robust approach toward feature space analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 24(5):603–619

    Article  Google Scholar 

  5. Dash JK, Mukhopadhyay S, Prabhakar N, Garg M, Khandelwal N (2013) Content-based image retrieval for interstitial lung diseases using classification confidence. In: SPIE medical imaging. International Society for Optics and Photonics, pp 86702Y–86702Y

  6. Dash JK, Mukhopadhyay S, Garg MK, Prabhakar N, Khandelwal N (2014) Multi-classifier framework for lung tissue classification. In: Students’ technology symposium (TechSym), 2014 IEEE. IEEE, pp 264–269

  7. Dash JK, Mukhopadhyay S, Gupta RD (2015) Content-based image retrieval using fuzzy class membership and rules based on classifier confidence. IET Image Process 9(9):836–848

    Article  Google Scholar 

  8. Dash JK, Mukhopadhyay S (2018) Similarity learning for texture image retrieval using multiple classifier system. Multimedia Tools and Applications 77 (1):459–483

    Article  Google Scholar 

  9. Depeursinge A, Racoceanu D, Iavindrasana J, Cohen G, Platon A, Poletti P-A, Müller H (2010) Fusing visual and clinical information for lung tissue classification in high-resolution computed tomography. Artif Intell Med 50(1):13–21

    Article  Google Scholar 

  10. Depeursinge A, Vargas A, Platon A, Geissbuhler A, Poletti P-A, Müller H (2010) 3d case–based retrieval for interstitial lung diseases. In: Medical content-based retrieval for clinical decision support. Springer, pp 39–48

  11. Depeursinge A, Vargas A, Gaillard F, Platon A, Geissbuhler A, Poletti P-A, Müller H (2012) Case-based lung image categorization and retrieval for interstitial lung diseases: clinical workflows. Int J CARS 7(1):97–110

    Article  Google Scholar 

  12. Depeursinge A, Vargas A, Platon A, Geissbuhler A, Poletti P-A, Müller H (2012) Building a reference multimedia database for interstitial lung diseases. Comput Med Imaging Graph 36(3):227–238

    Article  Google Scholar 

  13. Dy JG, Brodley CE, Kak A, Broderick LS, Aisen AM (2003) Unsupervised feature selection applied to content-based retrieval of lung images. IEEE Transactions on Pattern Analysis and Machine Intelligence 25(3):373–378

    Article  Google Scholar 

  14. Farnoosh R, Zarpak B (2008) Image segmentation using gaussian mixture model. IUST International Journal of Engineering Science 19(1):29–32

    MATH  Google Scholar 

  15. Fu Z, Wang L (2012) Color image segmentation using gaussian mixture model and em algorithm. In: Multimedia and signal processing. Springer, pp 61–66

  16. Gangeh MJ, Sørensen L, Shaker SB, Kamel MS, De Bruijne M, Loog M (2010) A texton-based approach for the classification of lung parenchyma in ct images. Springer, pp 595–602

  17. Georgescu B, Christoudias CM (2003) The edge detection and image segmentation (edison) system. Robust Image Understanding Laboratory, Rutgers University. Code available at http://web.archive.org/web/20060617020918/www.caip.rutgers.edu/riul/research/code/EDISON/index.html

  18. Guo G, Li SZ, Chan KL (2000) Learning similarity for texture image retrieval. Computer Vision-ECCV 2000:178–190

    Google Scholar 

  19. Gupta RD (2018) Rotation and shape invariant texture feature extraction for content based image retrieval. PhD thesis, Indian Institute of Technology Kharagpur

  20. Han J, Ma K-K (2007) Rotation-invariant and scale-invariant gabor features for texture image retrieval. Image Vis Comput 25(9):1474–1481

    Article  Google Scholar 

  21. Huang K-W, Zhao Z-Y, Gong Q, Zha J, Chen L, Yang R (2015) Nasopharyngeal carcinoma segmentation via hmrf-em with maximum entropy. In: 2015 37th annual international conference of the IEEE engineering in medicine and biology society (EMBC). IEEE, pp 2968–2972

  22. Jain AK, Duin RPW, Mao J (2000) Statistical pattern recognition: a review. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(1):4–37

    Article  Google Scholar 

  23. Kim KG, Goo JM, Kim JH, Lee HJ, Min BG, Bae KT, Im J-G (2005) Computer-aided diagnosis of localized ground-glass opacity in the lung at ct: Initial experience 1. Radiology 237(2):657–661

    Article  Google Scholar 

  24. King TE Jr. (2005) Clinical advances in the diagnosis and therapy of the interstitial lung diseases. Am J Respir Crit Care Med 172(3):268–279

    Article  Google Scholar 

  25. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems, pp 1097–1105

  26. Leader JK, Warfel TE, Fuhrman CR, Golla SK, Weissfeld JL, Avila RS, Turner WD, Zheng B (2005) Pulmonary nodule detection with low-dose ct of the lung: agreement among radiologists. Am J Roentgenol 185(4):973–978

    Article  Google Scholar 

  27. Liu C-T, Tai P-L, Chen AY-J, Peng C-H, Lee T, Wang J-S, et al. (2001) A content-based ct lung image retrieval system for assisting differential diagnosis images collection. In: 2001 IEEE international conference on multimedia and expo (ICME 01)

  28. Liu Y, Zhou X, Ma W-Y (2004) Extracting texture features from arbitrary-shaped regions for image retrieval. In: 2004 IEEE international conference on multimedia and expo, 2004. ICME’04, vol 3, pp 1891–1894. IEEE

  29. Lu J, Chen J, Zhang J, Zou L (2011) Medical image segmentation using mean shift algorithm and general edge detection. IFAC Proceedings Volumes 44(1):9656–9661

    Article  Google Scholar 

  30. Ma W-Y, Manjunath BS (1996) Texture features and learning similarity. In: 1996 IEEE computer society conference on Computer vision and pattern recognition, 1996. Proceedings CVPR’96. IEEE, pp 425–430

  31. MacArthur SD, Brodley CE, Kak AC, Broderick LS (2002) Interactive content-based image retrieval using relevance feedback. Comput Vis Image Underst 88(2):55–75

    Article  Google Scholar 

  32. Meena Prakash R, Bhuvaneshwari K, Divya M, Jamuna Sri K, Sulaiha Begum A (2017) Segmentation of thermal infrared breast images using k-means, fcm and em algorithms for breast cancer detection. In: 2017 International conference on innovations in information, embedded and communication systems (ICIIECS). IEEE, pp 1–4

  33. Minka TP, Picard RW (1997) Interactive learning with a society of models. Pattern Recogn 30(4):565–581

    Article  Google Scholar 

  34. Mukhopadhyay S, Dash JK, Gupta RD (2013) Content-based texture image retrieval using fuzzy class membership. Pattern Recogn Lett 34(6):646–654

    Article  Google Scholar 

  35. Park SC, Tan J, Wang X, Lederman D, Leader JK, Kim SH, Zheng B (2011) Computer-aided detection of early interstitial lung diseases using low-dose ct images. Phys Med Biol 56(4):1139

    Article  Google Scholar 

  36. Prasad M, Sowmya A (2008) Multi-level classification of emphysema in hrct lung images using delegated classifiers. In: Medical image computing and computer-assisted intervention–MICCAI 2008. Springer, pp 59–66

  37. Ragothaman S, Narasimhan S, Basavaraj MG, Dewar R (2016) Unsupervised segmentation of cervical cell images using gaussian mixture model. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 70–75

  38. Raj R, Khanna Nehemiah H, Shiloah Elizabeth D, Kannan A (2018) A novel feature-significance based k-nearest neighbour classification approach for computer aided diagnosis of lung disorders. Current Medical Imaging Reviews 14 (2):289–300

    Article  Google Scholar 

  39. Rui Y, Huang TS, Chang S-F (1999) Image retrieval: current techniques, promising directions, and open issues. J Vis Commun Image Represent 10 (1):39–62

    Article  Google Scholar 

  40. Santini S, Jain R (1999) Similarity measures. IEEE Transactions on Pattern Analysis and Machine Intelligence 21(9):871–883

    Article  Google Scholar 

  41. Shyu C-R, Brodley CE, Kak AC, Kosaka A, Aisen AM, Broderick LS (1999) Assert: a physician-in-the-loop content-based retrieval system for hrct image databases. Comput Vis Image Underst 75(1):111–132

    Article  Google Scholar 

  42. Shyu C-R, Pavlopoulou C, Kak AC, Brodley CE, Broderick LS (2002) Using human perceptual categories for content-based retrieval from a medical image database. Comput Vis Image Underst 88(3):119–151

    Article  Google Scholar 

  43. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556

  44. Sorensen L, Shaker SB, Bruijne MD (2010) Quantitative analysis of pulmonary emphysema using local binary patterns. IEEE Trans Med Imaging 29 (2):559–569

    Article  Google Scholar 

  45. Sorensen L, Shaker SB, De Bruijne M (2010) Quantitative analysis of pulmonary emphysema using local binary patterns. IEEE Transactions on Medical Imaging 29(2):559–569

    Article  Google Scholar 

  46. Sørensen L, Shaker SB, De Bruijne M (2008) Texture classification in lung ct using local binary patterns. In: Medical image computing and computer-assisted intervention–MICCAI 2008. Springer, pp 934–941

  47. Vo K.T, Sowmya A (2009) Directional multi-scale modeling of high-resolution computed tomography (hrct) lung images for diffuse lung disease classification. In: Computer analysis of images and patterns. Springer, pp 663–671

  48. Vo KT, Sowmya A (2010) Multiple kernel learning for classification of diffuse lung disease using hrct lung images. In: 2010 annual international conference of the IEEE engineering in medicine and biology society (EMBC). IEEE, pp 3085–3088

  49. Wang Q (2012) Hmrf-em-image: implementation of the hidden markov random field model and its expectation-maximization algorithm. arXiv:1207.3510

  50. Webb WR, Müller NL, Naidich DP, et al. (2001) High-resolution CT of the lung, vol 1 Lippincott Williams & Wilkins Philadelphia

Download references

Author information

Authors and Affiliations

  1. SRM University-AP, Amaravati, Andhra Pradesh, 522503, India

    Jatindra Kumar Dash

  2. Indian Institute of Technology Kharagpur, West Bengal, 721302, India

    Sudipta Mukhopadhyay & Rahul Dash Gupta

  3. Post Graduate Institute of Medical Education and Research, Chandigarh, 160012, India

    Niranjan Khandelwal

Authors
  1. Jatindra Kumar Dash
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sudipta Mukhopadhyay
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Rahul Dash Gupta
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Niranjan Khandelwal
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jatindra Kumar Dash.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dash, J.K., Mukhopadhyay, S., Gupta, R.D. et al. Content-based image retrieval system for HRCT lung images: assisting radiologists in self-learning and diagnosis of Interstitial Lung Diseases. Multimed Tools Appl 80, 22589–22618 (2021). https://doi.org/10.1007/s11042-020-10173-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-10173-4

Keywords

Search

Navigation