Computational intelligence based secure three-party CBIR scheme for medical data for cloud-assisted healthcare applications | Multimedia Tools and Applications Skip to main content
Log in

Computational intelligence based secure three-party CBIR scheme for medical data for cloud-assisted healthcare applications

  • 1181: Multimedia-based Healthcare Systems using Computational Intelligence
  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Medical images with various modalities have become an integral part of the diagnosis and treatment of several diseases. The medical practitioners often use previous case studies to deal with the current medical condition of any particular patient. In such circumstance, they need to securely access medical images of various cases which are generally stored in a network and are vulnerable to malicious attacks. To address these sensitive inadequacies, we have proposed computational intelligence based secure healthcare Content based Image Retrieval (CBIR) for medical image retrieval scheme through which any medical practitioner can retrieve the image in an encrypted domain in cloud environment. In this regard, hamming distance-based similarity matching is the only available technique that effectively handles the comparison between encrypted features. This technique requires binary features to perform similarity matching, and the performance of such features in image retrieval is poor. In this concern, we have suggested a salient component-based binary feature extraction approach to enhance retrieval accuracy. Initially, we have re-arranged the input image using the saliency map, principal texture direction, and entropy to place the salient components at the starting blocks. Subsequently, we have employed a block-level majority voting scheme on the salient blocks of the image to obtain local binary features. As a result, the final feature vector carries more features from the salient part of the image, which propitiously improves the retrieval accuracy. Later, we have encrypted the binary feature vector and performed image retrieval on cloud environment which involve Data Owner, Database Service Provider and Client over encrypted domain to full fill the security aspect. Finally, we have used medical as well as Corel image datasets to validate the retrieval performance accuracy of the proposed scheme. The experimental results obtained from real life datasets exhibit that the proposed method is secure and provides comparable retrieval accuracy concerning other related schemes in the domain.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Ahmed KT, Ummesafi S, Iqbal A (2019) Content based image retrieval using image features information fusion. Inform Fusion 51:76–99

    Article  Google Scholar 

  2. Al Omar A, Bhuiyan MZA, Basu A, Kiyomoto S, Rahman MS (2019) Privacy-friendly platform for healthcare data in cloud based on blockchain environment. Future Gen Comput Syst 95:511–521

    Article  Google Scholar 

  3. Almazroa A, Alodhayb S, Osman E, Ramadan E, Hummadi M, Dlaim M, Alkatee M, Raahemifar K, Lakshminarayanan V (2018) Retinal fundus images for glaucoma analysis: the riga dataset. In: Medical Imaging 2018: Imaging informatics for healthcare, research, and applications, vol 10579, p 105790B. International Society for Optics and Photonics

  4. Avramović A, Marović B (2012) Performance of texture descriptors in classification of medical images with outsiders in database. In: 11th symposium on neural network applications in electrical engineering, pp 209–212. IEEE

  5. Azeez NA, Van der Vyver C (2019) Security and privacy issues in e-health cloud-based system A comprehensive content analysis. Egypt Inform J 20 (2):97–108

    Article  Google Scholar 

  6. Baluja S, Pomerleau DA (1997) Expectation-based selective attention for visual monitoring and control of a robot vehicle. Rob Auton Syst 22(3-4):329–344

    Article  MATH  Google Scholar 

  7. Cheng MM, Mitra NJ, Huang X, Torr PHS, Hu SM (2014) Global contrast based salient region detection. IEEE Trans Pattern Anal Mach Intell 37 (3):569–582

    Article  Google Scholar 

  8. Codella NCF, Gutman D, Celebi ME, Helba B, Marchetti MA, Dusza SW, Kalloo A, Liopyris K, Mishra N, Kittler H et al (2018) Skin lesion analysis toward melanoma detection: A challenge at the 2017 international symposium on biomedical imaging (isbi), hosted by the international skin imaging collaboration (isic). In: 2018 IEEE 15th international symposium on biomedical imaging (ISBI 2018), pp 168–172. IEEE

  9. Colonnese S, Biagi M, Cusani R, Scarano G (2016) Artifacts removal in nevi medical images based on moving frame domain texture analysis. In: 2016 6th European workshop on visual information processing (EUVIP), pp 1–6. IEEE

  10. Combalia M, Codella NCF, Rotemberg V, Helba B, Vilaplana V, Reiter O, Halpern AC, Puig S, Malvehy J (2019) Bcn20000: Dermoscopic lesions in the wild. arXiv:1908.02288

  11. Datta R, Joshi D, Li J, retrieval Wang JZ (2008) Image Ideas, influences, and trends of the new age. ACM Computing Surveys (Csur) 40(2):5

  12. Diaz-Pinto A, Morales S, Naranjo V, Köhler T, Mossi JM, Amparo N (2019) Cnns for automatic glaucoma assessment using fundus images: An extensive validation. Biomed Eng Online 18(1):29

    Article  Google Scholar 

  13. Dubey SR, Singh SK, Singh RK (2015) Local diagonal extrema pattern: A new and efficient feature descriptor for ct image retrieval. IEEE Signal Process Lett 22(9):1215–1219

    Article  Google Scholar 

  14. Dubey SR, Singh SK, Singh RK (2016) Multichannel decoded local binary patterns for content-based image retrieval. IEEE Trans Image Process 25 (9):4018–4032

    Article  MathSciNet  MATH  Google Scholar 

  15. Ferreira B, Rodrigues J, Leitao J, Domingos H (2017) Practical privacy-preserving content-based retrieval in cloud image repositories. IEEE Trans Cloud Comput

  16. Gupta M, Prabhakar Rao BVVSN, Rajagopalan V (2016) Brain tumor detection in conventional mr images based on statistical texture and morphological features. In: 2016 international conference on information technology (ICIT), pp 129–133. IEEE

  17. He S, Soraghan JJ, O’Reilly BF, Xing D (2009) Quantitative analysis of facial paralysis using local binary patterns in biomedical videos. IEEE Trans Biomed Eng 56(7):1864–1870

    Article  Google Scholar 

  18. Hou X, Harel J, Koch C (2011) Image signature: Highlighting sparse salient regions. IEEE Trans Pattern Anal Mach Intell 34(1):194–201

    Google Scholar 

  19. Hsu CY, Lu CS, Pei SC (2011) Homomorphic encryption-based secure sift for privacy-preserving feature extraction. In: Media Watermarking, Security, and Forensics III, vol 7880, pp 788005. International Society for Optics and Photonics

  20. Huang HK, Liss W (2004) Pacs and imaging informatics basic principles and applications. A Wiley. INC Publication

  21. Itti L, Koch C, Niebur E (1998) A model of saliency-based visual attention for rapid scene analysis. IEEE Trans Pattern Anal Mach Intell, (11). pp 1254–1259

  22. Jafari-Khouzani K, Soltanian-Zadeh H (2005) Radon transform orientation estimation for rotation invariant texture analysis. IEEE Trans Pattern Anal Mach Intell 27(6):1004–1008

    Article  Google Scholar 

  23. Kijak E, Furon T, Amsaleg L (2009) Challenging the security of cbir systems, PhD thesis. INRIA

  24. Koch C, Ullman S (1987) Shifts in selective visual attention: towards the underlying neural circuitry. In: Matters of intelligence, pp 115–141. Springer

  25. Kokare M, Biswas PK, Chatterji BN (2005) Texture image retrieval using new rotated complex wavelet filters. IEEE Trans Syst Man Cybern Part B (Cybernetics) 35(6):1168–1178

    Article  Google Scholar 

  26. Krishnan KR, Radhakrishnan S (2017) Hybrid approach to classification of focal and diffused liver disorders using ultrasound imageswith wavelets and texture features. IET Image Process 11(7):530–538

    Article  Google Scholar 

  27. Kunio D (2007) Computer-aided diagnosis in medical imaging: Historical review, current status and future potential. Comput Med Imaging Graph 31 (4-5):198–211

    Article  Google Scholar 

  28. Lehmann TM, Guld MO, Thies C, Fischer B, Keysers D, Kohnen M, Schubert H, Wein BB (2003) Content-based image retrieval in medical applications for picture archiving and communication systems. In: Medical imaging PACS and integrated medical information systems: Design and evaluation, vol 5033, pp 109–117, International society for optics and photonics, p 2003

  29. Lew MS, Sebe N, Djeraba C, Jain R (2006) Content-based multimedia information retrieval: State of the art and challenges. ACM Trans Multimed Comput Commun Appl (TOMM) 2(1):1–19

    Article  Google Scholar 

  30. Li J, Wang JZ (2003) Automatic linguistic indexing of pictures by a statistical modeling approach. IEEE Trans Pattern Anal Machine Intell 25(9):1075–1088

    Article  Google Scholar 

  31. Li X, Zhang G, Zhang X (2015) Image encryption algorithm with compound chaotic maps. J Ambient Intell Hum Comp 6(5):563–570

    Article  Google Scholar 

  32. Litjens G, Bandi P, Ehteshami Bejnordi B, Geessink O, Balkenhol M, Bult P, Halilovic A, Hermsen M, van de Loo R, Vogels R et al (2018) 1399 h&e-stained sentinel lymph node sections of breast cancer patients: the camelyon dataset. GigaScience 7(6):giy065

  33. Majhi M, Pal AK, Islam SKH, Khan MK (2020) Secure content-based image retrieval using modified euclidean distance for encrypted features. Trans Emerg Telecommun Technol e4013

  34. Masud M, Shamim Hossain M (2018) Secure data-exchange protocol in a cloud-based collaborative health care environment. Multimed Tools Appl 77(9):11121–11135

    Article  Google Scholar 

  35. Milanese R, Gil Milanese S, Pun T (1995) Attentive mechanisms for dynamic and static scene analysis. Opt Eng 34(8):2428–2434

    Article  Google Scholar 

  36. Müller H, Michoux N, Bandon D, Geissbuhler A (2004) A review of content-based image retrieval systems in medical applications–clinical benefits and future directions. Inter J Med Inform 73(1):1–23

    Article  Google Scholar 

  37. Muller H, Zhou X, Depeursinge A, Pitkanen M, Iavindrasana J, Geissbuhler A (2007) Medical visual information retrieval: State of the art and challenges ahead. In: 2007 IEEE International conference on multimedia and expo, pp 683–686. IEEE

  38. Murala S, Wu QMJ (2013) Local mesh patterns versus local binary patterns: Biomedical image indexing and retrieval. IEEE J Biomed Health Inform 18(3):929–938

    Article  Google Scholar 

  39. Nagasubramanian G, Sakthivel RK, Patan R, Gandomi AH, Sankayya M, Balusamy B (2020) Securing e-health records using keyless signature infrastructure blockchain technology in the cloud. Neural Comput Applic 32(3):639–647

    Article  Google Scholar 

  40. Ojala T, Pietikainen M, Maenpaa T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987

    Article  MATH  Google Scholar 

  41. Peng SH, Kim DH, Lee SL, Lim MK (2010) Texture feature extraction based on a uniformity estimation method for local brightness and structure in chest ct images. Comput Bio Med 40(11-12):931–942

    Article  Google Scholar 

  42. Pogorelov K, Randel KR, Griwodz C, Eskeland SL, de Lange T, Johansen D, Spampinato C, Dang-Nguyen DT, Lux M, Schmidt PT et al (2017) Kvasir: A multi-class image dataset for computer aided gastrointestinal disease detection. In: Proceedings of the 8th ACM on multimedia systems conference, pp 164–169

  43. Ponraj N, Mercy M et al (2017) Texture analysis of mammogram for the detection of breast cancer using lbp and lgp: A comparison. In: 2016 eighth international conference on advanced computing (ICoAC), pp 182–185. IEEE

  44. Qi J, Khan MK, Xiang L, Ma J, He D (2016) A privacy preserving three-factor authentication protocol for e-health clouds. J Supercomputing 72(10):3826–3849

    Article  Google Scholar 

  45. Qin J, Li H, Xiang Xuyu, Tan Y, Pan W, Ma W, Xiong NN (2019) An encrypted image retrieval method based on harris corner optimization and lsh in cloud computing. IEEE Access 7:24626–24633

    Article  Google Scholar 

  46. Quellec G, Lamard M, Cazuguel G, Cochener B, Roux C (2010) Wavelet optimization for content-based image retrieval in medical databases. Med Image Anal 14(2):227–241

    Article  MATH  Google Scholar 

  47. Ranjan R, Pal AK (2012) Encryption of image using chaotic map. In: International conference on recent trends in engineering and technology (ICRTET2012)

  48. Ren K, Wang C, Wang Q (2012) Security challenges for the public cloud. IEEE Internet Comput 16(1):69–73

    Article  Google Scholar 

  49. Rui Y, Huang TS, Chang SF (1999) Image retrieval: Current techniques, promising directions, and open issues. J Vis Commun Image Represent 10 (1):39–62

    Article  Google Scholar 

  50. Saleh HM, Younis HA (2017) Private searching on encrypted data in cloud. Inter J Comput Appl 165(7)

  51. Sayood K (2017) Introduction to data compression. Morgan Kaufmann, Burlington

    MATH  Google Scholar 

  52. Shen L, Jiang CJ, Liu GJ (2015) Satellite objects extraction and classification based on similarity measure. IEEE Trans Syst Man Cybern Syst 46 (8):1148–1154

    Article  Google Scholar 

  53. Smeulders AWM, Worring M, Santini S, Gupta A, Jain R (2000) Content-based image retrieval at the end of the early years. IEEE Trans Pattern Anal Machine Intell 22(12):1349–1380

    Article  Google Scholar 

  54. Sorensen L, Shaker SB, Bruijne MD (2010) Quantitative analysis of pulmonary emphysema using local binary patterns. IEEE Trans Med Imaging 29 (2):559–569

    Article  Google Scholar 

  55. Staal J, Abramoff MD, Niemeijer M, Viergever MA, Ginneken BV (2019) DRIVE: Digital Retinal Images for Vessel Extraction medical image dataset

  56. Sucharitha G, Senapati RK (2020) Biomedical image retrieval by using local directional edge binary patterns and zernike moments. Multimed Tools Appl 79(3):1847–1864

    Article  Google Scholar 

  57. Tagare HD, Jaffe CC, Duncan J (1997) Medical image databases: A content-based retrieval approach. J Am Med Inform Assoc 4(3):184–198

    Article  Google Scholar 

  58. Tan X, Triggs B (2010) Enhanced local texture feature sets for face recognition under difficult lighting conditions. IEEE Trans Image Process 19(6):1635–1650

    Article  MathSciNet  MATH  Google Scholar 

  59. Thomas MD (2009) Content-based image retrieval in medicine. Int J Healthcare Inform Syst Inform 4(1):1–16

    Article  Google Scholar 

  60. Tschandl P, Rosendahl C, Kittler H (2018) The ham10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions. Scientif data 5:180161

    Article  Google Scholar 

  61. Wang S, Ding C, Zhang N, Liu X, Zhou A, Cao J, Shen XS (2019) A cloud-guided feature extraction approach for image retrieval in mobile edge computing. IEEE Trans Mob Comput

  62. Wang Y, Miao M, Shen J, Wang J (2017) Towards efficient privacy-preserving encrypted image search in cloud computing. Soft Comput, pp 1–12

  63. Weng L, Amsaleg L, Furon T (2016) Privacy-preserving outsourced media search. IEEE Trans Knowl Data Eng 28(10):2738–2751

    Article  Google Scholar 

  64. Weng L, Amsaleg L, Morton A, Marchand-Maillet S (2015) A privacy-preserving framework for large-scale content-based information retrieval. IEEE Trans Inform Forens Secur 10(1):152–167

    Article  Google Scholar 

  65. Xia Z, Ma X, Shen Z, Sun X, Xiong NN, Jeon B (2018) Secure image lbp feature extraction in cloud-based smart campus. IEEE Access

  66. Xia Z, Wang X, Sun X, Wang Q (2015) A secure and dynamic multi-keyword ranked search scheme over encrypted cloud data. IEEE Trans Parallel Distrib Syst 27(2):340–352

    Article  Google Scholar 

  67. Xia Z, Xiong NN, Vasilakos AV, Sun X (2017) Epcbir: An efficient and privacy-preserving content-based image retrieval scheme in cloud computing. Inf Sci 387:195–204

    Article  Google Scholar 

  68. Xu Y, Gong J, Xiong L, Xu Z, Wang J, Shi Y (2017) A privacy-preserving content-based image retrieval method in cloud environment. J Vis Commun Image Represent 43:164–172

    Article  Google Scholar 

  69. Xu W, Xiang S, Sachnev V (2018) A cryptograph domain image retrieval method based on paillier homomorphic block encryption

  70. Xu Y, Zhao X, Gong J (2019) A large-scale secure image retrieval method in cloud environment. IEEE Access 7:160082–160090

    Article  Google Scholar 

  71. Zakeri FS, Behnam H, Ahmadinejad N (2012) Classification of benign and malignant breast masses based on shape and texture features in sonography images. J Med Syst 36(3):1621–1627

    Article  Google Scholar 

Download references

Acknowledgements

The author Ms. Mukul Majhi (Admission No: 2015DR0082) is supported by the institute Ph.D. scholarship, Indian Institute of Technology [Indian School of Mines] Dhanbad, Jharkhand, India. The author Prof. Muhammad Khurram Khan acknowledges that his work is supported by Researchers Supporting Project number (RSP-2020/12), King Saud University, Riyadh, Saudi Arabia.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to SK Hafizul Islam.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Majhi, M., Pal, A.K., Pradhan, J. et al. Computational intelligence based secure three-party CBIR scheme for medical data for cloud-assisted healthcare applications. Multimed Tools Appl 81, 41545–41577 (2022). https://doi.org/10.1007/s11042-020-10483-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-10483-7

Keywords

Navigation