Abstract
Medical images with various modalities have become an integral part of the diagnosis and treatment of several diseases. The medical practitioners often use previous case studies to deal with the current medical condition of any particular patient. In such circumstance, they need to securely access medical images of various cases which are generally stored in a network and are vulnerable to malicious attacks. To address these sensitive inadequacies, we have proposed computational intelligence based secure healthcare Content based Image Retrieval (CBIR) for medical image retrieval scheme through which any medical practitioner can retrieve the image in an encrypted domain in cloud environment. In this regard, hamming distance-based similarity matching is the only available technique that effectively handles the comparison between encrypted features. This technique requires binary features to perform similarity matching, and the performance of such features in image retrieval is poor. In this concern, we have suggested a salient component-based binary feature extraction approach to enhance retrieval accuracy. Initially, we have re-arranged the input image using the saliency map, principal texture direction, and entropy to place the salient components at the starting blocks. Subsequently, we have employed a block-level majority voting scheme on the salient blocks of the image to obtain local binary features. As a result, the final feature vector carries more features from the salient part of the image, which propitiously improves the retrieval accuracy. Later, we have encrypted the binary feature vector and performed image retrieval on cloud environment which involve Data Owner, Database Service Provider and Client over encrypted domain to full fill the security aspect. Finally, we have used medical as well as Corel image datasets to validate the retrieval performance accuracy of the proposed scheme. The experimental results obtained from real life datasets exhibit that the proposed method is secure and provides comparable retrieval accuracy concerning other related schemes in the domain.
Similar content being viewed by others
References
Ahmed KT, Ummesafi S, Iqbal A (2019) Content based image retrieval using image features information fusion. Inform Fusion 51:76–99
Al Omar A, Bhuiyan MZA, Basu A, Kiyomoto S, Rahman MS (2019) Privacy-friendly platform for healthcare data in cloud based on blockchain environment. Future Gen Comput Syst 95:511–521
Almazroa A, Alodhayb S, Osman E, Ramadan E, Hummadi M, Dlaim M, Alkatee M, Raahemifar K, Lakshminarayanan V (2018) Retinal fundus images for glaucoma analysis: the riga dataset. In: Medical Imaging 2018: Imaging informatics for healthcare, research, and applications, vol 10579, p 105790B. International Society for Optics and Photonics
Avramović A, Marović B (2012) Performance of texture descriptors in classification of medical images with outsiders in database. In: 11th symposium on neural network applications in electrical engineering, pp 209–212. IEEE
Azeez NA, Van der Vyver C (2019) Security and privacy issues in e-health cloud-based system A comprehensive content analysis. Egypt Inform J 20 (2):97–108
Baluja S, Pomerleau DA (1997) Expectation-based selective attention for visual monitoring and control of a robot vehicle. Rob Auton Syst 22(3-4):329–344
Cheng MM, Mitra NJ, Huang X, Torr PHS, Hu SM (2014) Global contrast based salient region detection. IEEE Trans Pattern Anal Mach Intell 37 (3):569–582
Codella NCF, Gutman D, Celebi ME, Helba B, Marchetti MA, Dusza SW, Kalloo A, Liopyris K, Mishra N, Kittler H et al (2018) Skin lesion analysis toward melanoma detection: A challenge at the 2017 international symposium on biomedical imaging (isbi), hosted by the international skin imaging collaboration (isic). In: 2018 IEEE 15th international symposium on biomedical imaging (ISBI 2018), pp 168–172. IEEE
Colonnese S, Biagi M, Cusani R, Scarano G (2016) Artifacts removal in nevi medical images based on moving frame domain texture analysis. In: 2016 6th European workshop on visual information processing (EUVIP), pp 1–6. IEEE
Combalia M, Codella NCF, Rotemberg V, Helba B, Vilaplana V, Reiter O, Halpern AC, Puig S, Malvehy J (2019) Bcn20000: Dermoscopic lesions in the wild. arXiv:1908.02288
Datta R, Joshi D, Li J, retrieval Wang JZ (2008) Image Ideas, influences, and trends of the new age. ACM Computing Surveys (Csur) 40(2):5
Diaz-Pinto A, Morales S, Naranjo V, Köhler T, Mossi JM, Amparo N (2019) Cnns for automatic glaucoma assessment using fundus images: An extensive validation. Biomed Eng Online 18(1):29
Dubey SR, Singh SK, Singh RK (2015) Local diagonal extrema pattern: A new and efficient feature descriptor for ct image retrieval. IEEE Signal Process Lett 22(9):1215–1219
Dubey SR, Singh SK, Singh RK (2016) Multichannel decoded local binary patterns for content-based image retrieval. IEEE Trans Image Process 25 (9):4018–4032
Ferreira B, Rodrigues J, Leitao J, Domingos H (2017) Practical privacy-preserving content-based retrieval in cloud image repositories. IEEE Trans Cloud Comput
Gupta M, Prabhakar Rao BVVSN, Rajagopalan V (2016) Brain tumor detection in conventional mr images based on statistical texture and morphological features. In: 2016 international conference on information technology (ICIT), pp 129–133. IEEE
He S, Soraghan JJ, O’Reilly BF, Xing D (2009) Quantitative analysis of facial paralysis using local binary patterns in biomedical videos. IEEE Trans Biomed Eng 56(7):1864–1870
Hou X, Harel J, Koch C (2011) Image signature: Highlighting sparse salient regions. IEEE Trans Pattern Anal Mach Intell 34(1):194–201
Hsu CY, Lu CS, Pei SC (2011) Homomorphic encryption-based secure sift for privacy-preserving feature extraction. In: Media Watermarking, Security, and Forensics III, vol 7880, pp 788005. International Society for Optics and Photonics
Huang HK, Liss W (2004) Pacs and imaging informatics basic principles and applications. A Wiley. INC Publication
Itti L, Koch C, Niebur E (1998) A model of saliency-based visual attention for rapid scene analysis. IEEE Trans Pattern Anal Mach Intell, (11). pp 1254–1259
Jafari-Khouzani K, Soltanian-Zadeh H (2005) Radon transform orientation estimation for rotation invariant texture analysis. IEEE Trans Pattern Anal Mach Intell 27(6):1004–1008
Kijak E, Furon T, Amsaleg L (2009) Challenging the security of cbir systems, PhD thesis. INRIA
Koch C, Ullman S (1987) Shifts in selective visual attention: towards the underlying neural circuitry. In: Matters of intelligence, pp 115–141. Springer
Kokare M, Biswas PK, Chatterji BN (2005) Texture image retrieval using new rotated complex wavelet filters. IEEE Trans Syst Man Cybern Part B (Cybernetics) 35(6):1168–1178
Krishnan KR, Radhakrishnan S (2017) Hybrid approach to classification of focal and diffused liver disorders using ultrasound imageswith wavelets and texture features. IET Image Process 11(7):530–538
Kunio D (2007) Computer-aided diagnosis in medical imaging: Historical review, current status and future potential. Comput Med Imaging Graph 31 (4-5):198–211
Lehmann TM, Guld MO, Thies C, Fischer B, Keysers D, Kohnen M, Schubert H, Wein BB (2003) Content-based image retrieval in medical applications for picture archiving and communication systems. In: Medical imaging PACS and integrated medical information systems: Design and evaluation, vol 5033, pp 109–117, International society for optics and photonics, p 2003
Lew MS, Sebe N, Djeraba C, Jain R (2006) Content-based multimedia information retrieval: State of the art and challenges. ACM Trans Multimed Comput Commun Appl (TOMM) 2(1):1–19
Li J, Wang JZ (2003) Automatic linguistic indexing of pictures by a statistical modeling approach. IEEE Trans Pattern Anal Machine Intell 25(9):1075–1088
Li X, Zhang G, Zhang X (2015) Image encryption algorithm with compound chaotic maps. J Ambient Intell Hum Comp 6(5):563–570
Litjens G, Bandi P, Ehteshami Bejnordi B, Geessink O, Balkenhol M, Bult P, Halilovic A, Hermsen M, van de Loo R, Vogels R et al (2018) 1399 h&e-stained sentinel lymph node sections of breast cancer patients: the camelyon dataset. GigaScience 7(6):giy065
Majhi M, Pal AK, Islam SKH, Khan MK (2020) Secure content-based image retrieval using modified euclidean distance for encrypted features. Trans Emerg Telecommun Technol e4013
Masud M, Shamim Hossain M (2018) Secure data-exchange protocol in a cloud-based collaborative health care environment. Multimed Tools Appl 77(9):11121–11135
Milanese R, Gil Milanese S, Pun T (1995) Attentive mechanisms for dynamic and static scene analysis. Opt Eng 34(8):2428–2434
Müller H, Michoux N, Bandon D, Geissbuhler A (2004) A review of content-based image retrieval systems in medical applications–clinical benefits and future directions. Inter J Med Inform 73(1):1–23
Muller H, Zhou X, Depeursinge A, Pitkanen M, Iavindrasana J, Geissbuhler A (2007) Medical visual information retrieval: State of the art and challenges ahead. In: 2007 IEEE International conference on multimedia and expo, pp 683–686. IEEE
Murala S, Wu QMJ (2013) Local mesh patterns versus local binary patterns: Biomedical image indexing and retrieval. IEEE J Biomed Health Inform 18(3):929–938
Nagasubramanian G, Sakthivel RK, Patan R, Gandomi AH, Sankayya M, Balusamy B (2020) Securing e-health records using keyless signature infrastructure blockchain technology in the cloud. Neural Comput Applic 32(3):639–647
Ojala T, Pietikainen M, Maenpaa T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987
Peng SH, Kim DH, Lee SL, Lim MK (2010) Texture feature extraction based on a uniformity estimation method for local brightness and structure in chest ct images. Comput Bio Med 40(11-12):931–942
Pogorelov K, Randel KR, Griwodz C, Eskeland SL, de Lange T, Johansen D, Spampinato C, Dang-Nguyen DT, Lux M, Schmidt PT et al (2017) Kvasir: A multi-class image dataset for computer aided gastrointestinal disease detection. In: Proceedings of the 8th ACM on multimedia systems conference, pp 164–169
Ponraj N, Mercy M et al (2017) Texture analysis of mammogram for the detection of breast cancer using lbp and lgp: A comparison. In: 2016 eighth international conference on advanced computing (ICoAC), pp 182–185. IEEE
Qi J, Khan MK, Xiang L, Ma J, He D (2016) A privacy preserving three-factor authentication protocol for e-health clouds. J Supercomputing 72(10):3826–3849
Qin J, Li H, Xiang Xuyu, Tan Y, Pan W, Ma W, Xiong NN (2019) An encrypted image retrieval method based on harris corner optimization and lsh in cloud computing. IEEE Access 7:24626–24633
Quellec G, Lamard M, Cazuguel G, Cochener B, Roux C (2010) Wavelet optimization for content-based image retrieval in medical databases. Med Image Anal 14(2):227–241
Ranjan R, Pal AK (2012) Encryption of image using chaotic map. In: International conference on recent trends in engineering and technology (ICRTET2012)
Ren K, Wang C, Wang Q (2012) Security challenges for the public cloud. IEEE Internet Comput 16(1):69–73
Rui Y, Huang TS, Chang SF (1999) Image retrieval: Current techniques, promising directions, and open issues. J Vis Commun Image Represent 10 (1):39–62
Saleh HM, Younis HA (2017) Private searching on encrypted data in cloud. Inter J Comput Appl 165(7)
Sayood K (2017) Introduction to data compression. Morgan Kaufmann, Burlington
Shen L, Jiang CJ, Liu GJ (2015) Satellite objects extraction and classification based on similarity measure. IEEE Trans Syst Man Cybern Syst 46 (8):1148–1154
Smeulders AWM, Worring M, Santini S, Gupta A, Jain R (2000) Content-based image retrieval at the end of the early years. IEEE Trans Pattern Anal Machine Intell 22(12):1349–1380
Sorensen L, Shaker SB, Bruijne MD (2010) Quantitative analysis of pulmonary emphysema using local binary patterns. IEEE Trans Med Imaging 29 (2):559–569
Staal J, Abramoff MD, Niemeijer M, Viergever MA, Ginneken BV (2019) DRIVE: Digital Retinal Images for Vessel Extraction medical image dataset
Sucharitha G, Senapati RK (2020) Biomedical image retrieval by using local directional edge binary patterns and zernike moments. Multimed Tools Appl 79(3):1847–1864
Tagare HD, Jaffe CC, Duncan J (1997) Medical image databases: A content-based retrieval approach. J Am Med Inform Assoc 4(3):184–198
Tan X, Triggs B (2010) Enhanced local texture feature sets for face recognition under difficult lighting conditions. IEEE Trans Image Process 19(6):1635–1650
Thomas MD (2009) Content-based image retrieval in medicine. Int J Healthcare Inform Syst Inform 4(1):1–16
Tschandl P, Rosendahl C, Kittler H (2018) The ham10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions. Scientif data 5:180161
Wang S, Ding C, Zhang N, Liu X, Zhou A, Cao J, Shen XS (2019) A cloud-guided feature extraction approach for image retrieval in mobile edge computing. IEEE Trans Mob Comput
Wang Y, Miao M, Shen J, Wang J (2017) Towards efficient privacy-preserving encrypted image search in cloud computing. Soft Comput, pp 1–12
Weng L, Amsaleg L, Furon T (2016) Privacy-preserving outsourced media search. IEEE Trans Knowl Data Eng 28(10):2738–2751
Weng L, Amsaleg L, Morton A, Marchand-Maillet S (2015) A privacy-preserving framework for large-scale content-based information retrieval. IEEE Trans Inform Forens Secur 10(1):152–167
Xia Z, Ma X, Shen Z, Sun X, Xiong NN, Jeon B (2018) Secure image lbp feature extraction in cloud-based smart campus. IEEE Access
Xia Z, Wang X, Sun X, Wang Q (2015) A secure and dynamic multi-keyword ranked search scheme over encrypted cloud data. IEEE Trans Parallel Distrib Syst 27(2):340–352
Xia Z, Xiong NN, Vasilakos AV, Sun X (2017) Epcbir: An efficient and privacy-preserving content-based image retrieval scheme in cloud computing. Inf Sci 387:195–204
Xu Y, Gong J, Xiong L, Xu Z, Wang J, Shi Y (2017) A privacy-preserving content-based image retrieval method in cloud environment. J Vis Commun Image Represent 43:164–172
Xu W, Xiang S, Sachnev V (2018) A cryptograph domain image retrieval method based on paillier homomorphic block encryption
Xu Y, Zhao X, Gong J (2019) A large-scale secure image retrieval method in cloud environment. IEEE Access 7:160082–160090
Zakeri FS, Behnam H, Ahmadinejad N (2012) Classification of benign and malignant breast masses based on shape and texture features in sonography images. J Med Syst 36(3):1621–1627
Acknowledgements
The author Ms. Mukul Majhi (Admission No: 2015DR0082) is supported by the institute Ph.D. scholarship, Indian Institute of Technology [Indian School of Mines] Dhanbad, Jharkhand, India. The author Prof. Muhammad Khurram Khan acknowledges that his work is supported by Researchers Supporting Project number (RSP-2020/12), King Saud University, Riyadh, Saudi Arabia.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Majhi, M., Pal, A.K., Pradhan, J. et al. Computational intelligence based secure three-party CBIR scheme for medical data for cloud-assisted healthcare applications. Multimed Tools Appl 81, 41545–41577 (2022). https://doi.org/10.1007/s11042-020-10483-7
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-020-10483-7