{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T14:56:23Z","timestamp":1740149783926,"version":"3.37.3"},"reference-count":32,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2020,11,14]],"date-time":"2020-11-14T00:00:00Z","timestamp":1605312000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"A new solution to overcome the constraints of multimodality medical intra-subject image registration is proposed, using the mutual information (MI) of image histogram-oriented gradients as a new matching criterion. We present a rigid, multi-modal image registration algorithm based on linear transformation and oriented gradients for the alignment of T2-weighted (T2w) images (as a fixed reference) and diffusion tensor imaging (DTI) (b-values of 500 and 1250 s\/mm2) as floating images of three patients to compensate for the motion during the acquisition process. Diffusion MRI is very sensitive to motion, especially when the intensity and duration of the gradient pulses (characterized by the b-value) increases. The proposed method relies on the whole brain surface and addresses the variability of anatomical features into an image stack. The sparse features refer to corners detected using the Harris corner detector operator, while dense features use all image pixels through the image histogram of oriented gradients (HOG) as a measure of the degree of statistical dependence between a pair of registered images. HOG as a dense feature is focused on the structure and extracts the oriented gradient image in the x and y directions. MI is used as an objective function for the optimization process. The entropy functions and joint entropy function are determined using the HOGs data. To determine the best image transformation, the fiducial registration error (FRE) measure is used. We compare the results against the MI-based intensities results computed using a statistical intensity relationship between corresponding pixels in source and target images. Our approach, which is devoted to the whole brain, shows improved registration accuracy, robustness, and computational cost compared with the registration algorithms, which use anatomical features or regions of interest areas with specific neuroanatomy. Despite the supplementary HOG computation task, the computation time is comparable for MI-based intensities and MI-based HOG methods.<\/jats:p>","DOI":"10.3390\/e22111299","type":"journal-article","created":{"date-parts":[[2020,11,16]],"date-time":"2020-11-16T16:04:20Z","timestamp":1605542660000},"page":"1299","source":"Crossref","is-referenced-by-count":10,"title":["Combining Sparse and Dense Features to Improve Multi-Modal Registration for Brain DTI Images"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5934-329X","authenticated-orcid":false,"given":"Simona","family":"Moldovanu","sequence":"first","affiliation":[{"name":"Department of Computer Science and Information Technology, Faculty of Automation, Computers, Electrical Engineering and Electronics, Dunarea de Jos University of Galati, Galati 47 Domneasca Str., 800008 Galati, Romania"},{"name":"The Modelling & Simulation Laboratory, Dunarea de Jos University of Galati, Galati 47 Domneasca Str., 800008 Galati, Romania"}]},{"given":"Lenuta Pan\u0103","family":"Topora\u0219","sequence":"additional","affiliation":[{"name":"The Modelling & Simulation Laboratory, Dunarea de Jos University of Galati, Galati 47 Domneasca Str., 800008 Galati, Romania"},{"name":"Department of Chemistry, Physics & Environment, Faculty of Sciences and Environment, Dunarea de Jos University of Galati, 47 Domneasca Str., 800008 Galati, Romania"}]},{"given":"Anjan","family":"Biswas","sequence":"additional","affiliation":[{"name":"Department of Physics, Chemistry and Mathematics, Alabama A&M University, Normal, AL 35762-4900, USA"},{"name":"Department of Mathematics, King Abdulaziz University, Jeddah 21589, Saudi Arabia"},{"name":"Department of Applied Mathematics, National Research Nuclear University, 31 Kashirskoe Hwy, 115409 Moscow, Russia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9121-5714","authenticated-orcid":false,"given":"Luminita","family":"Moraru","sequence":"additional","affiliation":[{"name":"The Modelling & Simulation Laboratory, Dunarea de Jos University of Galati, Galati 47 Domneasca Str., 800008 Galati, Romania"},{"name":"Department of Chemistry, Physics & Environment, Faculty of Sciences and Environment, Dunarea de Jos University of Galati, 47 Domneasca Str., 800008 Galati, Romania"}]}],"member":"1968","published-online":{"date-parts":[[2020,11,14]]},"reference":[{"key":"ref_1","first-page":"8","article-title":"Survey of medical image registration","volume":"1","author":"Mani","year":"2013","journal-title":"J. Biomed. Eng. Technol."},{"key":"ref_2","first-page":"90","article-title":"Image registration using log polar transform and phase correlation to recover higher scale","volume":"7","author":"Sarvaiya","year":"2012","journal-title":"J. Pattern Recognit. Res."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"539","DOI":"10.1109\/TMI.2015.2481609","article-title":"Confidence estimation for medical image registration based on stereo confidences","volume":"35","author":"Saygili","year":"2016","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Han, D., Dezert, J., and Yang, Y.A. (2019). New image registration algorithm based on evidential reasoning. Sensors, 19.","DOI":"10.3390\/s19051091"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Bashiri, F.S., Baghaie, A., Rostami, R., Yu, Z., and D\u2019Souza, R.M. (2019). Multi-Modal medical image registration with full or partial data: A manifold learning approach. J. Imaging, 5.","DOI":"10.3390\/jimaging5010005"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Kirino, E., Hayakawa, Y., Inami, R., Inoue, R., and Aoki, S. (2019). Simultaneous fMRI-EEG-DTI recording of MMN in patients with schizophrenia. PLoS ONE, 14.","DOI":"10.1371\/journal.pone.0215023"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"\u0160piclin, \u017d., McClelland, J., Kybic, J., and Goksel, O. (2020). Diffusion Tensor Driven Image Registration: A Deep Learning Approach. Biomedical Image Registration, Springer.","DOI":"10.1007\/978-3-030-50120-4"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"S140","DOI":"10.1259\/bjr\/25329214","article-title":"Non-rigid image registration: Theory and practice","volume":"77","author":"Crum","year":"2004","journal-title":"Br. J. Radiol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1002\/mrm.28092","article-title":"Three-dimensional simultaneous brain T1, T2, and ADC mapping with MR multitasking","volume":"84","author":"Ma","year":"2020","journal-title":"Magn. Reson. Med."},{"key":"ref_10","first-page":"245","article-title":"Multi-channel registration of fractional anisotropy and T1-weighted images in the presence of atrophy: Application to multiple sclerosis","volume":"30","author":"Roura","year":"2015","journal-title":"Funct. Neurol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"973","DOI":"10.3174\/ajnr.A5122","article-title":"Performance assessment for brain MR imaging registration methods","volume":"38","author":"Lin","year":"2017","journal-title":"Am. J. Neuroradiol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"909","DOI":"10.3389\/fnins.2019.00909","article-title":"Linear registration of brain MRI using knowledge-based multiple intermediator libraries","volume":"13","author":"Zhang","year":"2019","journal-title":"Front. Neurosci."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"13112","DOI":"10.1038\/s41598-018-31474-7","article-title":"Groupwise image registration based on a total correlation dissimilarity measure for quantitative MRI and dynamic imaging data","volume":"8","author":"Guyader","year":"2018","journal-title":"Sci. Rep."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"5504","DOI":"10.1038\/s41467-019-13374-0","article-title":"Multimodal image registration and connectivity analysis for integration of connectomic data from microscopy to MRI","volume":"10","author":"Goubran","year":"2019","journal-title":"Nat. Commun."},{"key":"ref_15","first-page":"111","article-title":"Multi-channel Registration for Diffusion MRI: Longitudinal Analysis for the Neonatal","volume":"12120","author":"Uus","year":"2020","journal-title":"Brain Biomed. Image Reg."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"786","DOI":"10.1016\/j.neuroimage.2008.12.037","article-title":"Evaluation of 14 nonlinear deformation algorithms applied to human brain MRI registration","volume":"46","author":"Klein","year":"2009","journal-title":"Neuroimage"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Krebs, J., Mansi, T., Delingette, H., Zhang, L., and Ghesu, F. (2017, January 10). Robust non-rigid registration through agent-based action learning. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Quebec City, QC, Canada.","DOI":"10.1007\/978-3-319-66182-7_40"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1023\/A:1007958904918","article-title":"Alignment by maximization of mutual information","volume":"24","author":"Viola","year":"1997","journal-title":"Int. J. Comput. Vis."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1374","DOI":"10.1166\/jmihi.2018.2443","article-title":"Non-rigid registration of multi-modality medical image using combined gradient information and mutual information","volume":"8","author":"Fan","year":"2018","journal-title":"J. Med. Imaging Health Inform."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1002\/acm2.12612","article-title":"Nonrigid registration of medical image based on adaptive local structure tensor and normalized mutual information","volume":"20","author":"Yang","year":"2019","journal-title":"J. Appl. Clin. Med. Phys."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"385","DOI":"10.1109\/TMI.2016.2610583","article-title":"Isotropic total variation regularization of displacements in parametric image registration","volume":"36","author":"Vishnevskiy","year":"2017","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1109\/TMI.2010.2091513","article-title":"General approach to first-order error prediction in rigid point registration","volume":"30","author":"Danilchenko","year":"2011","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1016\/j.media.2010.07.010","article-title":"Geometrical analysis of registration errors in point-based rigid-body registration using invariants","volume":"15","author":"Shamir","year":"2011","journal-title":"Med. Image Anal."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1491","DOI":"10.1118\/1.3553403","article-title":"Validation for 2D\/3D registration. II: The comparison of intensity- and gradient-based merit functions using a new gold standard data set","volume":"38","author":"Gendrin","year":"2011","journal-title":"Med. Phys."},{"key":"ref_25","unstructured":"Harris, C., and Stephens, M. (September, January 31). A combined corner and edge detector. Proceedings of the Alvey Vision Conference, Manchester, UK."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"305","DOI":"10.5201\/ipol.2018.229","article-title":"An analysis and implementation of the Harris corner detector","volume":"8","author":"Sanchez","year":"2018","journal-title":"IPOL"},{"key":"ref_27","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201326). Histograms of oriented gradients for human detection. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"3956363","DOI":"10.1155\/2017\/3956363","article-title":"Histograms of Oriented 3D gradients for fully automated fetal brain localization and robust motion correction in 3T Magnetic Resonance Images","volume":"2017","author":"Serag","year":"2017","journal-title":"BioMed Res. Int."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1250","DOI":"10.1109\/TPAMI.2010.182","article-title":"Vehicle detection using partial least squares","volume":"33","author":"Kembhavi","year":"2011","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1023\/A:1020830525823","article-title":"Variational methods for multimodal image matching","volume":"50","author":"Hermosillo","year":"2002","journal-title":"Int. J. Comput. Vis."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1109\/TMI.2017.2744663","article-title":"Image Registration based on Low Rank Matrix: Rank-Regularized SSD","volume":"37","author":"Ghaffari","year":"2017","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"804","DOI":"10.1007\/s00234-003-1071-4","article-title":"Enhancing accuracy of magnetic resonance image fusion by defining a volume of interest","volume":"45","author":"Hoelper","year":"2003","journal-title":"Neuroradiology"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/11\/1299\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,5]],"date-time":"2024-07-05T09:08:35Z","timestamp":1720170515000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/11\/1299"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,14]]},"references-count":32,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2020,11]]}},"alternative-id":["e22111299"],"URL":"https:\/\/doi.org\/10.3390\/e22111299","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2020,11,14]]}}}