{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,12,12]],"date-time":"2024-12-12T05:37:22Z","timestamp":1733981842808,"version":"3.30.2"},"reference-count":34,"publisher":"SAGE Publications","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IDT"],"published-print":{"date-parts":[[2023,7,31]]},"abstract":"In computer vision, the recognition of expressions from partially occluded faces is one of the serious problems. By the prior recognizing techniques it can solve the issue by various assumptions. A benchmark-guided branch was proposed for detecting and eliminating the manipulated features from the occluded regions since the human visual system is proficient for eliminating the occlusion and the appropriate focal point was obtained on the non-occluded areas. In recent years deep learning has attained a great place in the recognition of facial reactions Still, the precision of facial expression is affected by the occlusion and large skew. In this research work, a deep structure-based occlusionaware facial expression recognition mechanism is introduced to provide superior recognition results. Firstly, the required image is taken from publically provided online sources and the gathered images are subjected to the face extraction method. The face extraction method is done via the ViolaJones method for the extraction of redundant patterns from the original images. Secondly, the extracted face features are given to the pattern recognition stage, where the Adaptive CNN with Attention Mechanism (ACNN-AM) is introduced. This mechanism automatically forms the occluded region of the face and the focal point was on the most discriminative un-occluded regions. Moreover, the hidden patterns in the Occlusion aware facial expressions are identified through the Hybrid Galactic Swarm Yellow Saddle Goatfish Optimization (HGSYSGO). Finally, the overall effectiveness of the developed occlusion aware facial expression recognition model is examined through the comparative analysis of different existing baseline recognition techniques.<\/jats:p>","DOI":"10.3233\/idt-230047","type":"journal-article","created":{"date-parts":[[2023,5,23]],"date-time":"2023-05-23T16:18:57Z","timestamp":1684858737000},"page":"773-797","source":"Crossref","is-referenced-by-count":2,"title":["Hybrid heuristic mechanism for occlusion aware facial expression recognition scheme using patch based adaptive CNN with attention mechanism"],"prefix":"10.1177","volume":"17","author":[{"given":"A. Reddy","family":"Prasad","sequence":"first","affiliation":[]},{"given":"A.","family":"Rajesh","sequence":"additional","affiliation":[]}],"member":"179","reference":[{"issue":"4","key":"10.3233\/IDT-230047_ref1","doi-asserted-by":"crossref","first-page":"2226","DOI":"10.1109\/TCSVT.2021.3089724","article-title":"AP-GAN: Improving Attribute Preservation in Video Face Swapping","volume":"32","author":"Zhang","year":"2022","journal-title":"IEEE Transactions on Circuits and Systems for Video Technology"},{"issue":"2","key":"10.3233\/IDT-230047_ref2","doi-asserted-by":"crossref","first-page":"690","DOI":"10.1109\/TCSVT.2021.3063052","article-title":"Triplet Loss With Multistage Outlier Suppression and Class-Pair Margins for Facial Expression Recognition","volume":"32","author":"Xie","year":"2022","journal-title":"IEEE Transactions on Circuits and Systems for Video Technology"},{"issue":"3","key":"10.3233\/IDT-230047_ref3","doi-asserted-by":"crossref","first-page":"1681","DOI":"10.1109\/TCSVT.2021.3056098","article-title":"Joint Expression Synthesis and Representation Learning for Facial Expression Recognition","volume":"32","author":"Zhang","year":"2022","journal-title":"IEEE Transactions on Circuits and Systems for Video Technology"},{"issue":"1","key":"10.3233\/IDT-230047_ref4","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1109\/TIP.2006.884954","article-title":"Facial Expression Recognition in Image Sequences Using Geometric Deformation Features and Support Vector Machines","volume":"16","author":"Kotsia","year":"2007","journal-title":"IEEE Transactions on Image Processing"},{"key":"10.3233\/IDT-230047_ref5","doi-asserted-by":"crossref","first-page":"4445","DOI":"10.1109\/TIP.2020.2972114","article-title":"Geometry Guided Pose-Invariant Facial Expression Recognition","volume":"29","author":"Zhang","year":"2020","journal-title":"IEEE Transactions on Image Processing"},{"key":"10.3233\/IDT-230047_ref6","doi-asserted-by":"crossref","first-page":"19409","DOI":"10.1109\/ACCESS.2017.2737821","article-title":"Facial Expression Recognition from Image Sequence Based on LBP and Taylor Expansion","volume":"5","author":"Ding","year":"2017","journal-title":"IEEE Access"},{"key":"10.3233\/IDT-230047_ref7","doi-asserted-by":"crossref","first-page":"4630","DOI":"10.1109\/ACCESS.2017.2784096","article-title":"Facial Expression Recognition Using Weighted Mixture Deep Neural Network Based on Double-Channel Facial Images","volume":"6","author":"Yang","year":"2018","journal-title":"IEEE Access"},{"issue":"3","key":"10.3233\/IDT-230047_ref8","doi-asserted-by":"crossref","first-page":"1443","DOI":"10.1109\/TCSVT.2021.3074032","article-title":"Local and Global Perception Generative Adversarial Network for Facial Expression Synthesis","volume":"32","author":"Xia","year":"2022","journal-title":"IEEE Transactions on Circuits and Systems for Video Technology"},{"key":"10.3233\/IDT-230047_ref9","doi-asserted-by":"crossref","first-page":"3327","DOI":"10.1109\/TMM.2021.3096068","article-title":"Identity-Aware Facial Expression Recognition Via Deep Metric Learning Based on Synthesized Images","volume":"24","author":"Huang","year":"2022","journal-title":"IEEE Transactions on Multimedia"},{"issue":"2","key":"10.3233\/IDT-230047_ref10","doi-asserted-by":"crossref","first-page":"348","DOI":"10.1109\/TAFFC.2017.2780838","article-title":"Co-Clustering to Reveal Salient Facial Features for Expression Recognition","volume":"11","author":"Khan","year":"2020","journal-title":"IEEE Transactions on Affective Computing"},{"issue":"4","key":"10.3233\/IDT-230047_ref11","doi-asserted-by":"crossref","first-page":"916","DOI":"10.1109\/TCYB.2015.2418092","article-title":"Time-Delay Neural Network for Continuous Emotional Dimension Prediction From Facial Expression Sequences","volume":"46","author":"Meng","year":"2016","journal-title":"IEEE Transactions on Cybernetics"},{"key":"10.3233\/IDT-230047_ref12","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TIM.2020.3031835","article-title":"Facial Expression Recognition Using Local Gravitational Force Descriptor-Based Deep Convolution Neural Networks","volume":"70","author":"Mohan","year":"2021","journal-title":"IEEE Transactions on Instrumentation and Measurement"},{"issue":"1","key":"10.3233\/IDT-230047_ref13","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1109\/T-AFFC.2012.33","article-title":"Facial Expression Recognition in the Encrypted Domain Based on Local Fisher Discriminant Analysis","volume":"4","author":"Rahulamathavan","year":"2013","journal-title":"IEEE Transactions on Affective Computing"},{"key":"10.3233\/IDT-230047_ref14","doi-asserted-by":"crossref","first-page":"164130","DOI":"10.1109\/ACCESS.2020.3021994","article-title":"Expression-EEG Based Collaborative Multimodal Emotion Recognition Using Deep AutoEncoder","volume":"8","author":"Zhang","year":"2020","journal-title":"IEEE Access"},{"key":"10.3233\/IDT-230047_ref15","doi-asserted-by":"crossref","first-page":"32297","DOI":"10.1109\/ACCESS.2019.2901521","article-title":"Learning Affective Video Features for Facial Expression Recognition via Hybrid Deep Learning","volume":"7","author":"Zhang","year":"2019","journal-title":"IEEE Access"},{"key":"10.3233\/IDT-230047_ref16","first-page":"367","article-title":"Covariance pooling for facial expression recognition","author":"Acharya","year":"2018","journal-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)"},{"key":"10.3233\/IDT-230047_ref17","first-page":"3359","article-title":"Joint pose and expression modeling for facial expression recognition","author":"Zhang","year":"2018","journal-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)"},{"key":"10.3233\/IDT-230047_ref18","doi-asserted-by":"crossref","first-page":"6977","DOI":"10.1109\/TIP.2020.2996086","article-title":"Multi-Modal Recurrent Attention Networks for Facial Expression Recognition","volume":"29","author":"Kim","year":"2020","journal-title":"IEEE Transactions on Image Processing"},{"key":"10.3233\/IDT-230047_ref19","doi-asserted-by":"crossref","first-page":"19409","DOI":"10.1109\/ACCESS.2017.2737821","article-title":"Facial Expression Recognition from Image Sequence Based on LBP and Taylor Expansion","volume":"5","author":"Ding","year":"2017","journal-title":"IEEE Access"},{"key":"10.3233\/IDT-230047_ref20","doi-asserted-by":"crossref","first-page":"2315","DOI":"10.1007\/s00371-020-01988-1","article-title":"Facial emotion recognition using subband selective multilevel stationary wavelet gradient transform and fuzzy support vector machine","volume":"37","author":"Arumugam","year":"2021","journal-title":"The Visual Computer"},{"key":"10.3233\/IDT-230047_ref21","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1007\/s12193-020-00363-7","article-title":"Facial expression and action unit recognition augmented by their dependencies on graph convolutional networks","volume":"15","author":"He","year":"2021","journal-title":"Journal on Multimodal User Interfaces"},{"key":"10.3233\/IDT-230047_ref22","doi-asserted-by":"crossref","first-page":"633","DOI":"10.1007\/s11045-020-00752-x","article-title":"Transformation guided representation GAN for pose invariant face recognition","volume":"32","author":"Chikontwe","year":"2021","journal-title":"Multidimensional Systems and Signal Processing"},{"key":"10.3233\/IDT-230047_ref23","doi-asserted-by":"crossref","unstructured":"Liang X, Xu L, Zhang W, Zhang Y, Liu J, Liu Z. A convolution-transformer dual branch network for head-pose and occlusion facial expression recognition. The Visual Computer. 2022.","DOI":"10.1007\/s00371-022-02413-5"},{"key":"10.3233\/IDT-230047_ref24","doi-asserted-by":"crossref","first-page":"30861","DOI":"10.1007\/s11042-020-09566-2","article-title":"Rapid facial expression recognition under part occlusion based on symmetric SURF and heterogeneous soft partition network","volume":"79","author":"Hu","year":"2020","journal-title":"Multimedia Tools and Applications"},{"issue":"5","key":"10.3233\/IDT-230047_ref25","doi-asserted-by":"crossref","first-page":"2439","DOI":"10.1109\/TIP.2018.2886767","article-title":"Occlusion Aware Facial Expression Recognition Using CNN With Attention Mechanism","volume":"28","author":"Li","year":"2019","journal-title":"IEEE Transactions on Image Processing"},{"key":"10.3233\/IDT-230047_ref26","first-page":"14","article-title":"Face Detection System Based on Viola\u00a0\u2013 Jones Algorithm","volume":"6","author":"Dabhi","year":"2013","journal-title":"International Journal of Science and Research (IJSR)"},{"key":"10.3233\/IDT-230047_ref27","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1016\/j.promfg.2020.07.005","article-title":"Intelligent bearing Fault diagnosis using Attention-based CNN","volume":"49","author":"Wang","year":"2020","journal-title":"Procedia Manufacturing"},{"key":"10.3233\/IDT-230047_ref28","doi-asserted-by":"crossref","first-page":"397","DOI":"10.1007\/s11042-013-1610-x","article-title":"Speech driven photo realistic facial animation based on an articulatory DBN model and AAM features","volume":"73","author":"Jiang","year":"2014","journal-title":"Multimedia Tools and Applications"},{"key":"10.3233\/IDT-230047_ref29","doi-asserted-by":"crossref","unstructured":"Podder T, Bhattacharya D, Majumdar A. Time efficient real time facial expression recognition with CNN and transfer learning. S\u0101dhan\u0101. 2022; 47(177).","DOI":"10.1007\/s12046-022-01943-x"},{"key":"10.3233\/IDT-230047_ref30","doi-asserted-by":"crossref","unstructured":"Brammya G, Praveena S, Ninu Preetha NS, Ramya R, Rajakumar BR, Binu D. Deer Hunting Optimization Algorithm: A New Nature-Inspired Meta-heuristic Paradigm. The Computer Journal. 2019.","DOI":"10.1093\/comjnl\/bxy133"},{"key":"10.3233\/IDT-230047_ref31","doi-asserted-by":"crossref","first-page":"50001","DOI":"10.1109\/ACCESS.2021.3067597","article-title":"Grasshopper Optimization Algorithm: Theory, Variants, and Applications","volume":"9","author":"Meraihi","year":"2021","journal-title":"IEEE Access"},{"key":"10.3233\/IDT-230047_ref32","doi-asserted-by":"crossref","first-page":"771","DOI":"10.1016\/j.asoc.2015.10.034","article-title":"Galactic Swarm Optimization: A new global optimization metaheuristic inspired by galactic motion","volume":"38","author":"Muthiah-Nakarajan","year":"2016","journal-title":"Applied Soft Computing"},{"key":"10.3233\/IDT-230047_ref33","first-page":"1","article-title":"Facial-Expression Recognition from Video using Enhanced Convolutional LSTM","author":"Miyoshi","year":"2019","journal-title":"2019 Digital Image Computing: Techniques and Applications (DICTA)"},{"key":"10.3233\/IDT-230047_ref34","doi-asserted-by":"crossref","unstructured":"Ye M, Hu Q, Liu G. CNN-LSTM Facial Expression Recognition Method Fused with Two-Layer Attention Mechanism. Computational Intelligence and Neuroscience. 2022.","DOI":"10.1155\/2022\/7450637"}],"container-title":["Intelligent Decision Technologies"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/IDT-230047","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,11]],"date-time":"2024-12-11T13:40:48Z","timestamp":1733924448000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/IDT-230047"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,31]]},"references-count":34,"journal-issue":{"issue":"3"},"URL":"https:\/\/doi.org\/10.3233\/idt-230047","relation":{},"ISSN":["1872-4981","1875-8843"],"issn-type":[{"type":"print","value":"1872-4981"},{"type":"electronic","value":"1875-8843"}],"subject":[],"published":{"date-parts":[[2023,7,31]]}}}