{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,11,21]],"date-time":"2024-11-21T00:10:11Z","timestamp":1732147811756,"version":"3.28.0"},"reference-count":139,"publisher":"PeerJ","license":[{"start":{"date-parts":[[2024,6,3]],"date-time":"2024-06-03T00:00:00Z","timestamp":1717372800000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Key Research and Development Program of China","award":["2018AAA0103203"]},{"name":"Chengdu Technology Project","award":["2022-YF05-02014-SN"]},{"name":"Science and Technology Plan Project of Luzhou City, Sichuan Province","award":["2022-XDY-192"]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"abstract":"With the cutting-edge advancements in computer vision, facial expression recognition (FER) is an active research area due to its broad practical applications. It has been utilized in various fields, including education, advertising and marketing, entertainment and gaming, health, and transportation. The facial expression recognition-based systems are rapidly evolving due to new challenges, and significant research studies have been conducted on both basic and compound facial expressions of emotions; however, measuring emotions is challenging. Fueled by the recent advancements and challenges to the FER systems, in this article, we have discussed the basics of FER and architectural elements, FER applications and use-cases, FER-based global leading companies, interconnection between FER, Internet of Things (IoT) and Cloud computing, summarize open challenges in-depth to FER technologies, and future directions through utilizing Preferred Reporting Items for Systematic reviews and Meta Analyses Method (PRISMA). In the end, the conclusion and future thoughts are discussed. By overcoming the identified challenges and future directions in this research study, researchers will revolutionize the discipline of facial expression recognition in the future.<\/jats:p>","DOI":"10.7717\/peerj-cs.2024","type":"journal-article","created":{"date-parts":[[2024,6,3]],"date-time":"2024-06-03T07:26:01Z","timestamp":1717399561000},"page":"e2024","source":"Crossref","is-referenced-by-count":0,"title":["Facial expression recognition (FER) survey: a vision, architectural elements, and future directions"],"prefix":"10.7717","volume":"10","author":[{"given":"Sana","family":"Ullah","sequence":"first","affiliation":[{"name":"School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu, Sichuan, China"}]},{"given":"Jie","family":"Ou","sequence":"additional","affiliation":[{"name":"School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu, Sichuan, China"}]},{"given":"Yuanlun","family":"Xie","sequence":"additional","affiliation":[{"name":"School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu, Sichuan, China"}]},{"given":"Wenhong","family":"Tian","sequence":"additional","affiliation":[{"name":"School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu, Sichuan, China"}]}],"member":"4443","published-online":{"date-parts":[[2024,6,3]]},"reference":[{"issue":"8","key":"10.7717\/peerj-cs.2024\/ref-1","doi-asserted-by":"publisher","first-page":"1188","DOI":"10.3390\/electronics9081188","article-title":"Past, present, and future of face recognition: a review","volume":"9","author":"Adjabi","year":"2020","journal-title":"Electronics"},{"key":"10.7717\/peerj-cs.2024\/ref-2","doi-asserted-by":"publisher","first-page":"348","DOI":"10.1016\/j.procs.2023.03.045","article-title":"Towards IoT-big data architecture for future education","volume":"220","author":"Ahaidous","year":"2023","journal-title":"Procedia Computer Science"},{"first-page":"193","article-title":"Comparing the performance of facial emotion recognition systems on real-life videos: gender, ethnicity and age","year":"2022","author":"Ahmad","key":"10.7717\/peerj-cs.2024\/ref-3"},{"issue":"11","key":"10.7717\/peerj-cs.2024\/ref-4","doi-asserted-by":"publisher","first-page":"688","DOI":"10.3390\/bioengineering9110688","article-title":"A survey on physiological signal-based emotion recognition","volume":"9","author":"Ahmad","year":"2022","journal-title":"Bioengineering"},{"key":"10.7717\/peerj-cs.2024\/ref-5","doi-asserted-by":"publisher","first-page":"4825","DOI":"10.1007\/s11042-020-09850-1","article-title":"Classical and modern face recognition approaches: a complete review","volume":"80","author":"Ali","year":"2021","journal-title":"Multimedia Tools and Applications"},{"first-page":"217","volume-title":"Facial recognition","year":"2022","author":"Andrejevic","key":"10.7717\/peerj-cs.2024\/ref-6"},{"issue":"1","key":"10.7717\/peerj-cs.2024\/ref-7","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1109\/TCSS.2022.3154442","article-title":"Ensemble hybrid learning methods for automated depression detection","volume":"10","author":"Ansari","year":"2022","journal-title":"IEEE Transactions on Computational Social Systems"},{"issue":"6","key":"10.7717\/peerj-cs.2024\/ref-8","doi-asserted-by":"crossref","first-page":"664","DOI":"10.2174\/2352096516666230403091253","article-title":"Learning framework for compound facial emotion recognition","volume":"16","author":"Appasaheb\u00a0Borgalli","year":"2023","journal-title":"Recent Advances in Electrical & Electronic Engineering (Formerly Recent Patents on Electrical & Electronic Engineering)"},{"key":"10.7717\/peerj-cs.2024\/ref-9","first-page":"2133","article-title":"Intelligent security system based on face recognition and IoT","volume":"62","author":"Bagchi","year":"2022","journal-title":"Materials Today: Proceedings"},{"issue":"3","key":"10.7717\/peerj-cs.2024\/ref-10","doi-asserted-by":"publisher","first-page":"965","DOI":"10.1109\/JSYST.2013.2271540","article-title":"Two systems for the detection of melanomas in dermoscopy images using texture and color features","volume":"8","author":"Barata","year":"2014","journal-title":"IEEE Systems"},{"first-page":"279","article-title":"Training deep networks for facial expression recognition with crowd-sourced label distribution","year":"2016","author":"Barsoum","key":"10.7717\/peerj-cs.2024\/ref-11"},{"issue":"6","key":"10.7717\/peerj-cs.2024\/ref-12","doi-asserted-by":"publisher","first-page":"1450","DOI":"10.1109\/TNN.2002.804287","article-title":"Face recognition by independent component analysis","volume":"13","author":"Bartlett","year":"2002","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"first-page":"5562","article-title":"Emotionet: an accurate, real-time algorithm for the automatic annotation of a million facial expressions in the wild","year":"2016","author":"Benitez-Quiroz","key":"10.7717\/peerj-cs.2024\/ref-13"},{"article-title":"Emotionet challenge: recognition of facial expressions of emotion in the wild","year":"2017","author":"Benitez-Quiroz","key":"10.7717\/peerj-cs.2024\/ref-14"},{"issue":"5","key":"10.7717\/peerj-cs.2024\/ref-15","doi-asserted-by":"publisher","first-page":"1029","DOI":"10.1111\/j.1365-2133.2004.06210.x","article-title":"Digital image analysis for diagnosis of cutaneous melanoma. Development of a highly effective computer algorithm based on analysis of 837 melanocytic lesions","volume":"151","author":"Blum","year":"2004","journal-title":"British Journal of Dermatology"},{"issue":"2","key":"10.7717\/peerj-cs.2024\/ref-16","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1038\/s41562-022-01489-2","article-title":"Deep learning reveals what vocal bursts express in different cultures","volume":"7","author":"Brooks","year":"2023","journal-title":"Nature Human Behaviour"},{"issue":"2","key":"10.7717\/peerj-cs.2024\/ref-17","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1016\/S0376-6357(02)00078-5","article-title":"What is emotion?","volume":"60","author":"Cabanac","year":"2002","journal-title":"Behavioural Processes"},{"key":"10.7717\/peerj-cs.2024\/ref-18","doi-asserted-by":"publisher","first-page":"104569","DOI":"10.1016\/j.imavis.2022.104569","article-title":"Emotion detection and face recognition of drivers in autonomous vehicles in IoT platform","volume":"128","author":"Chen","year":"2022","journal-title":"Image and Vision Computing"},{"issue":"22","key":"10.7717\/peerj-cs.2024\/ref-19","doi-asserted-by":"publisher","first-page":"4712","DOI":"10.3390\/rs13224712","article-title":"Review of image classification algorithms based on convolutional neural networks","volume":"13","author":"Chen","year":"2021","journal-title":"Remote Sensing"},{"first-page":"605","article-title":"Low-resolution face recognition","year":"2019","author":"Cheng","key":"10.7717\/peerj-cs.2024\/ref-20"},{"key":"10.7717\/peerj-cs.2024\/ref-21","doi-asserted-by":"publisher","first-page":"106689","DOI":"10.1016\/j.chb.2021.106689","article-title":"The recognition of emotions beyond facial expressions: comparing emoticons specifically designed to convey basic emotions with other modes of expression","volume":"118","author":"Cherbonnier","year":"2021","journal-title":"Computers in Human Behavior"},{"key":"10.7717\/peerj-cs.2024\/ref-22","doi-asserted-by":"publisher","first-page":"108374","DOI":"10.1109\/ACCESS.2022.3212767","article-title":"Neural architecture search for transformers: a survey","volume":"10","author":"Chitty-Venkata","year":"2022","journal-title":"IEEE Access"},{"issue":"16","key":"10.7717\/peerj-cs.2024\/ref-23","doi-asserted-by":"publisher","first-page":"7092","DOI":"10.3390\/s23167092","article-title":"New trends in emotion recognition using image analysis by neural networks. A systematic review","volume":"23","author":"C\u00eerneanu","year":"2023","journal-title":"Sensors"},{"issue":"7","key":"10.7717\/peerj-cs.2024\/ref-24","doi-asserted-by":"publisher","first-page":"2461","DOI":"10.3390\/s22072461","article-title":"The emotion probe: on the universality of cross-linguistic and cross-gender speech emotion recognition via machine learning","volume":"22","author":"Costantini","year":"2022","journal-title":"Sensors"},{"key":"10.7717\/peerj-cs.2024\/ref-25","doi-asserted-by":"publisher","first-page":"1071","DOI":"10.1007\/s11831-019-09344-w","article-title":"A survey of deep learning and its applications: a new paradigm to machine learning","volume":"27","author":"Dargan","year":"2020","journal-title":"Archives of Computational Methods in Engineering"},{"issue":"3","key":"10.7717\/peerj-cs.2024\/ref-26","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2845089","article-title":"A comprehensive survey on pose-invariant face recognition","volume":"7","author":"Ding","year":"2016","journal-title":"ACM Transactions on Intelligent Systems and Technology (TIST)"},{"issue":"7","key":"10.7717\/peerj-cs.2024\/ref-27","doi-asserted-by":"publisher","first-page":"111","DOI":"10.3390\/jimaging7070111","article-title":"A deep learning ensemble method to assist cytopathologists in pap test image classification","volume":"7","author":"Diniz","year":"2021","journal-title":"Journal of Imaging"},{"issue":"4","key":"10.7717\/peerj-cs.2024\/ref-28","doi-asserted-by":"publisher","first-page":"443","DOI":"10.31887\/DCNS.2015.17.4\/sdu","article-title":"Compound facial expressions of emotion: from basic research to clinical applications","volume":"17","author":"Du","year":"2015","journal-title":"Dialogues in Clinical Neuroscience"},{"issue":"15","key":"10.7717\/peerj-cs.2024\/ref-29","first-page":"E1454","article-title":"Compound facial expressions of emotion","volume":"111","author":"Du","year":"2014","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"},{"issue":"14","key":"10.7717\/peerj-cs.2024\/ref-30","first-page":"200","article-title":"A thorough review on the current advance of neural network structures","volume":"14","author":"Dupond","year":"2019","journal-title":"Annual Reviews in Control"},{"first-page":"211","article-title":"Will transfer learning enhance imagenet classification accuracy using imagenet-pretrained models?","year":"2019","author":"Ebrahim","key":"10.7717\/peerj-cs.2024\/ref-31"},{"issue":"3\u20134","key":"10.7717\/peerj-cs.2024\/ref-32","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1080\/02699939208411068","article-title":"An argument for basic emotions","volume":"6","author":"Ekman","year":"1992","journal-title":"Cognition & Emotion"},{"key":"10.7717\/peerj-cs.2024\/ref-33","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1126\/science.164.3875.86","article-title":"Pan-cultural elements in facial displays of emotion","volume":"164","author":"Ekman","year":"1969","journal-title":"Science"},{"key":"10.7717\/peerj-cs.2024\/ref-34","doi-asserted-by":"publisher","first-page":"136944","DOI":"10.1109\/ACCESS.2021.3113464","article-title":"Facial expression recognition: a review of trends and techniques","volume":"9","author":"Ekundayo","year":"2021","journal-title":"IEEE Access"},{"first-page":"125","article-title":"Discriminant analysis for recognition of human face images","year":"1997","author":"Etemad","key":"10.7717\/peerj-cs.2024\/ref-35"},{"issue":"11","key":"10.7717\/peerj-cs.2024\/ref-36","doi-asserted-by":"publisher","first-page":"1955","DOI":"10.1109\/TPAMI.2010.36","article-title":"Age synthesis and estimation via faces: a survey","volume":"32","author":"Fu","year":"2010","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"issue":"6","key":"10.7717\/peerj-cs.2024\/ref-37","doi-asserted-by":"publisher","first-page":"6655","DOI":"10.1007\/s11042-018-6371-0","article-title":"An adaptive localization of pupil degraded by eyelash occlusion and poor contrast","volume":"78","author":"Gautam","year":"2019","journal-title":"Multimedia Tools and Applications"},{"first-page":"403","article-title":"FEAIS: facial emotion recognition enabled education aids IoT system for online learning","year":"2022","author":"Geng","key":"10.7717\/peerj-cs.2024\/ref-38"},{"key":"10.7717\/peerj-cs.2024\/ref-39","doi-asserted-by":"publisher","first-page":"100514","DOI":"10.1016\/j.iot.2022.100514","article-title":"AI for next generation computing: emerging trends and future directions","volume":"19","author":"Gill","year":"2022","journal-title":"Internet of Things"},{"article-title":"Internet of things, deep learning, facial expression, facial recognition systems, machine learning","year":"2024","author":"Google\u00a0Trends","key":"10.7717\/peerj-cs.2024\/ref-40"},{"key":"10.7717\/peerj-cs.2024\/ref-41","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1049\/iet-bmt.2017.0083","article-title":"Strengths and weaknesses of deep learning models for face recognition against image degradations","volume":"7","author":"Grm","year":"2018","journal-title":"IET Biometrics"},{"key":"10.7717\/peerj-cs.2024\/ref-42","doi-asserted-by":"publisher","first-page":"26391","DOI":"10.1109\/ACCESS.2018.2831927","article-title":"Dominant and complementary emotion recognition from still images of faces","volume":"6","author":"Guo","year":"2018","journal-title":"IEEE Access"},{"first-page":"196","article-title":"Face recognition by support vector machines","year":"2000","author":"Guo","key":"10.7717\/peerj-cs.2024\/ref-43"},{"issue":"6","key":"10.7717\/peerj-cs.2024\/ref-44","doi-asserted-by":"publisher","first-page":"8677","DOI":"10.1007\/s11042-016-3470-7","article-title":"Face alignment under occlusion based on local and global feature regression","volume":"76","author":"Guo","year":"2017","journal-title":"Multimedia Tools and Applications"},{"issue":"4","key":"10.7717\/peerj-cs.2024\/ref-45","doi-asserted-by":"publisher","first-page":"539","DOI":"10.1016\/S0031-3203(96)00111-2","article-title":"Face recognition using hybrid classifiers","volume":"30","author":"Gutta","year":"1997","journal-title":"Pattern Recognition"},{"issue":"1","key":"10.7717\/peerj-cs.2024\/ref-46","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1109\/TPAMI.2022.3152247","article-title":"A survey on vision transformer","volume":"45","author":"Han","year":"2022","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"issue":"1","key":"10.7717\/peerj-cs.2024\/ref-47","article-title":"Synthesis of compound facial expressions based on indonesian sentences using multinomial Na\u00efve Bayes model and dominance threshold equations","volume":"30","author":"Haryanto","year":"2022","journal-title":"Engineering Letters"},{"issue":"4","key":"10.7717\/peerj-cs.2024\/ref-48","doi-asserted-by":"publisher","first-page":"90","DOI":"10.11648\/j.ajnc.20150404.12","article-title":"Article: a novel hybrid method for face recognition based on 2d wavelet and singular value decomposition","volume":"4","author":"Hashemi","year":"2015","journal-title":"American Journal of Networks and Communications"},{"first-page":"770","article-title":"Deep residual learning for image recognition","year":"2016","author":"He","key":"10.7717\/peerj-cs.2024\/ref-49"},{"volume-title":"Psychology of gender","year":"2020","author":"Helgeson","key":"10.7717\/peerj-cs.2024\/ref-50","doi-asserted-by":"crossref","DOI":"10.4324\/9781003016014"},{"issue":"6","key":"10.7717\/peerj-cs.2024\/ref-51","doi-asserted-by":"publisher","first-page":"177","DOI":"10.3390\/fi14060177","article-title":"Evaluation of online teaching quality based on facial expression recognition","volume":"14","author":"Hou","year":"2022","journal-title":"Future Internet"},{"issue":"4","key":"10.7717\/peerj-cs.2024\/ref-52","doi-asserted-by":"publisher","first-page":"1910","DOI":"10.1109\/TII.2016.2607178","article-title":"Fog computing based face identification and resolution scheme in internet of things","volume":"13","author":"Hu","year":"2017","journal-title":"IEEE Transactions on Industrial Informatics"},{"issue":"10","key":"10.7717\/peerj-cs.2024\/ref-53","doi-asserted-by":"publisher","first-page":"1189","DOI":"10.3390\/sym11101189","article-title":"Facial expression recognition: a survey","volume":"11","author":"Huang","year":"2019","journal-title":"Symmetry"},{"issue":"12","key":"10.7717\/peerj-cs.2024\/ref-54","doi-asserted-by":"publisher","first-page":"18635","DOI":"10.1007\/s11042-022-14066-6","article-title":"Facial expression recognition based on improved depthwise separable convolutional network","volume":"82","author":"Huo","year":"2023","journal-title":"Multimedia Tools and Applications"},{"issue":"3","key":"10.7717\/peerj-cs.2024\/ref-55","first-page":"261","article-title":"Towards smart sustainable cities vision and challenges","volume":"15","author":"Ibrahim\u00a0Khalil","year":"2024","journal-title":"International Journal of Nonlinear Analysis and Applications"},{"issue":"19","key":"10.7717\/peerj-cs.2024\/ref-56","doi-asserted-by":"crossref","first-page":"7241","DOI":"10.1073\/pnas.1200155109","article-title":"Facial expressions of emotion are not culturally universal","volume":"109","author":"Jack","year":"2012","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"},{"key":"10.7717\/peerj-cs.2024\/ref-57","doi-asserted-by":"publisher","first-page":"69311","DOI":"10.1109\/ACCESS.2020.2986654","article-title":"Compound emotion recognition of autistic children during meltdown crisis based on deep spatiotemporal analysis of facial geometric features","volume":"8","author":"Jarraya","year":"2020","journal-title":"IEEE Access"},{"key":"10.7717\/peerj-cs.2024\/ref-58","doi-asserted-by":"publisher","first-page":"172231","DOI":"10.1109\/ACCESS.2019.2956508","article-title":"A survey on the new generation of deep learning in image processing","volume":"7","author":"Jiao","year":"2019","journal-title":"IEEE Access"},{"journal-title":"Ph.D. thesis","article-title":"Picture processing system by computer complex and recognition of human faces","year":"1973","author":"Kanade","key":"10.7717\/peerj-cs.2024\/ref-59"},{"key":"10.7717\/peerj-cs.2024\/ref-60","first-page":"1","article-title":"Understanding deep learning techniques for recognition of human emotions using facial expressions: a comprehensive survey","volume":"72","author":"Karnati","year":"2023","journal-title":"IEEE Transactions on Instrumentation and Measurement"},{"issue":"3","key":"10.7717\/peerj-cs.2024\/ref-61","doi-asserted-by":"crossref","first-page":"81","DOI":"10.14257\/ijsia.2016.10.3.08","article-title":"Face recognition using neural network: a review","volume":"10","author":"Kasar","year":"2016","journal-title":"International Journal of Security and Its Applications"},{"issue":"1","key":"10.7717\/peerj-cs.2024\/ref-62","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1016\/j.infsof.2008.09.009","article-title":"Systematic literature reviews in software engineering\u2014a systematic literature review","volume":"51","author":"Kitchenham","year":"2009","journal-title":"Information and Software Technology"},{"issue":"2","key":"10.7717\/peerj-cs.2024\/ref-63","doi-asserted-by":"crossref","first-page":"401","DOI":"10.3390\/s18020401","article-title":"A brief review of facial emotion recognition based on visual information","volume":"18","author":"Ko","year":"2018","journal-title":"Sensors"},{"issue":"11","key":"10.7717\/peerj-cs.2024\/ref-64","first-page":"2755","article-title":"Context based emotion recognition using emotic dataset","volume":"42","author":"Kosti","year":"2019","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"volume-title":"Pattern recognition","year":"2008","author":"Koutroumbas","key":"10.7717\/peerj-cs.2024\/ref-65"},{"first-page":"1097","article-title":"Imagenet classification with deep convolutional neural networks","year":"2012","author":"Krizhevsky","key":"10.7717\/peerj-cs.2024\/ref-66"},{"volume-title":"Ensemble methods for machine learning","year":"2023","author":"Kunapuli","key":"10.7717\/peerj-cs.2024\/ref-67"},{"issue":"9","key":"10.7717\/peerj-cs.2024\/ref-68","doi-asserted-by":"publisher","first-page":"7271","DOI":"10.1016\/j.jksuci.2021.06.012","article-title":"Emotion recognition from facial images with simultaneous occlusion, pose and illumination variations using meta-learning","volume":"34","author":"Kuruvayil","year":"2022","journal-title":"Journal of King Saud University-Computer and Information Sciences"},{"key":"10.7717\/peerj-cs.2024\/ref-69","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1007\/s00521-017-2994-8","article-title":"A novel hybrid approach based on principal component analysis and tolerance rough similarity for face identification","volume":"29","author":"Lavanya","year":"2018","journal-title":"Neural Computing and Applications"},{"issue":"3","key":"10.7717\/peerj-cs.2024\/ref-70","doi-asserted-by":"crossref","first-page":"1195","DOI":"10.1109\/TAFFC.2020.2981446","article-title":"Deep facial expression recognition: a survey","volume":"13","author":"Li","year":"2020","journal-title":"IEEE Transactions on Affective Computing"},{"issue":"17","key":"10.7717\/peerj-cs.2024\/ref-71","doi-asserted-by":"publisher","first-page":"4727","DOI":"10.3390\/s20174727","article-title":"End-to-end training for compound expression recognition","volume":"20","author":"Li","year":"2020","journal-title":"Sensors"},{"first-page":"101","article-title":"Tutorial on multimodal machine learning: principles, challenges, and open questions","year":"2023","author":"Liang","key":"10.7717\/peerj-cs.2024\/ref-72"},{"first-page":"27","article-title":"Mix emotion recognition from facial expression using SVM-CRF sequence classifier","year":"2017","author":"Liliana","key":"10.7717\/peerj-cs.2024\/ref-73"},{"first-page":"56","article-title":"The Indonesian Mixed Emotion Dataset (IMED) a facial expression dataset for mixed emotion recognition","year":"2018","author":"Liliana","key":"10.7717\/peerj-cs.2024\/ref-74"},{"issue":"11","key":"10.7717\/peerj-cs.2024\/ref-75","doi-asserted-by":"publisher","first-page":"669","DOI":"10.1038\/s44159-022-00105-4","article-title":"The cultural evolution of emotion","volume":"1","author":"Lindquist","year":"2022","journal-title":"Nature Reviews Psychology"},{"key":"10.7717\/peerj-cs.2024\/ref-76","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1109\/TAFFC.2023.3264719","article-title":"Modeling uncertainty for low-resolution facial expression recognition","volume":"15","author":"Lo","year":"2023","journal-title":"IEEE Transactions on Affective Computing"},{"issue":"1","key":"10.7717\/peerj-cs.2024\/ref-77","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1002\/ptr.8025","article-title":"Quality of systematic reviews with meta-analyses of resveratrol: a methodological systematic review","volume":"38","author":"Lu","year":"2024","journal-title":"Phytotherapy Research"},{"first-page":"13","article-title":"Combining classifiers for face recognition","year":"2003","author":"Lu","key":"10.7717\/peerj-cs.2024\/ref-78"},{"issue":"1","key":"10.7717\/peerj-cs.2024\/ref-79","doi-asserted-by":"crossref","first-page":"381","DOI":"10.21275\/ART20203995","article-title":"Machine learning algorithms\u2014a review","volume":"9","author":"Mahesh","year":"2020","journal-title":"International Journal of Science and Research (IJSR)"},{"issue":"5","key":"10.7717\/peerj-cs.2024\/ref-80","article-title":"A model of the perception of facial expressions of emotion by humans: research overview and perspectives","volume":"13","author":"Martinez","year":"2012","journal-title":"Journal of Machine Learning Research"},{"key":"10.7717\/peerj-cs.2024\/ref-81","doi-asserted-by":"publisher","first-page":"103927","DOI":"10.1016\/j.imavis.2020.103927","article-title":"Cross-resolution learning for face recognition","volume":"99","author":"Massoli","year":"2020","journal-title":"Image and Vision Computing"},{"key":"10.7717\/peerj-cs.2024\/ref-82","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1016\/j.comcom.2020.01.050","article-title":"Deep learning-based intelligent face recognition in IoT-cloud environment","volume":"152","author":"Masud","year":"2020","journal-title":"Computer Communications"},{"key":"10.7717\/peerj-cs.2024\/ref-83","doi-asserted-by":"crossref","first-page":"599","DOI":"10.1007\/978-981-15-3383-9_54","article-title":"Deep learning techniques: an overview","volume":"2020","author":"Mathew","year":"2021","journal-title":"Advanced Machine Learning Technologies and Applications: Proceedings of AMLTA"},{"key":"10.7717\/peerj-cs.2024\/ref-84","doi-asserted-by":"publisher","first-page":"108487","DOI":"10.1016\/j.patcog.2021.108487","article-title":"Action transformer: a self-attention model for short-time pose-based human action recognition","volume":"124","author":"Mazzia","year":"2022","journal-title":"Pattern Recognition"},{"key":"10.7717\/peerj-cs.2024\/ref-85","first-page":"1","article-title":"LAMSTAR: for IoT-based face recognition system to manage the safety factor in smart cities","volume":"2019","author":"Medapati","year":"2019","journal-title":"Transactions on Emerging Telecommunications Technologies"},{"article-title":"Smart fashion: a review of AI applications in the Fashion & Apparel Industry","year":"2021","author":"Mohammadi","key":"10.7717\/peerj-cs.2024\/ref-86"},{"article-title":"Towards verifying robustness of neural networks against semantic perturbations","year":"2019","author":"Mohapatra","key":"10.7717\/peerj-cs.2024\/ref-87"},{"issue":"44","key":"10.7717\/peerj-cs.2024\/ref-88","doi-asserted-by":"crossref","first-page":"22071","DOI":"10.1073\/pnas.1900654116","article-title":"Definitions, methods, and applications in interpretable machine learning","volume":"116","author":"Murdoch","year":"2019","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"},{"key":"10.7717\/peerj-cs.2024\/ref-89","doi-asserted-by":"publisher","first-page":"100873","DOI":"10.1016\/j.iot.2023.100873","article-title":"IoT enabled vehicle recognition system using inkjet-printed windshield tag and 5G cloud network","volume":"23","author":"Mufti","year":"2023","journal-title":"Internet of Things"},{"key":"10.7717\/peerj-cs.2024\/ref-90","doi-asserted-by":"publisher","first-page":"105906","DOI":"10.1016\/j.ijsu.2021.105906","article-title":"The PRISMA 2020 statement: an updated guideline for reporting systematic reviews","volume":"88","author":"Page","year":"2021","journal-title":"International Journal of Surgery"},{"first-page":"90","article-title":"Performance comparison of deep learning based face identification methods for video under adverse conditions","year":"2019","author":"Pala","key":"10.7717\/peerj-cs.2024\/ref-91"},{"issue":"3","key":"10.7717\/peerj-cs.2024\/ref-92","doi-asserted-by":"publisher","first-page":"369","DOI":"10.1017\/S0317167100004315","article-title":"Duchenne de boulogne: a pioneer in neurology and medical photography","volume":"32","author":"Parent","year":"2005","journal-title":"Canadian Journal of Neurological Sciences"},{"article-title":"Compound emotions: a mixed emotion detection","year":"2022","author":"Pendhari","key":"10.7717\/peerj-cs.2024\/ref-93","doi-asserted-by":"crossref","DOI":"10.2139\/ssrn.4120265"},{"issue":"3","key":"10.7717\/peerj-cs.2024\/ref-94","first-page":"385","article-title":"Comparative analysis of pattern recognition methods: an overview","volume":"2","author":"Rao","year":"2011","journal-title":"Indian Journal of Computer Science and Engineering (IJCSE)"},{"first-page":"304","article-title":"Ensemble approach for differentiation of malignant melanoma","year":"2015","author":"Rastgoo","key":"10.7717\/peerj-cs.2024\/ref-95"},{"first-page":"47","article-title":"A survey of transfer learning for convolutional neural networks","year":"2019","author":"Ribani","key":"10.7717\/peerj-cs.2024\/ref-96"},{"first-page":"1","article-title":"Ensemble learning techniques and its efficiency in machine learning: a survey","year":"2020","author":"Rincy","key":"10.7717\/peerj-cs.2024\/ref-97"},{"journal-title":"Ph.D. thesis","article-title":"Machine perception of three-dimensional solids","year":"1963","author":"Roberts","key":"10.7717\/peerj-cs.2024\/ref-98"},{"issue":"3","key":"10.7717\/peerj-cs.2024\/ref-99","doi-asserted-by":"publisher","first-page":"496","DOI":"10.3390\/electronics11030496","article-title":"Bringing emotion recognition out of the lab into real life: recent advances in sensors and machine learning","volume":"11","author":"Saganowski","year":"2022","journal-title":"Electronics"},{"key":"10.7717\/peerj-cs.2024\/ref-100","doi-asserted-by":"publisher","first-page":"817","DOI":"10.1016\/j.aej.2023.01.017","article-title":"A comprehensive survey on deep facial expression recognition: challenges, applications, and future guidelines","volume":"68","author":"Sajjad","year":"2023","journal-title":"AlexandRia Engineering Journal"},{"article-title":"A survey on facial expression recognition: modality, methodologies, challenges and emerging topics","year":"2023","author":"Shahid","key":"10.7717\/peerj-cs.2024\/ref-101"},{"volume-title":"Understanding machine learning: from theory to algorithms","year":"2014","author":"Shalev-Shwartz","key":"10.7717\/peerj-cs.2024\/ref-102","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9781107298019"},{"issue":"3","key":"10.7717\/peerj-cs.2024\/ref-103","doi-asserted-by":"crossref","first-page":"033021","DOI":"10.1117\/1.JEI.30.3.033021","article-title":"TAMNet: two attention modules-based network on facial expression recognition under uncertainty","volume":"30","author":"Shao","year":"2021","journal-title":"Journal of Electronic Imaging"},{"issue":"8","key":"10.7717\/peerj-cs.2024\/ref-104","doi-asserted-by":"crossref","first-page":"50","DOI":"10.5815\/ijigsp.2012.08.07","article-title":"Human emotion recognition system","volume":"4","author":"Singh","year":"2012","journal-title":"International Journal of Image, Graphics and Signal Processing"},{"issue":"3","key":"10.7717\/peerj-cs.2024\/ref-105","doi-asserted-by":"crossref","first-page":"519","DOI":"10.1364\/JOSAA.4.000519","article-title":"Low-dimensional procedure for the characterization of human faces","volume":"4","author":"Sirovich","year":"1987","journal-title":"Josa A"},{"issue":"2","key":"10.7717\/peerj-cs.2024\/ref-106","doi-asserted-by":"crossref","first-page":"410","DOI":"10.1108\/BIJ-09-2022-0588","article-title":"Modern-day marketing concepts based on face recognition and neuro-marketing: a review and future research directions","volume":"31","author":"Srivastava","year":"2023","journal-title":"Benchmarking: An International Journal"},{"issue":"2","key":"10.7717\/peerj-cs.2024\/ref-107","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1177\/17540739221082203","article-title":"What is an emotion? A connectionist perspective","volume":"14","author":"Suri","year":"2022","journal-title":"Emotion Review"},{"key":"10.7717\/peerj-cs.2024\/ref-108","doi-asserted-by":"publisher","first-page":"104693","DOI":"10.1016\/j.micpro.2022.104693","article-title":"The IoT-based real-time image processing for animal recognition and classification using deep convolutional neural network (DCNN)","volume":"95","author":"Surya","year":"2022","journal-title":"Microprocessors and Microsystems"},{"first-page":"1","article-title":"Going deeper with convolutions","year":"2015","author":"Szegedy","key":"10.7717\/peerj-cs.2024\/ref-109"},{"issue":"15","key":"10.7717\/peerj-cs.2024\/ref-110","doi-asserted-by":"publisher","first-page":"1811","DOI":"10.3390\/electronics10151811","article-title":"A survey on modern cloud computing security over smart city networks: threats, vulnerabilities, consequences, countermeasures, and challenges","volume":"10","author":"Tahirkheli","year":"2021","journal-title":"Electronics"},{"issue":"17","key":"10.7717\/peerj-cs.2024\/ref-111","doi-asserted-by":"publisher","first-page":"12717","DOI":"10.1007\/s00521-023-08372-9","article-title":"Real-time facial emotion recognition system among children with autism based on deep learning and IoT","volume":"35","author":"Talaat","year":"2023","journal-title":"Neural Computing and Applications"},{"key":"10.7717\/peerj-cs.2024\/ref-112","doi-asserted-by":"crossref","first-page":"102809","DOI":"10.1016\/j.dsp.2020.102809","article-title":"Face recognition: past, present and future (a review)","volume":"106","author":"Taskiran","year":"2020","journal-title":"Digital Signal Processing"},{"key":"10.7717\/peerj-cs.2024\/ref-113","doi-asserted-by":"crossref","first-page":"147711","DOI":"10.1109\/ACCESS.2020.3015917","article-title":"Complex emotion profiling: an incremental active learning based approach with sparse annotations","volume":"8","author":"Thuseethan","year":"2020","journal-title":"IEEE Access"},{"issue":"1","key":"10.7717\/peerj-cs.2024\/ref-114","first-page":"1","article-title":"Deciphering facial expressions: factors that affect emotion recognition","volume":"11","author":"Tipirneni","year":"2022","journal-title":"Journal of Student Research"},{"issue":"8","key":"10.7717\/peerj-cs.2024\/ref-115","doi-asserted-by":"crossref","first-page":"837","DOI":"10.1080\/019697200750038968","article-title":"A parameter-based combined classifier for invariant face recognition","volume":"31","author":"Tolba","year":"2000","journal-title":"Cybernetics and Systems"},{"volume-title":"Natural language processing with transformers","year":"2022","author":"Tunstall","key":"10.7717\/peerj-cs.2024\/ref-116"},{"key":"10.7717\/peerj-cs.2024\/ref-117","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1162\/jocn.1991.3.1.71","article-title":"Eigenfaces for face recognition","volume":"3","author":"Turk","year":"1991","journal-title":"Journal of Cognitive Neuroscience"},{"first-page":"586","article-title":"Face recognition using eigenfaces","year":"1991","author":"Turk","key":"10.7717\/peerj-cs.2024\/ref-118"},{"issue":"3","key":"10.7717\/peerj-cs.2024\/ref-119","first-page":"1","article-title":"Emotion recognition systems in retail: a detailed analysis of their role in enhancing customer interactions, driving sales, and predicting trends","volume":"8","author":"Van Thanh","year":"2023","journal-title":"Journal of Computational Social Dynamics"},{"first-page":"1071","article-title":"Exploring the role of computer vision in human emotion recognition: a systematic review and meta-analysis","year":"2023","author":"Vashishth","key":"10.7717\/peerj-cs.2024\/ref-120"},{"journal-title":"Ph.D. dissertation","article-title":"Recognizing compound expressions and emotion intensity","year":"2019","author":"Wagner","key":"10.7717\/peerj-cs.2024\/ref-121"},{"article-title":"Deep face recognition: a survey","year":"2019","author":"Wang","key":"10.7717\/peerj-cs.2024\/ref-122"},{"key":"10.7717\/peerj-cs.2024\/ref-123","first-page":"1","article-title":"Emotion recognition of students based on facial expressions in online education based on the perspective of computer simulation","volume":"2020","author":"Wang","year":"2020","journal-title":"Complexity"},{"issue":"8","key":"10.7717\/peerj-cs.2024\/ref-124","doi-asserted-by":"publisher","first-page":"11549","DOI":"10.1007\/s11042-022-14289-7","article-title":"Compound facial expressions image generation for complex emotions","volume":"82","author":"Win","year":"2023","journal-title":"Multimedia Tools and Applications"},{"issue":"1","key":"10.7717\/peerj-cs.2024\/ref-125","doi-asserted-by":"publisher","first-page":"e0190634","DOI":"10.1371\/journal.pone.0190634","article-title":"Sex differences in facial emotion recognition across varying expression intensity levels from videos","volume":"13","author":"Wingenbach","year":"2018","journal-title":"PLOS ONE"},{"issue":"3","key":"10.7717\/peerj-cs.2024\/ref-126","doi-asserted-by":"publisher","first-page":"468","DOI":"10.1177\/09717218211003411","article-title":"Suspect AI: vibraimage, emotion recognition technology and algorithmic opacity","volume":"28","author":"Wright","year":"2023","journal-title":"Science, Technology and Society"},{"issue":"2","key":"10.7717\/peerj-cs.2024\/ref-127","doi-asserted-by":"publisher","first-page":"807","DOI":"10.3390\/app12020807","article-title":"On-road driver emotion recognition using facial expression","volume":"12","author":"Xiao","year":"2022","journal-title":"Applied Sciences"},{"first-page":"95","article-title":"A transfer learning approach to compound facial expression recognition","year":"2020","author":"Xie","key":"10.7717\/peerj-cs.2024\/ref-128"},{"issue":"1","key":"10.7717\/peerj-cs.2024\/ref-129","doi-asserted-by":"crossref","first-page":"363","DOI":"10.1109\/TCSS.2022.3223251","article-title":"Emotion recognition from gait analyses: current research and future directions","volume":"11","author":"Xu","year":"2022","journal-title":"IEEE Transactions on Computational Social Systems"},{"first-page":"3384","article-title":"Realization of face recognition system based on Gabor wavelet and elastic bunch graph matching","year":"2013","author":"Xue-fang","key":"10.7717\/peerj-cs.2024\/ref-130"},{"key":"10.7717\/peerj-cs.2024\/ref-131","doi-asserted-by":"publisher","first-page":"76178","DOI":"10.1109\/ACCESS.2021.3082641","article-title":"Real-time facial expression recognition based on edge computing","volume":"9","author":"Yang","year":"2021","journal-title":"IEEE Access"},{"key":"10.7717\/peerj-cs.2024\/ref-132","doi-asserted-by":"publisher","first-page":"563","DOI":"10.1016\/j.future.2018.08.040","article-title":"IoT big data analytics for smart homes with fog and cloud computing","volume":"91","author":"Yassine","year":"2019","journal-title":"Future Generation Computer Systems"},{"issue":"19","key":"10.7717\/peerj-cs.2024\/ref-133","doi-asserted-by":"publisher","first-page":"3619","DOI":"10.3390\/math10193619","article-title":"A survey on deep transfer learning and beyond","volume":"10","author":"Yu","year":"2022","journal-title":"Mathematics"},{"key":"10.7717\/peerj-cs.2024\/ref-134","doi-asserted-by":"publisher","first-page":"152","DOI":"10.1007\/s11801-018-7199-6","article-title":"Application of robust face recognition in video surveillance systems","volume":"14","author":"Zhang","year":"2018","journal-title":"Optoelectronics Letters"},{"key":"10.7717\/peerj-cs.2024\/ref-135","doi-asserted-by":"publisher","first-page":"1280136","DOI":"10.3389\/fpsyg.2023.1280136","article-title":"Facial expression recognition in virtual reality environments: challenges and opportunities","volume":"14","author":"Zhang","year":"2023","journal-title":"Frontiers in Psychology"},{"first-page":"900","article-title":"Two-stage recognition and beyond for compound facial emotion recognition","year":"2020","author":"Zhang","key":"10.7717\/peerj-cs.2024\/ref-136"},{"issue":"5","key":"10.7717\/peerj-cs.2024\/ref-137","doi-asserted-by":"publisher","first-page":"1511","DOI":"10.1016\/j.patcog.2012.10.025","article-title":"Pose-robust face recognition via sparse representation","volume":"46","author":"Zhang","year":"2013","journal-title":"Pattern Recognition"},{"volume-title":"Robust face recognition using symmetric shape-from shading","year":"1999","author":"Zhao","key":"10.7717\/peerj-cs.2024\/ref-138"},{"issue":"4","key":"10.7717\/peerj-cs.2024\/ref-139","doi-asserted-by":"publisher","first-page":"399","DOI":"10.1145\/954339.954342","article-title":"Face recognition: a literature survey","volume":"35","author":"Zhao","year":"2003","journal-title":"ACM Computing Surveys (CSUR)"}],"container-title":["PeerJ Computer Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/peerj.com\/articles\/cs-2024.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/articles\/cs-2024.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/articles\/cs-2024.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/articles\/cs-2024.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,20]],"date-time":"2024-11-20T23:34:22Z","timestamp":1732145662000},"score":1,"resource":{"primary":{"URL":"https:\/\/peerj.com\/articles\/cs-2024"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,3]]},"references-count":139,"alternative-id":["10.7717\/peerj-cs.2024"],"URL":"https:\/\/doi.org\/10.7717\/peerj-cs.2024","archive":["CLOCKSS","LOCKSS","Portico"],"relation":{},"ISSN":["2376-5992"],"issn-type":[{"type":"electronic","value":"2376-5992"}],"subject":[],"published":{"date-parts":[[2024,6,3]]},"article-number":"e2024"}}