{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,1]],"date-time":"2024-09-01T01:09:14Z","timestamp":1725152954364},"reference-count":73,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2020,2,4]],"date-time":"2020-02-04T00:00:00Z","timestamp":1580774400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002347","name":"Bundesministerium f\u00fcr Bildung und Forschung","doi-asserted-by":"publisher","award":["SenseEmotion","e:Med, CONFIRM, ID 01ZX1708C"],"id":[{"id":"10.13039\/501100002347","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Ministry of Science and Education Baden-W\u00fcrttemberg","award":["Projekt ZIV"]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"Several approaches have been proposed for the analysis of pain-related facial expressions. These approaches range from common classification architectures based on a set of carefully designed handcrafted features, to deep neural networks characterised by an autonomous extraction of relevant facial descriptors and simultaneous optimisation of a classification architecture. In the current work, an end-to-end approach based on attention networks for the analysis and recognition of pain-related facial expressions is proposed. The method combines both spatial and temporal aspects of facial expressions through a weighted aggregation of attention-based neural networks\u2019 outputs, based on sequences of Motion History Images (MHIs) and Optical Flow Images (OFIs). Each input stream is fed into a specific attention network consisting of a Convolutional Neural Network (CNN) coupled to a Bidirectional Long Short-Term Memory (BiLSTM) Recurrent Neural Network (RNN). An attention mechanism generates a single weighted representation of each input stream (MHI sequence and OFI sequence), which is subsequently used to perform specific classification tasks. Simultaneously, a weighted aggregation of the classification scores specific to each input stream is performed to generate a final classification output. The assessment conducted on both the BioVid Heat Pain Database (Part A) and SenseEmotion Database points at the relevance of the proposed approach, as its classification performance is on par with state-of-the-art classification approaches proposed in the literature.<\/jats:p>","DOI":"10.3390\/s20030839","type":"journal-article","created":{"date-parts":[[2020,2,5]],"date-time":"2020-02-05T08:18:48Z","timestamp":1580890728000},"page":"839","source":"Crossref","is-referenced-by-count":26,"title":["Two-Stream Attention Network for Pain Recognition from Video Sequences"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"http:\/\/orcid.org\/0000-0002-6769-8410","authenticated-orcid":false,"given":"Patrick","family":"Thiam","sequence":"first","affiliation":[{"name":"Institute of Medical Systems Biology, Ulm University, Albert-Einstein-Allee 11, 89081 Ulm, Germany"},{"name":"Institute of Neural Information Processing, Ulm University, James-Frank-Ring, 89081 Ulm, Germany"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-4759-5254","authenticated-orcid":false,"given":"Hans A.","family":"Kestler","sequence":"additional","affiliation":[{"name":"Institute of Medical Systems Biology, Ulm University, Albert-Einstein-Allee 11, 89081 Ulm, Germany"}]},{"ORCID":"http:\/\/orcid.org\/0000-0001-5118-0812","authenticated-orcid":false,"given":"Friedhelm","family":"Schwenker","sequence":"additional","affiliation":[{"name":"Institute of Neural Information Processing, Ulm University, James-Frank-Ring, 89081 Ulm, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2020,2,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1007\/s00138-010-0298-4","article-title":"Motion History Image: its variants and applications","volume":"23","author":"Ahad","year":"2012","journal-title":"Mach. Vis. Appl."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1016\/0004-3702(81)90024-2","article-title":"Determining optical flow","volume":"17","author":"Horn","year":"1981","journal-title":"Artif. Intell."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Lucey, P., Cohn, J.F., Prkachin, K.M., Solomon, P.E., and Matthews, I. (2011, January 21\u201325). Painful data: The UNBC-McMaster shoulder pain expression archive database. Proceedings of the Face and Gesture, Santa Barbara, CA, USA.","DOI":"10.1109\/FG.2011.5771462"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Walter, S., Gruss, S., Ehleiter, H., Tan, J., Traue, H.C., Crawcour, S., Werner, P., Al-Hamadi, A., and Andrade, A. (2013, January 13\u201315). The BioVid heat pain database data for the advancement and systematic validation of an automated pain recognition system. Proceedings of the IEEE International Conference on Cybernetics, Lausanne, Switzerland.","DOI":"10.1109\/CYBConf.2013.6617456"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"435","DOI":"10.1109\/TAFFC.2015.2462830","article-title":"The automatic detection of chronic pain-related expression: requirements, challenges and multimodal dataset","volume":"7","author":"Aung","year":"2016","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Velana, M., Gruss, S., Layher, G., Thiam, P., Zhang, Y., Schork, D., Kessler, V., Gruss, S., Neumann, H., and Kim, J. (2016, January 4). The SenseEmotion Database: A multimodal database for the development and systematic validation of an automatic pain- and emotion-recognition system. Proceedings of the Multimodal Pattern Recognition of Social Signals in Human-Computer-Interaction, Cancun, Mexico.","DOI":"10.1007\/978-3-319-59259-6_11"},{"key":"ref_7","unstructured":"Thiam, P., Kessler, V., and Schwenker, F. (2017, January 26\u201328). Hierarchical combination of video features for personalised pain level recognition. Proceedings of the 25th European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, Bruges, Belgium."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1109\/TAFFC.2016.2537327","article-title":"Automatic Pain Assessment with Facial Activity Descriptors","volume":"8","author":"Werner","year":"2017","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Tsai, F.S., Hsu, Y.L., Chen, W.C., Weng, Y.M., Ng, C.J., and Lee, C.C. (2016, January 8\u201312). Toward Development and Evaluation of Pain Level-Rating Scale For Emergency Triage Based on Vocal Characteristics and Facial Expressions. Proceedings of the Interspeech 2016, San-Francisco, CA, USA.","DOI":"10.21437\/Interspeech.2016-408"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Thiam, P., and Schwenker, F. (2018, January 20). Combining deep and hand-crafted features for audio-based pain intensity classification. Proceedings of the Multimodal Pattern Recognition of Social Signals in Human-Computer- Interaction, Beijing, China.","DOI":"10.1007\/978-3-030-20984-1_5"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"363","DOI":"10.3922\/j.psns.2014.041","article-title":"Automatic pain quantification using autonomic parameters","volume":"7","author":"Walter","year":"2014","journal-title":"Psych. Neurosci."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"279","DOI":"10.3389\/fnins.2017.00279","article-title":"Physiological signal-based method for measurement of pain intensity","volume":"11","author":"Chu","year":"2017","journal-title":"Front. Neurosci."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Lopez-Martinez, D., and Picard, R. (2018, January 18\u201321). Continuous pain intensity estimation from autonomic signals with recurrent neural networks. Proceedings of the 40th Annual International Conference of the IEEE Engineering in Medecine and Biology Society, Honolulu, HI, USA.","DOI":"10.1109\/EMBC.2018.8513575"},{"key":"ref_14","unstructured":"Thiam, P., and Schwenker, F. (December, January 28). Multi-modal data fusion for pain intensity assessement and classification. Proceedings of the 7th International Conference on Image Processing Theory, Tools and Applications, Montreal, QC, Canada."},{"key":"ref_15","unstructured":"Thiam, P., Kessler, V., Amirian, M., Bellmann, P., Layher, G., Zhang, Y., Velana, M., Gruss, S., Walter, S., and Traue, H.C. (2019). Multi-modal pain intensity recognition based on the SenseEmotion Database. IEEE Trans. Affect. Comput."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Thiam, P., Bellmann, P., Kestler, H.A., and Schwenker, F. (2019). Exploring deep physiological models for nociceptive pain recognition. Sensors, 19.","DOI":"10.1101\/622431"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ekman, P., and Friesen, W.V. (1978). The Facial Action Unit System: A Technique for the Measurement of Facial Movement, Consulting Psychologist Press.","DOI":"10.1037\/t27734-000"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Senechal, T., McDuff, D., and Kaliouby, R.E. (2015, January 7\u201313). Facial Action Unit detection using active learning and an efficient non-linear kernel approximation. Proceedings of the IEEE International Conference on Computer Vision Workshop, Santiago, Chile.","DOI":"10.1109\/ICCVW.2015.11"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Lucey, P., Cohn, J., Lucey, S., Matthews, I., Sridharan, S., and Prkachin, K.M. (2009, January 10\u201312). Automatically detecting pain using Facial Actions. Proceedings of the 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, Amsterdam, The Netherlands.","DOI":"10.1109\/ACII.2009.5349321"},{"key":"ref_20","unstructured":"Abe, S. (2005). Support Vector Machines for Pattern Classification, Springer."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1016\/j.csl.2005.08.001","article-title":"Application-independent evaluation of speaker detection","volume":"20","author":"Preez","year":"2006","journal-title":"Comput. Speech Lang."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Zafar, Z., and Khan, N.A. (2014, January 24\u201328). Pain intensity evaluation through Facial Action Units. Proceedings of the 22nd International Conference on Pattern Recognition, Stockholm, Sweden.","DOI":"10.1109\/ICPR.2014.803"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1109\/TIT.1967.1053964","article-title":"Nearest Neighbor Pattern Classification","volume":"13","author":"Cover","year":"1967","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1016\/j.pain.2008.04.010","article-title":"The structure, reliability and validity of pain expression: Evidence from patients with shoulder pain","volume":"139","author":"Prkachin","year":"2008","journal-title":"Pain"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Xu, X., Craig, K.D., Diaz, D., Goodwin, M.S., Akcakaya, M., Susam, B.T., Huang, J.S., and de Sa, V.S. (2018, January 13\u201314). Automated pain detection in facial videos of children using human-assisted transfer learning. Proceedings of the International Workshop on Artificial Intelligence in Health, Stockholm, Sweden.","DOI":"10.1007\/978-3-030-12738-1_12"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Monwar, M., and Rezaei, S. (2006, January 27\u201330). Pain recognition using artificial neural network. Proceedings of the IEEE International Symposium on Signal Processing and Information Theory, Vancouver, BC, Canada.","DOI":"10.1109\/ISSPIT.2006.270764"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Yang, R., Tong, S., Bordallo, M., Boutellaa, E., Peng, J., Feng, X., and Hadid, A. (2016, January 12\u201315). On pain assessment from facial videos using spatio-temporal local descriptors. Proceedings of the 6th International Conference on Image Processing Theory, Tools and Applications, Oulu, Finland.","DOI":"10.1109\/IPTA.2016.7820930"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"915","DOI":"10.1109\/TPAMI.2007.1110","article-title":"Dynamic texture recognition using local binary patterns with an application to facial expressions","volume":"29","author":"Zhao","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Ojansivu, V., and Heikkil\u00e4, J. (2008, January 1\u20133). Blur insensitive texture classification using local phase quantization. Proceedings of the Image and Signal Processing, Cherbourg-Octeville, France.","DOI":"10.1007\/978-3-540-69905-7_27"},{"key":"ref_30","unstructured":"Kannala, J., and Rahtu, E. (2012, January 11\u201315). BSIF: Binarized Statistical Image Features. Proceedings of the 21st International Conference on Pattern Recognition, Tsukuba, Japan."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"K\u00e4chele, M., Thiam, P., Amirian, M., Werner, P., Walter, S., Schwenker, F., and Palm, G. (2015, January 25\u201328). Engineering Applications of Neural Networks. Multimodal data fusion for person-independent, continuous estimation of pain Intensity. Proceedings of the Engineering Applications of Neural Networks, Rhodes, Greece.","DOI":"10.1007\/978-3-319-23983-5_26"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random Forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Thiam, P., Kessler, V., Walter, S., Palm, G., and Scwenker, F. (2016, January 4). Audio-visual recognition of pain intensity. Proceedings of the Multimodal Pattern Recognition of Social Signals in Human-Computer-Interaction, Cancun, Mexico.","DOI":"10.1007\/978-3-319-59259-6_10"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Bosch, A., Zisserman, A., and Munoz, X. (2007, January 9\u201311). Representing shape with a spatial pyramid kernel. Proceedings of the 6th ACM International Conference on Image and Video Retrieval, Amsterdam, The Netherlands.","DOI":"10.1145\/1282280.1282340"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Almaev, T.R., and Valstar, M.F. (2013, January 2\u20135). Local Gabor Binary Patterns from Three Orthogonal Planes for automatic facial expression recognition. Proceedings of the 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction, Geneva, Switzerland.","DOI":"10.1109\/ACII.2013.65"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Bellantonio, M., Haque, M.A., Rodriguez, P., Nasrollahi, K., Telve, T., Guerrero, S.E., Gonz\u00e0lez, J., Moeslund, T.B., Rasti, P., and Anbarjafari, G. (2016, January 4). Spatio-temporal pain recognition in CNN-based super-resolved facial images. Proceedings of the International Conference on Pattern Recognition: Workshop on Face and Facial Expression Recognition, Cancun, Mexico.","DOI":"10.1007\/978-3-319-56687-0_13"},{"key":"ref_37","unstructured":"Rodriguez, P., Cucurull, G., Gonz\u00e0lez, J., Gonfaus, J.M., Nasrollahi, K., Moeslund, T.B., and Roca, F.X. (2018). Deep Pain: Exploiting Long Short-Term Memory networks for facial expression classification. IEEE Trans. Cybern."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Kalischek, N., Thiam, P., Bellmann, P., and Schwenker, F. (2019, January 3\u20136). Deep domain adaptation for facial expression analysis. Proceedings of the 8th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos, Cambridge, UK.","DOI":"10.1109\/ACIIW.2019.8925055"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"LeCun, Y., Kavukcuoglu, K., and Farabet, C. (June, January 30). Convolutional networks and application in vision. Proceedings of the IEEE International Symposium on Circuits and Systems, 2010, Paris, France.","DOI":"10.1109\/ISCAS.2010.5537907"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long Short-Term Memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Soar, J., Bargshady, G., Zhou, X., and Whittaker, F. (2018, January 10\u201312). Deep learning model for detection of pain intensity from facial expression. Proceedings of the International Conference on Smart Homes and Health Telematics, Singapore.","DOI":"10.1007\/978-3-319-94523-1_22"},{"key":"ref_42","unstructured":"Lafferty, J.D., McCallum, A., and Pereira, F.C.N. (July, January 28). Conditional Random Fields: Probabilistic models for segmenting and labeling sequence data. Proceedings of the 18th International Conference on Machine Learning, Williams College, Williamstown, MA, USA."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Bargshady, G., Soar, J., Zhou, X., Deo, R.C., Whittaker, F., and Wang, H. (2019, January 23\u201325). A joint deep neural network model for pain recognition from face. Proceedings of the IEEE 4th International Conference on Computer and Communication Systems, Singapore.","DOI":"10.1109\/CCOMS.2019.8821779"},{"key":"ref_44","unstructured":"Zhou, J., Hong, X., Su, F., and Zhao, G. (July, January 26). Recurrent convolutional neural network regression for continuous pain intensity estimation in Video. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Las Vegas, NV, USA."},{"key":"ref_45","unstructured":"Liang, M., and Hi, X. (2015, January 7\u201312). Recurrent convolutional neural network for object recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Wang, F., Xiang, X., Liu, C., Tran, T.D., Reiter, A., Hager, G.D., Quaon, H., Cheng, J., and Yuille, A.L. (2017, January 17\u201320). Regularizing face verification nets for pain intensity regression. Proceedings of the IEEE International Conference on Image Processing, Beijing, China.","DOI":"10.1109\/ICIP.2017.8296449"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Meng, D., Peng, X., Wang, K., and Qiao, Y. (2019, January 22\u201325). Frame attention networks for facial expression recognition in videos. Proceedings of the IEEE International Conference on Image Processing, Taipei, Taiwan.","DOI":"10.1109\/ICIP.2019.8803603"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1109\/34.910878","article-title":"The recognition of human movement using temporal templates","volume":"23","author":"Bobick","year":"2001","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_49","unstructured":"Yin, Z., and Collins, R. (2006, January 17\u201322). Moving object localization in thermal imagery by forward-backward MHI. Proceedings of the Conference on Computer Vision and Pattern Recognition Workshop, New York, NY, USA."},{"key":"ref_50","unstructured":"Farneb\u00e4ck, G. (July, January 29). Two-frame motion estimation based on polynomial expansion. Proceedings of the Scandinavian Conference on Image Analysis, Halmstad, Sweden."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Brox, T., Bruhn, A., Papenberg, N., and Weickert, J. (2004, January 11\u201314). High accuracy optical flow estimation based on a theory for warping. Proceedings of the European Conference on Computer Vision, Prague, Czech Republic.","DOI":"10.1007\/978-3-540-24673-2_3"},{"key":"ref_52","unstructured":"Lucas, B.D., and Kanade, T. (1981, January 24\u201328). An iterative image registration technique with an application to stereo vision. Proceedings of the 7th International Joint Conference on Artificial Intelligence, University of British Columbia, Vancouver, BC, Canada."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1145\/212094.212141","article-title":"The computation of optical flow","volume":"27","author":"Beauchemin","year":"1995","journal-title":"ACM Comput. Surv."},{"key":"ref_54","unstructured":"Deligiannidis, L., and Arabnia, H.R. (2015). Chapter 21\u2014Optical flow-based representation for video action detection. Emerging Trends in Image Processing, Computer Vision and Pattern Recognition, Morgan Kaufmann."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"2031","DOI":"10.1007\/s00521-013-1362-6","article-title":"A survey of multi-view machine learning","volume":"23","author":"Sun","year":"2013","journal-title":"Neural Comput. Appl."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"2673","DOI":"10.1109\/78.650093","article-title":"Bidirectional Recurrent Neural Network","volume":"45","author":"Schuster","year":"1997","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_57","unstructured":"Hochreiter, S., Bengio, Y., and Frasconi, P. (2001). Gradient flow in recurrent nets: The difficulty of learning long-term dependencies. Field Guide to Dynamical Recurrent Networks, IEEE Press."},{"key":"ref_58","unstructured":"Clevert, D.A., Unterthiner, T., and Hochreiter, S. (2016). Fast and accurate deep network learning by exponential linear units (elus). arXiv, Available online: https:\/\/arxiv.org\/abs\/1511.07289."},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Werner, P., Al-Hamadi, A., Niese, R., Walter, S., Gruss, S., and Traue, H.C. (2014, January 24\u201328). Automatic pain recognition from video and biomedical signals. Proceedings of the International Conference on Pattern Recognition, Stockholm, Sweden.","DOI":"10.1109\/ICPR.2014.784"},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Walter, S., Gruss, S., Traue, H., Werner, P., Al-Hamadi, A., K\u00e4chele, M., Schwenker, F., Andrade, A., and Moreira, G. (2015, January 20\u201323). Data fusion for automated pain recognition. Proceedings of the 9th International Conference on Pervasive Computing Technologies for Healthcare, Istanbul, Turkey.","DOI":"10.4108\/icst.pervasivehealth.2015.259166"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"854","DOI":"10.1109\/JSTSP.2016.2535962","article-title":"Methods for person-centered continuous pain intensity assessment from bio-physiological channels","volume":"10","author":"Thiam","year":"2016","journal-title":"IEEE J. Sel. Top. Sign. Process."},{"key":"ref_62","first-page":"1","article-title":"Adaptive confidence learning for the personalization of pain intensity estimation systems","volume":"8","author":"Amirian","year":"2016","journal-title":"Evol. Syst."},{"key":"ref_63","doi-asserted-by":"crossref","unstructured":"Pedrycz, W., and Chen, S.M. (2018). Computational Intelligence for Pattern Recognition. Computational Intelligence for Pattern Recognition, Springer International Publishing.","DOI":"10.1007\/978-3-319-89629-8"},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Bellmann, P., Thiam, P., and Schwenker, F. (2019, January 3\u20136). Using a quartile-based data transtransform for pain intensity classification based on the SenseEmotion Database. Proceedings of the 8th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos, Cambridge, UK.","DOI":"10.1109\/ACIIW.2019.8925244"},{"key":"ref_65","doi-asserted-by":"crossref","unstructured":"Baltrusaitis, T., Robinson, P., and Morency, L.P. (2016, January 7\u201310). OpenFace: An open source facial behavior analysis toolkit. Proceedings of the IEEE Winter Conference on Applications of Computer Vision, Lake Placid, NY, USA.","DOI":"10.1109\/WACV.2016.7477553"},{"key":"ref_66","first-page":"120","article-title":"The OpenCV library","volume":"25","author":"Bradski","year":"2000","journal-title":"Dr Dobb\u2019s J. Softw. Tools"},{"key":"ref_67","unstructured":"Simonyan, K., and Zisserman, A. (2015). Very deep convolution networks for large-scale image recognition. arXiv, Available online: https:\/\/arxiv.org\/abs\/1409.1556."},{"key":"ref_68","unstructured":"Ioffe, S., and Szegedy, C. (2015). Batch Normalization: Accelerating deep network training by reducing internal covariate shift. arXiv, Available online: https:\/\/arxiv.org\/abs\/1502.03167."},{"key":"ref_69","unstructured":"Kingma, D.P., and Ba, J. (2015). Adam: A method for stochastic optimization. arXiv, Available online: https:\/\/arxiv.org\/abs\/1412.6980."},{"key":"ref_70","unstructured":"Chollet, F. (2020, January 21). Keras. Available online: https:\/\/keras.io."},{"key":"ref_71","unstructured":"Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, C., Davis, A., Dean, J., and Devin, M. (2020, January 21). TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. Available online: https:\/\/www.tensorflow.org\/."},{"key":"ref_72","first-page":"2825","article-title":"Scikit-learn: Machine Learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_73","doi-asserted-by":"crossref","unstructured":"Werner, P., and Al-HamadiAl-Hamadi, A.S. (2017, January 23\u201326). Analysis of facial expressiveness during experimentally induced heat pain. In Proceedings of the 7th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos, San Antonio, TX, USA.","DOI":"10.1109\/ACIIW.2017.8272610"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/3\/839\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,24]],"date-time":"2024-06-24T02:24:33Z","timestamp":1719195873000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/3\/839"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,4]]},"references-count":73,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2020,2]]}},"alternative-id":["s20030839"],"URL":"https:\/\/doi.org\/10.3390\/s20030839","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,2,4]]}}}