{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T14:52:43Z","timestamp":1740149563947,"version":"3.37.3"},"reference-count":31,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2022,8,30]],"date-time":"2022-08-30T00:00:00Z","timestamp":1661817600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"BASE project","award":["POCI-01-0145-FEDER-031581"]},{"name":"Centro de Inform\u00e1tica e Sistemas da Universidade de Coimbra"},{"name":"FCT\u2014Foundation for Science and Technology"},{"name":"national funds (PIDDAC)","award":["UIDB\/00326\/2020","UIDP\/00326\/2020"]},{"name":"Coimbra Institute for Biomedical Imaging and Translational Re-search (CIBIT)"},{"name":"Institute of Nuclear Sciences Applied to Health (ICNAS)"},{"DOI":"10.13039\/501100005727","name":"University of Coimbra","doi-asserted-by":"crossref","award":["PTDC\/PSI-GER\/30852\/2017|CONNECT-BCI"],"id":[{"id":"10.13039\/501100005727","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"Ultra-short-term HRV features assess minor autonomous nervous system variations such as variations resulting from cognitive stress peaks during demanding tasks. Several studies compare ultra-short-term and short-term HRV measurements to investigate their reliability. However, existing experiments are conducted in low cognitively demanding environments. In this paper, we propose to evaluate these measurements\u2019 reliability under cognitively demanding tasks using a near real-life setting. For this purpose, we selected 31 HRV features, extracted from data collected from 21 programmers performing code comprehension, and compared them across 18 different time frames, ranging from 3 min to 10 s. Statistical significance and correlation tests were performed between the features extracted using the larger window (3 min) and the same features extracted with the other 17 time frames. We paired these analyses with Bland\u2013Altman plots to inspect how the extraction window size affects the HRV features. The main results show 13 features that presented at least 50% correlation when using 60-second windows. The HF and mNN features achieved around 50% correlation using a 30-second window. The 30-second window was the smallest time frame considered to have reliable measurements. Furthermore, the mNN feature proved to be quite robust to the shortening of the time resolution.<\/jats:p>","DOI":"10.3390\/s22176528","type":"journal-article","created":{"date-parts":[[2022,8,31]],"date-time":"2022-08-31T04:13:56Z","timestamp":1661919236000},"page":"6528","source":"Crossref","is-referenced-by-count":10,"title":["How Reliable Are Ultra-Short-Term HRV Measurements during Cognitively Demanding Tasks?"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6408-9938","authenticated-orcid":false,"given":"Andr\u00e9","family":"Bernardes","sequence":"first","affiliation":[{"name":"Centre for Informatics and Systems of the University of Coimbra (CISUC), 3030-290 Coimbra, Portugal"}]},{"given":"Ricardo","family":"Couceiro","sequence":"additional","affiliation":[{"name":"Centre for Informatics and Systems of the University of Coimbra (CISUC), 3030-290 Coimbra, Portugal"}]},{"given":"J\u00falio","family":"Medeiros","sequence":"additional","affiliation":[{"name":"Centre for Informatics and Systems of the University of Coimbra (CISUC), 3030-290 Coimbra, Portugal"}]},{"given":"Jorge","family":"Henriques","sequence":"additional","affiliation":[{"name":"Centre for Informatics and Systems of the University of Coimbra (CISUC), 3030-290 Coimbra, Portugal"}]},{"given":"C\u00e9sar","family":"Teixeira","sequence":"additional","affiliation":[{"name":"Centre for Informatics and Systems of the University of Coimbra (CISUC), 3030-290 Coimbra, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3713-2464","authenticated-orcid":false,"given":"Marco","family":"Sim\u00f5es","sequence":"additional","affiliation":[{"name":"Centre for Informatics and Systems of the University of Coimbra (CISUC), 3030-290 Coimbra, Portugal"}]},{"given":"Jo\u00e3o","family":"Dur\u00e3es","sequence":"additional","affiliation":[{"name":"Centre for Informatics and Systems of the University of Coimbra (CISUC), 3030-290 Coimbra, Portugal"}]},{"given":"Raul","family":"Barbosa","sequence":"additional","affiliation":[{"name":"Centre for Informatics and Systems of the University of Coimbra (CISUC), 3030-290 Coimbra, Portugal"}]},{"given":"Henrique","family":"Madeira","sequence":"additional","affiliation":[{"name":"Centre for Informatics and Systems of the University of Coimbra (CISUC), 3030-290 Coimbra, Portugal"}]},{"given":"Paulo","family":"Carvalho","sequence":"additional","affiliation":[{"name":"Centre for Informatics and Systems of the University of Coimbra (CISUC), 3030-290 Coimbra, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"258","DOI":"10.3389\/fpubh.2017.00258","article-title":"Ginsberg. An overview of heart rate variability metrics and norms","volume":"5","author":"Shaffer","year":"2017","journal-title":"Front. Public Health"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1049\/htl.2017.0090","article-title":"Are ultra-short heart rate variability features good surrogates of short-term ones? State-of-the-art review and recommendations","volume":"5","author":"Pecchia","year":"2018","journal-title":"Healthc. Technol. Lett."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"710","DOI":"10.3389\/fnins.2019.00710","article-title":"Heart rate variability and cognitive function: A systematic review","volume":"13","author":"Forte","year":"2019","journal-title":"Front. Neurosci."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1088\/0967-3334\/23\/2\/308","article-title":"A study on the optimum order of autoregressive models for heart rate variability","volume":"23","author":"Boardman","year":"2002","journal-title":"Physiol. Meas."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"594880","DOI":"10.3389\/fnins.2020.594880","article-title":"A critical review of ultra-short-term heart rate variability norms research","volume":"14","author":"Shaffer","year":"2020","journal-title":"Front. Neurosci."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"101736","DOI":"10.1016\/j.bspc.2019.101736","article-title":"Multilevel mental stress detection using ultra-short pulse rate variability series","volume":"57","author":"Zubair","year":"2020","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"370","DOI":"10.1016\/j.bspc.2015.02.012","article-title":"Acute mental stress assessment via short term HRV analysis in healthy adults: A systematic review with meta-analysis","volume":"18","author":"Castaldo","year":"2015","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Salahuddin, L., Cho, J., Jeong, M.G., and Kim, D. (2007, January 22\u201326). Ultra short term analysis of heart rate variability for monitoring mental stress in mobile settings. Proceedings of the 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Lyon, France.","DOI":"10.1109\/IEMBS.2007.4353378"},{"key":"ref_9","unstructured":"Hall, J.E., and Hall, M.E. (2020). Guyton and Hall Textbook of Medical Physiology e-Book, Elsevier Health Sciences."},{"key":"ref_10","unstructured":"(1996). Heart rate variability: Standards of measurement, physiological interpretation, and clinical use. Task Force of the European Society of Cardiology the North American Society of Pacing and Electrophysiology. Circulation, 93, 1043\u20131065."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Castaldo, R., Montesinos, L., Melillo, P., James, C., and Pecchia, L. (2019). Ultra-short term HRV features as surrogates of short term HRV: A case study on mental stress detection in real life. BMC Med. Inform. Decis. Mak., 19.","DOI":"10.1186\/s12911-019-0742-y"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"741","DOI":"10.1109\/JBHI.2017.2694999","article-title":"Reliability of lagged poincar\u00e9 plot parameters in ultrashort heart rate variability series: Application on affective sounds","volume":"22","author":"Nardelli","year":"2017","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Landreani, F., Faini, A., Martin-Yebra, A., Morri, M., Parati, G., and Caiani, E.G. (2019). Assessment of ultra-short heart variability indices derived by smartphone accelerometers for stress detection. Sensors, 19.","DOI":"10.20944\/preprints201907.0062.v1"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Minelli, R., Mocci, A., and Lanza, M. (2015, January 18\u201319). I know what you did last summer-an investigation of how developers spend their time. Proceedings of the 2015 IEEE 23rd International Conference on Program Comprehension, Florence, Italy.","DOI":"10.1109\/ICPC.2015.12"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"110946","DOI":"10.1016\/j.jss.2021.110946","article-title":"Brain and autonomic nervous system activity measurement in software engineering: A systematic literature review","volume":"178","author":"Weber","year":"2021","journal-title":"J. Syst. Softw."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"404","DOI":"10.1089\/tmj.2014.0104","article-title":"Reliability of ultra-short-term analysis as a surrogate of standard 5-min analysis of heart rate variability","volume":"21","author":"Baek","year":"2015","journal-title":"Telemed. e-Health"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"545","DOI":"10.3389\/fneur.2019.00545","article-title":"Spectral analysis of heart rate variability: Time window matters","volume":"10","author":"Li","year":"2019","journal-title":"Front. Neurol."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Salahuddin, L., Jeong, M.G., and Kim, D. (2007, January 19\u201322). Ultra short term analysis of heart rate variability using normal sinus rhythm and atrial fibrillation ECG data. Proceedings of the 2007 9th International Conference on e-Health Networking, Application and Services, Taipei, Taiwan.","DOI":"10.1109\/HEALTH.2007.381639"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1111\/j.1542-474X.2011.00417.x","article-title":"Reliability of ultra-short ECG indices for heart rate variability","volume":"16","author":"Nussinovitch","year":"2011","journal-title":"Ann. Noninvasive Electrocardiol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"747","DOI":"10.1007\/s11517-006-0097-2","article-title":"Reliability and accuracy of heart rate variability metrics versus ECG segment duration","volume":"44","author":"McNames","year":"2006","journal-title":"Med. Biol. Eng. Comput."},{"key":"ref_21","unstructured":"Rehatschek, H., and Kienast, G. (, January May). Vizard-an innovative tool for video navigation, retrieval, annotation and editing. Proceedings of the 23rd Workshop of PVA: Multimedia and Middleware, Vienna, Austria."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1075\/ml.6.1.06ste","article-title":"The EEG\/ERP technologies in linguistic research: An essay on the advantages they offer and a survey of their purveyors","volume":"6","author":"Stemmer","year":"2011","journal-title":"Ment. Lex."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"720","DOI":"10.1016\/j.neuroimage.2005.06.067","article-title":"Removal of FMRI environment artifacts from EEG data using optimal basis sets","volume":"28","author":"Niazy","year":"2005","journal-title":"Neuroimage"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1186\/1475-925X-3-28","article-title":"Real time electrocardiogram QRS detection using combined adaptive threshold","volume":"3","author":"Christov","year":"2004","journal-title":"Biomed. Eng. Online"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.15761\/JIC.1000258","article-title":"Heart rate variability: Highlights from hidden signals","volume":"4","author":"Yilmaz","year":"2018","journal-title":"J. Integr. Cardiol."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Vollmer, M. (2015, January 6\u20139). A robust, simple and reliable measure of heart rate variability using relative RR intervals. Proceedings of the 2015 Computing in Cardiology Conference (CinC), Nice, France.","DOI":"10.1109\/CIC.2015.7410984"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Sahoo, T.K., Mahapatra, A., and Ruban, N. (2019, January 22\u201323). Stress index calculation and analysis based on heart rate variability of ECG signal with arrhythmia. Proceedings of the 2019 Innovations in Power and Advanced Computing Technologies (i-PACT), Vellore, India.","DOI":"10.1109\/i-PACT44901.2019.8959524"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1186\/1475-925X-10-96","article-title":"Nonlinear Heart Rate Variability features for real-life stress detection. Case study: Students under stress due to university examination","volume":"10","author":"Melillo","year":"2011","journal-title":"Biomed. Eng. Online"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/0010-4825(88)90041-8","article-title":"Fractals and the analysis of waveforms","volume":"18","author":"Katz","year":"1988","journal-title":"Comput. Biol. Med."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1016\/0167-2789(88)90081-4","article-title":"Approach to an irregular time series on the basis of the fractal theory","volume":"31","author":"Higuchi","year":"1988","journal-title":"Phys. D Nonlinear Phenom."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1037\/0021-9010.72.1.146","article-title":"Averaging correlation coefficients: Should Fisher\u2019s z transformation be used?","volume":"72","author":"Silver","year":"1987","journal-title":"J. Appl. Psychol."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/17\/6528\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,17]],"date-time":"2025-01-17T21:19:20Z","timestamp":1737148760000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/17\/6528"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,30]]},"references-count":31,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2022,9]]}},"alternative-id":["s22176528"],"URL":"https:\/\/doi.org\/10.3390\/s22176528","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2022,8,30]]}}}