{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,4]],"date-time":"2024-09-04T05:52:09Z","timestamp":1725429129212},"reference-count":33,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2021,3,24]],"date-time":"2021-03-24T00:00:00Z","timestamp":1616544000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003246","name":"Nederlandse Organisatie voor Wetenschappelijk Onderzoek","doi-asserted-by":"publisher","award":["15345"],"id":[{"id":"10.13039\/501100003246","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"Aiming at continuous unobtrusive respiration monitoring, motion robustness is paramount. However, some types of motion can completely hide the respiration information and the detection of these events is required to avoid incorrect rate estimations. Therefore, this work proposes a motion detector optimized to specifically detect severe motion of infants combined with a respiration rate detection strategy based on automatic pixels selection, which proved to be robust to motion of the infants involving head and limbs. A dataset including both thermal and RGB (Red Green Blue) videos was used amounting to a total of 43 h acquired on 17 infants. The method was successfully applied to both RGB and thermal videos and compared to the chest impedance signal. The Mean Absolute Error (MAE) in segments where some motion is present was 1.16 and 1.97 breaths\/min higher than the MAE in the ideal moments where the infants were still for testing and validation set, respectively. Overall, the average MAE on the testing and validation set are 3.31 breaths\/min and 5.36 breaths\/min, using 64.00% and 69.65% of the included video segments (segments containing events such as interventions were excluded based on a manual annotation), respectively. Moreover, we highlight challenges that need to be overcome for continuous camera-based respiration monitoring. The method can be applied to different camera modalities, does not require skin visibility, and is robust to some motion of the infants.<\/jats:p>","DOI":"10.3390\/s21072268","type":"journal-article","created":{"date-parts":[[2021,3,25]],"date-time":"2021-03-25T01:36:51Z","timestamp":1616636211000},"page":"2268","source":"Crossref","is-referenced-by-count":23,"title":["Towards Continuous Camera-Based Respiration Monitoring in Infants"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"http:\/\/orcid.org\/0000-0002-1479-2446","authenticated-orcid":false,"given":"Ilde","family":"Lorato","sequence":"first","affiliation":[{"name":"Department of Electrical Engineering, Eindhoven University of Technology, 5612 AZ Eindhoven, The Netherlands"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-2518-6847","authenticated-orcid":false,"given":"Sander","family":"Stuijk","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, Eindhoven University of Technology, 5612 AZ Eindhoven, The Netherlands"}]},{"given":"Mohammed","family":"Meftah","sequence":"additional","affiliation":[{"name":"Department of Family Care Solutions, Philips Research, 5656 AE Eindhoven, The Netherlands"}]},{"given":"Deedee","family":"Kommers","sequence":"additional","affiliation":[{"name":"Department of Neonatology, Maxima Medical Centre, 5504 DB Veldhoven, The Netherlands"},{"name":"Department of Applied Physics, Eindhoven University of Technology, 5612 AZ Eindhoven, The Netherlands"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-5159-6874","authenticated-orcid":false,"given":"Peter","family":"Andriessen","sequence":"additional","affiliation":[{"name":"Department of Neonatology, Maxima Medical Centre, 5504 DB Veldhoven, The Netherlands"},{"name":"Department of Applied Physics, Eindhoven University of Technology, 5612 AZ Eindhoven, The Netherlands"}]},{"ORCID":"http:\/\/orcid.org\/0000-0001-7342-9623","authenticated-orcid":false,"given":"Carola","family":"van Pul","sequence":"additional","affiliation":[{"name":"Department of Applied Physics, Eindhoven University of Technology, 5612 AZ Eindhoven, The Netherlands"},{"name":"Department of Clinical Physics, Maxima Medical Centre, 5504 DB Veldhoven, The Netherlands"}]},{"given":"Gerard","family":"de Haan","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, Eindhoven University of Technology, 5612 AZ Eindhoven, The Netherlands"}]}],"member":"1968","published-online":{"date-parts":[[2021,3,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1038\/pr.2016.43","article-title":"Clinical associations of immature breathing in preterm infants: Part 1\u2014central apnea","volume":"80","author":"Fairchild","year":"2016","journal-title":"Pediatr. Res."},{"key":"ref_2","first-page":"34","article-title":"An overview of neonatal and pediatric wound care knowledge and considerations","volume":"53","author":"Baharestani","year":"2007","journal-title":"Ostomy\/Wound Manag."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1016\/j.siny.2003.11.009","article-title":"Neonatal cardiorespiratory monitoring techniques","volume":"9","year":"2004","journal-title":"Semin. Neonatol."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Alinovi, D., Ferrari, G., Pisani, F., and Raheli, R. (2018, January 3\u20137). Respiratory rate monitoring by video processing using local motion magnification. Proceedings of the 2018 26th European Signal Processing Conference (EUSIPCO), Rome, Italy.","DOI":"10.23919\/EUSIPCO.2018.8553066"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Sun, Y., Wang, W., Long, X., Meftah, M., Tan, T., Shan, C., Aarts, R.M., and de With, P.H.N. (2019). Respiration monitoring for premature neonates in NICU. Appl. Sci., 9.","DOI":"10.3390\/app9235246"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Jorge, J., Villarroel, M., Chaichulee, S., Guazzi, A., Davis, S., Green, G., McCormick, K., and Tarassenko, L. (June, January 30). Non-contact monitoring of respiration in the neonatal intensive care unit. Proceedings of the 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017), Washington, DC, USA.","DOI":"10.1109\/FG.2017.44"},{"key":"ref_7","unstructured":"Huang, X., Sun, L., Tian, T., Huang, Z., and Clancy, E. (2015, January 18\u201320). Real-time non-contact infant respiratory monitoring using UWB radar. Proceedings of the 2015 IEEE 16th International Conference on Communication Technology (ICCT), Hangzhou, China."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"190149","DOI":"10.1098\/rsos.190149","article-title":"Non-contact respiration monitoring using impulse radio ultrawideband radar in neonates","volume":"6","author":"Kim","year":"2019","journal-title":"R. Soc. Open Sci."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"252","DOI":"10.1038\/s41928-019-0258-6","article-title":"Vital-sign monitoring and spatial tracking of multiple people using a contactless radar-based sensor","volume":"2","author":"Mercuri","year":"2019","journal-title":"Nat. Electron."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"045003","DOI":"10.1088\/1361-6579\/ab1595","article-title":"Monitoring the respiratory rate of preterm infants using an ultrathin film sensor embedded in the bedding: A comparative feasibility study","volume":"40","author":"Joshi","year":"2019","journal-title":"Physiol. Meas."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Bu, N., Ueno, N., and Fukuda, O. (2007, January 22\u201326). Monitoring of respiration and heartbeat during sleep using a flexible piezoelectric film sensor and empirical mode decomposition. Proceedings of the 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Lyon, France.","DOI":"10.1109\/IEMBS.2007.4352551"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Bekele, A., Nizami, S., Dosso, Y.S., Aubertin, C., Greenwood, K., Harrold, J., and Green, J.R. (2018, January 11\u201313). Real-time neonatal respiratory rate estimation using a pressure-sensitive mat. Proceedings of the 2018 IEEE International Symposium on Medical Measurements and Applications (MeMeA), Rome, Italy.","DOI":"10.1109\/MeMeA.2018.8438682"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1186\/1475-925X-10-93","article-title":"Neonatal non-contact respiratory monitoring based on real-time infrared thermography","volume":"10","author":"Abbas","year":"2011","journal-title":"Biomed. Eng. Online"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"4378","DOI":"10.1364\/BOE.6.004378","article-title":"Remote monitoring of breathing dynamics using infrared thermography","volume":"6","author":"Pereira","year":"2015","journal-title":"Biomed. Opt. Express"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"350","DOI":"10.1109\/TBME.2020.2993649","article-title":"Multispectral Video Fusion for Non-contact Monitoring of Respiratory Rate and Apnea","volume":"68","author":"Scebba","year":"2021","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"e20153757","DOI":"10.1542\/peds.2015-3757","article-title":"Apnea of prematurity","volume":"137","author":"Eichenwald","year":"2016","journal-title":"Pediatrics"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1021\/acssensors.0c02042","article-title":"Noncontact Physiological Measurement Using a Camera: A Technical Review and Future Directions","volume":"6","author":"Shao","year":"2021","journal-title":"ACS Sens."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Massaroni, C., Nicol\u00f2, A., Sacchetti, M., and Schena, E. (2020). Contactless Methods For Measuring Respiratory Rate: A Review. IEEE Sens. J., to be published.","DOI":"10.3390\/s19040908"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"435","DOI":"10.1016\/B978-0-444-64029-1.00021-7","article-title":"Neonatal hypotonia and neuromuscular conditions","volume":"Volume 162","author":"Mercuri","year":"2019","journal-title":"Handbook of Clinical Neurology"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1002\/1098-2779(2000)6:4<229::AID-MRDD2>3.0.CO;2-Y","article-title":"Neonatal seizures: Early-onset seizure syndromes and their consequences for development","volume":"6","author":"Mizrahi","year":"2000","journal-title":"Ment. Retard. Dev. Disabil. Res. Rev."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"570","DOI":"10.3389\/fped.2020.00570","article-title":"Predicting apnoeic events in preterm infants","volume":"8","author":"Lim","year":"2020","journal-title":"Front. Pediatr."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1109\/JBHI.2019.2927463","article-title":"Predicting Neonatal Sepsis Using Features of Heart Rate Variability, Respiratory Characteristics, and ECG-Derived Estimates of Infant Motion","volume":"24","author":"Joshi","year":"2019","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Alinovi, D., Ferrari, G., Pisani, F., and Raheli, R. (2016, January 12\u201314). Respiratory rate monitoring by maximum likelihood video processing. Proceedings of the 2016 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT), Limassol, Cyprus.","DOI":"10.1109\/ISSPIT.2016.7886029"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1088\/0967-3334\/37\/1\/100","article-title":"Video-based respiration monitoring with automatic region of interest detection","volume":"37","author":"Janssen","year":"2015","journal-title":"Physiol. Meas."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41746-019-0199-5","article-title":"Non-contact physiological monitoring of preterm infants in the Neonatal Intensive Care Unit","volume":"2","author":"Villarroel","year":"2019","journal-title":"NPJ Digit. Med."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"4848","DOI":"10.1364\/BOE.397188","article-title":"Multi-camera infrared thermography for infant respiration monitoring","volume":"11","author":"Lorato","year":"2020","journal-title":"Biomed. Opt. Express"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Sun, Y., Kommers, D., Wang, W., Joshi, R., Shan, C., Tan, T., Aarts, R.M., van Pul, C., Andriessen, P., and de With, P.H. (2019, January 23\u201327). Automatic and continuous discomfort detection for premature infants in a NICU using video-based motion analysis. Proceedings of the 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Berlin, Germany.","DOI":"10.1109\/EMBC.2019.8857597"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1111\/j.1651-2227.1997.tb08838.x","article-title":"Recording non-nutritive sucking in the neonate. Description of an automatized system for analysis","volume":"86","author":"Lundquist","year":"1997","journal-title":"Acta Paediatr."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"268","DOI":"10.1055\/s-0038-1667289","article-title":"Non-nutritive sucking in the preterm infant","volume":"36","author":"Pineda","year":"2019","journal-title":"Am. J. Perinatol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1038\/pr.2016.58","article-title":"Clinical associations with immature breathing in preterm infants: Part 2\u2014periodic breathing","volume":"80","author":"Patel","year":"2016","journal-title":"Pediatr. Res."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1415","DOI":"10.1088\/0967-3334\/36\/7\/1415","article-title":"Quantification of periodic breathing in premature infants","volume":"36","author":"Mohr","year":"2015","journal-title":"Physiol. Meas."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Lorato, I., Stuijk, S., Meftah, M., Verkruijsse, W., and de Haan, G. (2019, January 27\u201328). Camera-Based On-Line Short Cessation of Breathing Detection. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision Workshop (ICCVW), Seoul, Korea.","DOI":"10.1109\/ICCVW.2019.00205"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1088\/0967-3334\/33\/1\/1","article-title":"A new algorithm for detecting central apnea in neonates","volume":"33","author":"Lee","year":"2011","journal-title":"Physiol. Meas."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/7\/2268\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,10]],"date-time":"2024-07-10T02:53:56Z","timestamp":1720580036000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/7\/2268"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,24]]},"references-count":33,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2021,4]]}},"alternative-id":["s21072268"],"URL":"https:\/\/doi.org\/10.3390\/s21072268","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,24]]}}}