{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,4]],"date-time":"2024-09-04T12:55:55Z","timestamp":1725454555678},"reference-count":39,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2010,8,27]],"date-time":"2010-08-27T00:00:00Z","timestamp":1282867200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"The lack of trustworthy sensors makes development of Advanced Driver Assistance System (ADAS) applications a tough task. It is necessary to develop intelligent systems by combining reliable sensors and real-time algorithms to send the proper, accurate messages to the drivers. In this article, an application to detect and predict the movement of pedestrians in order to prevent an imminent collision has been developed and tested under real conditions. The proposed application, first, accurately measures the position of obstacles using a two-sensor hybrid fusion approach: a stereo camera vision system and a laser scanner. Second, it correctly identifies pedestrians using intelligent algorithms based on polylines and pattern recognition related to leg positions (laser subsystem) and dense disparity maps and u-v disparity (vision subsystem). Third, it uses statistical validation gates and confidence regions to track the pedestrian within the detection zones of the sensors and predict their position in the upcoming frames. The intelligent sensor application has been experimentally tested with success while tracking pedestrians that cross and move in zigzag fashion in front of a vehicle.<\/jats:p>","DOI":"10.3390\/s100908028","type":"journal-article","created":{"date-parts":[[2010,8,27]],"date-time":"2010-08-27T15:02:35Z","timestamp":1282921355000},"page":"8028-8053","source":"Crossref","is-referenced-by-count":47,"title":["Identifying and Tracking Pedestrians Based on Sensor Fusion and Motion Stability Predictions"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"http:\/\/orcid.org\/0000-0002-7485-7029","authenticated-orcid":false,"given":"Basam","family":"Musleh","sequence":"first","affiliation":[{"name":"Intelligent Systems Laboratory, Universidad Carlos III de Madrid\/ Avda de la Universidad 30, 28911, Legan\u00e9s, Madrid, Spain"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-6291-5009","authenticated-orcid":false,"given":"Fernando","family":"Garc\u00eda","sequence":"additional","affiliation":[{"name":"Intelligent Systems Laboratory, Universidad Carlos III de Madrid\/ Avda de la Universidad 30, 28911, Legan\u00e9s, Madrid, Spain"}]},{"given":"Javier","family":"Otamendi","sequence":"additional","affiliation":[{"name":"Universidad Rey Juan Carlos\/ Paseo Artilleros s\/n. 28032, Vic\u00e1lvaro, Madrid, Spain,"}]},{"given":"Jos\u00e9 M\u00aa","family":"Armingol","sequence":"additional","affiliation":[{"name":"Intelligent Systems Laboratory, Universidad Carlos III de Madrid\/ Avda de la Universidad 30, 28911, Legan\u00e9s, Madrid, Spain"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-2618-857X","authenticated-orcid":false,"given":"Arturo","family":"De la Escalera","sequence":"additional","affiliation":[{"name":"Intelligent Systems Laboratory, Universidad Carlos III de Madrid\/ Avda de la Universidad 30, 28911, Legan\u00e9s, Madrid, Spain"}]}],"member":"1968","published-online":{"date-parts":[[2010,8,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1109\/TITS.2007.903444","article-title":"Pedestrian protection systems: Issues, survey, and challenges","volume":"8","author":"Gandhi","year":"2007","journal-title":"IEEE Trans. Intell. Transp. Syst"},{"key":"ref_2","unstructured":"Broggi, A, Cerri, P, Ghidoni, S, Grisleri, P, and Ho Gi, J (2008). Proceedings of the IEEE Intelligent Vehicles Symposium, Eindhoven."},{"key":"ref_3","unstructured":"Broggi, A, Cappalunga, A, Caraffi, C, Cattani, S, Ghidoni, S, Grisleri, P, Porta, P-P, Posterli, M, Zani, P, and Beck, J (2008). Proceedings of the IEEE Intelligent Vehicles Symposium, Eindhoven."},{"key":"ref_4","unstructured":"Hwang, P, Cho, SE, Ryu, KJ, Park, S, and Kim, E Multi-classifier based LIDAR and camera fusion. Seattle, WA, USA."},{"key":"ref_5","unstructured":"Mahlisch, M, Schweiger, R, Ritter, W, and Dietmayer, K Sensorfusion using spatio-temporal aligned video and lidar for improved vehicle detection. Tokyo, Japan."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1007\/s10514-005-0611-7","article-title":"Cooperative fusion for multi-obstacles detection with use of stereovision and laser scanner","volume":"19","author":"Labayrade","year":"2005","journal-title":"Auton. Robots"},{"key":"ref_7","unstructured":"Kaempchen, N, Buehler, M, and Dietmayer, K Feature-level fusion for free-form object tracking using laserscanner and video. Las Vegas, NV, USA."},{"key":"ref_8","unstructured":"Premebida, C, Monteiro, G, Nunes, U, and Peixoto, P A lidar and vision-based approach for pedestrian and vehicle detection and tracking. Seattle, WA, USA."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"696","DOI":"10.1002\/rob.20312","article-title":"LIDAR and vision-based pedestrian detection system","volume":"26","author":"Premebida","year":"2009","journal-title":"J. Field Robotic"},{"key":"ref_10","unstructured":"Floudas, N, Polychronopoulos, A, Aycard, O, Burlet, J, and Ahrholdt, M (, June). High level sensor data fusion approaches for object recognition road environment. Istanbul, Turkey."},{"key":"ref_11","unstructured":"Kaempchen, N, and Dietmayer, K (, January October). Fusion of laser scanner and video for advanced driver assistance systems. Nagoya, Japan."},{"key":"ref_12","unstructured":"Spinello, L, and Siegwart, R Human detection using multimodal and multidimensional features. Pasadena, CA, USA."},{"key":"ref_13","unstructured":"Aycard, O, Spalanzani, A, Burlet, J, Fulgenzi, C, Dung, V, Raulo, D, and Yguel, M (, January September). Grid based fusion & tracking. Toronto, Canada."},{"key":"ref_14","unstructured":"Mahlisch, M, Hering, R, Ritter, W, and Dietmayer, K (2006). Proceedings of the IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"376","DOI":"10.1109\/70.88147","article-title":"Mobile robot location by tracking geometric beacons","volume":"7","author":"Leonard","year":"1991","journal-title":"IEEE Trans. Robotic. Autom"},{"key":"ref_16","unstructured":"Hogg, RV, Craig, A, and McKean, JW (2004). Introduction to Mathematical Statistics, Prentice Hall. [6th ed]."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"184","DOI":"10.2307\/2533155","article-title":"Confidence regions for evolutionary trajectories","volume":"52","author":"McCulloch","year":"1996","journal-title":"Biometrics"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"391","DOI":"10.1007\/978-3-642-04772-5_51","article-title":"Vehicle detection based on laser radar","volume":"5717","author":"Garcia","year":"2009","journal-title":"Lect. N. Comput. Sci"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1007\/s001380050120","article-title":"A compact algorithm for rectification of stereo pairs","volume":"12","author":"Fusiello","year":"2000","journal-title":"Mach. Vision Appl"},{"key":"ref_20","unstructured":"Fusiello, A, and Irsara, L (, January December). Quasi-Euclidean uncalibrated epipolar rectification. Tampa, FL, USA."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1023\/A:1008115206617","article-title":"Theory and practice of projective rectification","volume":"2","author":"Hartley","year":"1999","journal-title":"Int. J. Comput. Vision"},{"key":"ref_22","unstructured":"Soquet, N, Perrollaz, R, Labayrade, R, and Auber, D Free space estimation for autonomous navigation. Bielefeld, Germany."},{"key":"ref_23","unstructured":"NVIDIA CUDA Programming guide, 2.3.1 version, NVIDIA Co. Available online: http:\/\/developer.download.nvidia.com\/compute\/cuda\/1_0\/NVIDIA_CUDA_Programming_Guide_1.0.pdf (accessed on August 26, 2010)."},{"key":"ref_24","unstructured":"Stam, J, Gallup, D, and Frahm, JM (2008). CUDA stereo imaging. Draft, Available online: openvidia.sourceforge.net (accessed on August 26, 2010)."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1023\/A:1014573219977","article-title":"A taxonomy and evaluation of dense two-frame stereo correspondence algorithms","volume":"47","author":"Scharstein","year":"2002","journal-title":"Int. J. Comput. Vision"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"993","DOI":"10.1109\/TPAMI.2003.1217603","article-title":"Advances in computational stereo","volume":"25","author":"Brown","year":"2003","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1007\/s11263-006-0032-x","article-title":"Performance study on different cost aggregation approaches used in real-time stereo matching","volume":"75","author":"Gong","year":"2007","journal-title":"Int. J. Comput. Vision"},{"key":"ref_28","unstructured":"Yang, Q, Wang, L, Yang, R, Wang, S, Liao, M, and Nist\u00e9r, D Real-time global stereo matching using hierarchical belief propagation. Edinburgh, UK."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1023\/A:1014554110407","article-title":"Real time correlation based stereo vision with reduced border errors","volume":"47","author":"Innocent","year":"2002","journal-title":"Int. J. Comput. Vision"},{"key":"ref_30","unstructured":"Broggi, A, Caraffi, C, Fedriga, RI, and Grisleri, P Obstacle detection with stereo vision for off-road vehicle navigation. San Diego, CA, USA."},{"key":"ref_31","unstructured":"Labayrade, R, Aubert, D, and Tarel, JP Real time obstacles detection in stereovision on non flat road geometry through V-disparity representation. Versailles, France."},{"key":"ref_32","unstructured":"Hu, Z, and Uchimura, K U_V disparity: An efficient algorithm for stereo vision based scene analysis. Las Vegas, NV, USA."},{"key":"ref_33","unstructured":"Soquet, N, Aubert, D, and Hautiere, N Road segmentation supervised by an extended V-disparity algorithm for autonomous navigation. Istanbul, Turkey."},{"key":"ref_34","unstructured":"Lee, CH, Lim, YC, Kong, S, and Lee, JH Obstacle localization with a binarized v-disparity map using local maximum frequency values in stereo vision. Proceedings of the International Conference on Signals, Circuits and System, Monastir, Tunisia."},{"key":"ref_35","first-page":"626","article-title":"Rectangular confidence regions for the means of multivariate normal distributions","volume":"62","author":"Sidak","year":"1967","journal-title":"J. Am. Stat. Assoc"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"399","DOI":"10.2307\/2348711","article-title":"Confidence intervals versus regions","volume":"44","author":"Draper","year":"1995","journal-title":"Statistician"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"307","DOI":"10.2307\/1270037","article-title":"Bivariate extensions of the boxplot","volume":"34","author":"Goldberg","year":"1992","journal-title":"Technometrics"},{"key":"ref_38","unstructured":"Leibe, B, Cornelis, N, Cornelis, K, and van Gool, L Dynamic 3D scene analysis from a moving vehicle. Minneapolis, MN, USA."},{"key":"ref_39","unstructured":"Bolder, B, Dunn, M, Gienger, M, Janssen, H, Sugiura, H, and Goerick, C Visually guided whole body interaction. Rome, Italy."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/10\/9\/8028\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,29]],"date-time":"2024-05-29T23:25:31Z","timestamp":1717025131000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/10\/9\/8028"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,8,27]]},"references-count":39,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2010,9]]}},"alternative-id":["s100908028"],"URL":"https:\/\/doi.org\/10.3390\/s100908028","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2010,8,27]]}}}