{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,9]],"date-time":"2024-09-09T12:06:29Z","timestamp":1725883589053},"reference-count":48,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2016,3,11]],"date-time":"2016-03-11T00:00:00Z","timestamp":1457654400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"Autonomous route following with road vehicles has gained popularity in the last few decades. In order to provide highly automated driver assistance systems, different types and combinations of sensors have been presented in the literature. However, most of these approaches apply quite sophisticated and expensive sensors, and hence, the development of a cost-efficient solution still remains a challenging problem. This work proposes the use of a single monocular camera sensor for an automatic steering control, speed assistance for the driver and localization of the vehicle on a road. Herein, we assume that the vehicle is mainly traveling along a predefined path, such as in public transport. A computer vision approach is presented to detect a line painted on the road, which defines the path to follow. Visual markers with a special design painted on the road provide information to localize the vehicle and to assist in its speed control. Furthermore, a vision-based control system, which keeps the vehicle on the predefined path under inner-city speed constraints, is also presented. Real driving tests with a commercial car on a closed circuit finally prove the applicability of the derived approach. In these tests, the car reached a maximum speed of 48 km\/h and successfully traveled a distance of 7 km without the intervention of a human driver and any interruption.<\/jats:p>","DOI":"10.3390\/s16030362","type":"journal-article","created":{"date-parts":[[2016,3,14]],"date-time":"2016-03-14T15:03:45Z","timestamp":1457967825000},"page":"362","source":"Crossref","is-referenced-by-count":16,"title":["Vision-Based Steering Control, Speed Assistance and Localization for Inner-City Vehicles"],"prefix":"10.3390","volume":"16","author":[{"given":"Miguel","family":"Olivares-Mendez","sequence":"first","affiliation":[{"name":"Centre for Automation and Robotics (CAR), Universidad Polit\u00e9cnica de Madrid (UPM-CSIC), Calle de Jos\u00e9 Guti\u00e9rrez Abascal 2, 28006 Madrid, Spain"},{"name":"Interdisciplinary Centre for Security, Reliability and Trust, SnT - University of Luxembourg, Weicker 1711, Luxembourg"}]},{"given":"Jose","family":"Sanchez-Lopez","sequence":"additional","affiliation":[{"name":"Centre for Automation and Robotics (CAR), Universidad Polit\u00e9cnica de Madrid (UPM-CSIC), Calle de Jos\u00e9 Guti\u00e9rrez Abascal 2, 28006 Madrid, Spain"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-9532-3835","authenticated-orcid":false,"given":"Felipe","family":"Jimenez","sequence":"additional","affiliation":[{"name":"University Institute for Automobile Research (INSIA), Technical University of Madrid, INSIA, Campus Sur UPM, Carretera de Valencia km 7, 28031 Madrid, Spain"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-9894-2009","authenticated-orcid":false,"given":"Pascual","family":"Campoy","sequence":"additional","affiliation":[{"name":"Centre for Automation and Robotics (CAR), Universidad Polit\u00e9cnica de Madrid (UPM-CSIC), Calle de Jos\u00e9 Guti\u00e9rrez Abascal 2, 28006 Madrid, Spain"}]},{"given":"Seyed","family":"Sajadi-Alamdari","sequence":"additional","affiliation":[{"name":"Interdisciplinary Centre for Security, Reliability and Trust, SnT - University of Luxembourg, Weicker 1711, Luxembourg"}]},{"given":"Holger","family":"Voos","sequence":"additional","affiliation":[{"name":"Interdisciplinary Centre for Security, Reliability and Trust, SnT - University of Luxembourg, Weicker 1711, Luxembourg"}]}],"member":"1968","published-online":{"date-parts":[[2016,3,11]]},"reference":[{"key":"ref_1","unstructured":"Nath, C. Autonomous Road Vehicles\u2014POST Note, PN 443. Houses of Parliament. Parliamentary Office of Science and Technology, 2013. Available online: http:\/\/researchbriefings.parliament.uk\/ ResearchBriefing\/Summary\/POST-PN-443."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1007\/978-3-642-37387-9_3","article-title":"Autonomous Guided Car Using a Fuzzy Controller","volume":"Volume 480","author":"Bailey","year":"2013","journal-title":"Recent Advances in Robotics and Automation"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Luo, Q. (2015). Sports Technology and Engineering, CRC Press. Advances in Sports Technology and Engineering.","DOI":"10.1201\/b18417"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1241","DOI":"10.1016\/j.robot.2014.03.016","article-title":"Positioning accuracy improvement of laser navigation using UKF and FIS","volume":"62","author":"Jung","year":"2014","journal-title":"Robot. Auton. Syst."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Kim, J.H., Yang, W., Jo, J., Sincak, P., and Myung, H. (2015). Robot Intelligence Technology and Applications 3, Springer International Publishing.","DOI":"10.1007\/978-3-319-16841-8"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Li, S., Wei, W., and Wang, R. (2015, January 23\u201325). Study on Control Structure for the Automated Guided Vehicle Base on Visual Navigation. Proceedings of the 2015 27th Chinese Control and Decision Conference (CCDC), Qingdao, China.","DOI":"10.1109\/CCDC.2015.7162344"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1109\/MITS.2014.2336271","article-title":"Three Decades of Driver Assistance Systems: Review and Future Perspectives","volume":"6","author":"Bengler","year":"2014","journal-title":"IEEE Intell. Transp. Syst. Mag."},{"key":"ref_8","unstructured":"Bertozzi, M., Broggi, A., Conte, G., Fascioli, A., and Fascioli, R. (1998). Vision-based Automated Vehicle Guidance: The Experience of the ARGO Vehicle, Elservier."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1006\/rtim.1999.0191","article-title":"Architectural Issues on Vision-Based Automatic Vehicle Guidance: The Experience of the ARGO Project","volume":"6","author":"Broggi","year":"2000","journal-title":"Real Time Imaging"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"810","DOI":"10.1109\/70.720356","article-title":"Autonomous road vehicle guidance from autobahnen to narrow curves","volume":"14","author":"Behringer","year":"1998","journal-title":"IEEE Trans. Robot. Autom."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Shladover, S. (2006, January 17\u201320). PATH at 20 History and Major Milestones. Proceedings of the IEEE Intelligent Transportation Systems Conference (ITSC 2006), Toronto, ON, Canada.","DOI":"10.1109\/ITSC.2006.1706710"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Meyer, G., and Beiker, S. (2014). Road Vehicle Automation, Springer International Publishing.","DOI":"10.1007\/978-3-319-05990-7"},{"key":"ref_13","unstructured":"DARPA Challenge, 2015. Available online: http:\/\/www.theroboticschallenge.org."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"661","DOI":"10.1002\/rob.20147","article-title":"Winning the DARPA Grand Challenge","volume":"23","author":"Thrun","year":"2006","journal-title":"J. Field Robot."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"569","DOI":"10.1002\/rob.20258","article-title":"Junior: The Stanford Entry in the Urban Challenge","volume":"25","author":"Montemerlo","year":"2008","journal-title":"J. Field Robot."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1007\/978-3-642-03991-1_11","article-title":"Caroline: An Autonomously Driving Vehicle for Urban Environments","volume":"Volume 56","author":"Buehler","year":"2009","journal-title":"The DARPA Urban Challenge"},{"key":"ref_17","unstructured":"Google Inc., 2010. Available online: http:\/\/googleblog.blogspot.com.es\/2010\/10\/what-were-driving-at.html."},{"key":"ref_18","unstructured":"Jadranka, D., M\u00fcller, B., and Meyer, G. (2015). European Roadmap Smart Systems for Automated Driving, European Technology Platform on Smart Systems Integration (EPoSS)."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Dickmann, J., Appenrodt, N., Bloecher, H.L., Brenk, C., Hackbarth, T., Hahn, M., Klappstein, J., Muntzinger, M., and Sailer, A. (2014, January 8\u201310). Radar contribution to highly automated driving. Proceedings of the 2014 11th European Radar Conference (EuRAD), Rome, Italy.","DOI":"10.1109\/EuRAD.2014.6991295"},{"key":"ref_20","unstructured":"SARTRE Project, 2012. Accesible online: http:\/\/www.sartre-project.eu\/en\/Sidor\/default.aspx."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1016\/j.arcontrol.2012.03.012","article-title":"Autonomous vehicles control in the VisLab Intercontinental Autonomous Challenge","volume":"36","author":"Broggi","year":"2012","journal-title":"Annu. Rev. Control"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1403","DOI":"10.1109\/TITS.2013.2262331","article-title":"Extensive Tests of Autonomous Driving Technologies","volume":"14","author":"Broggi","year":"2013","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Kohlhaas, R., Schamm, T., Lenk, D., and Zollner, J. (2013, January 23\u201326). Towards driving autonomously: Autonomous cruise control in urban environments. Proceedings of the 2013 IEEE Intelligent Vehicles Symposium Workshops (IV Workshops), Gold Coast, QLD, Australia.","DOI":"10.1109\/IVWorkshops.2013.6615235"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Funke, J., Theodosis, P., Hindiyeh, R., Stanek, G., Kritatakirana, K., Gerdes, C., Langer, D., Hernandez, M., Muller-Bessler, B., and Huhnke, B. (2012, January 3\u20137). Up to the limits: Autonomous Audi TTS. Proceedings of the 2012 IEEE Intelligent Vehicles Symposium (IV), Alcala de Henares, Spain.","DOI":"10.1109\/IVS.2012.6232212"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"244","DOI":"10.1049\/iet-its.2012.0202","article-title":"Intersection detection and recognition for autonomous urban driving using a virtual cylindrical scanner","volume":"8","author":"Li","year":"2014","journal-title":"IET Intell. Transp. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"12386","DOI":"10.3390\/s120912386","article-title":"Design of a Multi-Sensor Cooperation Travel Environment Perception System for Autonomous Vehicle","volume":"12","author":"Chen","year":"2012","journal-title":"Sensors"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1049\/iet-its.2013.0167","article-title":"On creating vision-based advanced driver assistance systems","volume":"9","author":"Otaegui","year":"2015","journal-title":"IET Intell. Transp. Syst."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Morales, S., and Klette, R. (2009). A Third Eye for Performance Evaluation in Stereo Sequence Analysis, Springer Berlin Heidelberg.","DOI":"10.1007\/978-3-642-03767-2_131"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"9228","DOI":"10.3390\/s150409228","article-title":"Visual Object Recognition with 3D-Aware Features in KITTI Urban Scenes","volume":"15","author":"Yebes","year":"2015","journal-title":"Sensors"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Rezaei, M., and Klette, R. (2014, January 23\u201328). Look at the Driver, Look at the Road: No Distraction! No Accident!. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.24"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1773","DOI":"10.1109\/TITS.2013.2266661","article-title":"Looking at Vehicles on the Road: A Survey of Vision-Based Vehicle Detection, Tracking, and Behavior Analysis","volume":"14","author":"Sivaraman","year":"2013","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Satzoda, R.K., Lee, S., Lu, F., and Trivedi, M.M. (July, January 28). Snap-DAS: A vision-based driver assistance system on a SnapdragonTM embedded platform. Proceedings of the 2015 IEEE Intelligent Vehicles Symposium (IV), Seoul, Korea.","DOI":"10.1109\/IVS.2015.7225760"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Ros, G., Ramos, S., Granados, M., Bakhtiary, A., Vazquez, D., and Lopez, A.M. (2015, January 5\u20139). Vision-Based Offline-Online Perception Paradigm for Autonomous Driving. Proceedings of the 2015 IEEE Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA.","DOI":"10.1109\/WACV.2015.38"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"459","DOI":"10.1109\/TITS.2012.2221088","article-title":"Road Geometry Classification by Adaptive Shape Models","volume":"14","author":"Alvarez","year":"2013","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Wang, B., Fremont, V., and Rodriguez, S.A. (2014, January 8\u201311). Color-based road detection and its evaluation on the KITTI road benchmark. Proceedings of the 2014 IEEE Intelligent Vehicles Symposium Proceedings, Deadborn, MI, USA.","DOI":"10.1109\/IVS.2014.6856619"},{"key":"ref_36","unstructured":"Jochem, T., Pomerleau, D., and Thorpe, C. (1995, January 5\u20139). Vision-based neural network road and intersection detection and traversal. Proceedings of the 1995 IEEE\/RSJ International Conference on Intelligent Robots and Systems 95. \u2019Human Robot Interaction and Cooperative Robots\u2019, Pittsburgh, PA, USA."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TITS.2014.2347400","article-title":"Lane Departure Identification for Advanced Driver Assistance","volume":"16","author":"Gaikwad","year":"2014","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_38","unstructured":"Maddern, W., Stewart, A., McManus, C., Upcroft, B., Churchill, W., and Newman, P. (June, January 31). Illumination Invariant Imaging: Applications in Robust Vision-based Localisation, Mapping and Classification for Autonomous Vehicles. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Visual Place Recognition in Changing Environments Workshop, Hong Kong, China."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"16498","DOI":"10.3390\/s121216498","article-title":"Autonomous Manoeuvring Systems for Collision Avoidance on Single Carriageway Roads","volume":"12","author":"Jimenez","year":"2012","journal-title":"Sensors"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1080\/10798587.2012.10643247","article-title":"Low Level Control Layer Definition for Autonomous Vehicles Based on Fuzzy Logic","volume":"18","author":"Naranjo","year":"2012","journal-title":"Intell. Autom. Soft Comput."},{"key":"ref_41","first-page":"398","article-title":"Dispositivo universal para el control automatico de la direccion de un vehiculo","volume":"89","author":"Jimenez","year":"2014","journal-title":"Dyna Ing. Ind."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"55","DOI":"10.3724\/SP.J.1218.2010.00055","article-title":"Ground Feature Point Matching Based Global Localization for Driverless Vehicles","volume":"32","author":"Hui","year":"2010","journal-title":"Robots"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1007\/s10514-010-9183-2","article-title":"Unmanned aerial vehicles UAVs attitude, height, motion estimation and control using visual systems","volume":"29","author":"Campoy","year":"2010","journal-title":"Auton. Robots"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Olivares-Mendez, M., Mejias, L., IMellado-Bataller, I., and Campoy, P. (2012, January 10\u201315). See-and-avoid quadcopter using fuzzy control optimized by cross-entropy. Proceedings of the 2012 IEEE International Conference on Fuzzy Systems (FUZZ), Brisbane, QLD, Australia.","DOI":"10.1109\/FUZZ-IEEE.2012.6251179"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Siciliano, B., and Khatib, O. (2008). Springer Handbook of Robotics, Springer.","DOI":"10.1007\/978-3-540-30301-5"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Sanchez-Lopez, J.L., Campoy, P., Olivares-Mendez, M.A., Mellado-Bataller, I., and Galindo-Gallego, D. (2012, January 28\u201330). Adaptive Control System based on Linear Control Theory for the Path-Following Problem of a Car-Like Mobile Robot. Proceedings of the IFAC Conference on Advances in PID Control PID\u201912, Brescia, Italy.","DOI":"10.3182\/20120328-3-IT-3014.00043"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Olivares-Mendez, M., Mellado-Bataller, I., Campoy, P., Mondragon, I., and Martinez, C. (2011, January 6\u20138). A Visual AGV-urban Car using Fuzzy Control. Proceedings of the 2011 IEEE International Conference on Automation, Robotics and Applicatios (ICARA), Wellington, New Zealand.","DOI":"10.1109\/ICARA.2011.6144872"},{"key":"ref_48","unstructured":"Computer Vision Group - UPM (vision4uav) Website, 2016. Available online: http:\/\/vision4uav.eu\/?q =researchline\/partialAutonomousCar."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/3\/362\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,4]],"date-time":"2024-06-04T16:16:08Z","timestamp":1717517768000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/3\/362"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,3,11]]},"references-count":48,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2016,3]]}},"alternative-id":["s16030362"],"URL":"https:\/\/doi.org\/10.3390\/s16030362","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,3,11]]}}}