{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,10,6]],"date-time":"2024-10-06T01:09:06Z","timestamp":1728176946589},"reference-count":62,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2021,8,10]],"date-time":"2021-08-10T00:00:00Z","timestamp":1628553600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100008555","name":"Middle Tennessee State University","doi-asserted-by":"publisher","award":["CBAS-ET"],"id":[{"id":"10.13039\/100008555","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["CNS-1919855"],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"Autonomous vehicles (AVs) rely on various types of sensor technologies to perceive the environment and to make logical decisions based on the gathered information similar to humans. Under ideal operating conditions, the perception systems (sensors onboard AVs) provide enough information to enable autonomous transportation and mobility. In practice, there are still several challenges that can impede the AV sensors\u2019 operability and, in turn, degrade their performance under more realistic conditions that actually occur in the physical world. This paper specifically addresses the effects of different weather conditions (precipitation, fog, lightning, etc.) on the perception systems of AVs. In this work, the most common types of AV sensors and communication modules are included, namely: RADAR, LiDAR, ultrasonic, camera, and global navigation satellite system (GNSS). A comprehensive overview of their physical fundamentals, electromagnetic spectrum, and principle of operation is used to quantify the effects of various weather conditions on the performance of the selected AV sensors. This quantification will lead to several advantages in the simulation world by creating more realistic scenarios and by properly fusing responses from AV sensors in any object identification model used in AVs in the physical world. Moreover, it will assist in selecting the appropriate fading or attenuation models to be used in any X-in-the-loop (XIL, e.g., hardware-in-the-loop, software-in-the-loop, etc.) type of experiments to test and validate the manner AVs perceive the surrounding environment under certain conditions.<\/jats:p>","DOI":"10.3390\/s21165397","type":"journal-article","created":{"date-parts":[[2021,8,10]],"date-time":"2021-08-10T12:57:14Z","timestamp":1628600234000},"page":"5397","source":"Crossref","is-referenced-by-count":154,"title":["An Overview of Autonomous Vehicles Sensors and Their Vulnerability to Weather Conditions"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"http:\/\/orcid.org\/0000-0002-1939-7699","authenticated-orcid":false,"given":"Jorge","family":"Vargas","sequence":"first","affiliation":[{"name":"Department of Engineering Technology, Middle Tennessee State University, Murfreesboro, TN 37132, USA"}]},{"ORCID":"http:\/\/orcid.org\/0000-0001-8942-697X","authenticated-orcid":false,"given":"Suleiman","family":"Alsweiss","sequence":"additional","affiliation":[{"name":"Global Science & Technology (GST) Inc., Greenbelt, MD 20770, USA"}]},{"given":"Onur","family":"Toker","sequence":"additional","affiliation":[{"name":"Advanced Mobility Institute (AMI), Florida Polytechnic University, 4700 Research Way, Lakeland, FL 33805, USA"}]},{"given":"Rahul","family":"Razdan","sequence":"additional","affiliation":[{"name":"Advanced Mobility Institute (AMI), Florida Polytechnic University, 4700 Research Way, Lakeland, FL 33805, USA"}]},{"given":"Joshua","family":"Santos","sequence":"additional","affiliation":[{"name":"Advanced Mobility Institute (AMI), Florida Polytechnic University, 4700 Research Way, Lakeland, FL 33805, USA"}]}],"member":"1968","published-online":{"date-parts":[[2021,8,10]]},"reference":[{"key":"ref_1","unstructured":"(2020, June 15). SAE International. Available online: https:\/\/www.sae.org."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Bimbraw, K. (2015, January 21\u201323). Autonomous cars: Past, present and future a review of the developments in the last century, the present scenario and the expected future of autonomous vehicle technology. Proceedings of the 2015 12th International Conference on Informatics in Control, Automation and Robotics (ICINCO), Colmar, France.","DOI":"10.5220\/0005540501910198"},{"key":"ref_3","unstructured":"Daraei, M. (2018). Tightly-Coupled LiDAR and Camera for Autonomous Vehicle. [Ph.D. Thesis, University of California]."},{"key":"ref_4","unstructured":"(2020, June 10). History of Autonomous Cars. Available online: https:\/\/en.wikipedia.org\/wiki\/History_of_self-driving_cars."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Jernigan, M., Alsweiss, S., Cathcart, J., and Razdan, R. (2018, January 5\u20137). Conceptual Sensors Testing Framework for Autonomous Vehicles. Proceedings of the 2018 IEEE Vehicular Networking Conference (VNC), Taipei, Taiwan.","DOI":"10.1109\/VNC.2018.8628370"},{"key":"ref_6","unstructured":"(2020, June 01). Autonomous Vehicles Cannot Be Test-Driven Enough Miles to Demonstrate Their Safety; Alternative Testing Methods Needed. Available online: https:\/\/www.rand.org\/news\/press\/2016\/04\/12.htm."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1016\/j.tra.2016.09.010","article-title":"Driving to safety: How many miles of driving would it take to demonstrate autonomous vehicle reliability?","volume":"94","author":"Kalra","year":"2016","journal-title":"Transp. Res. Part A Policy Pract."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Rosique, F., Navarro, P.J., Fern\u00e1ndez, C., and Padilla, A. (2019). A Systematic Review of Perception System and Simulators for Autonomous Vehicles Research. Sensors, 19.","DOI":"10.3390\/s19030648"},{"key":"ref_9","unstructured":"Buller, W., Wilson, B., Garbarino, J., Kelly, J., Subotic, N., Thelen, B., and Belzowski, B. (2018). Radar Congestion Study, Report No. DOT HS 812 632."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Steinbaeck, J., Steger, C., Holweg, G., and Druml, N. (2017, January 10\u201312). Next generation radar sensors in automotive sensor fusion systems. Proceedings of the 2017 Sensor Data Fusion: Trends, Solutions, Applications (SDF), Bonn, Germany.","DOI":"10.1109\/SDF.2017.8126389"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Toker, O., and Kuhn, B. (2019, January 4\u20136). A Python Based Testbed for Real-Time Testing and Visualization using Tis 77 GHz Automotive Radars. Proceedings of the 2019 IEEE Vehicular Networking Conference (VNC), Los Angeles, CA, USA.","DOI":"10.1109\/VNC48660.2019.9062830"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Vargas, J., Alsweiss, S., Jernigan, M., Amin, A., Brinkmann, M., Santos, J., and Razdan, R. (2019, January 11\u201314). Development of Sensors Testbed for Autonomous Vehicles. Proceedings of the 2019 IEEE SoutheastCon, Huntsville, AL, USA.","DOI":"10.1109\/SoutheastCon42311.2019.9020344"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"183","DOI":"10.2478\/s11772-014-0190-2","article-title":"Comparison of 905 nm and 1550 nm semiconductor laser rangefinders\u2019 performance deterioration due to adverse environmental conditions","volume":"22","author":"Wojtanowski","year":"2014","journal-title":"Opto Electron. Rev."},{"key":"ref_14","unstructured":"International Standard IEC 60825-1 (2007). Safety of Laser Products\u2014Part 1: Equipment Classification and Requirements, International Electrotechnical Commission."},{"key":"ref_15","unstructured":"(2020, June 22). Choosing an Ultrasonic Sensor for Proximity or Distance Measurement\u2014Part 1: Acoustic Considerations.FierceElectronics. Available online: https:\/\/www.fierceelectronics.com\/components\/choosing-ultrasonic-sensor-for-proximity-or-distance-measurement-part-1-acoustic-0."},{"key":"ref_16","first-page":"158","article-title":"Evaluation of Attenuation of Ultrasonic Wave in Air to Measure Concrete Roughness Using Aerial Ultrasonic Sensor","volume":"4","author":"Nagaoka","year":"2018","journal-title":"Int. J. GEOMATE"},{"key":"ref_17","unstructured":"(2019, May 28). GPS: The Global Positioning System, Available online: https:\/\/www.gps.gov\/systems\/gps."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1109\/TSMCB.2008.2005417","article-title":"Tracking by parts:A bayesian approach with component collaboration","volume":"39","author":"Chang","year":"2019","journal-title":"IEEE Trans. Syst. Man Cybern. Part B Cybern."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1409","DOI":"10.1109\/TPAMI.2011.239","article-title":"Tracking-learning-detection","volume":"34","author":"Kalal","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_20","first-page":"356","article-title":"3D2PM\u20133D Deformable part models","volume":"Volume 7577","author":"Pepik","year":"2012","journal-title":"Computer Vision\u2014ECCV"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1007\/s11263-011-0514-3","article-title":"PWP3D: Real-time segmentation and tracking of 3d objects","volume":"98","author":"Prisacariu","year":"2012","journal-title":"Int. J. Comput. Vis."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"498","DOI":"10.1109\/TITS.2014.2366248","article-title":"Stereovision-based multiple object tracking in traffic scenarios using free-form obstacle delimiters and particle filters","volume":"16","author":"Vatavu","year":"2015","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Erbs, F., Barth, A., and Franke, U. (2011, January 5\u20139). Moving vehicle detection by optimal segmentation of the dynamic stixel world. Proceedings of the 2011 IEEE Intelligent Vehicles Symposium (IV), Baden-Baden, Germany.","DOI":"10.1109\/IVS.2011.5940532"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1017\/S0263574710000299","article-title":"Far infrared pedestrian detection and tracking for night driving","volume":"29","author":"Olmeda","year":"2011","journal-title":"Robotica"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1007\/s00138-013-0570-5","article-title":"Thermal cameras and applications: A survey","volume":"25","author":"Gade","year":"2014","journal-title":"Mach. Vis. Appl."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Gonz\u00e1lez, A., Fang, Z., Socarras, Y., Serrat, J., V\u00e1zquez, D., Xu, J., L\u00f3pez, A., Gonz\u00e1lez, A., Fang, Z., and Socarras, Y. (2016). Pedestrian Detection at Day\/Night Time with Visible and FIR Cameras: A Comparison. Sensors, 16.","DOI":"10.3390\/s16060820"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Sun, H., Wang, C., and Wang, B. (2011, January 10\u201312). Night Vision Pedestrian Detection Using a Forward-Looking Infrared Camera. Proceedings of the 2011 IEEE International Workshop on Multi-Platform\/Multi-Sensor Remote Sensing and Mapping, Xiamen, China.","DOI":"10.1109\/M2RSM.2011.5697384"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"John, V., Mita, S., Liu, Z., and Qi, B. (2015, January 18\u201322). Pedestrian detection in thermal images using adaptive fuzzy C-means clustering and convolutional neural networks. Proceedings of the 2015 IEEE 14th IAPR International Conference on Machine Vision Applications (MVA), Tokyo, Japan.","DOI":"10.1109\/MVA.2015.7153177"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Forslund, D., and Bjarkefur, J. (2014, January 8\u201311). Night vision animal detection. Proceedings of the 2014 IEEE Intelligent Vehicles Symposium Proceedings, Dearborn, MI, USA.","DOI":"10.1109\/IVS.2014.6856446"},{"key":"ref_30","unstructured":"Hadj-Bachir, M., and Souza, P. (2020, July 10). LIDAR Sensor Simulation in Adverse Weather Condition for Driving Assistance Development (hal-01998668f), Hal.archives-ouvertes.fr. Available online: https:\/\/hal.archives-ouvertes.fr\/hal-01998668."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Bertoldo, S., Lucianaz, C., and Allegretti, M. (2017, January 11\u201315). 77 GHz automotive anti-collision radar used for meteorological purposes. Proceedings of the 2017 IEEE-APS Topical Conference on Antennas and Propagation in Wireless Communications (APWC), Verona, Italy.","DOI":"10.1109\/APWC.2017.8062238"},{"key":"ref_32","unstructured":"(2020, July 12). ITU, Specific Attenuation Model for Rain for Use in Prediction Methods. Available online: https:\/\/www.itu.int\/rec\/R-REC-P.838."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Gourova, R., Krasnov, O., and Yarovoy, A. (2017, January 11\u201313). Analysis of rain clutter detections in commercial 77 GHz automotive radar. Proceedings of the 2017 European Radar Conference (EURAD), Nuremberg, Germany.","DOI":"10.23919\/EURAD.2017.8249138"},{"key":"ref_34","unstructured":"Hassen, A.A. (2007). Indicators for the Signal Degradation and Optimization of Automotive Radar Sensors under Adverse Weather Conditions. [Ph.D. Thesis, TU]."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"917","DOI":"10.1023\/A:1014922632540","article-title":"Rain backscattering properties and effects on the radar performance at mm wave band","volume":"22","author":"Huang","year":"2001","journal-title":"Int. J. Infrared Millim. Waves"},{"key":"ref_36","unstructured":"Kaplan, E., and Hegarty, C. (2005). Understanding GPS: Principles and Applications, Artech House. [2nd ed.]."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1109\/MVT.2019.2892497","article-title":"The Impact of Adverse Weather Conditions on Autonomous Vehicles: How Rain, Snow, Fog, and Hail Affect the Performance of a Self-Driving Car","volume":"14","author":"Zang","year":"2019","journal-title":"IEEE Veh. Technol. Mag."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2944","DOI":"10.1109\/TIP.2017.2691802","article-title":"Clearing the skies: A deep network architecture for single-image rain removal","volume":"26","author":"Fu","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Gultepe, I. (2008). Fog and Boundary Layer Clouds: Fog Visibility and Forecasting, Birkh\u00e4user.","DOI":"10.1007\/978-3-7643-8419-7"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Awan, M.S., Leitgeb, E., Loeschnig, M., Nadeem, F., and Capsoni, C. (2009, January 20\u201323). Spatial and Time Variability of Fog Attenuations for Optical Wireless Links in the Troposphere. Proceedings of the 2009 IEEE 70th Vehicular Technology Conference Fall, Anchorage, AK, USA.","DOI":"10.1109\/VETECF.2009.5379065"},{"key":"ref_41","unstructured":"(2020, July 02). What is Humidity? How is Humidity Measured?. Available online: https:\/\/www.edinformatics.com\/math_science\/what-is-humidity.html."},{"key":"ref_42","unstructured":"(2019, July 05). Vehicles and Lightning\u2014National Lightning Safety Institute. Available online: http:\/\/lightningsafety.com\/nlsi_pls\/vehicle_strike.html."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Gaynutdinov, R.R., and Chermoshentsev, S.F. (2017, January 18\u201322). Electromagnetic stability of an unmanned aerial vehicle at the indirect effect of a lightning discharge. Proceedings of the 2017 International Multi-Conference on Engineering, Computer and Information Sciences (SIBIRCON), Novosibirsk, Russia.","DOI":"10.1109\/SIBIRCON.2017.8109917"},{"key":"ref_44","unstructured":"(2019, July 05). The Thunder Mechanism\u2014National Lightning Safety Institute. Available online: http:\/\/lightningsafety.com\/nlsi_info\/thunder.html."},{"key":"ref_45","unstructured":"(2021, March 02). Why is Sound Attenuation Greater in Dry Air than Humid Air?. Available online: https:\/\/physics.stackexchange.com\/questions\/507729\/why-is-sound-attenuation-greater-in-dry-air-than-humid-air."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1016\/j.isprsjprs.2017.06.004","article-title":"The impacts of environmental variables on water reflectance measured using a lightweight unmanned aerial vehicle (UAV)-based spectrometer system","volume":"130","author":"Zeng","year":"2017","journal-title":"ISPRS J. Photogramm. Remote. Sens."},{"key":"ref_47","unstructured":"Blowing, K. (2019, July 03). Dust and Dust Storms: One of Arizona\u2019s Most Underrated Weather Hazards. Available online: http:\/\/www.atmo.arizona.edu\/images\/news\/Aish_Article.pdf."},{"key":"ref_48","unstructured":"World Meteorological Organization (2019, July 03). Sand and Dust Storms. Available online: https:\/\/public.wmo.int\/en\/our-mandate\/focus-areas\/environment\/SDS."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1459","DOI":"10.1007\/s10694-013-0356-3","article-title":"Evaluation of Navigation Sensors in Fire Smoke Environments","volume":"50","author":"Starr","year":"2013","journal-title":"Fire Technol."},{"key":"ref_50","unstructured":"(2019, July 03). Earth\u2019s Atmospheric Layers, NASA, Available online: https:\/\/www.nasa.gov\/mission_pages\/sunearth\/science\/atmosphere-layers2.html."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Sreeja, V. (2016). Impact and mitigation of space weather effects on GNSS receiver performance. Geosci. Lett., 3.","DOI":"10.1186\/s40562-016-0057-0"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Heinzler, R., Schindler, P., Seekircher, J., Ritter, W., and Stork, W. (2019, January 9\u201312). Weather Influence and Classification with Automotive Lidar Sensors. Proceedings of the 2019 IEEE Intelligent Vehicles Symposium (IV), Paris, France.","DOI":"10.1109\/IVS.2019.8814205"},{"key":"ref_53","unstructured":"(2021, April 01). Lidar vs. Radar: Pros and Cons for Autonomous Driving. Available online: https:\/\/archer-soft.com\/blog\/lidar-vs-radar-pros-and-cons-autonomous-driving."},{"key":"ref_54","first-page":"170","article-title":"Influence of propagation effects on millimeter wave radar operation","volume":"3704","author":"Kulemin","year":"1999","journal-title":"Radar Sens. Technol."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1109\/36.3028","article-title":"Millimeter-wave propagation measurements at the ballistic research laboratory","volume":"26","author":"Wallace","year":"1988","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1175\/1520-0450(1971)010<0247:RABWIS>2.0.CO;2","article-title":"Radar attenuation by wet ice spheres","volume":"10","author":"Battan","year":"1971","journal-title":"J. Appl. Meteorol."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"464","DOI":"10.1175\/1520-0426(1990)007<0464:AASOMW>2.0.CO;2","article-title":"Attenuation and scattering of millimeter wavelength radiation by clouds and precipitation","volume":"7","author":"Lhermitte","year":"1990","journal-title":"J. Atmos. Ocean. Technol."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"1223","DOI":"10.1134\/S1064226910110033","article-title":"Estimation of attenuation and backscattering of millimeter radio waves in meteorological formations","volume":"55","author":"Pozhidaev","year":"2010","journal-title":"J. Commun. Technol. Electron."},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Yu, X., and Marinov, M. (2020). A Study on Recent Developments and Issues with Obstacle Detection Systems for Automated Vehicles. Sustainability, 12.","DOI":"10.3390\/su12083281"},{"key":"ref_60","unstructured":"Hane, C., Sattler, T., and Pollefeys, M. (October, January 28). Obstacle detection for self-driving cars using only monocular cameras and wheel odometry. Proceedings of the International Conference on Intelligent Robots and Systems, Hamburg, Germany."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"205","DOI":"10.5194\/ars-3-205-2005","article-title":"Automotive radar and lidar systems for next generation driver assistance functions","volume":"3","author":"Rasshofer","year":"2005","journal-title":"Adv. Radio Sci."},{"key":"ref_62","unstructured":"Langer, D., and Thorpe, C.E. (1992, January 7\u201310). Sonar Based Outdoor Vehicle Navigation and Collsion Avoidance. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems, Pittsburgh, PA, USA."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/16\/5397\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,16]],"date-time":"2024-07-16T23:29:48Z","timestamp":1721172588000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/16\/5397"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,10]]},"references-count":62,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2021,8]]}},"alternative-id":["s21165397"],"URL":"https:\/\/doi.org\/10.3390\/s21165397","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,10]]}}}