{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,3,12]],"date-time":"2025-03-12T04:04:21Z","timestamp":1741752261297,"version":"3.38.0"},"reference-count":29,"publisher":"SAGE Publications","issue":"4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["AIC"],"published-print":{"date-parts":[[2022,9,20]]},"abstract":"Achieving safe and robust autonomy is the key bottleneck on the path towards broader adoption of autonomous vehicles technology. This motivates going beyond extrinsic metrics such as miles between disengagement, and calls for approaches that embody safety by design. In this paper, we address some aspects of this challenge, with emphasis on issues of motion planning and prediction. We do this through description of novel approaches taken to solving selected sub-problems within an autonomous driving stack, in the process introducing the design philosophy being adopted within Five. This includes safe-by-design planning, interpretable as well as verifiable prediction, and modelling of perception errors to enable effective sim-to-real and real-to-sim transfer within the testing pipeline of a realistic autonomous system.<\/jats:p>","DOI":"10.3233\/aic-220148","type":"journal-article","created":{"date-parts":[[2022,9,2]],"date-time":"2022-09-02T15:21:51Z","timestamp":1662132111000},"page":"285-294","source":"Crossref","is-referenced-by-count":1,"title":["Perspectives on the system-level design of a safe autonomous driving stack"],"prefix":"10.1177","volume":"35","author":[{"given":"Majd","family":"Hawasly","sequence":"first","affiliation":[{"name":"Five AI Ltd., United Kingdom"}]},{"given":"Jonathan","family":"Sadeghi","sequence":"additional","affiliation":[{"name":"Five AI Ltd., United Kingdom"}]},{"given":"Morris","family":"Antonello","sequence":"additional","affiliation":[{"name":"Five AI Ltd., United Kingdom"}]},{"given":"Stefano\u00a0V.","family":"Albrecht","sequence":"additional","affiliation":[{"name":"Five AI Ltd., United Kingdom"},{"name":"School of Informatics, University of Edinburgh, Edinburgh, United Kingdom"}]},{"given":"John","family":"Redford","sequence":"additional","affiliation":[{"name":"Five AI Ltd., United Kingdom"}]},{"given":"Subramanian","family":"Ramamoorthy","sequence":"additional","affiliation":[{"name":"Five AI Ltd., United Kingdom"},{"name":"School of Informatics, University of Edinburgh, Edinburgh, United Kingdom"}]}],"member":"179","reference":[{"key":"10.3233\/AIC-220148_ref1","unstructured":"D.S.\u00a0Agency, The Highway Code, The Stationery Office, 2015."},{"key":"10.3233\/AIC-220148_ref2","doi-asserted-by":"crossref","unstructured":"S.V.\u00a0Albrecht, C.\u00a0Brewitt, J.\u00a0Wilhelm, B.\u00a0Gyevnar, F.\u00a0Eiras, M.\u00a0Dobre and S.\u00a0Ramamoorthy, Interpretable goal-based prediction and planning for autonomous driving, in: IEEE International Conference on Robotics and Automation (ICRA), 2021.","DOI":"10.1109\/ICRA48506.2021.9560849"},{"key":"10.3233\/AIC-220148_ref3","doi-asserted-by":"crossref","unstructured":"M.\u00a0Antonello, M.\u00a0Dobre, S.V.\u00a0Albrecht, J.\u00a0Redford and S.\u00a0Ramamoorthy, Flash: Fast and light motion prediction for autonomous driving with Bayesian inverse planning and learned motion profiles, in: IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), 2022.","DOI":"10.1109\/IROS47612.2022.9981347"},{"key":"10.3233\/AIC-220148_ref4","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-55754-6_4"},{"key":"10.3233\/AIC-220148_ref5","unstructured":"M.\u00a0Bojarski, D.\u00a0Del Testa, D.\u00a0Dworakowski, B.\u00a0Firner, B.\u00a0Flepp, P.\u00a0Goyal, L.D.\u00a0Jackel, M.\u00a0Monfort, U.\u00a0Muller, J.\u00a0Zhang et al., End to end learning for self-driving cars, in: NIPS 2016 Deep Learning Symposium, 2016."},{"key":"10.3233\/AIC-220148_ref6","doi-asserted-by":"crossref","unstructured":"C.\u00a0Brewitt, B.\u00a0Gyevnar, S.\u00a0Garcin and S.V.\u00a0Albrecht, GRIT: Fast, interpretable, and verifiable goal recognition with learned decision trees for autonomous driving, in: 2021 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, pp.\u00a01023\u20131030.","DOI":"10.1109\/IROS51168.2021.9636279"},{"key":"10.3233\/AIC-220148_ref7","unstructured":"A.\u00a0Dosovitskiy, G.\u00a0Ros, F.\u00a0Codevilla, A.\u00a0Lopez and V.\u00a0Koltun, CARLA: An open urban driving simulator, in: Proceedings of the 1st Annual Conference on Robot Learning, 2017, pp.\u00a01\u201316."},{"issue":"2","key":"10.3233\/AIC-220148_ref8","doi-asserted-by":"publisher","first-page":"822","DOI":"10.1109\/TRO.2021.3088009","article-title":"A two-stage optimization-based motion planner for safe urban driving","volume":"38","author":"Eiras","year":"2022","journal-title":"IEEE Transactions on Robotics"},{"key":"10.3233\/AIC-220148_ref9","doi-asserted-by":"publisher","DOI":"10.15607\/RSS.2021.XVII.049"},{"issue":"4","key":"10.3233\/AIC-220148_ref10","doi-asserted-by":"publisher","first-page":"1135","DOI":"10.1109\/TITS.2015.2498841","article-title":"A review of motion planning techniques for automated vehicles","volume":"17","author":"Gonz\u00e1lez","year":"2015","journal-title":"IEEE Transactions on intelligent transportation systems"},{"key":"10.3233\/AIC-220148_ref11","unstructured":"B.\u00a0Gyevnar, M.\u00a0Tamborski, C.\u00a0Wang, C.G.\u00a0Lucas, S.B.\u00a0Cohen and S.V.\u00a0Albrecht, A human-centric method for generating causal explanations in natural language for autonomous vehicle motion planning, in: IJCAI Workshop on Artificial Intelligence for Autonomous Driving, 2022."},{"key":"10.3233\/AIC-220148_ref12","doi-asserted-by":"crossref","unstructured":"J.P.\u00a0Hanna, A.\u00a0Rahman, E.\u00a0Fosong, F.\u00a0Eiras, M.\u00a0Dobre, J.\u00a0Redford, S.\u00a0Ramamoorthy and S.V.\u00a0Albrecht, Interpretable goal recognition in the presence of occluded factors for autonomous vehicles, in: 2021 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, 2021, pp.\u00a07044\u20137051.","DOI":"10.1109\/IROS51168.2021.9635903"},{"issue":"6","key":"10.3233\/AIC-220148_ref13","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1109\/37.334412","article-title":"Control issues in automated highway systems","volume":"14","author":"Hedrick","year":"1994","journal-title":"IEEE Control Systems Magazine"},{"key":"10.3233\/AIC-220148_ref14","doi-asserted-by":"crossref","unstructured":"M.\u00a0Hoss, M.\u00a0Scholtes and L.\u00a0Eckstein, A review of testing object-based environment perception for safe automated driving, Automotive Innovation (2022).","DOI":"10.1007\/s42154-021-00172-y"},{"issue":"1\u20133","key":"10.3233\/AIC-220148_ref15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1561\/0600000079","article-title":"Computer vision for autonomous vehicles: Problems, datasets and state of the art","volume":"12","author":"Janai","year":"2020","journal-title":"Foundations and Trends in Computer Graphics and Vision"},{"key":"10.3233\/AIC-220148_ref16","doi-asserted-by":"publisher","first-page":"182","DOI":"10.1016\/j.tra.2016.09.010","article-title":"Driving to safety: How many miles of driving would it take to demonstrate autonomous vehicle reliability?","volume":"94","author":"Kalra","year":"2016","journal-title":"Transportation Research Part A: Policy and Practice"},{"key":"10.3233\/AIC-220148_ref17","unstructured":"N.G.\u00a0Leveson, Engineering a Safer World: Systems Thinking Applied to Safety, MIT Press, 2016."},{"key":"10.3233\/AIC-220148_ref18","doi-asserted-by":"crossref","unstructured":"J.\u00a0Philion, A.\u00a0Kar and S.\u00a0Fidler, Learning to evaluate perception models using planner-centric metrics, in: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, 2020, pp.\u00a014055\u201314064.","DOI":"10.1109\/CVPR42600.2020.01407"},{"key":"10.3233\/AIC-220148_ref19","doi-asserted-by":"crossref","unstructured":"A.\u00a0Piazzoni, J.\u00a0Cherian, M.\u00a0Slavik and J.\u00a0Dauwels, Modeling sensing and perception errors towards robust decision making in autonomous vehicles, in: International Joint Conference on Artificial Intelligence (IJCAI-20), 2020.","DOI":"10.24963\/ijcai.2020\/483"},{"key":"10.3233\/AIC-220148_ref20","doi-asserted-by":"crossref","unstructured":"H.\u00a0Pulver, F.\u00a0Eiras, L.\u00a0Carozza, M.\u00a0Hawasly, S.\u00a0Albrecht and S.\u00a0Ramamoorthy, PILOT: Efficient planning by imitation learning and optimisation for safe autonomous driving, in: IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), 2020.","DOI":"10.1109\/IROS51168.2021.9636862"},{"key":"10.3233\/AIC-220148_ref21","doi-asserted-by":"publisher","DOI":"10.1109\/CDC.2014.7039363"},{"issue":"3","key":"10.3233\/AIC-220148_ref22","doi-asserted-by":"publisher","first-page":"900","DOI":"10.1109\/TITS.2019.2901817","article-title":"Autonomous vehicles that interact with pedestrians: A survey of theory and practice","volume":"21","author":"Rasouli","year":"2020","journal-title":"IEEE Transactions on Intelligent Transportation Systems"},{"key":"10.3233\/AIC-220148_ref23","unstructured":"S.\u00a0Ross, G.\u00a0Gordon and D.\u00a0Bagnell, A reduction of imitation learning and structured prediction to no-regret online learning, in: Proceedings of the International Conference on Artificial Intelligence and Statistics, 2011, pp.\u00a0627\u2013635."},{"key":"10.3233\/AIC-220148_ref24","unstructured":"J.\u00a0Sadeghi, B.\u00a0Rogers, J.\u00a0Gunn, T.\u00a0Saunders, S.\u00a0Samangooei, P.K.\u00a0Dokania and J.\u00a0Redford, A step towards efficient evaluation of complex perception tasks in simulation, in: NeurIPS Workshop on Machine Learning for Autonomous Driving, 2021."},{"key":"10.3233\/AIC-220148_ref25","doi-asserted-by":"crossref","unstructured":"W.\u00a0Schwarting, J.\u00a0Alonso-Mora, L.\u00a0Paull, S.\u00a0Karaman and D.\u00a0Rus, Safe nonlinear trajectory generation for parallel autonomy with a dynamic vehicle model, IEEE Transactions on Intelligent Transportation Systems 19(99) (2017).","DOI":"10.1109\/TITS.2017.2771351"},{"key":"10.3233\/AIC-220148_ref26","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1146\/annurev-control-060117-105157","article-title":"Planning and decision-making for autonomous vehicles","volume":"1","author":"Schwarting","year":"2018","journal-title":"Annual Review of Control, Robotics, and Autonomous Systems"},{"key":"10.3233\/AIC-220148_ref28","doi-asserted-by":"publisher","first-page":"58443","DOI":"10.1109\/ACCESS.2020.2983149","article-title":"A survey of autonomous driving: Common practices and emerging technologies","volume":"8","author":"Yurtsever","year":"2020","journal-title":"IEEE access"},{"key":"10.3233\/AIC-220148_ref29","doi-asserted-by":"crossref","unstructured":"E.L.\u00a0Zec, N.\u00a0Mohammadiha and A.\u00a0Schliep, Statistical sensor modelling for autonomous driving using autoregressive input-output HMMs, in: 21st International Conference on Intelligent Transportation Systems (ITSC), IEEE, 2018, pp.\u00a01331\u20131336.","DOI":"10.1109\/ITSC.2018.8569592"},{"key":"10.3233\/AIC-220148_ref30","unstructured":"K.\u00a0Zhou and J.C.\u00a0Doyle, Essentials of Robust Control, Vol.\u00a0104, Prentice Hall, Upper Saddle River, NJ, 1998."}],"container-title":["AI Communications"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/AIC-220148","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,10]],"date-time":"2025-03-10T23:37:03Z","timestamp":1741649823000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/AIC-220148"}},"subtitle":[],"editor":[{"given":"Stefano V.","family":"Albrecht","sequence":"additional","affiliation":[]},{"given":"Michael","family":"Woolridge","sequence":"additional","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2022,9,20]]},"references-count":29,"journal-issue":{"issue":"4"},"URL":"https:\/\/doi.org\/10.3233\/aic-220148","relation":{},"ISSN":["1875-8452","0921-7126"],"issn-type":[{"type":"electronic","value":"1875-8452"},{"type":"print","value":"0921-7126"}],"subject":[],"published":{"date-parts":[[2022,9,20]]}}}