{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,19]],"date-time":"2024-09-19T16:25:42Z","timestamp":1726763142942},"reference-count":67,"publisher":"Association for Computing Machinery (ACM)","issue":"6","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2022,12]]},"abstract":"\n We introduce a novel\n differentiable hybrid traffic simulator<\/jats:italic>\n , which simulates traffic using a hybrid model of both macroscopic and microscopic models and can be directly\n integrated into a neural network for traffic control and flow optimization.<\/jats:italic>\n This is the first differentiable traffic simulator for macroscopic and hybrid models that can compute gradients for traffic states across time steps and inhomogeneous lanes. To compute the gradient flow between two types of traffic models in a hybrid framework, we present a novel intermediate conversion component that bridges the lanes in a differentiable manner as well. We also show that we can use analytical gradients to accelerate the overall process and enhance scalability. Thanks to these gradients, our simulator can provide more efficient and scalable solutions for complex learning and control problems posed in traffic engineering than other existing algorithms. Refer to https:\/\/sites.google.com\/umd.edu\/diff-hybrid-traffic-sim for our project.\n <\/jats:p>","DOI":"10.1145\/3550454.3555492","type":"journal-article","created":{"date-parts":[[2022,11,30]],"date-time":"2022-11-30T21:19:07Z","timestamp":1669843147000},"page":"1-10","update-policy":"http:\/\/dx.doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["Differentiable Hybrid Traffic Simulation"],"prefix":"10.1145","volume":"41","author":[{"given":"Sanghyun","family":"Son","sequence":"first","affiliation":[{"name":"University of Maryland"}]},{"given":"Yi-Ling","family":"Qiao","sequence":"additional","affiliation":[{"name":"University of Maryland"}]},{"given":"Jason","family":"Sewall","sequence":"additional","affiliation":[{"name":"NVIDIA"}]},{"given":"Ming C.","family":"Lin","sequence":"additional","affiliation":[{"name":"University of Maryland"}]}],"member":"320","published-online":{"date-parts":[[2022,11,30]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/IROS45743.2020.9341538"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3437959.3459261"},{"key":"e_1_2_2_3_1","series-title":"SIAM journal on applied mathematics 60, 3","volume-title":"Resurrection of\" second order\" models of traffic flow","author":"Aw AATM","year":"2000","unstructured":"AATM Aw and Michel Rascle. 2000. Resurrection of\" second order\" models of traffic flow. SIAM journal on applied mathematics 60, 3 (2000), 916--938."},{"key":"e_1_2_2_4_1","volume-title":"Dynamical model of traffic congestion and numerical simulation. Physical review E 51, 2","author":"Bando Masako","year":"1995","unstructured":"Masako Bando, Katsuya Hasebe, Akihiro Nakayama, Akihiro Shibata, and Yuki Sugiyama. 1995. Dynamical model of traffic congestion and numerical simulation. Physical review E 51, 2 (1995), 1035."},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.3141\/1852-24"},{"key":"e_1_2_2_6_1","volume-title":"A unified framework for hybrid control: Model and optimal control theory","author":"Branicky Michael S","year":"1998","unstructured":"Michael S Branicky, Vivek S Borkar, and Sanjoy K Mitter. 1998. A unified framework for hybrid control: Model and optimal control theory. IEEE transactions on automatic control 43, 1 (1998), 31--45."},{"key":"e_1_2_2_7_1","volume-title":"Differentiable 3D CAD Programs for Bidirectional Editing. arXiv preprint arXiv:2110.01182","author":"Cascaval Dan","year":"2021","unstructured":"Dan Cascaval, Mira Shalah, Phillip Quinn, Rastislav Bodik, Maneesh Agrawala, and Adriana Schulz. 2021. Differentiable 3D CAD Programs for Bidirectional Editing. arXiv preprint arXiv:2110.01182 (2021)."},{"key":"e_1_2_2_8_1","unstructured":"Michael J Cassidy and John R Windover. 1995. v\u00cdethodology for Assessing Dynamics of Freeway Traffic Flow. (1995)."},{"key":"e_1_2_2_9_1","volume-title":"Interaction Fields: Intuitive Sketch-based Steering Behaviors for Crowd Simulation. In Computer Graphics Forum.","author":"Colas Ad\u00e8le","year":"2022","unstructured":"Ad\u00e8le Colas, Wouter van Toll, Katja Zibrek, Ludovic Hoyet, Anne-H\u00e9l\u00e8ne Olivier, and Julien Pettr\u00e9. 2022. Interaction Fields: Intuitive Sketch-based Steering Behaviors for Crowd Simulation. In Computer Graphics Forum."},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/0191-2615(95)00007-Z"},{"key":"e_1_2_2_11_1","volume-title":"End-to-end differentiable physics for learning and control. Advances in neural information processing systems 31","author":"de Avila Belbute-Peres Filipe","year":"2018","unstructured":"Filipe de Avila Belbute-Peres, Kevin Smith, Kelsey Allen, Josh Tenenbaum, and J Zico Kolter. 2018. End-to-end differentiable physics for learning and control. Advances in neural information processing systems 31 (2018), 7178--7189."},{"key":"e_1_2_2_12_1","volume-title":"Proceedings of the 1st Annual Conference on Robot Learning. 1--16","author":"Dosovitskiy Alexey","year":"2017","unstructured":"Alexey Dosovitskiy, German Ros, Felipe Codevilla, Antonio Lopez, and Vladlen Koltun. 2017. CARLA: An Open Urban Driving Simulator. In Proceedings of the 1st Annual Conference on Robot Learning. 1--16."},{"key":"e_1_2_2_13_1","volume-title":"DiffPD: Differentiable Projective Dynamics with Contact. arXiv:2101.05917","author":"Du Tao","year":"2021","unstructured":"Tao Du, Kui Wu, Pingchuan Ma, Sebastien Wah, Andrew Spielberg, Daniela Rus, and Wojciech Matusik. 2021. DiffPD: Differentiable Projective Dynamics with Contact. arXiv:2101.05917 (2021)."},{"key":"e_1_2_2_14_1","doi-asserted-by":"crossref","unstructured":"Tao Du Kui Wu Andrew Spielberg Wojciech Matusik Bo Zhu and Eftychios Sifakis. 2020. Functional Optimization of Fluidic Devices with Differentiable Stokes Flow. ACM Trans. Graph. (2020).","DOI":"10.1145\/3414685.3417795"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12544-020-00440-8"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/ROBOT.2001.932546"},{"key":"e_1_2_2_17_1","volume-title":"Car-following theory of steady-state traffic flow. Operations research 7, 4","author":"Gazis Denos C","year":"1959","unstructured":"Denos C Gazis, Robert Herman, and Renfrey B Potts. 1959. Car-following theory of steady-state traffic flow. Operations research 7, 4 (1959), 499--505."},{"key":"e_1_2_2_18_1","volume-title":"Nonlinear follow-the-leader models of traffic flow. Operations research 9, 4","author":"Gazis Denos C","year":"1961","unstructured":"Denos C Gazis, Robert Herman, and Richard W Rothery. 1961. Nonlinear follow-the-leader models of traffic flow. Operations research 9, 4 (1961), 545--567."},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417766"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/0191-2615(81)90037-0"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2366145.2366167"},{"key":"e_1_2_2_22_1","volume-title":"International conference on machine learning. PMLR","author":"Haarnoja Tuomas","year":"2018","unstructured":"Tuomas Haarnoja, Aurick Zhou, Pieter Abbeel, and Sergey Levine. 2018. Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor. In International conference on machine learning. PMLR, 1861--1870."},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450626.3459954"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-32494-1_4"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3386569.3392407"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.15607\/RSS.2021.XVII.067"},{"key":"e_1_2_2_27_1","volume-title":"NeurIPS Workshop.","author":"Holl Philipp","year":"2020","unstructured":"Philipp Holl, Vladlen Koltun, Kiwon Um, and Nils Thuerey. 2020. phiflow: A differentiable pde solving framework for deep learning via physical simulations. In NeurIPS Workshop."},{"key":"e_1_2_2_28_1","unstructured":"Yuanming Hu Luke Anderson Tzu-Mao Li Qi Sun Nathan Carr Jonathan Ragan-Kelley and Fr\u00e9do Durand. 2020. DiffTaichi: Differentiable Programming for Physical Simulation. In ICLR."},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3478513.3480520"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.64.017101"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.3141\/1999-10"},{"key":"e_1_2_2_32_1","unstructured":"Dieter Kraft et al. 1988. A software package for sequential quadratic programming. (1988)."},{"key":"e_1_2_2_33_1","doi-asserted-by":"crossref","unstructured":"Randall J LeVeque et al. 2002. Finite volume methods for hyperbolic problems. Vol. 31. Cambridge university press.","DOI":"10.1017\/CBO9780511791253"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275109"},{"key":"e_1_2_2_35_1","unstructured":"Yifei Li Tao Du Kui Wu Jie Xu and Wojciech Matusik. 2022. DiffCloth: Differentiable Cloth Simulation with Dry Frictional Contact. ACM Trans. Graph. (2022)."},{"key":"e_1_2_2_36_1","volume-title":"Traffic simulation. Traffic flow theory","author":"Lieberman Edward","year":"1997","unstructured":"Edward Lieberman and Ajay K Rathi. 1997. Traffic simulation. Traffic flow theory (1997)."},{"key":"e_1_2_2_37_1","series-title":"Series A. Mathematical and Physical Sciences 229, 1178","volume-title":"On kinematic waves II. A theory of traffic flow on long crowded roads. Proceedings of the Royal Society of London","author":"Lighthill Michael James","year":"1955","unstructured":"Michael James Lighthill and Gerald Beresford Whitham. 1955. On kinematic waves II. A theory of traffic flow on long crowded roads. Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences 229, 1178 (1955), 317--345."},{"key":"e_1_2_2_38_1","volume-title":"Continuous control with deep reinforcement learning. arXiv preprint arXiv:1509.02971","author":"Lillicrap Timothy P","year":"2015","unstructured":"Timothy P Lillicrap, Jonathan J Hunt, Alexander Pritzel, Nicolas Heess, Tom Erez, Yuval Tassa, David Silver, and Daan Wierstra. 2015. Continuous control with deep reinforcement learning. arXiv preprint arXiv:1509.02971 (2015)."},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/ITSC.2018.8569938"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450626.3459832"},{"key":"e_1_2_2_41_1","unstructured":"Laurent Magne Sylvestre Rabut and Jean-Fran\u00e7ois Gabard. 2000. Towards an hybrid macro-micro traffic flow simulation model. In INFORMS spring 2000 meeting."},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.3182\/20060829-3-NL-2908.00108"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10404-009-0529-z"},{"key":"e_1_2_2_44_1","volume-title":"International Conference on Machine Learning. PMLR, 7805--7817","author":"Zamora Mora Miguel Angel","year":"2021","unstructured":"Miguel Angel Zamora Mora, Momchil P Peychev, Sehoon Ha, Martin Vechev, and Stelian Coros. 2021. PODS: Policy Optimization via Differentiable Simulation. In International Conference on Machine Learning. PMLR, 7805--7817."},{"key":"e_1_2_2_45_1","doi-asserted-by":"crossref","unstructured":"Rahul Narain Abhinav Golas Sean Curtis and Ming C Lin. 2009. Aggregate dynamics for dense crowd simulation. In ACM SIGGRAPH Asia 2009 papers. 1--8.","DOI":"10.1145\/1661412.1618468"},{"key":"e_1_2_2_46_1","doi-asserted-by":"crossref","unstructured":"Rahul Narain Abhinav Golas and Ming C Lin. 2010. Free-flowing granular materials with two-way solid coupling. In ACM SIGGRAPH Asia 2010 papers. 1--10.","DOI":"10.1145\/1866158.1866195"},{"key":"e_1_2_2_47_1","volume-title":"A simplex method for function minimization. The computer journal 7, 4","author":"Nelder John A","year":"1965","unstructured":"John A Nelder and Roger Mead. 1965. A simplex method for function minimization. The computer journal 7, 4 (1965), 308--313."},{"key":"e_1_2_2_48_1","volume-title":"Nonlinear effects in the dynamics of car following. Operations research 9, 2","author":"Newell Gordon Frank","year":"1961","unstructured":"Gordon Frank Newell. 1961. Nonlinear effects in the dynamics of car following. Operations research 9, 2 (1961), 209--229."},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356498"},{"key":"e_1_2_2_50_1","volume-title":"Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems 32","author":"Paszke Adam","year":"2019","unstructured":"Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et al. 2019. Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems 32 (2019), 8026--8037."},{"key":"e_1_2_2_51_1","volume-title":"Model of freeway traffic and control. Mathematical Model of Public System","author":"Payne Harold J","year":"1971","unstructured":"Harold J Payne. 1971. Model of freeway traffic and control. Mathematical Model of Public System (1971), 51--61."},{"key":"e_1_2_2_52_1","volume-title":"Lin","author":"Qiao Yi-Ling","year":"2020","unstructured":"Yi-Ling Qiao, Junbang Liang, Vladlen Koltun, and Ming C. Lin. 2020. Scalable Differentiable Physics for Learning and Control. In ICML."},{"volume-title":"Differentiable Simulation of Soft Multi-body Systems. In Conference on Neural Information Processing Systems (NeurIPS).","author":"Qiao Yi-Ling","key":"e_1_2_2_53_1","unstructured":"Yi-Ling Qiao, Junbang Liang, Vladlen Koltun, and Ming C. Lin. 2021a. Differentiable Simulation of Soft Multi-body Systems. In Conference on Neural Information Processing Systems (NeurIPS)."},{"key":"e_1_2_2_54_1","volume-title":"Lin","author":"Qiao Yi-Ling","year":"2021","unstructured":"Yi-Ling Qiao, Junbang Liang, Vladlen Koltun, and Ming C. Lin. 2021b. Efficient Differentiable Simulation of Articulated Bodies. In ICML."},{"key":"e_1_2_2_55_1","volume-title":"Shock waves on the highway. Operations research 4, 1","author":"Richards Paul I","year":"1956","unstructured":"Paul I Richards. 1956. Shock waves on the highway. Operations research 4, 1 (1956), 42--51."},{"key":"e_1_2_2_56_1","volume-title":"Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347","author":"Schulman John","year":"2017","unstructured":"John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. 2017. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347 (2017)."},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2024156.2024169"},{"volume-title":"Computer Graphics Forum","author":"Sewall Jason","key":"e_1_2_2_58_1","unstructured":"Jason Sewall, David Wilkie, Paul Merrell, and Ming C Lin. 2010. Continuum traffic simulation. In Computer Graphics Forum, Vol. 29. Wiley Online Library, 439--448."},{"key":"e_1_2_2_60_1","volume-title":"High-order differentiable autoencoder for nonlinear model reduction. arXiv preprint arXiv:2102.11026","author":"Shen Siyuan","year":"2021","unstructured":"Siyuan Shen, Yang Yin, Tianjia Shao, He Wang, Chenfanfu Jiang, Lei Lan, and Kun Zhou. 2021. High-order differentiable autoencoder for nonlinear model reduction. arXiv preprint arXiv:2102.11026 (2021)."},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i7.16764"},{"key":"e_1_2_2_62_1","volume-title":"Congested traffic states in empirical observations and microscopic simulations. Physical review E 62, 2","author":"Treiber Martin","year":"2000","unstructured":"Martin Treiber, Ansgar Hennecke, and Dirk Helbing. 2000. Congested traffic states in empirical observations and microscopic simulations. Physical review E 62, 2 (2000), 1805."},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1142008"},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3220096"},{"volume-title":"Linear and nonlinear waves","author":"Whitham Gerald Beresford","key":"e_1_2_2_65_1","unstructured":"Gerald Beresford Whitham. 2011. Linear and nonlinear waves. Vol. 42. John Wiley & Sons."},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.automatica.2018.10.040"},{"key":"e_1_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0191-2615(00)00050-3"},{"key":"e_1_2_2_68_1","volume-title":"Consensus of hybrid multi-agent systems","author":"Zheng Yuanshi","year":"2017","unstructured":"Yuanshi Zheng, Jingying Ma, and Long Wang. 2017. Consensus of hybrid multi-agent systems. IEEE transactions on neural networks and learning systems 29, 4 (2017), 1359--1365."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3550454.3555492","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,5]],"date-time":"2024-09-05T00:40:20Z","timestamp":1725496820000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3550454.3555492"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,30]]},"references-count":67,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["10.1145\/3550454.3555492"],"URL":"https:\/\/doi.org\/10.1145\/3550454.3555492","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"type":"print","value":"0730-0301"},{"type":"electronic","value":"1557-7368"}],"subject":[],"published":{"date-parts":[[2022,11,30]]},"assertion":[{"value":"2022-11-30","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}