{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,10,20]],"date-time":"2024-10-20T19:10:26Z","timestamp":1729451426790,"version":"3.27.0"},"reference-count":51,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2023,5,18]],"date-time":"2023-05-18T00:00:00Z","timestamp":1684368000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Research Grants Council of the Hong Kong Special Administrative Region, China","award":["UGC\/FDS16\/E12\/20"]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"Functional objects are large and small physical entities installed in urban environments to offer specific functionalities to visitors, such as shops, escalators, and information kiosks. Instances of the novel notion are focal points of human activities and are significant in pedestrian movement. Pedestrian trajectory modelling in an urban scene is a challenging problem because of the complex patterns resulting from social interactions of the crowds and the diverse relation between pedestrians and functional objects. Many data-driven methods have been proposed to explain the complex movements in urban scenes. However, the methods considering functional objects in their formulation are rare. This study aims to reduce the knowledge gap by demonstrating the importance of pedestrian\u2013object relations in the modelling task. The proposed modelling method, called pedestrian\u2013object relation guided trajectory prediction (PORTP), uses a dual-layer architecture that includes a predictor of pedestrian\u2013object relation and a series of relation-specific specialized pedestrian trajectory prediction models. The experiment findings indicate that the inclusion of pedestrian\u2013object relation results in more accurate predictions. This study provides an empirical foundation for the novel notion and a strong baseline for future work on this topic.<\/jats:p>","DOI":"10.3390\/s23104882","type":"journal-article","created":{"date-parts":[[2023,5,19]],"date-time":"2023-05-19T04:55:29Z","timestamp":1684472129000},"page":"4882","source":"Crossref","is-referenced-by-count":1,"title":["Functional Objects in Urban Walking Environments and Pedestrian Trajectory Modelling"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"http:\/\/orcid.org\/0000-0003-4990-7570","authenticated-orcid":false,"given":"Andrew Kwok Fai","family":"Lui","sequence":"first","affiliation":[{"name":"School of Science and Technology, Hong Kong Metropolitan University, Hong Kong SAR, China"}]},{"given":"Yin Hei","family":"Chan","sequence":"additional","affiliation":[{"name":"School of Science and Technology, Hong Kong Metropolitan University, Hong Kong SAR, China"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-5421-7622","authenticated-orcid":false,"given":"Kevin","family":"Hung","sequence":"additional","affiliation":[{"name":"School of Science and Technology, Hong Kong Metropolitan University, Hong Kong SAR, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,5,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"928","DOI":"10.1080\/10511482.2016.1165722","article-title":"Peak Millennials: Three Reinforcing Cycles That Amplify the Rise and Fall of Urban Concentration by Millennials","volume":"26","author":"Myers","year":"2016","journal-title":"Hous. Policy Debate"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1177\/0739456X18781453","article-title":"Revisiting Lively Streets: Social Interactions in Public Space","volume":"41","author":"Mehta","year":"2021","journal-title":"J. Plan. Educ. Res."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"258","DOI":"10.1016\/j.cities.2014.10.012","article-title":"The Walkable City and the Importance of the Proximity Environments for Barcelona\u2019s Everyday Mobility","volume":"42","author":"Marquet","year":"2015","journal-title":"Cities"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1093\/jeg\/1.1.27","article-title":"Consumer City","volume":"1","author":"Glaeser","year":"2001","journal-title":"J. Econ. Geogr."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Baeza, L., Carpio-Pinedo, J., Sievert, J., Landwehr, A., Preuner, P., Borgmann, K., Avakumovi\u0107, M., Weissbach, A., Bruns-Berentelg, J., and Noennig, J.R. (2021). Modeling Pedestrian Flows: Agent-Based Simulations of Pedestrian Activity for Land Use Distributions in Urban Developments. Sustainability, 13.","DOI":"10.3390\/su13169268"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1639","DOI":"10.1109\/TPAMI.2017.2728788","article-title":"Learning and Inferring \u201cDark Matter\u201d and Predicting Human Intents and Trajectories in Videos","volume":"40","author":"Xie","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1016\/j.simpat.2015.11.003","article-title":"Modeling Pedestrians\u2019 Interest in Locations: A Concept to Improve Simulations of Pedestrian Destination Choice","volume":"61","author":"Kielar","year":"2016","journal-title":"Simul. Model. Pract. Theory"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"101807","DOI":"10.1016\/j.jenvp.2022.101807","article-title":"Empirical Characterisation of Agents\u2019 Spatial Behaviour in Pedestrian Movement Simulation","volume":"82","author":"Filomena","year":"2022","journal-title":"J. Environ. Psychol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"126436","DOI":"10.1016\/j.physa.2021.126436","article-title":"Walking Model on Passenger in Merging Passage of Subway Station Considering Overtaking Behavior","volume":"585","author":"Shi","year":"2022","journal-title":"Phys. A Stat. Mech. Its Appl."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"127033","DOI":"10.1016\/j.physa.2022.127033","article-title":"Stochastic User Equilibrium Path Planning for Crowd Evacuation at Subway Station Based on Social Force Model","volume":"594","author":"Yang","year":"2022","journal-title":"Phys. A Stat. Mech. Its Appl."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Song, S., Baba, J., Nakanishi, J., Yoshikawa, Y., and Ishiguro, H. (2021, January 8\u201313). Teleoperated Robot Sells Toothbrush in a Shopping Mall: A Field Study. Proceedings of the Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, Yokohama, Japan.","DOI":"10.1145\/3411763.3451754"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1361","DOI":"10.1109\/JAS.2020.1003300","article-title":"A Recurrent Attention and Interaction Model for Pedestrian Trajectory Prediction","volume":"7","author":"Li","year":"2020","journal-title":"IEEE\/CAA J. Autom. Sin."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1068\/b2758t","article-title":"\u201cSo Go Downtown\u201d: Simulating Pedestrian Movement in Town Centres","volume":"28","author":"Haklay","year":"2001","journal-title":"Environ. Plan. B Plan. Des."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"396","DOI":"10.1049\/itr2.12033","article-title":"Social Graph Convolutional LSTM for Pedestrian Trajectory Prediction","volume":"15","author":"Zhou","year":"2021","journal-title":"IET Intell. Transp. Syst."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Sun, J., Jiang, Q., and Lu, C. (2020, January 14\u201319). Recursive Social Behavior Graph for Trajectory Prediction. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00074"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Yucel, Z., Zanlungo, F., Feliciani, C., Gregorj, A., and Kanda, T. (2019). Identification of Social Relation within Pedestrian Dyads. PLoS ONE, 14.","DOI":"10.1371\/journal.pone.0223656"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Hidaka, K., and Yamamoto, T. (2021). Activity Scheduling Behavior of the Visitors to an Outdoor Recreational Facility Using GPS Data. Sustainability, 13.","DOI":"10.3390\/su13094871"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"137","DOI":"10.7551\/mitpress\/9816.003.0023","article-title":"Modeling and Prediction of Pedestrian Behavior Based on the Subgoal Concept","volume":"10","author":"Ikeda","year":"2013","journal-title":"Robotics"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Korbmacher, R., and Tordeux, A. (2021). Review of Pedestrian Trajectory Prediction Methods: Comparing Deep Learning and Knowledgebased Approaches. arXiv.","DOI":"10.1109\/TITS.2022.3205676"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Yamaguchi, K., Berg, A.C., Ortiz, L.E., and Berg, T.L. (2011, January 20\u201325). Who Are You with and Where Are You Going?. Proceedings of the CVPR 2011, Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995468"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Meuter, M., Iurgel, U., Park, S., and Kummert, A. (2008, January 4\u20136). The Unscented Kalman Filter for Pedestrian Tracking from a Moving Host. Proceedings of the 2008 IEEE Intelligent Vehicles Symposium, Eindhoven, The Netherlands.","DOI":"10.1109\/IVS.2008.4621191"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2287","DOI":"10.1109\/TPAMI.2011.64","article-title":"Trajectory Learning for Activity Understanding: Unsupervised, Multilevel, and Long term Adaptive Approach","volume":"33","author":"Morris","year":"2011","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"6884","DOI":"10.1073\/pnas.1016507108","article-title":"How Simple Rules Determine Pedestrian Behavior and Crowd Disasters","volume":"108","author":"Helbing","year":"2011","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"487","DOI":"10.1038\/35035023","article-title":"Simulating Dynamical Features of Escape Panic","volume":"407","author":"Helbing","year":"2000","journal-title":"Nature"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"124501","DOI":"10.1088\/1674-1056\/27\/12\/124501","article-title":"Cellular Automaton Modeling of Pedestrian Movement Behavior on an Escalator","volume":"27","author":"Yue","year":"2018","journal-title":"Chin. Phys. B"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1950027","DOI":"10.1142\/S012918311950027X","article-title":"Pedestrian Choice Behavior Analysis and Simulation of Ticket Gate Machine in Rail Transit Station","volume":"30","author":"Li","year":"2019","journal-title":"Int. J. Mod. Phys. C"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"5594738","DOI":"10.1155\/2021\/5594738","article-title":"Deviation of Pedestrian Path due to the Presence of Building Entrances","volume":"2021","author":"Sun","year":"2021","journal-title":"J. Adv. Transp."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Pfeiffer, M., Paolo, G., Sommer, H., Nieto, J., Siegwart, R., and Cadena, C. (2018, January 21\u201325). A Data-Driven Model for Interaction-Aware Pedestrian Motion Prediction in Object Cluttered Environments. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia.","DOI":"10.1109\/ICRA.2018.8461157"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1109\/TNNLS.2020.2975837","article-title":"PoPPL: Pedestrian Trajectory Prediction by LSTM with Automatic Route Class Clustering","volume":"32","author":"Xue","year":"2020","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1080\/01441640701365239","article-title":"Behavioural Issues in Pedestrian Speed Choice and Street Crossing Behaviour: A Review","volume":"28","author":"Ishaque","year":"2008","journal-title":"Transp. Rev."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1049198","DOI":"10.3389\/fdata.2022.1049198","article-title":"Spatial Data Analysis for Intelligent Buildings: Awareness of Context and Data Uncertainty","volume":"5","author":"Li","year":"2022","journal-title":"Front. Big Data"},{"key":"ref_32","first-page":"117","article-title":"A Simulation Model for Non-signalized Pedestrian Crosswalks Based on Evidence from on Field Observation","volume":"11","author":"Feliciani","year":"2017","journal-title":"Intell. Artif."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"87","DOI":"10.3141\/2135-11","article-title":"Location Choice Modeling for Shopping and Leisure Activities with MATSim: Combining Microsimulation and Time Geography","volume":"1","author":"Horni","year":"2009","journal-title":"Transp. Res. Record."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1177\/0278364904048962","article-title":"Learning Motion Patterns of People for Compliant Robot Motion","volume":"24","author":"Bennewitz","year":"2005","journal-title":"Int. J. Robot. Res."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/j.jtrangeo.2019.04.009","article-title":"Developing a Pedestrian Destination Choice Model Using the Stratified Importance Sampling Method","volume":"77","author":"Berjisian","year":"2019","journal-title":"J. Transp. Geogr."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1016\/j.jtrangeo.2012.03.021","article-title":"Modeling Constrained Destination Choice for Shopping: A GIS based, Time geographic Approach","volume":"23","author":"Scott","year":"2012","journal-title":"J. Transp. Geogr."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.cities.2019.01.020","article-title":"The Effect of Built Environments on the Walking and Shopping Behaviors of Pedestrians; a Study with GPS Experiment in Sinchon Retail District in Seoul, South Korea","volume":"89","author":"Hahm","year":"2019","journal-title":"Cities"},{"key":"ref_38","unstructured":"Hoogendoorn, S., Bovy, P., and Daamen, W. (2010, January 8\u201310). Microscopic Pedestrian Wayfinding and Dynamics Modelling. Proceedings of the Pedestrian and Evacuation Dynamics, Technology, MD, USA."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1016\/j.trpro.2015.06.020","article-title":"Continuum Theory for Pedestrian Traffic Flow: Local Route Choice Modelling and Its Implications","volume":"7","author":"Hoogendoorn","year":"2015","journal-title":"Transp. Res. Procedia"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Lui, A.K., Chan, Y., and Leung, M. (2022, January 8\u201310). Modelling of Pedestrian Movements near an Amenity in Walkways of Public Buildings. Proceedings of the 2022 8th International Conference on Control, Automation and Robotics (ICCAR), Xiamen, China.","DOI":"10.1109\/ICCAR55106.2022.9782667"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Lui, A.K., Chan, Y., and Leung, M. (2021, January 15\u201318). Modelling of Destinations for Data driven Pedestrian Trajectory Prediction in Public Buildings. Proceedings of the 2021 IEEE International Conference on Big Data (Big Data), Orlando, FL, USA.","DOI":"10.1109\/BigData52589.2021.9671813"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Lee, N., Choi, W., Vernaza, P., Choy, C.B., Torr, P.H., and Chandraker, M. (2017, January 21\u201326). Desire: Distant Future Prediction in Dynamic Scenes with Interacting Agents. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.233"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"2716","DOI":"10.1109\/LRA.2022.3145090","article-title":"Stepwise Goal-driven Networks for Trajectory Prediction","volume":"7","author":"Wang","year":"2022","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Alahi, A., Goel, K., Ramanathan, V., Robicquet, A., FeiFei, L., and Savarese, S. (2016, January 27\u201330). Social Lstm: Human Trajectory Prediction in Crowded Spaces. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.110"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"126172","DOI":"10.1109\/ACCESS.2021.3111917","article-title":"Pedestrian Trajectory Prediction Based on Transfer Learning for Human following Mobile Robots","volume":"9","author":"Akabane","year":"2021","journal-title":"IEEE Access"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Liang, J., Jiang, L., Murphy, K., Yu, T., and Hauptmann, A. (2020, January 13\u201319). The Garden of Forking Paths: Towards Multi-future Trajectory Prediction. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01052"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Chiou, Y., and Bayer, A.Y. (2021). Microscopic Modeling of Pedestrian Movement in a Shida Night Market Street Segment: Using Vision and Destination Attractiveness. Sustainability, 13.","DOI":"10.3390\/su13148015"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Mangalam, K., An, Y., Girase, H., and Malik, J. (2021, January 11\u201317). From Goals, Waypoints & Paths to Long Term Human Trajectory Forecasting. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.01495"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Hasan, I., Setti, F., Tsesmelis, T., Bue, D., Cristani, M., and Galasso, F. (2018, January 12\u201315). \u201cSeeing Is Believing\u201d: Pedestrian Trajectory Forecasting Using Visual Frustum of Attention. Proceedings of the 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), Lake Tahoe, NV, USA.","DOI":"10.1109\/WACV.2018.00134"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1016\/j.trc.2014.03.009","article-title":"Microscopic Modeling of Pedestrian Movement Behavior: Interacting with Visual Attractors in the Environment","volume":"44","author":"Wang","year":"2014","journal-title":"Transp. Res. Part C Emerg. Technol."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"500","DOI":"10.1109\/TRO.2016.2645206","article-title":"Do You Need Help? A Robot Providing Information to People Who Behave Atypically","volume":"33","author":"Ikeda","year":"2017","journal-title":"IEEE Trans. Robot."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/10\/4882\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,20]],"date-time":"2024-10-20T18:53:25Z","timestamp":1729450405000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/10\/4882"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,18]]},"references-count":51,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2023,5]]}},"alternative-id":["s23104882"],"URL":"https:\/\/doi.org\/10.3390\/s23104882","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2023,5,18]]}}}