{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,10,13]],"date-time":"2024-10-13T08:40:32Z","timestamp":1728808832493},"reference-count":50,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2023,1,28]],"date-time":"2023-01-28T00:00:00Z","timestamp":1674864000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"In recent years, social platforms have become integrated in a variety of economic, political and cultural domains. Social media have become the primary outlets for many citizens to consume news and information, and, at the same time, to produce and share online a large amount of data and meta-data. This paper presents an innovative system able to analyze visual information shared by citizens on social media during extreme events for contributing to the situational awareness and supporting people in charge of coordinating the emergency management. The system analyzes all posts containing images shared by users by taking into account: (a) the event class and (b) the GPS coordinates of the geographical area affected by the event. Then, a Single Shot Multibox Detector (SSD) network is applied to select only the posted images correctly related to the event class and an advanced image processing procedure is used to verify if these images are correlated with the geographical area where the emergency event is ongoing. Several experiments have been carried out to evaluate the performance of the proposed system in the context of different emergency situations caused by earthquakes, floods and terrorist attacks.<\/jats:p>","DOI":"10.3390\/info14020078","type":"journal-article","created":{"date-parts":[[2023,1,30]],"date-time":"2023-01-30T15:19:28Z","timestamp":1675091968000},"page":"78","source":"Crossref","is-referenced-by-count":1,"title":["Automatic Identification and Geo-Validation of Event-Related Images for Emergency Management"],"prefix":"10.3390","volume":"14","author":[{"given":"Marco","family":"Vernier","sequence":"first","affiliation":[{"name":"Department of Mathematics, Computer Science and Physics, University of Udine, Via delle Scienze 206, 33100 Udine, Italy"}]},{"ORCID":"http:\/\/orcid.org\/0000-0001-8404-3187","authenticated-orcid":false,"given":"Manuela","family":"Farinosi","sequence":"additional","affiliation":[{"name":"Department of Mathematics, Computer Science and Physics, University of Udine, Via delle Scienze 206, 33100 Udine, Italy"}]},{"given":"Alberto","family":"Foresti","sequence":"additional","affiliation":[{"name":"Polytechnic of Turin, Corso Duca Degli Abruzzi 24, 10129 Torino, Italy"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-8425-6892","authenticated-orcid":false,"given":"Gian Luca","family":"Foresti","sequence":"additional","affiliation":[{"name":"Department of Mathematics, Computer Science and Physics, University of Udine, Via delle Scienze 206, 33100 Udine, Italy"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,28]]},"reference":[{"key":"ref_1","unstructured":"Blake, J.S. (2019). News in a Digital Age: Comparing the Presentation of News Information over Time and Across Media Platforms, Rand Corporation."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/disa.12092","article-title":"Social media and disasters: a functional framework for social media use in disaster planning, response, and research","volume":"39","author":"Houston","year":"2014","journal-title":"Disasters"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1122","DOI":"10.1177\/0163443717725574","article-title":"Conflict imagery in a connective environment: audiovisual content on Twitter following the 2015\/2016 terror attacks in Paris and Brussels","volume":"39","author":"Bruns","year":"2017","journal-title":"Media Cult. Soc."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1386\/iscc.6.2.179_1","article-title":"Citizens\u2019 involvement in emergency preparedness and response: A comparative analysis of media strategies and online presence in Turkey, Italy and Germany","volume":"6","author":"Scifo","year":"2015","journal-title":"Interact. Stud. Commun. Cult."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1177\/1742766513513192","article-title":"Challenging mainstream media, documenting real life and sharing with the community: An analysis of the motivations for producing citizen journalism in a post-disaster city","volume":"10","author":"Farinosi","year":"2014","journal-title":"Glob. Media Commun."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Carta, S. (2022). Machine Learning and the City: Applications in Architecture and Urban Design, Wiley.","DOI":"10.1002\/9781119815075"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1145","DOI":"10.1007\/s11069-018-3344-6","article-title":"Rumor response, debunking response, and decision makings of misinformed Twitter users during disasters","volume":"93","author":"Wang","year":"2018","journal-title":"Nat. Hazards"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"102701","DOI":"10.1016\/j.ijdrr.2021.102701","article-title":"Examining Community Vulnerabilities through multi-scale geospatial analysis of social media activity during Hurricane Irma","volume":"68","author":"Forati","year":"2022","journal-title":"Int. J. Disaster Risk Reduct."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"288","DOI":"10.1080\/0144929X.2019.1610908","article-title":"Descriptive and visual summaries of disaster events using artificial intelligence techniques: case studies of Hurricanes Harvey, Irma, and Maria","volume":"39","author":"Alam","year":"2020","journal-title":"Behav. Inf. Technol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"17069","DOI":"10.1007\/s11042-017-5276-7","article-title":"Review on computer vision techniques in emergency situations","volume":"77","author":"Skinnemoen","year":"2018","journal-title":"Multimed. Tools Appl."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Elmhadhbi, L., Karray, M.H., Archim\u00e8de, B., Otte, J.N., and Smith, B. (2021). An Ontological Approach to Enhancing Information Sharing in Disaster Response. Information, 12.","DOI":"10.3390\/info12100432"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Iglesias, C., Favenza, A., and Carrera, A. (2020). A Big Data Reference Architecture for Emergency Management. Information, 11.","DOI":"10.3390\/info11120569"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1111\/1468-5973.12196","article-title":"Fifteen years of social media in emergencies: A retrospective review and future directions for crisis informatics","volume":"26","author":"Reuter","year":"2018","journal-title":"J. Contingencies Crisis Manag."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1016\/j.ipm.2019.102132","article-title":"Rapid relevance classification of social media posts in disasters and emergencies: A system and evaluation featuring active, incremental and online learning","volume":"57","author":"Kaufhold","year":"2020","journal-title":"Inf. Process. Manag."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1080\/0144929X.2019.1620334","article-title":"Mitigating information overload in social media during conflicts and crises: design and evaluation of a cross-platform alerting system","volume":"39","author":"Kaufhold","year":"2020","journal-title":"Behav. Inf. Technol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1007\/s12652-014-0227-x","article-title":"Situational awareness in smart environments: socio-mobile and sensor data fusion for emergency response to disasters","volume":"6","author":"Foresti","year":"2015","journal-title":"J. Ambient. Intell. Humaniz. Comput."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1016\/j.ijinfomgt.2018.07.008","article-title":"Twitter as a tool for the management and analysis of emergency situations: A systematic literature review","volume":"43","year":"2018","journal-title":"Int. J. Inf. Manag."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"609","DOI":"10.1016\/j.ijinfomgt.2015.07.001","article-title":"Socializing in emergencies\u2014A review of the use of social media in emergency situations","volume":"35","author":"Simon","year":"2015","journal-title":"Int. J. Inf. Manag."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3178541","article-title":"Extracting and Summarizing Situational Information from the Twitter Social Media during Disasters","volume":"12","author":"Rudra","year":"2018","journal-title":"ACM Trans. Web"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Information Resources Management Association (2019). Emergency and Disaster Management: Concepts, Methodologies, Tools, and Applications, IGI Global.","DOI":"10.4018\/978-1-5225-6195-8"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Robinson, B., Power, R., and Cameron, M. (2013, January 13\u201317). A Sensitive Twitter Earthquake Detector. Proceedings of the 22nd International Conference on World Wide Web, Rio de Janeiro, Brazil.","DOI":"10.1145\/2487788.2488101"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Havas, C., Resch, B., Francalanci, C., Pernici, B., Scalia, G., Fernandez-Marquez, J.L., Van Achte, T., Zeug, G., Mondardini, M.R., and Grandoni, D. (2017). E2mC: Improving Emergency Management Service Practice through Social Media and Crowdsourcing Analysis in Near Real Time. Sensors, 17.","DOI":"10.3390\/s17122766"},{"key":"ref_23","unstructured":"Yin, J., Karimi, S., Robinson, B., and Cameron, M. (November, January 29). ESA: Emergency Situation Awareness via Microbloggers. Proceedings of the International Conference on Information and Knowledge Management (CIKM), Maui, HI, USA."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Schulz, A., Ristoski, P., and Paulheim, H. (2013, January 26\u201330). I See a Car Crash: Real-time Detection of Small Scale Incidents in Microblogs. Proceedings of the International Conference on Social Media and Linked Data for Emergency Response (SMILE), Montpellier, France.","DOI":"10.1007\/978-3-642-41242-4_3"},{"key":"ref_25","unstructured":"Alam, F., Imran, M., and Ofli, F. (2017, January 21\u201326). Online Social Media Image Processing Using AIDR 2.0: Artificial Intelligence for Digital Response. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"54","DOI":"10.3389\/frobt.2016.00054","article-title":"Image Classification to Support Emergency Situation Awareness","volume":"3","author":"Lagerstrom","year":"2016","journal-title":"Front. Robot. AI"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"791","DOI":"10.1007\/s10479-020-03514-x","article-title":"A deep multi-modal neural network for informative Twitter content classification during emergencies","volume":"319","author":"Kumar","year":"2020","journal-title":"Ann. Oper. Res."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Johnson, M., Murthy, D., Roberstson, B., Smith, R., and Stephens, K. (2020, January 7\u201310). DisasterNet: Evaluating the Performance of Transfer Learning to Classify Hurricane-Related Images Posted on Twitter. Proceedings of the Hawaii International Conference on System Sciences, Maui, HI, USA.","DOI":"10.24251\/HICSS.2020.071"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"102783","DOI":"10.1016\/j.ijdrr.2022.102783","article-title":"Social media use in disaster recovery: A systematic literature review","volume":"70","author":"Ogie","year":"2022","journal-title":"Int. J. Dis. Risk Reduct."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1389","DOI":"10.3390\/ijgi4031389","article-title":"A Volunteered Geographic Information Framework to Enable Bottom-Up Disaster Management Platforms","volume":"4","author":"Poorazizi","year":"2015","journal-title":"ISPRS Int. J. Geo-Inf."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1035","DOI":"10.1007\/s10708-022-10584-w","article-title":"Collecting, analyzing, and visualizing location-based social media data: review of methods in GIS-social media analysis","volume":"88","author":"McKitrick","year":"2022","journal-title":"Geojournal"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1177\/0081175019860244","article-title":"CASM: A Deep-Learning Approach for Identifying Collective Action Events with Text and Image Data from Social Media","volume":"49","author":"Zhang","year":"2019","journal-title":"Sociol. Methodol."},{"key":"ref_33","unstructured":"Shriya, G., and Raychaudhuri, D. (2020, January 26). Identification of Disaster-Related Tweets Using Natural Language Processing. Proceedings of the International Conference on Recent Trends in Artificial Intelligence, IOT, Smart Cities & Applications (ICAISC-2020), Hyderabad, India."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Kabir, Y., and Madria, S. (2019, January 5\u20138). A Deep Learning Approach for Tweet Classification and Rescue Scheduling for Effective Disaster Management. Proceedings of the 27th ACM International Conference on Advances in Geographic Information Systems (SIGSPATIAL), Chicago, IL, USA.","DOI":"10.1145\/3347146.3359097"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Thomas, C., McCreadie, R., and Ounis, I. (2019, January 21\u201325). Event tracker: A text analytics platform for use during disasters. Proceedings of the 42nd International ACM SIGIR Conference on Research and Development Information Retrieval, Paris, France.","DOI":"10.1145\/3331184.3331406"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2017, January 8\u201316). SSD: Single shot multibox detector. Proceedings of the 14th European Conference on Computer Vision (ECCV), Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive Image Features from Scale-Invariant Keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Bay, H., Tuytelaars, T., and Van Gool, L. (2006, January 7\u201313). Surf: Speeded up robust features. Proceedings of the European Conference on Computer Vision (ECCV), Graz, Austria.","DOI":"10.1007\/11744023_32"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Calonder, M., Lepetit, V., Strecha, C., and Fua, P. (2010, January 5\u201311). BRIEF: Binary robust independent elementary features. Proceedings of the 11th European Conference on Computer Vision (ECCV), Heraklion, Greece.","DOI":"10.1007\/978-3-642-15561-1_56"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Rublee, E., Rabaud, V., Konolige, K., and Bradski, G.R. (2011, January 6\u201313). ORB: An efficient alternative to SIFT or SURF. Proceedings of the 13th International Conference on Computer Vision (ICCV), Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"ref_41","unstructured":"Neo4j, Official Website (2023, January 02). The World\u2019s Leading Graph Database (2017). Available online: https:\/\/neo4j.com\/."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016, January 11\u201314). Ssd: Single shot multibox detector. Proceedings of the European Conference on Computer Vision (ECCV), Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"383","DOI":"10.11591\/eei.v10i1.1974","article-title":"Reconfiguration layers of convolutional neural network for fundus patches classification","volume":"10","author":"Setiawan","year":"2021","journal-title":"Bull. Electr. Eng. Inform."},{"key":"ref_44","unstructured":"Ofli, F., Alam, F., and Imran, M. (2020, January 23). Analysis of Social Media Data using Multimodal Deep Learning for Disaster Response. Proceedings of the 17th International Conference on Information Systems for Crisis Response and Management (ISCRAM), Blacksburg, VI, USA."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1316","DOI":"10.1109\/TIFS.2022.3159154","article-title":"Content-Aware Detection of Temporal Metadata Manipulation","volume":"17","author":"Padilha","year":"2022","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Barath, D., Cavalli, L., and Pollefeys, M. (2022, January 19\u201324). Learning to Find Good Models in RANSAC. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.01529"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1016\/j.neunet.2011.10.007","article-title":"A balanced neural tree for pattern classification","volume":"27","author":"Micheloni","year":"2012","journal-title":"Neural Netw."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1016\/j.neunet.2019.12.029","article-title":"An Advanced Neural Tree Exploiting Expert Nodes to Classify High-Dimensional Data","volume":"124","author":"Abpeykar","year":"2020","journal-title":"Neural Netw."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"3289","DOI":"10.1109\/TII.2018.2873237","article-title":"A Vision-Based System for Internal Pipeline Inspection","volume":"15","author":"Piciarelli","year":"2018","journal-title":"IEEE Trans. Ind. Informa."},{"key":"ref_50","first-page":"138","article-title":"Meta Random Forests","volume":"3","author":"Boinee","year":"2005","journal-title":"Int. J. Comput. Intell."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/14\/2\/78\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,13]],"date-time":"2024-10-13T08:26:09Z","timestamp":1728807969000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/14\/2\/78"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,28]]},"references-count":50,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2023,2]]}},"alternative-id":["info14020078"],"URL":"https:\/\/doi.org\/10.3390\/info14020078","relation":{},"ISSN":["2078-2489"],"issn-type":[{"type":"electronic","value":"2078-2489"}],"subject":[],"published":{"date-parts":[[2023,1,28]]}}}