{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T16:16:40Z","timestamp":1740154600176,"version":"3.37.3"},"reference-count":40,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2023,3,31]],"date-time":"2023-03-31T00:00:00Z","timestamp":1680220800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002347","name":"German Federal Ministry of Education and Research","doi-asserted-by":"publisher","award":["01UG2120A"],"id":[{"id":"10.13039\/501100002347","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"The ongoing digitization of historical photographs in archives allows investigating the quality, quantity, and distribution of these images. However, the exact interior and exterior camera orientations of these photographs are usually lost during the digitization process. The proposed method uses content-based image retrieval (CBIR) to filter exterior images of single buildings in combination with metadata information. The retrieved photographs are automatically processed in an adapted structure-from-motion (SfM) pipeline to determine the camera parameters. In an interactive georeferencing process, the calculated camera positions are transferred into a global coordinate system. As all image and camera data are efficiently stored in the proposed 4D database, they can be conveniently accessed afterward to georeference newly digitized images by using photogrammetric triangulation and spatial resection. The results show that the CBIR and the subsequent SfM are robust methods for various kinds of buildings and different quantity of data. The absolute accuracy of the camera positions after georeferencing lies in the range of a few meters likely introduced by the inaccurate LOD2 models used for transformation. The proposed photogrammetric method, the database structure, and the 4D visualization interface enable adding historical urban photographs and 3D models from other locations.<\/jats:p>","DOI":"10.3390\/rs15071879","type":"journal-article","created":{"date-parts":[[2023,3,31]],"date-time":"2023-03-31T14:19:33Z","timestamp":1680272373000},"page":"1879","source":"Crossref","is-referenced-by-count":6,"title":["Giving Historical Photographs a New Perspective: Introducing Camera Orientation Parameters as New Metadata in a Large-Scale 4D Application"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2456-9731","authenticated-orcid":false,"given":"Ferdinand","family":"Maiwald","sequence":"first","affiliation":[{"name":"Institute of Photogrammetry and Remote Sensing, Technische Universit\u00e4t Dresden, 01062 Dresden, Germany"},{"name":"Chair for Digital Humanities, The Friedrich Schiller University Jena, 07743 Jena, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5290-7435","authenticated-orcid":false,"given":"Jonas","family":"Bruschke","sequence":"additional","affiliation":[{"name":"Human-Computer Interaction, University of W\u00fcrzburg, 97070 W\u00fcrzburg, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7694-3457","authenticated-orcid":false,"given":"Danilo","family":"Schneider","sequence":"additional","affiliation":[{"name":"Chair for Photogrammetry, HTW Dresden, 01069 Dresden, Germany"}]},{"given":"Markus","family":"Wacker","sequence":"additional","affiliation":[{"name":"Chair for Computer Graphics, HTW Dresden, 01069 Dresden, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8706-3551","authenticated-orcid":false,"given":"Florian","family":"Niebling","sequence":"additional","affiliation":[{"name":"Human-Computer Interaction, University of W\u00fcrzburg, 97070 W\u00fcrzburg, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"M\u00fcnster, S., Friedrichs, K., Niebling, F., and Seidel-Grzesi\u0144ska, A. (2018). Digital Research and Education in Architectural Heritage. UHDL 2017, DECH 2017, Springer International Publishing.","DOI":"10.1007\/978-3-319-76992-9"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"DeTone, D., Malisiewicz, T., and Rabinovich, A. (2018, January 18\u201322). SuperPoint: Self-Supervised Interest Point Detection and Description. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00060"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Sarlin, P.E., DeTone, D., Malisiewicz, T., and Rabinovich, A. (2020, January 13\u201319). SuperGlue: Learning Feature Matching with Graph Neural Networks. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00499"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Sch\u00f6nberger, J.L., and Frahm, J.M. (2016, January 27\u201330). Structure-from-Motion Revisited. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.445"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"4267","DOI":"10.3390\/heritage5040220","article-title":"Heritage and Repeat Photography: Techniques, Management, Applications, and Publications","volume":"5","author":"Schaffland","year":"2022","journal-title":"Heritage"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Gaetani, C.I.D., Ioli, F., and Pinto, L. (2021). Aerial and UAV Images for Photogrammetric Analysis of Belvedere Glacier Evolution in the Period 1977\u20132019. Remote Sens., 13.","DOI":"10.3390\/rs13183787"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"113379","DOI":"10.1016\/j.rse.2022.113379","article-title":"Historical Structure from Motion (HSfM): Automated processing of historical aerial photographs for long-term topographic change analysis","volume":"285","author":"Knuth","year":"2023","journal-title":"Remote Sens. Environ."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"8310","DOI":"10.3390\/rs6098310","article-title":"Building Change Detection from Historical Aerial Photographs Using Dense Image Matching and Object-Based Image Analysis","volume":"6","author":"Nebiker","year":"2014","journal-title":"Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1989","DOI":"10.1007\/s10346-020-01437-z","article-title":"Leveraging historical aerial photographs and digital photogrammetry techniques for landslide investigation\u2014A practical perspective","volume":"17","author":"Deane","year":"2020","journal-title":"Landslides"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"973","DOI":"10.5194\/isprs-archives-XLI-B8-973-2016","article-title":"Multi-Temporal Analysis of WWII Reconnaissance Photos","volume":"XLI-B8","author":"Meixner","year":"2016","journal-title":"ISPRS\u2014Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"55","DOI":"10.5194\/isprs-archives-XLII-2-W15-55-2019","article-title":"2D & 3D Reconstruction workflows from archive images, case study of damaged monuments in Bosra Al-Sham city (Syria)","volume":"XLII-2\/W15","author":"Khalil","year":"2019","journal-title":"ISPRS\u2014Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1111\/phor.12363","article-title":"An automatic workflow for orientation of historical images with large radiometric and geometric differences","volume":"36","author":"Maiwald","year":"2021","journal-title":"Photogramm. Rec."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Farella, E.M., \u00d6zdemir, E., and Remondino, F. (2021). 4D Building Reconstruction with Machine Learning and Historical Maps. Appl. Sci., 11.","DOI":"10.3390\/app11041445"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"217","DOI":"10.5194\/isprs-archives-XLII-2-W11-217-2019","article-title":"3D Digital and Physical Reconstruction of a Collapsed Dome using SFM Techniques from Historical Images","volume":"XLII-2\/W11","author":"Beltrami","year":"2019","journal-title":"ISPRS\u2014Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"893","DOI":"10.5194\/isprs-archives-XLIII-B2-2022-893-2022","article-title":"Remote survey of traditional dwellings using advanced photogrammetry integrated with archival data: The case of Lisbon","volume":"XLIII-B2-2022","author":"Stellacci","year":"2022","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Muenster, S. (2022). Digital 3D Technologies for Humanities Research and Education: An Overview. Appl. Sci., 12.","DOI":"10.3390\/app12052426"},{"key":"ref_17","unstructured":"Manferdini, A.M., and Remondino, F. (2010). Digital Heritage, Springer."},{"key":"ref_18","first-page":"e00139","article-title":"A web repository for geo-located 3D digital cultural heritage models","volume":"16","author":"Nishanbaev","year":"2020","journal-title":"Digit. Appl. Archaeol. Cult. Herit."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Gominski, D., Gouet-Brunet, V., and Chen, L. (2021). Connecting Images through Sources: Exploring Low-Data, Heterogeneous Instance Retrieval. Remote Sens., 13.","DOI":"10.3390\/rs13163080"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Schaffland, A., Vornberger, O., and Heidemann, G. (2019, January 21). An Interactive Web Application for the Creation, Organization, and Visualization of Repeat Photographs. Proceedings of the 1st Workshop on Structuring and Understanding of Multimedia Heritage Contents, Nice, France.","DOI":"10.1145\/3347317.3357247"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Fanini, B., Ferdani, D., Demetrescu, E., Berto, S., and d\u2019Annibale, E. (2021). ATON: An Open-Source Framework for Creating Immersive, Collaborative and Liquid Web-Apps for Cultural Heritage. Appl. Sci., 11.","DOI":"10.3390\/app112211062"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.4995\/var.2020.13226","article-title":"Survey of 3D digital heritage repositories and platforms","volume":"11","author":"Champion","year":"2020","journal-title":"Virtual Archaeol. Rev."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"109","DOI":"10.5194\/isprs-annals-VIII-M-1-2021-109-2021","article-title":"Where Are We Now on the Road to 4D Urban History Research and Discovery?","volume":"VIII-M-1-2021","author":"Maiwald","year":"2021","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"124","DOI":"10.4304\/jmm.7.2.124-131","article-title":"4D Cities: Analyzing, Visualizing, and Interacting with Historical Urban Photo Collections","volume":"7","author":"Schindler","year":"2012","journal-title":"J. Multimed."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Niebling, F., M\u00fcnster, S., and Messemer, H. (2021). Research and Education in Urban History in the Age of Digital Libraries. UHDL 2019, Springer International Publishing.","DOI":"10.1007\/978-3-030-93186-5"},{"key":"ref_26","unstructured":"Bekiari, C., Bruseker, G., Doerr, M., Ore, C.E., Stead, S., and Velios, A. (2021). Definition of the CIDOC Conceptual Reference Model v7.1.1, The CIDOC Conceptual Reference Model Special Interest Group."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Maiwald, F., Lehmann, C., and Lazariv, T. (2021). Fully Automated Pose Estimation of Historical Images in the Context of 4D Geographic Information Systems Utilizing Machine Learning Methods. ISPRS Int. J. -Geo-Inf., 10.","DOI":"10.3390\/ijgi10110748"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Sharif Razavian, A., Azizpour, H., Sullivan, J., and Carlsson, S. (2014, January 23\u201328). CNN Features Off-the-Shelf: An Astounding Baseline for Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Columbus, OH, USA.","DOI":"10.1109\/CVPRW.2014.131"},{"key":"ref_29","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"251","DOI":"10.3169\/mta.4.251","article-title":"Visual instance retrieval with deep convolutional networks","volume":"4","author":"Razavian","year":"2016","journal-title":"ITE Trans. Media Technol. Appl."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"87","DOI":"10.5194\/isprs-archives-XLII-2-W13-87-2019","article-title":"Generation of a Benchmark Dataset Using Historical Photographs for an Automated Evaluation of Different Feature Matching Methods","volume":"XLII-2\/W13","author":"Maiwald","year":"2019","journal-title":"Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci."},{"key":"ref_32","unstructured":"Li, B., Peng, K., Ying, X., and Zha, H. (2010). Advances in Visual Computing, Springer."},{"key":"ref_33","unstructured":"Nixon, M., and Carter, J. (1998, January 14\u201317). Self-Calibration of a Rotating Camera with Varying Intrinsic Parameters. Proceedings of the British Machine Vision Conference, Southampton, UK."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"163","DOI":"10.5194\/isprs-archives-XLVIII-2-W1-2022-163-2022","article-title":"Photogrammetry Now And Then\u2014From Hand-Crafted To Deep-Learning Tie Points","volume":"XLVIII-2\/W1-2022","author":"Morelli","year":"2022","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"517","DOI":"10.1007\/s11263-020-01385-0","article-title":"Image Matching Across Wide Baselines: From Paper to Practice","volume":"129","author":"Jin","year":"2020","journal-title":"Int. J. Comput. Vis."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Sarlin, P.E., Cadena, C., Siegwart, R., and Dymczyk, M. (2019, January 15\u201320). From Coarse to Fine: Robust Hierarchical Localization at Large Scale. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.01300"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"376","DOI":"10.1109\/34.88573","article-title":"Least-squares estimation of transformation parameters between two point patterns","volume":"13","author":"Umeyama","year":"1991","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Chum, O., Mikulik, A., Perdoch, M., and Matas, J. (2011, January 20\u201325). Total recall II: Query expansion revisited. Proceedings of the CVPR 2011, Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995601"},{"key":"ref_40","unstructured":"Maiwald, F. (2022). A Window to the Past Through Modern Urban Environments\u2014Developing a Photogrammetric Workflow for the Orientation Parameter Estimation of Historical Images. [Ph.D. Thesis, Technische Universit\u00e4t Dresden]. Available online: https:\/\/nbn-resolving.org\/urn:nbn:de:bsz:14-qucosa2-810852."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/7\/1879\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,3,31]],"date-time":"2023-03-31T14:41:45Z","timestamp":1680273705000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/7\/1879"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,31]]},"references-count":40,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2023,4]]}},"alternative-id":["rs15071879"],"URL":"https:\/\/doi.org\/10.3390\/rs15071879","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2023,3,31]]}}}