{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T16:14:26Z","timestamp":1740154466585,"version":"3.37.3"},"reference-count":36,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2020,5,12]],"date-time":"2020-05-12T00:00:00Z","timestamp":1589241600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001807","name":"Funda\u00e7\u00e3o de Amparo \u00e0 Pesquisa do Estado de S\u00e3o Paulo","doi-asserted-by":"publisher","award":["2015\/50484-0","2016\/17652-9","2015\/22987-7"],"id":[{"id":"10.13039\/501100001807","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000270","name":"Natural Environment Research Council","doi-asserted-by":"publisher","award":["NE\/N012542\/1"],"id":[{"id":"10.13039\/501100000270","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001665","name":"Agence Nationale de la Recherche","doi-asserted-by":"publisher","award":["ANR-17-CE23-0009"],"id":[{"id":"10.13039\/501100001665","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Brazilian Development Bank","award":["17.2.0536.1"]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"Currently, there exists a growing demand for individual building mapping in regions of rapid urban growth in less-developed countries. Most existing methods can segment buildings but cannot discriminate adjacent buildings. Here, we present a new convolutional neural network architecture (CNN) called U-net-id that performs building instance segmentation. The proposed network is trained with WorldView-3 satellite RGB images (0.3 m) and three different labeled masks. The first is the building mask; the second is the border mask, which is the border of the building segment with 4 pixels added outside and 3 pixels inside; and the third is the inner segment mask, which is the segment of the building diminished by 2 pixels. The architecture consists of three parallel paths, one for each mask, all starting with a U-net model. To accurately capture the overlap between the masks, all activation layers of the U-nets are copied and concatenated on each path and sent to two additional convolutional layers before the output activation layers. The method was tested with a dataset of 7563 manually delineated individual buildings of the city of Joan\u00f3polis-SP, Brazil. On this dataset, the semantic segmentation showed an overall accuracy of 97.67% and an F1-Score of 0.937 and the building individual instance segmentation showed good performance with a mean intersection over union (IoU) of 0.582 (median IoU = 0.694).<\/jats:p>","DOI":"10.3390\/rs12101544","type":"journal-article","created":{"date-parts":[[2020,5,12]],"date-time":"2020-05-12T14:53:55Z","timestamp":1589295235000},"page":"1544","source":"Crossref","is-referenced-by-count":43,"title":["U-Net-Id, an Instance Segmentation Model for Building Extraction from Satellite Images\u2014Case Study in the Joan\u00f3polis City, Brazil"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9623-1182","authenticated-orcid":false,"given":"Fabien","family":"Wagner","sequence":"first","affiliation":[{"name":"GeoProcessing Division, Foundation for Science, Technology and Space Applications\u2014FUNCATE, S\u00e3o Jos\u00e9 dos Campos, SP 12210-131, Brazil"},{"name":"Remote Sensing Division, National Institute for Space Research\u2014INPE, S\u00e3o Jos\u00e9 dos Campos, SP 12227-010, Brazil"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7151-8697","authenticated-orcid":false,"given":"Ricardo","family":"Dalagnol","sequence":"additional","affiliation":[{"name":"Remote Sensing Division, National Institute for Space Research\u2014INPE, S\u00e3o Jos\u00e9 dos Campos, SP 12227-010, Brazil"}]},{"given":"Yuliya","family":"Tarabalka","sequence":"additional","affiliation":[{"name":"Luxcarta Technology, Parc d\u2019Activit\u00e9 l\u2019Argile, Lot 119b, 06370 Mouans Sartoux, France"},{"name":"Inria Sophia Antipolis, CEDEX, 06902 Sophia Antipolis, France"}]},{"given":"Tassiana","family":"Segantine","sequence":"additional","affiliation":[{"name":"GeoProcessing Division, Foundation for Science, Technology and Space Applications\u2014FUNCATE, S\u00e3o Jos\u00e9 dos Campos, SP 12210-131, Brazil"}]},{"given":"Rog\u00e9rio","family":"Thom\u00e9","sequence":"additional","affiliation":[{"name":"GeoProcessing Division, Foundation for Science, Technology and Space Applications\u2014FUNCATE, S\u00e3o Jos\u00e9 dos Campos, SP 12210-131, Brazil"}]},{"given":"Mayumi","family":"Hirye","sequence":"additional","affiliation":[{"name":"Quap\u00e1 Lab, Faculty of Architecture and Urbanism, University of S\u00e3o Paulo\u2014USP, S\u00e3o Paulo, SP 05508-900, Brazil"}]}],"member":"1968","published-online":{"date-parts":[[2020,5,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"LeCun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"734","DOI":"10.1016\/j.tree.2019.03.006","article-title":"Uncovering Ecological Patterns with Convolutional Neural Networks","volume":"34","author":"Brodrick","year":"2019","journal-title":"Trends Ecol. Evol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"7092","DOI":"10.1109\/TGRS.2017.2740362","article-title":"High-resolution aerial image labeling with convolutional neural networks","volume":"55","author":"Maggiori","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Huang, B., Lu, K., Audebert, N., Khalel, A., Tarabalka, Y., Malof, J., Boulch, A., Le Saux, B., Collins, L., and Bradbury, K. (2018, January 22\u201327). Large-scale semantic classification: Outcome of the first year of Inria aerial image labeling benchmark. Proceedings of the IEEE International Geoscience and Remote Sensing Symposium\u2014IGARSS 2018, Valencia, Spain.","DOI":"10.1109\/IGARSS.2018.8518525"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015). U-Net: Convolutional Networks for Biomedical Image Segmentation. arXiv.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017, January 22\u201329). Mask r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Bai, M., and Urtasun, R. (2017, January 21\u201326). Deep watershed transform for instance segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.305"},{"key":"ref_8","unstructured":"Pinheiro, P.O., Collobert, R., and Doll\u00e1r, P. (2015, January 7\u201312). Learning to segment object candidates. Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"296","DOI":"10.1016\/j.isprsjprs.2019.11.023","article-title":"Object detection in optical remote sensing images: A survey and a new benchmark","volume":"159","author":"Li","year":"2020","journal-title":"ISPRS J. Photogram. Remote Sens."},{"key":"ref_10","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2015, January 7\u201312). Faster r-cnn: Towards real-time object detection with region proposal networks. Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Su, H., Wei, S., Liu, S., Liang, J., Wang, C., Shi, J., and Zhang, X. (2020). HQ-ISNet: High-Quality Instance Segmentation for Remote Sensing Imagery. Remote Sens., 12.","DOI":"10.3390\/rs12060989"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Zhang, L., Wu, J., Fan, Y., Gao, H., and Shao, Y. (2020). An Efficient Building Extraction Method from High Spatial Resolution Remote Sensing Images Based on Improved Mask R-CNN. Sensors, 20.","DOI":"10.3390\/s20051465"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20\u201325). Imagenet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1007\/s11263-014-0733-5","article-title":"The Pascal Visual Object Classes Challenge: A Retrospective","volume":"111","author":"Everingham","year":"2015","journal-title":"Int. J. Comput. Vis."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1231","DOI":"10.1177\/0278364913491297","article-title":"Vision meets robotics: The KITTI dataset","volume":"32","author":"Geiger","year":"2013","journal-title":"Int. J. Robot. Res."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Braga, J.R., Peripato, V., Dalagnol, R., Ferreira, M.P., Tarabalka, Y., Arag\u00e3o, L.E., de Campos Velho, H.F., Shiguemori, E.H., and Wagner, F.H. (2020). Tree Crown Delineation Algorithm Based on a Convolutional Neural Network. Remote Sens., 12.","DOI":"10.3390\/rs12081288"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Vuola, A.O., Akram, S.U., and Kannala, J. (2019, January 8\u201311). Mask-RCNN and U-net ensembled for nuclei segmentation. Proceedings of the 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019), Venice, Italy.","DOI":"10.1109\/ISBI.2019.8759574"},{"key":"ref_18","unstructured":"IBGE, Brazilian Institute of Geography and Statistics (2020, February 13). 2019 Population Census, Available online: https:\/\/cidades.ibge.gov.br\/brasil\/sp\/joanopolis\/panorama."},{"key":"ref_19","unstructured":"Hallada, W.A., and Cox, S. (1983, January 9\u201313). Image sharpening for mixed spatial and spectral resolution satellite systems. Proceedings of the 17th International Symposium on Remote Sensing of Environment, Ann Arbor, MI, USA."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"297","DOI":"10.2307\/1932409","article-title":"Measures of the amount of ecologic association between species","volume":"26","author":"Dice","year":"1945","journal-title":"Ecology"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Allaire, J., and Chollet, F. (2016). Keras: R Interface to \u2018Keras\u2019, R Foundation for Statistical Computing. R Package Version 2.1.4.","DOI":"10.32614\/CRAN.package.keras"},{"key":"ref_22","unstructured":"Chollet, F. (2020, January 15). Keras. Available online: https:\/\/keras.io."},{"key":"ref_23","unstructured":"R Core Team (2016). R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing."},{"key":"ref_24","unstructured":"Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (2020, January 15). TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. Available online: tensorflow.org."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Bai, T., Li, D., Sun, K., Chen, Y., and Li, W. (2016). Cloud Detection for High-Resolution Satellite Imagery Using Machine Learning and Multi-Feature Fusion. Remote Sens., 8.","DOI":"10.3390\/rs8090715"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Leyk, S., Gaughan, A.E., Adamo, S.B., de Sherbinin, A., Balk, D., Freire, S., Rose, A., Stevens, F.R., Blankespoor, B., and Frye, C. (2019). The spatial allocation of population: A review of large-scale gridded population data products and their fitness for use. Earth Syst. Sci. Data, 11.","DOI":"10.5194\/essd-2019-82"},{"key":"ref_27","unstructured":"United Nations (2017). World Population Prospects: The 2017 Revision, Key Findings and Advance Tables, United Nations."},{"key":"ref_28","unstructured":"Allaire, J., and Chollet, F. (2019). Keras: R Interface to \u2018Keras\u2019, R Foundation for Statistical Computing. R Package Version 2.2.4.1.9001."},{"key":"ref_29","unstructured":"Chollet, F., and Allaire, J. (2018). Deep Learning with R, Manning Publications Co."},{"key":"ref_30","unstructured":"RStudio Team (2015). RStudio: Integrated Development Environment for R, RStudio, Inc."},{"key":"ref_31","unstructured":"Ushey, K., Allaire, J., and Tang, Y. (2019). Reticulate: Interface to \u2019Python\u2019, R Foundation for Statistical Computing. R Package Version 1.14."},{"key":"ref_32","unstructured":"Hijmans, R.J. (2019). Raster: Geographic Data Analysis and Modeling, R Foundation for Statistical Computing. R Package Version 3.0-2."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"439","DOI":"10.32614\/RJ-2018-009","article-title":"Simple Features for R: Standardized Support for Spatial Vector Data","volume":"10","author":"Pebesma","year":"2018","journal-title":"R J."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Ross, N. (2018). Fasterize: Fast Polygon to Raster Conversion, R Foundation for Statistical Computing. R Package Version 1.0.0.","DOI":"10.32614\/CRAN.package.fasterize"},{"key":"ref_35","unstructured":"GDAL\/OGR Contributors (2019). GDAL\/OGR Geospatial Data Abstraction Software Library, Open Source Geospatial Foundation."},{"key":"ref_36","unstructured":"Wilke, C. (2019). Isoband: Generate Isolines and Isobands from Regularly Spaced Elevation Grids, R Foundation for Statistical Computing. R Package Version 0.2.0."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/10\/1544\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,14]],"date-time":"2025-01-14T19:17:04Z","timestamp":1736882224000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/10\/1544"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,5,12]]},"references-count":36,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2020,5]]}},"alternative-id":["rs12101544"],"URL":"https:\/\/doi.org\/10.3390\/rs12101544","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2020,5,12]]}}}