{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,10]],"date-time":"2024-09-10T11:52:40Z","timestamp":1725969160890},"reference-count":35,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2018,11,6]],"date-time":"2018-11-06T00:00:00Z","timestamp":1541462400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"The use of Very High Spatial Resolution (VHSR) imagery in remote sensing applications is nowadays a current practice whenever fine-scale monitoring of the earth\u2019s surface is concerned. VHSR Land Cover classification, in particular, is currently a well-established tool to support decisions in several domains, including urban monitoring, agriculture, biodiversity, and environmental assessment. Additionally, land cover classification can be employed to annotate VHSR imagery with the aim of retrieving spatial statistics or areas with similar land cover. Modern VHSR sensors provide data at multiple spatial and spectral resolutions, most commonly as a couple of a higher-resolution single-band panchromatic (PAN) and a coarser multispectral (MS) imagery. In the typical land cover classification workflow, the multi-resolution input is preprocessed to generate a single multispectral image at the highest resolution available by means of a pan-sharpening process. Recently, deep learning approaches have shown the advantages of avoiding data preprocessing by letting machine learning algorithms automatically transform input data to best fit the classification task. Following this rationale, we here propose a new deep learning architecture to jointly use PAN and MS imagery for a direct classification without any prior image sharpening or resampling process. Our method, namely M u l t i R e s o L C C , consists of a two-branch end-to-end network which extracts features from each source at their native resolution and lately combine them to perform land cover classification at the PAN resolution. Experiments are carried out on two real-world scenarios over large areas with contrasted land cover characteristics. The experimental results underline the quality of our method while the characteristics of the proposed scenarios underline the applicability and the generality of our strategy in operational settings.<\/jats:p>","DOI":"10.3390\/rs10111746","type":"journal-article","created":{"date-parts":[[2018,11,7]],"date-time":"2018-11-07T08:45:22Z","timestamp":1541580322000},"page":"1746","source":"Crossref","is-referenced-by-count":54,"title":["A Two-Branch CNN Architecture for Land Cover Classification of PAN and MS Imagery"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"http:\/\/orcid.org\/0000-0002-9470-4791","authenticated-orcid":false,"given":"Raffaele","family":"Gaetano","sequence":"first","affiliation":[{"name":"CIRAD, UMR TETIS, Maison de la T\u00e9l\u00e9d\u00e9tection, 500 Rue J.-F. Breton, F-34000 Montpellier, France"},{"name":"UMR TETIS, University of Montpellier, AgroParisTech, CIRAD, CNRS, IRSTEA, F-34000 Montpellier, France"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-8736-3132","authenticated-orcid":false,"given":"Dino","family":"Ienco","sequence":"additional","affiliation":[{"name":"UMR TETIS, IRSTEA, University of Montpellier, F-34000 Montpellier, France"},{"name":"LIRMM Research Unit, CNRS, University of Montpellier, F-34000 Montpellier, France"}]},{"given":"Kenji","family":"Ose","sequence":"additional","affiliation":[{"name":"UMR TETIS, IRSTEA, University of Montpellier, F-34000 Montpellier, France"}]},{"given":"Remi","family":"Cresson","sequence":"additional","affiliation":[{"name":"UMR TETIS, IRSTEA, University of Montpellier, F-34000 Montpellier, France"}]}],"member":"1968","published-online":{"date-parts":[[2018,11,6]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"B\u00e9gu\u00e9, A., Arvor, D., Bell\u00f3n, B., Betbeder, J., de Abelleyra, D., Ferraz, R.P.D., Lebourgeois, V., Lelong, C., Sim\u00f5es, M., and Ver\u00f3n, S.R. (2018). Remote Sensing and Cropping Practices: A Review. Remote Sens., 10.","DOI":"10.3390\/rs10010099"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"607","DOI":"10.1109\/LGRS.2018.2803259","article-title":"Very High Resolution Object-Based Land Use-Land Cover Urban Classification Using Extreme Gradient Boosting","volume":"15","author":"Georganos","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1109\/TGRS.2017.2750220","article-title":"Deep Multiple Instance Learning-Based Spatial-Spectral Classification for PAN and MS Imagery","volume":"56","author":"Liu","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1847","DOI":"10.1109\/TGRS.2008.917131","article-title":"Bayesian Data Fusion for Adaptable Image Pansharpening","volume":"46","author":"Fasbender","year":"2008","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3311","DOI":"10.1080\/01431160600649254","article-title":"Influence of image fusion approaches on classification accuracy: A case study","volume":"27","author":"Colditz","year":"2006","journal-title":"Int. J. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"3722","DOI":"10.1109\/TGRS.2016.2526078","article-title":"Supervised Classification of Very High Resolution Optical Images Using Wavelet-Based Textural Features","volume":"54","author":"Regniers","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"3747","DOI":"10.1109\/TGRS.2010.2048116","article-title":"Morphological Attribute Profiles for the Analysis of Very High Resolution Images","volume":"48","author":"Mura","year":"2010","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1109\/LGRS.2009.2020825","article-title":"Multiresolution Remote Sensing Image Clustering","volume":"6","author":"Wemmert","year":"2009","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"539","DOI":"10.1109\/TGRS.2004.841395","article-title":"A bayesian approach to classification of multiresolution remote sensing data","volume":"43","author":"Storvik","year":"2005","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1109\/MGRS.2016.2540798","article-title":"Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art","volume":"4","author":"Zhang","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"11215","DOI":"10.1109\/ACCESS.2018.2798799","article-title":"Exploiting Convolutional Neural Networks with Deeply Local Description for Remote Sensing Image Classification","volume":"6","author":"Liu","year":"2018","journal-title":"IEEE Access"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Guo, W., Yang, W., Zhang, H., and Hua, G. (2018). Geospatial Object Detection in High Resolution Satellite Images Based on Multi-Scale Convolutional Neural Network. Remote Sens., 10.","DOI":"10.3390\/rs10010131"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"950","DOI":"10.1109\/TGRS.2017.2756911","article-title":"Large-Scale Remote Sensing Image Retrieval by Deep Hashing Neural Networks","volume":"56","author":"Li","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Tian, T., Li, C., Xu, J., and Ma, J. (2018). Urban Area Detection in Very High Resolution Remote Sensing Images Using Deep Convolutional Neural Networks. Sensors, 18.","DOI":"10.3390\/s18030904"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"549","DOI":"10.1109\/LGRS.2017.2657778","article-title":"Training Deep Convolutional Neural Networks for Land-Cover Classification of High-Resolution Imagery","volume":"14","author":"Scott","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1798","DOI":"10.1109\/TPAMI.2013.50","article-title":"Representation Learning: A Review and New Perspectives","volume":"35","author":"Bengio","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"881","DOI":"10.1109\/TGRS.2016.2616585","article-title":"Dense Semantic Labeling of Subdecimeter Resolution Images with Convolutional Neural Networks","volume":"55","author":"Volpi","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"4775","DOI":"10.1109\/TGRS.2017.2700322","article-title":"Deep Feature Fusion for VHR Remote Sensing Scene Classification","volume":"55","author":"Chaib","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"645","DOI":"10.1109\/TGRS.2016.2612821","article-title":"Convolutional Neural Networks for Large-Scale Remote-Sensing Image Classification","volume":"55","author":"Maggiori","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_20","first-page":"1","article-title":"Recurrent Multiresolution Convolutional Networks for VHR Image Classification","volume":"PP","author":"Bergado","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"474","DOI":"10.1109\/LGRS.2018.2795531","article-title":"Fully Convolutional Networks for Semantic Segmentation of Very High Resolution Remotely Sensed Images Combined With DSM","volume":"15","author":"Sun","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_22","unstructured":"Audebert, N., Saux, B.L., and Lef\u00e8vre, S. (2016, January 20\u201324). Semantic Segmentation of Earth Observation Data Using Multimodal and Multi-scale Deep Networks. Proceedings of the Asian Conference on Computer Vision, Taipei, Taiwan."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Noh, H., Hong, S., and Han, B. (2015, January 7\u201313). Learning Deconvolution Network for Semantic Segmentation. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.178"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"937","DOI":"10.1109\/TGRS.2017.2756851","article-title":"Multisource Remote Sensing Data Classification Based on Convolutional Neural Network","volume":"56","author":"Xu","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_25","unstructured":"Simonyan, K., and Zisserman, A. (arXiv, 2014). Very Deep Convolutional Networks for Large-Scale Image Recognition, arXiv."},{"key":"ref_26","unstructured":"Nair, V., and Hinton, G.E. (2010, January 21\u201324). Rectified Linear Units Improve Restricted Boltzmann Machines. Proceedings of the 27th International Conference on Machine Learning, Haifa, Israel."},{"key":"ref_27","unstructured":"Ioffe, S., and Szegedy, C. (arXiv, 2015). Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift, arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1685","DOI":"10.1109\/LGRS.2017.2728698","article-title":"Land Cover Classification via Multitemporal Spatial Data by Deep Recurrent Neural Networks","volume":"14","author":"Ienco","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Dahl, G.E., Sainath, T.N., and Hinton, G.E. (2013, January 26\u201330). Improving deep neural networks for LVCSR using rectified linear units and dropout. Proceedings of the IEEE International Conference on Speech and Signal Processing, Vancouver, BC, Canada.","DOI":"10.1109\/ICASSP.2013.6639346"},{"key":"ref_30","unstructured":"Perez, L., and Wang, J. (arXiv, 2017). The Effectiveness of Data Augmentation in Image Classification using Deep Learning, arXiv."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1186\/s40965-017-0031-6","article-title":"Orfeo ToolBox: open source processing of remote sensing images","volume":"2","author":"Manuel","year":"2017","journal-title":"Open Geospat. Data Softw. Stand."},{"key":"ref_32","unstructured":"Glorot, X., and Bengio, Y. (2010, January 13\u201315). Understanding the difficulty of training deep feedforward neural networks. Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, Sardinia, Italy."},{"key":"ref_33","unstructured":"Kingma, D.P., and Ba, J. (arXiv, 2014). Adam: A Method for Stochastic Optimization, arXiv."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Inglada, J., Vincent, A., Arias, M., Tardy, B., Morin, D., and Rodes, I. (2017). Operational High Resolution Land Cover Map Production at the Country Scale Using Satellite Image Time Series. Remote Sens., 9.","DOI":"10.3390\/rs9010095"},{"key":"ref_35","unstructured":"Tan, P.N., Steinbach, M., and Kumar, V. (2005). Introduction to Data Mining, Addison-Wesley Longman Publishing Co., Inc.. [1st ed.]."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/10\/11\/1746\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,13]],"date-time":"2024-06-13T11:39:49Z","timestamp":1718278789000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/10\/11\/1746"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,11,6]]},"references-count":35,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2018,11]]}},"alternative-id":["rs10111746"],"URL":"https:\/\/doi.org\/10.3390\/rs10111746","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,11,6]]}}}