{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,3]],"date-time":"2025-05-03T20:41:31Z","timestamp":1746304891560,"version":"3.37.3"},"reference-count":43,"publisher":"MDPI AG","issue":"22","license":[{"start":{"date-parts":[[2021,11,15]],"date-time":"2021-11-15T00:00:00Z","timestamp":1636934400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2018YFE0122700"],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["42001352"],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"High-quality training samples are essential for accurate land cover classification. Due to the difficulties in collecting a large number of training samples, it is of great significance to collect a high-quality sample dataset with a limited sample size but effective sample distribution. In this paper, we proposed an object-oriented sampling approach by segmenting image blocks expanded from systematically distributed seeds (object-oriented sampling approach) and carried out a rigorous comparison of seven sampling strategies, including random sampling, systematic sampling, stratified sampling (stratified sampling with the strata of land cover classes based on classification product, Latin hypercube sampling, and spatial Latin hypercube sampling), object-oriented sampling, and manual sampling, to explore the impact of training sample distribution on the accuracy of land cover classification when the samples are limited. Five study areas from different climate zones were selected along the China\u2013Mongolia border. Our research identified the proposed object-oriented sampling approach as the first-choice sampling strategy in collecting training samples. This approach improved the diversity and completeness of the training sample set. Stratified sampling with strata defined by the combination of different attributes and stratified sampling with the strata of land cover classes had their limitations, and they performed well in specific situations when we have enough prior knowledge or high-accuracy product. Manual sampling was greatly influenced by the experience of interpreters. All these sampling strategies mentioned above outperformed random sampling and systematic sampling in this study. The results indicate that the sampling strategies of training datasets do have great impacts on the land cover classification accuracies when the sample size is limited. This paper will provide guidance for efficient training sample collection to increase classification accuracies.<\/jats:p>","DOI":"10.3390\/rs13224594","type":"journal-article","created":{"date-parts":[[2021,11,16]],"date-time":"2021-11-16T01:46:47Z","timestamp":1637027207000},"page":"4594","source":"Crossref","is-referenced-by-count":20,"title":["Improving the Accuracy of Land Cover Mapping by Distributing Training Samples"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3882-5342","authenticated-orcid":false,"given":"Chenxi","family":"Li","sequence":"first","affiliation":[{"name":"College of Land Science and Technology, China Agricultural University, Beijing 100083, China"}]},{"given":"Zaiying","family":"Ma","sequence":"additional","affiliation":[{"name":"College of Land Science and Technology, China Agricultural University, Beijing 100083, China"}]},{"given":"Liuyue","family":"Wang","sequence":"additional","affiliation":[{"name":"College of Land Science and Technology, China Agricultural University, Beijing 100083, China"}]},{"given":"Weijian","family":"Yu","sequence":"additional","affiliation":[{"name":"College of Land Science and Technology, China Agricultural University, Beijing 100083, China"}]},{"given":"Donglin","family":"Tan","sequence":"additional","affiliation":[{"name":"College of Land Science and Technology, China Agricultural University, Beijing 100083, China"}]},{"given":"Bingbo","family":"Gao","sequence":"additional","affiliation":[{"name":"College of Land Science and Technology, China Agricultural University, Beijing 100083, China"}]},{"given":"Quanlong","family":"Feng","sequence":"additional","affiliation":[{"name":"College of Land Science and Technology, China Agricultural University, Beijing 100083, China"}]},{"given":"Hao","family":"Guo","sequence":"additional","affiliation":[{"name":"College of Land Science and Technology, China Agricultural University, Beijing 100083, China"}]},{"given":"Yuanyuan","family":"Zhao","sequence":"additional","affiliation":[{"name":"College of Land Science and Technology, China Agricultural University, Beijing 100083, China"},{"name":"Key Laboratory of Remote Sensing for Agri-Hazards, Ministry of Agriculture and Rural Affairs, Beijing 100083, China"},{"name":"Key Laboratory for Agricultural Land Quality, Ministry of Natural Resources of the People\u2019s Republic of China, Beijing 100083, China"}]}],"member":"1968","published-online":{"date-parts":[[2021,11,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Baudoux, L., Inglada, J., and Mallet, C. (2021). Toward a yearly country-scale CORINE land-cover map without using images: A map translation approach. Remote Sens., 13.","DOI":"10.3390\/rs13061060"},{"key":"ref_2","first-page":"131","article-title":"Assessment of variation of land use\/land cover and its impact on land surface temperature of Asansol subdivision","volume":"24","author":"Das","year":"2021","journal-title":"Egypt. J. Remote Sens. Space Sci."},{"key":"ref_3","first-page":"100272","article-title":"Land cover mapping of the Mekong Delta to support natural resource management with multi-temporal Sentinel-1A synthetic aperture radar imagery","volume":"17","author":"Ngo","year":"2020","journal-title":"Remote Sens. Appl. Soc. Environ."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1459","DOI":"10.1080\/01431161.2017.1400193","article-title":"Enhancing the temporal resolution of satellite-based flood extent generation using crowdsourced data for disaster monitoring","volume":"39","author":"Panteras","year":"2018","journal-title":"Int. J. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"142621","DOI":"10.1016\/j.scitotenv.2020.142621","article-title":"Impact assessment of river dust on regional air quality through integrated remote sensing and air quality modeling","volume":"755","author":"Chen","year":"2021","journal-title":"Sci. Total Environ."},{"key":"ref_6","first-page":"600","article-title":"Research on the factors affecting the classification accuracy of ETM remote sensing image land cover\/use","volume":"27","author":"Zhao","year":"2012","journal-title":"Remote Sens. Tech. Appl."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"665","DOI":"10.5194\/isprs-archives-XLII-5-665-2018","article-title":"A Comparative Study of Advanced Land Use\/Land Cover Classification Algorithms Using Sentinel-2 Data","volume":"XLII\u20135","author":"Priyadarshini","year":"2018","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Talukdar, S., Singha, P., Mahato, S., Pal, S., Liou, Y.A., and Rahman, A. (2020). Land-use land-cover classification by machine learning classifiers for satellite observations\u2014A review. Remote Sens., 12.","DOI":"10.3390\/rs12071135"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"11518","DOI":"10.3390\/rs61111518","article-title":"Land cover classification of landsat data with phenological features extracted from time series MODIS NDVI data","volume":"6","author":"Jia","year":"2014","journal-title":"Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1016\/j.isprsjprs.2016.11.004","article-title":"Optimizing selection of training and auxiliary data for operational land cover classification for the LCMAP initiative","volume":"122","author":"Zhu","year":"2016","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1016\/j.rse.2018.12.001","article-title":"Mapping pan-European land cover using Landsat spectral-temporal metrics and the European LUCAS survey","volume":"221","author":"Pflugmacher","year":"2019","journal-title":"Remote Sens. Environ."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"799","DOI":"10.1080\/014311697218764","article-title":"An evaluation of some factors affecting the accuracy of classification by an artificial neural network","volume":"18","author":"Foody","year":"1997","journal-title":"Int. J. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"964","DOI":"10.3390\/rs6020964","article-title":"Comparison of classification algorithms and training sample sizes in urban land classification with landsat thematic mapper imagery","volume":"6","author":"Li","year":"2014","journal-title":"Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"6937","DOI":"10.1109\/TGRS.2014.2305805","article-title":"Active and semisupervised learning for the classification of remote sensing images","volume":"52","author":"Persello","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"276","DOI":"10.1016\/j.isprsjprs.2020.07.013","article-title":"Improved land cover map of Iran using Sentinel imagery within Google Earth Engine and a novel automatic workflow for land cover classification using migrated training samples","volume":"167","author":"Ghorbanian","year":"2020","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1016\/j.isprsjprs.2020.01.010","article-title":"The migration of training samples towards dynamic global land cover mapping","volume":"161","author":"Huang","year":"2020","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1016\/j.isprsjprs.2013.01.011","article-title":"Assessing reference dataset representativeness through confidence metrics based on information density","volume":"78","author":"Mountrakis","year":"2013","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_18","first-page":"195","article-title":"Sampling Methods for Validation of Large Area Land Cover Mapping","volume":"27","author":"Ateishi","year":"2007","journal-title":"J. Remote Sens. Soc. Japan"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"9655","DOI":"10.3390\/rs70809655","article-title":"An evaluation of different training sample allocation schemes for discrete and continuous land cover classification using decision tree-based algorithms","volume":"7","author":"Colditz","year":"2015","journal-title":"Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2067","DOI":"10.1080\/01431161.2014.885152","article-title":"Assessing the impact of training sample selection on accuracy of an urban classification: A case study in Denver, Colorado","volume":"35","author":"Jin","year":"2014","journal-title":"Int. J. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1007\/s10651-017-0378-y","article-title":"Spatially-balanced sampling versus unbalanced stratified sampling for assessing forest change: Evidences in favour of spatial balance","volume":"25","author":"Pagliarella","year":"2018","journal-title":"Environ. Ecol. Stat."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1210","DOI":"10.1080\/2150704X.2017.1375610","article-title":"Active learning for training sample selection in remote sensing image classification using spatial information","volume":"8","author":"Lu","year":"2017","journal-title":"Remote Sens. Lett."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2218","DOI":"10.1109\/TGRS.2008.2010404","article-title":"Active learning methods for remote sensing image classification","volume":"47","author":"Tuia","year":"2009","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_24","first-page":"201","article-title":"Active Learning Literature Survey","volume":"15","author":"Settles","year":"2010","journal-title":"Mach. Learn."},{"key":"ref_25","first-page":"55","article-title":"The principle, method, and application of ecological regionalization\u2014Explanation of the ecological regionalization map of the Inner Mongolia Autonomous Region","volume":"14","author":"Li","year":"1990","journal-title":"Chinese J. Plant Ecol."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"5326","DOI":"10.1109\/JSTARS.2020.3021052","article-title":"Google Earth Engine Cloud Computing Platform for Remote Sensing Big Data Applications: A Comprehensive Review","volume":"13","author":"Amani","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2607","DOI":"10.1080\/01431161.2012.748992","article-title":"Finer resolution observation and monitoring of global land cover: First mapping results with Landsat TM and ETM+ data","volume":"34","author":"Gong","year":"2013","journal-title":"Int. J. Remote Sens."},{"key":"ref_28","first-page":"99","article-title":"Spatial sampling model for geographic data","volume":"12","author":"Li","year":"2002","journal-title":"Prog. Nat. Sci."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.spasta.2012.08.001","article-title":"A review of spatial sampling","volume":"2","author":"Wang","year":"2012","journal-title":"Spat. Stat."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Lesiv, M., See, L., Bayas, J.C.L., Sturn, T., Schepaschenko, D., Karner, M., Moorthy, I., McCallum, I., and Fritz, S. (2018). Characterizing the spatial and temporal availability of very high resolution satellite imagery in Google Earth and Microsoft Bing Maps as a source of reference data. Land, 7.","DOI":"10.5194\/essd-2018-13"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"839","DOI":"10.1007\/s10712-019-09533-z","article-title":"Recent Advances in Forest Observation with Visual Interpretation of Very High-Resolution Imagery","volume":"40","author":"Schepaschenko","year":"2019","journal-title":"Surv. Geophys."},{"key":"ref_32","first-page":"116","article-title":"Bamboo mapping of Ethiopia, Kenya and Uganda for the year 2016 using multi-temporal Landsat imagery","volume":"66","author":"Zhao","year":"2018","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"170","DOI":"10.1016\/j.rse.2016.05.016","article-title":"Detailed dynamic land cover mapping of Chile: Accuracy improvement by integrating multi-temporal data","volume":"183","author":"Zhao","year":"2016","journal-title":"Remote Sens. Environ."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"823","DOI":"10.1080\/01431160600746456","article-title":"A survey of image classification methods and techniques for improving classification performance","volume":"28","author":"Lu","year":"2007","journal-title":"Int. J. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Yu, X., Lu, D., Jiang, X., Li, G., Chen, Y., Li, D., and Chen, E. (2020). Examining the roles of spectral, spatial, and topographic features in improving land-cover and forest classifications in a subtropical region. Remote Sens., 12.","DOI":"10.3390\/rs12182907"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"496","DOI":"10.1080\/22797254.2017.1365570","article-title":"Land cover classification in Romanian Carpathians and Subcarpathians using multi-date Sentinel-2 remote sensing imagery","volume":"50","author":"Olariu","year":"2017","journal-title":"Eur. J. Remote Sens."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Zhao, Y., Feng, D., Yu, L., Cheng, Y., Zhang, M., Liu, X., Xu, Y., Fang, L., Zhu, Z., and Gong, P. (2019). Long-term land cover dynamics (1986\u20132016) of Northeast China derived from a multi-temporal landsat archive. Remote Sens., 11.","DOI":"10.3390\/rs11050599"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1016\/j.isprsjprs.2016.12.008","article-title":"Multi-source remotely sensed data fusion for improving land cover classification","volume":"124","author":"Chen","year":"2017","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"111354","DOI":"10.1016\/j.rse.2019.111354","article-title":"Auxiliary datasets improve accuracy of object-based land use\/land cover classification in heterogeneous savanna landscapes","volume":"233","author":"Hurskainen","year":"2019","journal-title":"Remote Sens. Environ."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random Forest","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1016\/j.patrec.2005.08.011","article-title":"Random forests for land cover classification","volume":"27","author":"Gislason","year":"2006","journal-title":"Pattern Recognit. Lett."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"4795","DOI":"10.1080\/01431161.2014.930202","article-title":"Towards a common validation sample set for global land-cover mapping","volume":"35","author":"Zhao","year":"2014","journal-title":"Int. J. Remote Sens."},{"key":"ref_43","first-page":"152","article-title":"Strata Efficiency and Optimization strategy of Stratified Sampling on Spatial Population","volume":"27","author":"Cao","year":"2008","journal-title":"Prog. Geogr."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/22\/4594\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,21]],"date-time":"2024-07-21T14:51:37Z","timestamp":1721573497000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/22\/4594"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,15]]},"references-count":43,"journal-issue":{"issue":"22","published-online":{"date-parts":[[2021,11]]}},"alternative-id":["rs13224594"],"URL":"https:\/\/doi.org\/10.3390\/rs13224594","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2021,11,15]]}}}