{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T16:14:09Z","timestamp":1740154449827,"version":"3.37.3"},"reference-count":54,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2020,1,15]],"date-time":"2020-01-15T00:00:00Z","timestamp":1579046400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"In recent years, deep learning technology has been widely used in the field of hyperspectral image classification and achieved good performance. However, deep learning networks need a large amount of training samples, which conflicts with the limited labeled samples of hyperspectral images. Traditional deep networks usually construct each pixel as a subject, ignoring the integrity of the hyperspectral data and the methods based on feature extraction are likely to lose the edge information which plays a crucial role in the pixel-level classification. To overcome the limit of annotation samples, we propose a new three-channel image build method (virtual RGB image) by which the trained networks on natural images are used to extract the spatial features. Through the trained network, the hyperspectral data are disposed as a whole. Meanwhile, we propose a multiscale feature fusion method to combine both the detailed and semantic characteristics, thus promoting the accuracy of classification. Experiments show that the proposed method can achieve ideal results better than the state-of-art methods. In addition, the virtual RGB image can be extended to other hyperspectral processing methods that need to use three-channel images.<\/jats:p>","DOI":"10.3390\/rs12020280","type":"journal-article","created":{"date-parts":[[2020,1,15]],"date-time":"2020-01-15T16:50:28Z","timestamp":1579107028000},"page":"280","source":"Crossref","is-referenced-by-count":22,"title":["Multiscale Deep Spatial Feature Extraction Using Virtual RGB Image for Hyperspectral Imagery Classification"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7158-6772","authenticated-orcid":false,"given":"Liqin","family":"Liu","sequence":"first","affiliation":[{"name":"Image Processing Center, School of Astronautics, Beihang University, Beijing 100191, China"},{"name":"Beijing Key Laboratory of Digital Media, Beihang University, Beijing 100191, China"},{"name":"State Key Laboratory of Virtual Reality Technology and Systems, School of Astronautics, Beihang University, Beijing 100191, China"}]},{"given":"Zhenwei","family":"Shi","sequence":"additional","affiliation":[{"name":"Image Processing Center, School of Astronautics, Beihang University, Beijing 100191, China"},{"name":"Beijing Key Laboratory of Digital Media, Beihang University, Beijing 100191, China"},{"name":"State Key Laboratory of Virtual Reality Technology and Systems, School of Astronautics, Beihang University, Beijing 100191, China"}]},{"given":"Bin","family":"Pan","sequence":"additional","affiliation":[{"name":"School of Statistics and Data Science, Nankai University, Tianjin 300071, China"}]},{"given":"Ning","family":"Zhang","sequence":"additional","affiliation":[{"name":"Shanghai Aerospace Electronic Technology Institute, Shanghai 201109, China"}]},{"given":"Huanlin","family":"Luo","sequence":"additional","affiliation":[{"name":"Shanghai Aerospace Electronic Technology Institute, Shanghai 201109, China"}]},{"given":"Xianchao","family":"Lan","sequence":"additional","affiliation":[{"name":"Shanghai Aerospace Electronic Technology Institute, Shanghai 201109, China"}]}],"member":"1968","published-online":{"date-parts":[[2020,1,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"693","DOI":"10.1007\/s11119-012-9274-5","article-title":"The application of small unmanned aerial systems for precision agriculture: A review","volume":"13","author":"Zhang","year":"2012","journal-title":"Precis. Agric."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1074","DOI":"10.1109\/JSTSP.2015.2414401","article-title":"An MRF Model-Based Active Learning Framework for the Spectral-Spatial Classification of Hyperspectral Imagery","volume":"9","author":"Sun","year":"2015","journal-title":"IEEE J. Sel. Top. Signal Process."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"3459","DOI":"10.1080\/01431161.2015.1055607","article-title":"Hyperspectral classification via deep networks and superpixel segmentation","volume":"36","author":"Liu","year":"2015","journal-title":"Int. J. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1579","DOI":"10.1109\/TGRS.2017.2765364","article-title":"Recent Advances on Spectral\u2013Spatial Hyperspectral Image Classification: An Overview and New Guidelines","volume":"56","author":"He","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1016\/j.isprsjprs.2017.11.003","article-title":"MugNet: Deep learning for hyperspectral image classification using limited samples","volume":"145","author":"Pan","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"3729","DOI":"10.1109\/TGRS.2018.2886853","article-title":"Analysis for the Weakly Pareto Optimum in Multiobjective-Based Hyperspectral Band Selection","volume":"57","author":"Pan","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_7","first-page":"1","article-title":"CoinNet: Copy Initialization Network for Multispectral Imagery Semantic Segmentation","volume":"16","author":"Pan","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"480","DOI":"10.1109\/TGRS.2004.842478","article-title":"Classification of hyperspectral data from urban areas based on extended morphological profiles","volume":"43","author":"Benediktsson","year":"2005","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1782","DOI":"10.1109\/LGRS.2016.2608963","article-title":"Hyperspectral Image Classification Based on Nonlinear Spectral-Spatial Network","volume":"13","author":"Pan","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2349","DOI":"10.1109\/TGRS.2017.2778343","article-title":"Two-Stream Deep Architecture for Hyperspectral Image Classification","volume":"56","author":"Hao","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"3534","DOI":"10.1109\/TGRS.2018.2801387","article-title":"A New Spatial-Spectral Feature Extraction Method for Hyperspectral Images Using Local Covariance Matrix Representation","volume":"56","author":"Fang","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"844","DOI":"10.1109\/TGRS.2012.2205263","article-title":"Spectral-Spatial Classification of Hyperspectral Data Using Loopy Belief Propagation and Active Learning","volume":"51","author":"Li","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Jia, S., Xie, H., Deng, L., Huang, Q., and Li, J. (2017, January 23\u201328). Gabor feature based support vector guided dictionary learning for hyperspectral image classification. Proceedings of the 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Fort Worth, TX, USA.","DOI":"10.1109\/IGARSS.2017.8127427"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"4177","DOI":"10.1109\/TGRS.2017.2689805","article-title":"Hierarchical Guidance Filtering-Based Ensemble Classification for Hyperspectral Images","volume":"55","author":"Pan","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1007\/BF00994018","article-title":"Support-vector networks","volume":"20","author":"Cortes","year":"1995","journal-title":"Mach. Learn."},{"key":"ref_16","unstructured":"Melgani, F., and Bruzzone, L. (2002, January 24\u201328). Support vector machines for classification of hyperspectral remote-sensing images. Proceedings of the IEEE International Geoscience and Remote Sensing Symposium, Toronto, ON, Canada."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Gualtieri, J.A., and Cromp, R.F. (1999, January 29). Support vector machines for hyperspectral remote sensing classification. Proceedings of the 27th AIPR Workshop: Advances in Computer-Assisted Recognition, International Society for Optics and Photonics, Washington, DC, USA.","DOI":"10.1117\/12.339824"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"6547","DOI":"10.1109\/TGRS.2017.2729882","article-title":"Multiple Kernel Learning for Hyperspectral Image Classification: A Review","volume":"55","author":"Gu","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2852","DOI":"10.1109\/TGRS.2011.2176341","article-title":"Representative Multiple Kernel Learning for Classification in Hyperspectral Imagery","volume":"50","author":"Gu","year":"2012","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1109\/TKDE.2007.190672","article-title":"Label Propagation through Linear Neighborhoods","volume":"20","author":"Wang","year":"2008","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"3973","DOI":"10.1109\/TGRS.2011.2129595","article-title":"Hyperspectral Image Classification Using Dictionary-Based Sparse Representation","volume":"49","author":"Chen","year":"2011","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1235","DOI":"10.1109\/LGRS.2013.2290531","article-title":"Structured Priors for Sparse-Representation-Based Hyperspectral Image Classification","volume":"11","author":"Sun","year":"2014","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"202","DOI":"10.1109\/TGRS.2017.2744662","article-title":"Random Forest Ensembles and Extended Multiextinction Profiles for Hyperspectral Image Classification","volume":"56","author":"Xia","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1080\/01431161.2013.869633","article-title":"Exploring ELM-based spatial-spectral classification of hyperspectral images","volume":"35","author":"Heras","year":"2014","journal-title":"Int. J. Remote Sens."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"Lecun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_26","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems, NIPS."},{"key":"ref_27","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Wei, L., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"517","DOI":"10.1109\/TASLP.2015.2400218","article-title":"From Feedforward to Recurrent LSTM Neural Networks for Language Modeling","volume":"23","author":"Sundermeyer","year":"2015","journal-title":"IEEE\/ACM Trans. Audio Speech Lang. Process."},{"key":"ref_31","unstructured":"Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014). Generative adversarial nets. Advances in Neural Information Processing Systems, NIPS."},{"key":"ref_32","unstructured":"Niepert, M., Ahmed, M., and Kutzkov, K. (2016, January 19\u201324). Learning convolutional neural networks for graphs. Proceedings of the International Conference on MACHINE learning, New York, NY, USA."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1527","DOI":"10.1162\/neco.2006.18.7.1527","article-title":"A Fast Learning Algorithm for Deep Belief Nets","volume":"18","author":"Hinton","year":"2006","journal-title":"Neural Comput."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1038\/nature14236","article-title":"Human-level control through deep reinforcement learning","volume":"518","author":"Mnih","year":"2015","journal-title":"Nature"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"2094","DOI":"10.1109\/JSTARS.2014.2329330","article-title":"Deep Learning-Based Classification of Hyperspectral Data","volume":"7","author":"Chen","year":"2014","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Liu, X., Sun, Q., Liu, B., Huang, B., and Fu, M. (2017, January 20\u201322). Hyperspectral image classification based on convolutional neural network and dimension reduction. Proceedings of the 2017 Chinese Automation Congress (CAC), Jinan, China.","DOI":"10.1109\/CAC.2017.8243039"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1016\/j.neucom.2016.09.010","article-title":"Convolutional neural networks for hyperspectral image classification","volume":"219","author":"Yu","year":"2017","journal-title":"Neurocomputing"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2015\/258619","article-title":"Deep Convolutional Neural Networks for Hyperspectral Image Classification","volume":"2015","author":"Hu","year":"2015","journal-title":"J. Sens."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1016\/j.patcog.2016.10.019","article-title":"Hyperspectral image reconstruction by deep convolutional neural network for classification","volume":"63","author":"Li","year":"2017","journal-title":"Pattern Recognit."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Makantasis, K., Karantzalos, K., Doulamis, A., and Doulamis, N. (2015, January 26\u201331). Deep supervised learning for hyperspectral data classification through convolutional neural networks. Proceedings of the 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Milan, Italy.","DOI":"10.1109\/IGARSS.2015.7326945"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"2145","DOI":"10.1109\/TGRS.2018.2871782","article-title":"Capsule Networks for Hyperspectral Image Classification","volume":"57","author":"Paoletti","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Wang, W., Li, H., Pan, L., Yang, G., and Du, Q. (2018, January 22\u201327). Hyperspectral Image Classification Based on Capsule Network. Proceedings of the IGARSS 2018\u20132018 IEEE International Geoscience and Remote Sensing Symposium, Valencia, Spain.","DOI":"10.1109\/IGARSS.2018.8518951"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"847","DOI":"10.1109\/TGRS.2017.2755542","article-title":"Spectral-Spatial Residual Network for Hyperspectral Image Classification: A 3-D Deep Learning Framework","volume":"56","author":"Zhong","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"3639","DOI":"10.1109\/TGRS.2016.2636241","article-title":"Deep Recurrent Neural Networks for Hyperspectral Image Classification","volume":"55","author":"Mou","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"5046","DOI":"10.1109\/TGRS.2018.2805286","article-title":"Generative Adversarial Networks for Hyperspectral Image Classification","volume":"56","author":"Zhu","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Long, J., Shelhamer, E., and Darrell, T. (2015, January 7\u201312). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"5585","DOI":"10.1109\/TGRS.2017.2710079","article-title":"Deep Fully Convolutional Network-Based Spatial Distribution Prediction for Hyperspectral Image Classification","volume":"55","author":"Jiao","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1109\/LGRS.2018.2871507","article-title":"DeepLab-Based Spatial Feature Extraction for Hyperspectral Image Classification","volume":"16","author":"Niu","year":"2019","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"292","DOI":"10.1109\/LGRS.2017.2786272","article-title":"Classification of Hyperspectral Imagery Using a New Fully Convolutional Neural Network","volume":"15","author":"Li","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"4729","DOI":"10.1109\/TGRS.2017.2698503","article-title":"Learning and transferring deep joint spectral-spatial features for hyperspectral classification","volume":"55","author":"Yang","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., and Darrell, T. (2014, January 21\u201325). Caffe: Convolutional architecture for fast feature embedding. Proceedings of the 22nd ACM international conference on Multimedia, Orlando, FL, USA.","DOI":"10.1145\/2647868.2654889"},{"key":"ref_52","first-page":"27","article-title":"LIBSVM: A library for support vector machines","volume":"2","author":"Chang","year":"2011","journal-title":"ACM Trans. Intell. Syst. Technol. (TIST)"},{"key":"ref_53","first-page":"1871","article-title":"LIBLINEAR: A Library for Large Linear Classification(Machine Learning Open Source Software Paper)","volume":"9","author":"Bax","year":"2008","journal-title":"J. Mach. Learn. Res."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"844","DOI":"10.1109\/TGRS.2016.2616355","article-title":"Hyperspectral Image Classification Using Deep Pixel-Pair Features","volume":"55","author":"Li","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/2\/280\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,23]],"date-time":"2024-06-23T15:40:12Z","timestamp":1719157212000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/2\/280"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1,15]]},"references-count":54,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2020,1]]}},"alternative-id":["rs12020280"],"URL":"https:\/\/doi.org\/10.3390\/rs12020280","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2020,1,15]]}}}