{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,19]],"date-time":"2024-09-19T16:21:00Z","timestamp":1726762860018},"reference-count":57,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2022,5,24]],"date-time":"2022-05-24T00:00:00Z","timestamp":1653350400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["32101610"],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"In many parts of the world, apple trees suffer from severe foliar damage each year due to infection of Alternaria blotch (Alternaria alternata f. sp. Mali), resulting in serious economic losses to growers. Traditional methods for disease detection and severity classification mostly rely on manual labor, which is slow, labor-intensive and highly subjective. There is an urgent need to develop an effective protocol to rapidly and accurately evaluate disease severity. In this study, DeeplabV3+, PSPNet and UNet were used to assess the severity of apple Alternaria leaf blotch. For identifications of leaves and disease areas, the dataset with a total of 5382 samples was randomly split into 74% (4004 samples) for model training, 9% (494 samples) for validation, 8% (444 samples) for testing and 8% (440 samples) for overall testing. Apple leaves were first segmented from complex backgrounds using the deep-learning algorithms with different backbones. Then, the recognition of disease areas was performed on the segmented leaves. The results showed that the PSPNet model with MobileNetV2 backbone exhibited the highest performance in leaf segmentation, with precision, recall and MIoU values of 99.15%, 99.26% and 98.42%, respectively. The UNet model with VGG backbone performed the best in disease-area prediction, with a precision of 95.84%, a recall of 95.54% and a MIoU value of 92.05%. The ratio of disease area to leaf area was calculated to assess the disease severity. The results showed that the average accuracy for severity classification was 96.41%. Moreover, both the correlation coefficient and the consistency correlation coefficient were 0.992, indicating a high agreement between the reference values and the value that the research predicted. This study proves the feasibility of rapid estimation of the severity of apple Alternaria leaf blotch, which will provide technical support for precise application of pesticides.<\/jats:p>","DOI":"10.3390\/rs14112519","type":"journal-article","created":{"date-parts":[[2022,5,25]],"date-time":"2022-05-25T04:14:14Z","timestamp":1653452054000},"page":"2519","source":"Crossref","is-referenced-by-count":28,"title":["Two-Stage Convolutional Neural Networks for Diagnosing the Severity of Alternaria Leaf Blotch Disease of the Apple Tree"],"prefix":"10.3390","volume":"14","author":[{"given":"Bo-Yuan","family":"Liu","sequence":"first","affiliation":[{"name":"College of Engineering, China Agricultural University, Beijing 100083, China"}]},{"given":"Ke-Jun","family":"Fan","sequence":"additional","affiliation":[{"name":"College of Engineering, China Agricultural University, Beijing 100083, China"}]},{"ORCID":"http:\/\/orcid.org\/0000-0003-1745-4722","authenticated-orcid":false,"given":"Wen-Hao","family":"Su","sequence":"additional","affiliation":[{"name":"College of Engineering, China Agricultural University, Beijing 100083, China"}]},{"given":"Yankun","family":"Peng","sequence":"additional","affiliation":[{"name":"College of Engineering, China Agricultural University, Beijing 100083, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,5,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1007\/s11036-020-01640-1","article-title":"MobileNet based apple leaf diseases identification","volume":"27","author":"Bi","year":"2020","journal-title":"Mob. Netw. Appl."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1007\/s11295-008-0164-y","article-title":"Rapid transcriptional response of apple to fire blight disease revealed by cDNA suppression subtractive hybridization analysis","volume":"5","author":"Norelli","year":"2009","journal-title":"Tree Genet. Genomes"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1889","DOI":"10.1094\/PDIS-10-18-1794-RE","article-title":"Genera Acremonium and Sarocladium cause brown spot on bagged apple fruit in China","volume":"103","author":"Hou","year":"2019","journal-title":"Plant Dis."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"462","DOI":"10.1046\/j.1365-3059.1999.00371.x","article-title":"Modelling and forecasting epidemics of apple powdery mildew (Podosphaera leucotricha)","volume":"48","author":"Xu","year":"1999","journal-title":"Plant Pathol."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Grove, G.G., Eastwell, K.C., Jones, A.L., and Sutton, T.B. (2003). 18 Diseases of Apple. Apples: Botany, Production, and Uses, CABI Publishing Oxon.","DOI":"10.1079\/9780851995922.0459"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"15327","DOI":"10.1007\/s00500-020-04866-z","article-title":"Multi-label learning for crop leaf diseases recognition and severity estimation based on convolutional neural networks","volume":"24","author":"Ji","year":"2020","journal-title":"Soft Comput."},{"key":"ref_7","first-page":"699","article-title":"Morphological characters of Alternaria mali Roberts","volume":"27","author":"Roberts","year":"1924","journal-title":"J. Agric. Res."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1007\/BF02931111","article-title":"Growth inhibition effect of pyroligneous acid on pathogenic fungus, Alternaria mali, the agent of Alternaria blotch of apple","volume":"12","author":"Jung","year":"2007","journal-title":"Biotechnol. Bioprocess Eng."},{"key":"ref_9","first-page":"382","article-title":"Isolation of Alternaria mali Roberts and its sensitivities to four fungicides","volume":"24","author":"Zhang","year":"2004","journal-title":"J. Shanxi Agric. Univ."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Zhang, C.-X., Tian, Y., and Cong, P.-H. (2015). Proteome analysis of pathogen-responsive proteins from apple leaves induced by the alternaria blotch Alternaria alternata. PLoS ONE, 10.","DOI":"10.1371\/journal.pone.0122233"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1016\/j.envint.2014.12.010","article-title":"Impacts of soil and water pollution on food safety and health risks in China","volume":"77","author":"Lu","year":"2015","journal-title":"Environ. Int."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"527","DOI":"10.1146\/annurev.phyto.34.1.527","article-title":"Changing options for the control of deciduous fruit tree diseases","volume":"34","author":"Sutton","year":"1996","journal-title":"Annu. Rev. Phytopathol."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1016\/j.foodres.2008.09.009","article-title":"Food processing a tool to pesticide residue dissipation\u2014A review","volume":"42","author":"Kaushik","year":"2009","journal-title":"Food Res. Int."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Mahmud, M.S., Zahid, A., He, L., and Martin, P. (2021). Opportunities and possibilities of developing an advanced precision spraying system for tree fruits. Sensors, 21.","DOI":"10.3390\/s21093262"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Pathania, A., Rialch, N., and Sharma, P. (2017). Marker-assisted selection in disease resistance breeding: A boon to enhance agriculture production. Current Developments in Biotechnology and Bioengineering, Elsevier.","DOI":"10.1016\/B978-0-444-63661-4.00009-8"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"59069","DOI":"10.1109\/ACCESS.2019.2914929","article-title":"Real-time detection of apple leaf diseases using deep learning approach based on improved convolutional neural networks","volume":"7","author":"Jiang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1016\/j.postharvbio.2013.04.003","article-title":"Predicting the spread of postharvest disease in stored fruit, with application to apples","volume":"85","author":"Dutot","year":"2013","journal-title":"Postharvest Biol. Technol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1080\/07352681003617285","article-title":"Plant disease severity estimated visually, by digital photography and image analysis, and by hyperspectral imaging","volume":"29","author":"Bock","year":"2010","journal-title":"Crit. Rev. Plant Sci."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Ampatzidis, Y., De Bellis, L., and Luvisi, A. (2017). iPathology: Robotic applications and management of plants and plant diseases. Sustainability, 9.","DOI":"10.3390\/su9061010"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"128507","DOI":"10.1016\/j.foodchem.2020.128507","article-title":"Hyperspectral imaging and improved feature variable selection for automated determination of deoxynivalenol in various genetic lines of barley kernels for resistance screening","volume":"343","author":"Su","year":"2021","journal-title":"Food Chem."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Su, W.-H., Sheng, J., and Huang, Q.-Y. (2022). Development of a Three-Dimensional Plant Localization Technique for Automatic Differentiation of Soybean from Intra-Row Weeds. Agriculture, 12.","DOI":"10.3390\/agriculture12020195"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"767","DOI":"10.3390\/smartcities3030039","article-title":"Advanced Machine Learning in Point Spectroscopy, RGB-and hyperspectral-imaging for automatic discriminations of crops and weeds: A review","volume":"3","author":"Su","year":"2020","journal-title":"Smart Cities"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"105155","DOI":"10.1016\/j.compag.2019.105155","article-title":"Non-destructive evaluation of photostability of crop signaling compounds and dose effects on celery vigor for precision plant identification using computer vision","volume":"168","author":"Su","year":"2020","journal-title":"Comput. Electron. Agric."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1016\/j.biosystemseng.2020.02.011","article-title":"Development of a systemic crop signalling system for automated real-time plant care in vegetable crops","volume":"193","author":"Su","year":"2020","journal-title":"Biosyst. Eng."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1016\/bs.afnr.2018.07.003","article-title":"Advanced analysis of roots and tubers by hyperspectral techniques","volume":"Volume 87","author":"Su","year":"2019","journal-title":"Advances in Food and Nutrition Research"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Su, W.-H., Zhang, J., Yang, C., Page, R., Szinyei, T., Hirsch, C.D., and Steffenson, B.J. (2020). Evaluation of Mask RCNN for Learning to Detect Fusarium Head Blight in Wheat Images. Proceedings of the 2020 ASABE Annual International Virtual Meeting, Online, 13\u201315 July 2020, American Society of Agricultural and Biological Engineers.","DOI":"10.13031\/aim.202000816"},{"key":"ref_27","first-page":"262","article-title":"Crop plant signaling for real-time plant identification in smart farm: A systematic review and new concept in artificial intelligence for automated weed control","volume":"4","author":"Su","year":"2020","journal-title":"Artif. Intell. Agric."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Gargade, A., and Khandekar, S. (2021). Custard apple leaf parameter analysis, leaf diseases, and nutritional deficiencies detection using machine learning. Advances in Signal and Data Processing, Springer.","DOI":"10.1007\/978-981-15-8391-9_5"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"31","DOI":"10.4018\/IJAEIS.2020070103","article-title":"Image Features Based Intelligent Apple Disease Prediction System: Machine Learning Based Apple Disease Prediction System","volume":"11","author":"Jan","year":"2020","journal-title":"Int. J. Agric. Environ. Inf. Syst. (IJAEIS)"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Liu, B., Zhang, Y., He, D., and Li, Y. (2018). Identification of apple leaf diseases based on deep convolutional neural networks. Symmetry, 10.","DOI":"10.3390\/sym10010011"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Chao, X., Sun, G., Zhao, H., Li, M., and He, D. (2020). Identification of apple tree leaf diseases based on deep learning models. Symmetry, 12.","DOI":"10.3390\/sym12071065"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Baliyan, A., Kukreja, V., Salonki, V., and Kaswan, K.S. (2021, January 3\u20134). Detection of Corn Gray Leaf Spot Severity Levels using Deep Learning Approach. Proceedings of the 2021 9th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO), Noida, India.","DOI":"10.1109\/ICRITO51393.2021.9596540"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"122537","DOI":"10.1016\/j.physa.2019.122537","article-title":"Automatic detection and classification of leaf spot disease in sugar beet using deep learning algorithms","volume":"535","author":"Ozguven","year":"2019","journal-title":"Phys. A Stat. Mech. Its Appl."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"105162","DOI":"10.1016\/j.compag.2019.105162","article-title":"Deep learning for classification and severity estimation of coffee leaf biotic stress","volume":"169","author":"Esgario","year":"2020","journal-title":"Comput. Electron. Agric."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1080\/09720529.2020.1721890","article-title":"Application of convolutional neural networks for evaluation of disease severity in tomato plant","volume":"23","author":"Verma","year":"2020","journal-title":"J. Discret. Math. Sci. Cryptogr."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Su, W.-H., Zhang, J., Yang, C., Page, R., Szinyei, T., Hirsch, C.D., and Steffenson, B.J. (2020). Automatic evaluation of wheat resistance to fusarium head blight using dual mask-RCNN deep learning frameworks in computer vision. Remote Sens., 13.","DOI":"10.3390\/rs13010026"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"106373","DOI":"10.1016\/j.compag.2021.106373","article-title":"A cucumber leaf disease severity classification method based on the fusion of DeepLabV3+ and U-Net","volume":"189","author":"Wang","year":"2021","journal-title":"Comput. Electron. Agric."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21\u201326). Pyramid scene parsing network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.660"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"106719","DOI":"10.1016\/j.compag.2022.106719","article-title":"Deep learning-based segmentation of multiple species of weeds and corn crop using synthetic and real image datasets","volume":"194","author":"Picon","year":"2022","journal-title":"Comput. Electron. Agric."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Lv, Q., and Wang, H. (2021, January 4\u20136). Cotton Boll Growth Status Recognition Method under Complex Background Based on Semantic Segmentation. Proceedings of the 2021 4th International Conference on Robotics, Control and Automation Engineering (RCAE), Wuhan, China.","DOI":"10.1109\/RCAE53607.2021.9638864"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.-C. (2018, January 18\u201322). Mobilenetv2: Inverted residuals and linear bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00474"},{"key":"ref_42","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Milletari, F., Navab, N., and Ahmadi, S.-A. (2016, January 25\u201328). V-net: Fully convolutional neural networks for volumetric medical image segmentation. Proceedings of the 2016 Fourth International Conference on 3D Vision (3DV), Stanford, CA, USA.","DOI":"10.1109\/3DV.2016.79"},{"key":"ref_44","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018, January 8\u201314). Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_49"},{"key":"ref_46","unstructured":"Chen, L.-C., Papandreou, G., Schroff, F., and Adam, H. (2017). Rethinking atrous convolution for semantic image segmentation. arXiv."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Chollet, F. (2017, January 21\u201326). Xception: Deep learning with depthwise separable convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.195"},{"key":"ref_48","unstructured":"Xia, X., Xu, C., and Nan, B. (2017, January 2\u20134). Inception-v3 for flower classification. Proceedings of the 2017 2nd International Conference on Image, Vision and Computing (ICIVC), Chengdu, China."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Garcia-Garcia, A., Orts-Escolano, S., Oprea, S., Villena-Martinez, V., and Garcia-Rodriguez, J. (2017). A review on deep learning techniques applied to semantic segmentation. arXiv.","DOI":"10.1016\/j.asoc.2018.05.018"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"923","DOI":"10.1007\/s42161-021-00886-2","article-title":"Determination of the severity level of yellow rust disease in wheat by using convolutional neural networks","volume":"103","author":"Hayit","year":"2021","journal-title":"J. Plant Pathol."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"28773","DOI":"10.1007\/s11042-020-09461-w","article-title":"Deep learning based assessment of disease severity for early blight in tomato crop","volume":"79","author":"Prabhakar","year":"2020","journal-title":"Multimed. Tools Appl."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"106443","DOI":"10.1016\/j.compag.2021.106443","article-title":"Segmentation of abnormal leaves of hydroponic lettuce based on DeepLabV3+ for robotic sorting","volume":"190","author":"Wu","year":"2021","journal-title":"Comput. Electron. Agric."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"106718","DOI":"10.1016\/j.compag.2022.106718","article-title":"Automatic detection and severity analysis of grape black measles disease based on deep learning and fuzzy logic","volume":"193","author":"Ji","year":"2022","journal-title":"Comput. Electron. Agric."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Nigam, S., Jain, R., Prakash, S., Marwaha, S., Arora, A., Singh, V.K., Singh, A.K., and Prakasha, T. (2021, January 29\u201330). Wheat Disease Severity Estimation: A Deep Learning Approach. Proceedings of the International Conference on Internet of Things and Connected Technologies, Patna, India.","DOI":"10.1007\/978-3-030-94507-7_18"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"272","DOI":"10.3389\/fpls.2019.00272","article-title":"A mobile-based deep learning model for cassava disease diagnosis","volume":"10","author":"Ramcharan","year":"2019","journal-title":"Front. Plant Sci."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"107023","DOI":"10.1016\/j.compeleceng.2021.107023","article-title":"Detection and severity analysis of tea leaf blight based on deep learning","volume":"90","author":"Hu","year":"2021","journal-title":"Comput. Electr. Eng."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"172882","DOI":"10.1109\/ACCESS.2020.3025196","article-title":"Gans-based data augmentation for citrus disease severity detection using deep learning","volume":"8","author":"Zeng","year":"2020","journal-title":"IEEE Access"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/11\/2519\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,30]],"date-time":"2024-07-30T06:42:23Z","timestamp":1722321743000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/11\/2519"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,24]]},"references-count":57,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2022,6]]}},"alternative-id":["rs14112519"],"URL":"https:\/\/doi.org\/10.3390\/rs14112519","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2022,5,24]]}}}