{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,11,19]],"date-time":"2024-11-19T17:38:45Z","timestamp":1732037925610},"reference-count":61,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2018,10,26]],"date-time":"2018-10-26T00:00:00Z","timestamp":1540512000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Centre-Val de Loire Region","award":["ADVENTICES 16032PR"]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"In recent years, weeds have been responsible for most agricultural yield losses. To deal with this threat, farmers resort to spraying the fields uniformly with herbicides. This method not only requires huge quantities of herbicides but impacts the environment and human health. One way to reduce the cost and environmental impact is to allocate the right doses of herbicide to the right place and at the right time (precision agriculture). Nowadays, unmanned aerial vehicles (UAVs) are becoming an interesting acquisition system for weed localization and management due to their ability to obtain images of the entire agricultural field with a very high spatial resolution and at a low cost. However, despite significant advances in UAV acquisition systems, the automatic detection of weeds remains a challenging problem because of their strong similarity to the crops. Recently, a deep learning approach has shown impressive results in different complex classification problems. However, this approach needs a certain amount of training data, and creating large agricultural datasets with pixel-level annotations by an expert is an extremely time-consuming task. In this paper, we propose a novel fully automatic learning method using convolutional neuronal networks (CNNs) with an unsupervised training dataset collection for weed detection from UAV images. The proposed method comprises three main phases. First, we automatically detect the crop rows and use them to identify the inter-row weeds. In the second phase, inter-row weeds are used to constitute the training dataset. Finally, we perform CNNs on this dataset to build a model able to detect the crop and the weeds in the images. The results obtained are comparable to those of traditional supervised training data labeling, with differences in accuracy of 1.5% in the spinach field and 6% in the bean field.<\/jats:p>","DOI":"10.3390\/rs10111690","type":"journal-article","created":{"date-parts":[[2018,10,26]],"date-time":"2018-10-26T14:51:01Z","timestamp":1540565461000},"page":"1690","source":"Crossref","is-referenced-by-count":153,"title":["Deep Learning with Unsupervised Data Labeling for Weed Detection in Line Crops in UAV Images"],"prefix":"10.3390","volume":"10","author":[{"given":"M Dian","family":"Bah","sequence":"first","affiliation":[{"name":"University of Orleans, PRISME, EA 4229, F45072 Orleans, France"}]},{"given":"Adel","family":"Hafiane","sequence":"additional","affiliation":[{"name":"INSA Centre Val de Loire, PRISME, EA 4229, F18020 Bourges, France"}]},{"given":"Raphael","family":"Canals","sequence":"additional","affiliation":[{"name":"University of Orleans, PRISME, EA 4229, F45072 Orleans, France"}]}],"member":"1968","published-online":{"date-parts":[[2018,10,26]]},"reference":[{"key":"ref_1","unstructured":"European Crop Protection (2017). With or Without Pesticides?, ECPA."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1017\/S0021859605005708","article-title":"Crop losses to pests","volume":"144","author":"Oerke","year":"2006","journal-title":"J. Agric. Sci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/S0065-2113(08)60513-1","article-title":"Aspects of Precision Agriculture","volume":"67","author":"Pierce","year":"1999","journal-title":"Adv. Agron."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1007\/s11119-005-0681-8","article-title":"Future Directions of Precision Agriculture","volume":"6","author":"McBratney","year":"2005","journal-title":"Precis. Agric."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"358","DOI":"10.1016\/j.biosystemseng.2012.08.009","article-title":"Twenty five years of remote sensing in precision agriculture: Key advances and remaining knowledge gaps","volume":"114","author":"Mulla","year":"2013","journal-title":"Biosyst. Eng."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1007\/s10343-008-0195-1","article-title":"Precision farming for weed management: Techniques","volume":"60","author":"Weis","year":"2008","journal-title":"Gesunde Pflanzen"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"637","DOI":"10.1007\/s11119-013-9321-x","article-title":"Ground-level hyperspectral imagery for detecting weeds in wheat fields","volume":"14","author":"Herrmann","year":"2013","journal-title":"Precis. Agric."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1016\/j.compag.2004.11.019","article-title":"Weed detection in multi-spectral images of cotton fields","volume":"Volume 47","author":"Alchanatis","year":"2005","journal-title":"Computers and Electronics in Agriculture"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/j.compag.2015.03.019","article-title":"An automatic object-based method for optimal thresholding in UAV images: Application for vegetation detection in herbaceous crops","volume":"114","year":"2015","journal-title":"Comput. Electron. Agric."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"693","DOI":"10.1007\/s11119-012-9274-5","article-title":"The application of small unmanned aerial systems for precision agriculture: A review","volume":"13","author":"Zhang","year":"2012","journal-title":"Precis. Agric."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1016\/j.compag.2017.10.027","article-title":"Weed detection in soybean crops using ConvNets","volume":"143","author":"Pistori","year":"2017","journal-title":"Comput. Electron. Agric."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Bah, M.D., Dericquebourg, E., Hafiane, A., and Canals, R. (, January July). Deep learning based classification system for identifying weeds using high-resolution UAV imagery. Proceedings of the 2018 Computing Conference, London, UK.","DOI":"10.1007\/978-3-030-01177-2_13"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1016\/j.compag.2016.04.024","article-title":"A survey of image processing techniques for plant extraction and segmentation in the field","volume":"125","author":"Hamuda","year":"2016","journal-title":"Comput. Electron. Agric."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/j.compag.2007.06.003","article-title":"Crop\/weed discrimination in perspective agronomic images","volume":"60","author":"Bossu","year":"2008","journal-title":"Comput. Electron. Agric."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"259","DOI":"10.13031\/2013.27838","article-title":"Color indices for weed identification under various soil, residue, and lighting conditions","volume":"38","author":"Woebbecke","year":"1995","journal-title":"Trans. ASAE"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1109\/TSMC.1979.4310076","article-title":"A threshold selection method from gray-level histograms","volume":"9","author":"Otsu","year":"1979","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_17","unstructured":"Hough, P.V.C. (2018). Method and Means for Recognizing Complex Patterns. (3,069,654), US Patent."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Pe\u00f1a, J.M., Torres-S\u00e1nchez, J., Isabel De Castro, A., Kelly, M., and L\u00f3pez-Granados, F. (2013). Weed Mapping in Early-Season Maize Fields Using Object-Based Analysis of Unmanned Aerial Vehicle (UAV) Images. PLoS ONE, 8.","DOI":"10.1371\/journal.pone.0077151"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1016\/j.isprsjprs.2009.06.004","article-title":"Object based image analysis for remote sensing","volume":"65","author":"Blaschke","year":"2010","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1247","DOI":"10.13031\/2013.13944","article-title":"Classification of Broadleaf and Grass Weeds Using Gabor Wavelets and an Artificial Neural Network","volume":"46","author":"Tang","year":"2003","journal-title":"Trans. Am. Soc. Agric. Eng."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"6270","DOI":"10.3390\/s110606270","article-title":"Robust crop and weed segmentation under uncontrolled outdoor illumination","volume":"11","author":"Jeon","year":"2011","journal-title":"Sensors"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1016\/j.cropro.2012.04.024","article-title":"Classification of crops and weeds from digital images: A support vector machine approach","volume":"40","author":"Ahmed","year":"2012","journal-title":"Crop Protect."},{"key":"ref_23","unstructured":"Latha, M., Poojith, A., Reddy, A., and Kumar, V. (2014). Image Processing in Agriculture. Int. J. Innov. Res. Electr. Electron. Instrum. Control Eng., 2."},{"key":"ref_24","first-page":"85","article-title":"Selecting patterns and features for between- and within-crop-row weed mapping using UAV-imagery","volume":"47","year":"2015","journal-title":"Expert Syst. Appl."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.biosystemseng.2017.02.002","article-title":"Weed segmentation using texture features extracted from wavelet sub-images","volume":"157","author":"Bakhshipour","year":"2017","journal-title":"Biosyst. Eng."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1016\/j.compag.2017.12.032","article-title":"Evaluation of support vector machine and artificial neural networks in weed detection using shape features","volume":"145","author":"Bakhshipour","year":"2018","journal-title":"Comput. Electron. Agric."},{"key":"ref_27","first-page":"43","article-title":"Fusion of pixel and object-based features for weed mapping using unmanned aerial vehicle imagery","volume":"67","author":"Gao","year":"2018","journal-title":"Int. J. Appl. Earth Observ. Geoinf."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"LeCun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_29","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). ImageNet Classification with Deep Convolutional Neural Networks. Advances in Neural Information Processing Systems, MIT Press Ltd."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"12037","DOI":"10.3390\/rs61212037","article-title":"Feature Learning Based Approach for Weed Classification Using High Resolution Aerial Images from a Digital Camera Mounted on a UAV","volume":"6","author":"Hung","year":"2014","journal-title":"Remote Sens."},{"key":"ref_31","unstructured":"Mortensen, A.K., Dyrmann, M., Karstoft, H., Nyholm J\u00f8rgensen, R., and Gislum, R. (2016, January 26\u201329). Semantic Segmentation of Mixed Crops using Deep Convolutional Neural Network. Proceedings of the International Conference on Agricultural Engineering, Aarhus, Denmark."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"41","DOI":"10.5194\/isprs-annals-IV-2-W3-41-2017","article-title":"Real-time blob-wise sugar beets vs. weeds classification for monitoring fields using convolutional neural networks","volume":"IV-2\/W3","author":"Milioto","year":"2017","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Di Cicco, M., Potena, C., Grisetti, G., and Pretto, A. (2017, January 24\u201328). Automatic model based dataset generation for fast and accurate crop and weeds detection. Proceedings of the 2017 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada.","DOI":"10.1109\/IROS.2017.8206408"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Louargant, M., Jones, G., Faroux, R., Paoli, J.N., Maillot, T., G\u00e9e, C., and Villette, S. (2018). Unsupervised Classification Algorithm for Early Weed Detection in Row-Crops by Combining Spatial and Spectral Information. Remote Sens., 10.","DOI":"10.3390\/rs10050761"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s11119-008-9086-9","article-title":"Modelling agronomic images for weed detection and comparison of crop\/weed discrimination algorithm performance","volume":"10","author":"Jones","year":"2009","journal-title":"Precis. Agric."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"11889","DOI":"10.1016\/j.eswa.2012.02.117","article-title":"Automatic detection of crop rows in maize fields with high weeds pressure","volume":"39","author":"Montalvo","year":"2012","journal-title":"Expert Syst. Appl."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Bah, M.D., Hafiane, A., and Canals, R. (December, January 28). Weeds detection in UAV imagery using SLIC and the hough transform. Proceedings of the 2017 Seventh International Conference on Image Processing Theory, Tools and Applications (IPTA), Montreal, QC, Canada.","DOI":"10.1109\/IPTA.2017.8310102"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2274","DOI":"10.1109\/TPAMI.2012.120","article-title":"SLIC Superpixels Compared to State-of-the-Art Superpixel Methods","volume":"34","author":"Achanta","year":"2011","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1016\/j.compag.2018.02.016","article-title":"Deep learning in agriculture: A survey","volume":"147","author":"Kamilaris","year":"2018","journal-title":"Comput. Electron. Agric."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_41","unstructured":"Simonyan, K., and Zisserman, A. (arXiv, 2015). Very Deep Convolutional Networks for Large-Scale Image Recognition, arXiv."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1345","DOI":"10.1109\/TKDE.2009.191","article-title":"A Survey on Transfer Learning","volume":"22","author":"Pan","year":"2010","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Huang, Z., Pan, Z., and Lei, B. (2017). Transfer learning with deep convolutional neural network for SAR target classification with limited labeled data. Remote Sens., 9.","DOI":"10.3390\/rs9090907"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Lottes, P., Khanna, R., Pfeifer, J., Siegwart, R., and Stachniss, C. (June, January 29). UAV-based crop and weed classification for smart farming. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Sands Expo, NV, USA.","DOI":"10.1109\/ICRA.2017.7989347"},{"key":"ref_45","unstructured":"Dalal, N., Triggs, W., and Triggs, B. (2005, January 20\u201326). Histograms of Oriented Gradients for Human Detection. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), San Diego, CA, USA."},{"key":"ref_46","first-page":"149","article-title":"HOG-based approach for leaf classification. Advanced Intelligent Computing Theories and Applications","volume":"Volume 6216","author":"Xiao","year":"2010","journal-title":"Proceedings of the 6th International Conference on Intelligent Computing, ICIC 2010"},{"key":"ref_47","first-page":"152","article-title":"Leaf Recognition using Texture Features for Herbal Plant Identification","volume":"9","author":"Ibrahim","year":"2018","journal-title":"Indones. J. Electr. Eng. Comput. Sci."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"610","DOI":"10.1109\/TSMC.1973.4309314","article-title":"Textural Features for Image Classification","volume":"3","author":"Haralick","year":"1973","journal-title":"Syst. Man Cybern."},{"key":"ref_49","first-page":"899","article-title":"Weed Recognition Using Image-Processing Technique Based on Leaf Parameters","volume":"2","author":"Agrawal","year":"2012","journal-title":"J. Agric. Sci. Technol. B J. Agric. Sci. Technol."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"780","DOI":"10.1109\/36.752194","article-title":"Texture analysis of sar sea ice imagery using gray level co-occurrence matrices","volume":"37","author":"Soh","year":"1999","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"4041","DOI":"10.1038\/s41598-017-04151-4","article-title":"Haralick texture features from apparent diffusion coefficient (ADC) MRI images depend on imaging and pre-processing parameters","volume":"7","author":"Brynolfsson","year":"2017","journal-title":"Sci. Rep."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1109\/34.41384","article-title":"Multichannel Texture Analysis Using Localized Spatial Filters","volume":"12","author":"Bovik","year":"1990","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1117\/12.238703","article-title":"Texture analysis using Gabor wavelets","volume":"2657","author":"Naghdy","year":"1996","journal-title":"Proc. SPIE"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1007\/BF00994018","article-title":"Support-vector networks","volume":"20","author":"Cortes","year":"1995","journal-title":"Mach. Learn."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"290","DOI":"10.1016\/j.compag.2015.08.023","article-title":"Exploiting affine invariant regions and leaf edge shapes for weed detection","volume":"118","author":"Kazmi","year":"2015","journal-title":"Comput. Electron. Agric."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"011008","DOI":"10.1117\/1.JEI.26.1.011008","article-title":"Special object extraction from medieval books using superpixels and bag-of-features","volume":"26","author":"Yang","year":"2016","journal-title":"J. Electron. Imaging"},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Cristianini, N., and Shawe-Taylor, J. (2000). An Introduction to Support Vector Machines and Other Kernel Based Learning Methods, Cambridge University Press.","DOI":"10.1017\/CBO9780511801389"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"De Castro, A.I., Torres-S\u00e1nchez, J., Pe\u00f1a, J.M., Jim\u00e9nez-Brenes, F.M., Csillik, O., and L\u00f3pez-Granados, F. (2018). An automatic random forest-OBIA algorithm for early weed mapping between and within crop rows using UAV imagery. Remote Sens., 10.","DOI":"10.3390\/rs10020285"},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/s10994-006-6226-1","article-title":"Extremely randomized trees","volume":"63","author":"Geurts","year":"2006","journal-title":"Mach. Learn."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/0034-4257(79)90013-0","article-title":"Red and photographic infrared linear combinations for monitoring vegetation","volume":"8","author":"Tucker","year":"1979","journal-title":"Remote Sens. Environ."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/10\/11\/1690\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,13]],"date-time":"2024-06-13T08:10:35Z","timestamp":1718266235000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/10\/11\/1690"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,10,26]]},"references-count":61,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2018,11]]}},"alternative-id":["rs10111690"],"URL":"https:\/\/doi.org\/10.3390\/rs10111690","relation":{"has-preprint":[{"id-type":"doi","id":"10.20944\/preprints201809.0088.v1","asserted-by":"object"}]},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,10,26]]}}}