{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,8,30]],"date-time":"2024-08-30T01:07:20Z","timestamp":1724980040358},"reference-count":52,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2022,12,23]],"date-time":"2022-12-23T00:00:00Z","timestamp":1671753600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100005908","name":"Federal Ministry of Food and Agriculture","doi-asserted-by":"publisher","award":["28DE106A18"],"id":[{"id":"10.13039\/501100005908","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Ministry for Food, Rural Areas, and Consumer Protection Baden-W\u00fcrttemberg"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"Fruit volume and leaf area are important indicators to draw conclusions about the growth condition of the plant. However, the current methods of manual measuring morphological plant properties, such as fruit volume and leaf area, are time consuming and mainly destructive. In this research, an image-based approach for the non-destructive determination of fruit volume and for the total leaf area over three growth stages for cabbage (brassica oleracea) is presented. For this purpose, a mask-region-based convolutional neural network (Mask R-CNN) based on a Resnet-101 backbone was trained to segment the cabbage fruit from the leaves and assign it to the corresponding plant. Combining the segmentation results with depth information through a structure-from-motion approach, the leaf length of single leaves, as well as the fruit volume of individual plants, can be calculated. The results indicated that even with a single RGB camera, the developed methods provided a mean accuracy of fruit volume of 87% and a mean accuracy of total leaf area of 90.9%, over three growth stages on an individual plant level.<\/jats:p>","DOI":"10.3390\/s23010129","type":"journal-article","created":{"date-parts":[[2022,12,23]],"date-time":"2022-12-23T08:55:21Z","timestamp":1671785721000},"page":"129","source":"Crossref","is-referenced-by-count":3,"title":["Fruit Volume and Leaf-Area Determination of Cabbage by a Neural-Network-Based Instance Segmentation for Different Growth Stages"],"prefix":"10.3390","volume":"23","author":[{"given":"Nils","family":"L\u00fcling","sequence":"first","affiliation":[{"name":"Department of Technology in Crop Production, University of Hohenheim, 70599 Stuttgart, Germany"}]},{"ORCID":"http:\/\/orcid.org\/0000-0003-0158-6456","authenticated-orcid":false,"given":"David","family":"Reiser","sequence":"additional","affiliation":[{"name":"Department of Technology in Crop Production, University of Hohenheim, 70599 Stuttgart, Germany"}]},{"given":"Jonas","family":"Straub","sequence":"additional","affiliation":[{"name":"Department of Technology in Crop Production, University of Hohenheim, 70599 Stuttgart, Germany"}]},{"given":"Alexander","family":"Stana","sequence":"additional","affiliation":[{"name":"Department of Technology in Crop Production, University of Hohenheim, 70599 Stuttgart, Germany"}]},{"given":"Hans W.","family":"Griepentrog","sequence":"additional","affiliation":[{"name":"Department of Technology in Crop Production, University of Hohenheim, 70599 Stuttgart, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Barriguinha, A., de Castro Neto, M., and Gil, A. (2021). Vineyard Yield Estimation, Prediction, and Forecasting: A Systematic Literature Review. Agronomy, 11.","DOI":"10.3390\/agronomy11091789"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Duckett, T., Pearson, S., Blackmore, S., and Grieve, B. (2018). Agricultural Robotics: The Future of Robotic Agriculture. arXiv.","DOI":"10.31256\/WP2018.2"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"105942","DOI":"10.1016\/j.compag.2020.105942","article-title":"Introducing digital twins to agriculture","volume":"184","author":"Pylianidis","year":"2021","journal-title":"Comput. Electron. Agric."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"103046","DOI":"10.1016\/j.agsy.2020.103046","article-title":"Digital twins in smart farming","volume":"189","author":"Verdouw","year":"2021","journal-title":"Agric. Syst."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1007\/BF01054326","article-title":"Available nitrogen in soils and is determination by the \u2018Nmin- method\u2019 and by electroultrafiltration (EUF)","volume":"28","author":"Mengel","year":"1991","journal-title":"Fertil. Res."},{"key":"ref_6","first-page":"11","article-title":"Influence of different dose of nitrogen on the growth and yield of cabbage (Brassica oleracea var. capitate 1.)","volume":"2","author":"Akand","year":"2015","journal-title":"Int. J. Multidiscip. Res. Dev."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"893","DOI":"10.1093\/aob\/mcg096","article-title":"Some Quantitative Relationships between Leaf Area Index and Canopy Nitrogen Content and Distribution","volume":"91","author":"Yin","year":"2003","journal-title":"Ann. Bot."},{"key":"ref_8","first-page":"199","article-title":"D\u00fcngung im Freiland Gem\u00fcsebau (Fertilisation in outdoor vegetable production)","volume":"3","author":"Feller","year":"2011","journal-title":"Schr. Leibniz-Inst. Gem\u00fcse-Zierpflanzenbau (IGZ)"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1459","DOI":"10.21273\/HORTSCI.45.10.1459","article-title":"Study of a Non-destructive Method for Estimating the Leaf Area Index in Vegetable Crops Using Digital Images","volume":"45","author":"Campillo","year":"2010","journal-title":"HortScience"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"475","DOI":"10.1016\/S2095-3119(15)61073-5","article-title":"Estimating the crop leaf area index using hyperspectral remote sensing","volume":"15","author":"Liu","year":"2016","journal-title":"J. Integr. Agric."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Apolo-Apolo, O., Perez-Ruiz, M., Martinez-Guanter, J., and Egea, G. (2020). A Mixed Data-Based Deep Neural Network to Estimate Leaf Area Index in Wheat Breeding Trials. Agronomy, 10.","DOI":"10.3390\/agronomy10020175"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.scienta.2016.12.032","article-title":"Using the artificial neural network to estimate leaf area","volume":"216","author":"Shabani","year":"2017","journal-title":"Sci. Hortic."},{"key":"ref_13","unstructured":"(2022, December 16). CID. Available online: https:\/\/cid-inc.com\/plant-science-tools\/leaf-area-measurement\/ci-202-portable-laser-leaf-area-meter\/."},{"key":"ref_14","unstructured":"Stafford, J.V. (2019, January 8\u201311). Using terrestrial photogrammetry for leaf area estimation in maize under different plant growth stages. Proceedings of the Precision Agriculture \u201919: 12th European Conference on Precision Agriculture, Montpellier, France."},{"key":"ref_15","first-page":"108","article-title":"Correlation studies in corn","volume":"24","author":"Montgomery","year":"1911","journal-title":"Neb. Agric. Exp. Stn. Annu. Rep."},{"key":"ref_16","first-page":"1073","article-title":"Leaf area-length allometry and its implications in leaf shape evolution","volume":"33","author":"Shi","year":"2019","journal-title":"Springer Nat. Trees"},{"key":"ref_17","first-page":"627","article-title":"An Estimation of Individual Leaf Area in Cabbage and Broccoli Using Non-destructive Methods","volume":"12","author":"Olfati","year":"2010","journal-title":"J. Agric. Sci. Technol."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Itakura, K., and Hosoi, F. (2018). Automatic Leaf Segmentation for Estimating Leaf Area and Leaf Inclination Angle in 3D Plant Images. Sensors, 18.","DOI":"10.3390\/s18103576"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Masuda, T. (2021, January 11\u201317). Leaf Area Estimation by Semantic Segmentation of Point Cloud of Tomato Plants. Proceedings of the IEEE\/CVF International Conference on Computer Vision Workshops (ICCVW), Montreal, BC, Canada.","DOI":"10.1109\/ICCVW54120.2021.00159"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1038\/s41438-020-00345-6","article-title":"Growth monitoring of greenhouse lettuce based on a convolutional neural network","volume":"7","author":"Zhang","year":"2020","journal-title":"Hortic. Res."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"684328","DOI":"10.3389\/fpls.2021.684328","article-title":"Intelligent Fruit Yield Estimation for Orchards Using Deep Learning Based Semantic Segmentation Techniques-A Review","volume":"25","author":"Maheswari","year":"2021","journal-title":"Front. Plant Sci."},{"key":"ref_22","first-page":"1","article-title":"Utilizing machine learning approaches to improve the prediction of leaf counts and individual leaf segmentation of rosette plant images","volume":"3","author":"Pape","year":"2015","journal-title":"Environ. Sci."},{"key":"ref_23","first-page":"2057","article-title":"Leaf Segmentation and Tracking in Arabidopsis thaliana Combined to an Organ-Scale Plant Model for Genotypic Differentiation","volume":"11","author":"Viaud","year":"2017","journal-title":"Front. Plant Sci."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1002\/rob.21897","article-title":"Automated crop plant detection based on the fusion of color and depth images for robotic weed control","volume":"37","author":"Gai","year":"2019","journal-title":"J. Field Robot."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Xu, L., Li, Y., Sun, Y., Song, L., and Jin, S. (2018, January 5\u20138). Leaf Instance Segmentation and Counting Based on Deep Object Detection and Segmentation Networks. Proceedings of the 2018 Joint 10th International Conference on Soft Computing and Intelligent Systems (SCIS) and 19th International Symposium on Advanced Intelligent Systems (ISIS), Toyama, Japan.","DOI":"10.1109\/SCIS-ISIS.2018.00038"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"3212","DOI":"10.1109\/TNNLS.2018.2876865","article-title":"Object Detection with Deep Learning: A Review","volume":"30","author":"Zhao","year":"2019","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_27","first-page":"84","article-title":"ImageNet Classification with Deep Convolutional Neural Networks","volume":"60","author":"Krizhevsky","year":"2012","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrel, T., and Malik, J. (2014, January 23\u201328). Rich feature hierarchies for object detection and semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_30","first-page":"640","article-title":"Fully Convolutional Networks for Semantic Segmentation","volume":"39","author":"Long","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Dollar, P., and Girshick, R. (2017, January 22\u201329). Mask R-CNN. Proceedings of the IEEE International Conference in Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1016\/j.compag.2018.01.002","article-title":"3-D reconstruction of maize plants using a time-of-flight camera","volume":"145","author":"Reiser","year":"2018","journal-title":"Comput. Electron. Agric."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1017\/S096249291700006X","article-title":"A survey of structure from motion","volume":"26","author":"Voroninski","year":"2017","journal-title":"Acta Numer."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"881","DOI":"10.1007\/s11119-019-09699-x","article-title":"Leaf Area Index evaluation in vineyards using 3D point clouds from UAV imagery","volume":"21","author":"Comba","year":"2020","journal-title":"Precis. Agric."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"2719","DOI":"10.3390\/s90402719","article-title":"Retrieving Leaf Area Index (LAI) Using Remote Sensing: Theories, Methods and Sensors","volume":"9","author":"Zheng","year":"2009","journal-title":"Sensors"},{"key":"ref_36","unstructured":"Meier, U. (2001). Entwicklungsstadien Mono- und Dikotyler Pflanzen\u2014BBCH Monografie. (Developmental Stages of Mono- and Dicotyledonous Plants\u2014BBCH Monograph), Biologische Bundesanstalt f\u00fcr Land und Forstwirtschaft."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Reiser, D., Sehsah, E.-S., Bumann, O., Morhard, J., and Griepentrog, H.W. (2019). Development of an Autonomous Electric Robot Implement for Intra-Row Weeding in Vineyards. Agriculture, 9.","DOI":"10.3390\/agriculture9010018"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"388","DOI":"10.21273\/HORTTECH.14.3.0388","article-title":"Rapid Estimation of Cabbage Head Volume across a Population Varying in Head Shape: A Test of two Geometric Formulae","volume":"14","author":"Radovich","year":"2004","journal-title":"Hort Technol."},{"key":"ref_39","unstructured":"Stafford, J.V. (2021, January 16\u201317). Volume and leaf area calculation of cabbage with a neural network-based instance segmentation. Proceedings of the Precision Agriculture \u201921: 14th European Conference on Precision Agriculture, Online."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"105591","DOI":"10.1016\/j.dib.2020.105591","article-title":"Fuji-SfM dataset: A collection of annotated images and point clouds for Fuji apple detection and location using structure- from-motion photogrammetry","volume":"30","author":"Morros","year":"2020","journal-title":"Data Brief"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Hartley, R., and Zisserman, A. (2003). Multiple View Geometry in Computer Vision, Cambridge University Press.","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_42","unstructured":"(2022, December 16). Metashape Professional, Agisoft LLC, St. Petersburg, Russia. Available online: https:\/\/www.agisoft.com."},{"key":"ref_43","unstructured":"Abdulla, W. (2021, November 22). Mask R-CNN for Object Detection and Instance Segmentation on Keras and TensorFlow. Available online: https:\/\/github.com\/matterport\/Mask_RCNN."},{"key":"ref_44","unstructured":"COCO (2022, December 16). Detection Evaluation. Available online: http:\/\/cocodataset.org\/#detection-eval."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1006\/cviu.1999.0832","article-title":"MLESAC: A New Robust Estimator with Application to Estimating Image Geometry","volume":"78","author":"Torr","year":"2000","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_46","unstructured":"(2022, December 16). Tensorflow. Available online: https:\/\/www.tensorflow.org\/install\/pip."},{"key":"ref_47","unstructured":"(2022, December 16). Keras. Available online: https:\/\/keras.io\/getting_started\/intro_to_keras_for_engineers\/."},{"key":"ref_48","unstructured":"(2022, December 16). Python 3.6.0. Available online: https:\/\/www.python.org\/downloads\/release\/python-360\/."},{"key":"ref_49","first-page":"740","article-title":"Microsoft COCO: Common Objects in Context","volume":"Volume 8693","author":"Lin","year":"2014","journal-title":"Proceedings of the European Conference on Computer Vision"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1016\/j.compag.2019.01.041","article-title":"Analysis of transfer learning for deep neural network based plant classification models","volume":"158","author":"Kaya","year":"2019","journal-title":"Comput. Electron. Agric."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1109\/MM.2014.9","article-title":"The XBOX One System on a Chip and Kinect Sensor","volume":"34","author":"Sell","year":"2014","journal-title":"IEEE Micro"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Lueling, N., Reiser, D., Stana, A., and Griepentrog, H.W. (June, January 30). Using depth information and colour space variations for improving outdoor robustness for instance segmentation of cabbage. Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi\u2019an, China.","DOI":"10.1109\/ICRA48506.2021.9561792"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/1\/129\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,11]],"date-time":"2024-08-11T14:21:39Z","timestamp":1723386099000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/1\/129"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,23]]},"references-count":52,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["s23010129"],"URL":"https:\/\/doi.org\/10.3390\/s23010129","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2022,12,23]]}}}