{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,8,22]],"date-time":"2024-08-22T02:50:35Z","timestamp":1724295035227},"reference-count":57,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2021,10,11]],"date-time":"2021-10-11T00:00:00Z","timestamp":1633910400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"publisher","award":["RGPIN-2014-4100"],"id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"The absorbance spectra for air-dried and ground soil samples from Ontario, Canada were collected in the visible and near-infrared (VIS-NIR) region from 343 to 2200 nm. The study examined thirteen combination of six preprocessing (1st derivative, 2nd derivative, Savitzky-Golay, Gap, SNV and Detrend) method included in \u2018prospectr\u2019 R package along with four modeling approaches: partial least square regression (PLSR), cubist, random forest (RF), and extreme learning machine (ELM) for prediction of the soil organic matter (SOM). The 1st derivative + gap, 2nd derivative + gap and standard normal variance (SNV) were the best preprocessing algorithms. Thus, only these three preprocessing algorithms along with four modeling approaches were used for prediction of soil pH, electrical conductively (EC), %sand, %silt, %clay, %very coarse sand (VCS), %coarse sand (CS), %medium sand (ms) and %fine sand (fs). The results showed that OM, pH, %sand, %silt and %CS were all predicted with confidence (R2 > 0.60) and the combination of 1st derivative + gap and RF gained the best performance. A detailed comparison of the preprocessing and modeling algorithms for various soil properties in this study demonstrate that for better prediction of soil properties using VIS-NIR spectroscopy requires different preprocessing and modeling algorithms. However, in general RF and 1st derivative + gap can be labeled at the best combination of preprocessing and modelling algorithms.<\/jats:p>","DOI":"10.3390\/s21206745","type":"journal-article","created":{"date-parts":[[2021,10,12]],"date-time":"2021-10-12T01:45:32Z","timestamp":1634003132000},"page":"6745","source":"Crossref","is-referenced-by-count":20,"title":["Evaluation of Optimized Preprocessing and Modeling Algorithms for Prediction of Soil Properties Using VIS-NIR Spectroscopy"],"prefix":"10.3390","volume":"21","author":[{"given":"Rebecca-Jo","family":"Vestergaard","sequence":"first","affiliation":[{"name":"School of Environmental Sciences, University of Guelph, Guelph, ON N1 G2W1, Canada"}]},{"given":"Hiteshkumar","family":"Vasava","sequence":"additional","affiliation":[{"name":"School of Environmental Sciences, University of Guelph, Guelph, ON N1 G2W1, Canada"}]},{"given":"Doug","family":"Aspinall","sequence":"additional","affiliation":[{"name":"Woodrill Farms Ltd., Guelph, ON N1H 6H8, Canada"}]},{"ORCID":"http:\/\/orcid.org\/0000-0003-1245-0482","authenticated-orcid":false,"given":"Songchao","family":"Chen","sequence":"additional","affiliation":[{"name":"ZJU-Hangzhou Global Scientific and Technological Innovation Center, Hangzhou 311200, China"}]},{"given":"Adam","family":"Gillespie","sequence":"additional","affiliation":[{"name":"School of Environmental Sciences, University of Guelph, Guelph, ON N1 G2W1, Canada"}]},{"ORCID":"http:\/\/orcid.org\/0000-0001-7279-3597","authenticated-orcid":false,"given":"Viacheslav","family":"Adamchuk","sequence":"additional","affiliation":[{"name":"Department of Bioresource Engineering, McGill University, Ste-Anne-de-Bellevue, QC H9X 3V9, Canada"}]},{"ORCID":"http:\/\/orcid.org\/0000-0003-0801-3546","authenticated-orcid":false,"given":"Asim","family":"Biswas","sequence":"additional","affiliation":[{"name":"School of Environmental Sciences, University of Guelph, Guelph, ON N1 G2W1, Canada"}]}],"member":"1968","published-online":{"date-parts":[[2021,10,11]]},"reference":[{"key":"ref_1","unstructured":"FAO (2021, August 13). The Multi-Faced r\u00f4le of Soil in the Near East. and North. Africa Region. Policy Brief. Rome. Available online: https:\/\/www.fao.org\/3\/ca3803en\/CA3803EN.pdf."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"993","DOI":"10.2136\/sssaj2016.08.0253","article-title":"Depth-specific prediction of soil properties in situ using vis-NIR spectroscopy","volume":"81","author":"Zhang","year":"2017","journal-title":"Soil Sci. Soc. Am. J."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1300\/J064v23n04_08","article-title":"Approaches to assessing sustainable agriculture","volume":"23","author":"Zinck","year":"2004","journal-title":"J. Sustain. Agric."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1007\/s11119-007-9051-z","article-title":"The use of near infrared (NIR) spectroscopy to improve soil mapping at the farm scale","volume":"9","author":"Wetterlind","year":"2008","journal-title":"Precis. Agric."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"637","DOI":"10.1111\/j.1365-2389.2011.01356.x","article-title":"Discrimination of Australian soil horizons and classes from their visible\u2013near infrared spectra","volume":"62","author":"Webster","year":"2011","journal-title":"Eur. J. Soil Sci."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Stenberg, B., and Rossel, R.V. (2010). Diffuse reflectance spectroscopy for high-resolution soil sensing. Proximal Soil Sensing, Springer.","DOI":"10.1007\/978-90-481-8859-8_3"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"113840","DOI":"10.1016\/j.geoderma.2019.06.043","article-title":"Near-infrared, mid-infrared or combined diffuse reflectance spectroscopy for assessing soil fertility in rice fields in sub-Saharan Africa","volume":"354","author":"Johnson","year":"2019","journal-title":"Geoderma"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1016\/j.geoderma.2018.03.025","article-title":"Local modeling approaches for estimating soil properties in selected Indian soils using diffuse reflectance data over visible to near-infrared region","volume":"325","author":"Gupta","year":"2018","journal-title":"Geoderma"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1009","DOI":"10.1007\/s11368-017-1766-5","article-title":"Using laboratory Vis-NIR spectroscopy for monitoring some forest soil properties","volume":"18","author":"Conforti","year":"2018","journal-title":"J. Soils Sediments"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1016\/j.geoderma.2015.04.017","article-title":"Spectral libraries for quantitative analyses of tropical Brazilian soils: Comparing vis\u2013NIR and mid-IR reflectance data","volume":"255","author":"Terra","year":"2015","journal-title":"Geoderma"},{"key":"ref_11","first-page":"859","article-title":"Visible and near infrared reflectance spectroscopy to determine chemical properties of paddy soils","volume":"11","author":"Gholizade","year":"2013","journal-title":"J. Food Agric. Environ."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"283","DOI":"10.2174\/157341112800392571","article-title":"Prediction of soil properties with PLSR and vis-NIR spectroscopy: Application to mediterranean soils from Southern Italy","volume":"8","author":"Leone","year":"2012","journal-title":"Curr. Anal. Chem."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"683","DOI":"10.13031\/2013.27385","article-title":"Wavelength identification and diffuse reflectance estimation for surface and profile soil properties","volume":"52","author":"Lee","year":"2009","journal-title":"Trans. ASABE"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1016\/j.geoderma.2005.03.007","article-title":"Visible, near infrared, mid infrared or combined diffuse reflectance spectroscopy for simultaneous assessment of various soil properties","volume":"131","author":"Rossel","year":"2006","journal-title":"Geoderma"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1101","DOI":"10.1071\/SR02137","article-title":"Simultaneous estimation of several soil properties by ultra-violet, visible, and near-infrared reflectance spectroscopy","volume":"41","author":"Islam","year":"2003","journal-title":"Soil Res."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1016\/j.scitotenv.2017.10.323","article-title":"Rapid prediction of total petroleum hydrocarbons concentration in contaminated soil using vis-NIR spectroscopy and regression techniques","volume":"616","author":"Douglas","year":"2018","journal-title":"Sci. Total Environ."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1016\/j.chemolab.2008.06.003","article-title":"Regression rules as a tool for predicting soil properties from infrared reflectance spectroscopy","volume":"94","author":"Minasny","year":"2008","journal-title":"Chemom. Intellig. Lab. Syst."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1232","DOI":"10.1016\/j.scitotenv.2018.06.319","article-title":"Rapid identification of soil organic matter level via visible and near-infrared spectroscopy: Effects of two-dimensional correlation coefficient and extreme learning machine","volume":"644","author":"Hong","year":"2018","journal-title":"Sci. Total Environ."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"e12355","DOI":"10.1111\/jfpe.12355","article-title":"Classification of apple varieties using near infrared reflectance spectroscopy and fuzzy discriminant c-means clustering model","volume":"40","author":"Wu","year":"2017","journal-title":"J. Food Process. Eng."},{"key":"ref_20","unstructured":"Stevens, A., Ramirez-Lopez, L., and Vignette, R. (2021, August 13). An Introduction to the Prospectr Package; 2013 R Package Version 0.1. Available online: https:\/\/mran.microsoft.com\/snapshot\/2017-08-06\/web\/packages\/prospectr\/vignettes\/prospectr-intro.pdf."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"116166","DOI":"10.1016\/j.trac.2020.116166","article-title":"Soil spectroscopy with the use of chemometrics, machine learning and pre-processing techniques in soil diagnosis: Recent advances-A review","volume":"135","author":"Barra","year":"2020","journal-title":"TrAC Trends Anal. Chem."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.geoderma.2008.04.007","article-title":"Comparison of multivariate methods for inferential modeling of soil carbon using visible\/near-infrared spectra","volume":"146","author":"Vasques","year":"2008","journal-title":"Geoderma"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"262","DOI":"10.1016\/j.geoderma.2017.11.006","article-title":"A systematic study on the application of scatter-corrective and spectral-derivative preprocessing for multivariate prediction of soil organic carbon by Vis-NIR spectra","volume":"314","author":"Dotto","year":"2018","journal-title":"Geoderma"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1016\/j.geoderma.2009.12.025","article-title":"Using data mining to model and interpret soil diffuse reflectance spectra","volume":"158","author":"Rossel","year":"2010","journal-title":"Geoderma"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"510","DOI":"10.1016\/j.still.2015.07.021","article-title":"Estimating the soil clay content and organic matter by means of different calibration methods of vis-NIR diffuse reflectance spectroscopy","volume":"155","author":"Nawar","year":"2016","journal-title":"Soil Tillage Res."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"218","DOI":"10.17221\/113\/2015-SWR","article-title":"Comparing different data preprocessing methods for monitoring soil heavy metals based on soil spectral features","volume":"10","author":"Gholizadeh","year":"2015","journal-title":"Soil Water Res."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1214\/ss\/1009213726","article-title":"Statistical modeling: The two cultures (with comments and a rejoinder by the author)","volume":"16","author":"Breiman","year":"2001","journal-title":"Stat. Sci."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Legget, R. (1961). Soils in Canada: Geological, Pedological and Engineering Studies, University of Toronto Press.","DOI":"10.3138\/9781487586218"},{"key":"ref_29","unstructured":"Hoffman, D.W., Matthews, B., and Wicklund, R. (1963). Soil Survey of Wellington County, Ontario, Research Branch, Canada Department of Agriculture and the Ontario."},{"key":"ref_30","unstructured":"Hoffman, D.W., Matthews, B., and Wickland, R. (1964). Soil Survey of Dufferin County, Ontario, Research Branch, Canada Department of Agriculture."},{"key":"ref_31","unstructured":"(2021, August 13). Canadian Climate Normals. Available online: https:\/\/climate.weather.gc.ca\/climate_normals\/."},{"key":"ref_32","unstructured":"Canadian Agricultural Services Coordinating Committee, Soil Classification Working Group, Soil Classification Working Group, National Research Council Canada, Canada, Agriculture and Agri-Food Canada, and Research Branch (1998). The Canadian System of Soil Classification, NRC Research Press."},{"key":"ref_33","unstructured":"Evaluation, O.C.f.S.R., Irvine, D., Schut, L., and Denholm, K.A. (1982). Field Manual for Describing Soils in Ontario, Ontario Institute of Pedology."},{"key":"ref_34","first-page":"475","article-title":"Soil pH and soil acidity","volume":"5","author":"Thomas","year":"1996","journal-title":"Methods Soil Anal. Part 3 Chem. Methods"},{"key":"ref_35","first-page":"985","article-title":"Solute content","volume":"5","author":"Rhoades","year":"1986","journal-title":"Methods Soil Anal. Part 1 Phys. Mineral. Methods"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"171","DOI":"10.5038\/1937-8602.47.1.13","article-title":"A comparative study between loss on ignition and total carbon analysis on mineralogenic sediments","volume":"47","year":"2002","journal-title":"Studia UBB Geol."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Klute, A. (1986). Particle-size analysis. Methods of Soil Analysis. Part 1. Agron. Monogr. 9, ASA and SSSA.","DOI":"10.2136\/sssabookser5.1.2ed"},{"key":"ref_38","unstructured":"Vasava, H.B. (2019). Spectral Reflectance of Bulk Soil Samples and Their Aggregate Size Fractions for Estimating soil properties, Indian Institute of Technology Kharagpur."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.biosystemseng.2016.06.005","article-title":"Assessment of soil properties in situ using a prototype portable MIR spectrometer in two agricultural fields","volume":"152","author":"Ji","year":"2016","journal-title":"Biosyst. Eng."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"10813","DOI":"10.3390\/rs61110813","article-title":"Modeling and mapping of soil salinity with reflectance spectroscopy and landsat data using two quantitative methods (PLSR and MARS)","volume":"6","author":"Nawar","year":"2014","journal-title":"Remote Sens."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"K\u00e5gstr\u00f6m, B., and Ruhe, A. (1983). The multivariate calibration problem in chemistry solved by the PLS method. Matrix Pencils, Springer.","DOI":"10.1007\/BFb0062089"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1613\/jair.279","article-title":"Improved use of continuous attributes in C4. 5","volume":"4","author":"Quinlan","year":"1996","journal-title":"J. Artif. Intell. Res."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"848","DOI":"10.1111\/j.1365-2389.2012.01495.x","article-title":"Predicting soil properties from the Australian soil visible\u2013near infrared spectroscopic database","volume":"63","author":"Rossel","year":"2012","journal-title":"Eur. J. Soil Sci."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random Forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_45","unstructured":"(2021, August 13). Package \u2018elmNN\u2019. Available online: https:\/\/mran.microsoft.com\/snapshot\/2018-04-23\/web\/packages\/elmNN\/elmNN.pdf."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Yang, M., Xu, D., Chen, S., Li, H., and Shi, Z. (2019). Evaluation of Machine Learning Approaches to Predict Soil Organic Matter and pH Using vis-NIR Spectra. Sensors, 19.","DOI":"10.3390\/s19020263"},{"key":"ref_47","unstructured":"Team, R.C (2021, August 13). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna. Available online: https:\/\/www.yumpu.com\/en\/document\/read\/6853895\/r-a-language-and-environment-for-statistical-computing."},{"key":"ref_48","unstructured":"Kuhn, M., Weston, S., Keefer, C., and Coulter, N. (2021, August 13). Cubist: Rule-and Instance-Based Regression Modeling (Version 0.2. 2). Available online: https:\/\/cran.r-project.org\/web\/packages\/Cubist\/index.html."},{"key":"ref_49","unstructured":"Kuhn, M., Wing, J., Weston, S., Williams, A., Keefer, C., Engelhardt, A., Cooper, T., and Mayer, Z. (2021, August 13). Caret: Classification and Regression Training. R Package Version 6.0-84. Available online: https:\/\/CRAN.R-project.org\/package=caret.2019."},{"key":"ref_50","unstructured":"Mevik, B.-H., Wehrens, R., and Liland, K.H. (2011). pls: Partial least squares and principal component regression. R Package Version, 2, Available online: https:\/\/cran.r-project.org\/web\/packages\/pls\/index.html."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1080\/00401706.1969.10490666","article-title":"Computer aided design of experiments","volume":"11","author":"Kennard","year":"1969","journal-title":"Technometrics"},{"key":"ref_52","unstructured":"Stevens, A., and Ramirez-Lopez, L. (2014). An introduction to the prospectr package. R Package VignetteRep. No. R Package Version 0.1, 3, Available online: http:\/\/cran.nexr.com\/web\/packages\/prospectr\/index.html."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1255\/jnirs.291","article-title":"Quantitative analysis of agricultural soils using near infrared reflectance spectroscopy and a fibre-optic probe","volume":"9","author":"Reeves","year":"2001","journal-title":"J. Near Infrared Spectrosc."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1255\/jnirs.248","article-title":"Near infrared reflectance spectroscopy for the analysis of agricultural soils","volume":"7","author":"Reeves","year":"1999","journal-title":"J. Near Infrared Spectrosc."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1016\/B978-0-12-386473-4.00005-1","article-title":"Proximal soil sensing: An effective approach for soil measurements in space and time","volume":"113","author":"Rossel","year":"2011","journal-title":"Adv. Agron."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1111\/ejss.12733","article-title":"Estimating soil texture from vis\u2013NIR spectra","volume":"70","author":"Hobley","year":"2019","journal-title":"Eur. J. Soil Sci."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"1800095","DOI":"10.1002\/minf.201800095","article-title":"Random Forest Model with Combined Features: A Practical Approach to Predict Liquid-crystalline Property","volume":"38","author":"Chen","year":"2019","journal-title":"Mol. Inform."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/20\/6745\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,20]],"date-time":"2024-07-20T03:38:57Z","timestamp":1721446737000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/20\/6745"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,11]]},"references-count":57,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2021,10]]}},"alternative-id":["s21206745"],"URL":"https:\/\/doi.org\/10.3390\/s21206745","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,11]]}}}