{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,2]],"date-time":"2024-09-02T20:26:06Z","timestamp":1725308766372},"reference-count":43,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2022,3,17]],"date-time":"2022-03-17T00:00:00Z","timestamp":1647475200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000268","name":"Biotechnology and Biological Sciences Research Council","doi-asserted-by":"publisher","award":["BB \/ M027333 \/ 1"],"id":[{"id":"10.13039\/501100000268","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000780","name":"European Commission","doi-asserted-by":"publisher","award":["810775"],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004564","name":"Ministry of Education, Science and Technological Development of the Republic of Serbia","doi-asserted-by":"publisher","award":["451-03-68\/2022-14\/200358"],"id":[{"id":"10.13039\/501100004564","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"Monitoring and classification of dairy cattle behaviours is essential for optimising milk yields. Early detection of illness, days before the critical conditions occur, together with automatic detection of the onset of oestrus cycles is crucial for obviating prolonged cattle treatments and improving the pregnancy rates. Accelerometer-based sensor systems are becoming increasingly popular, as they are automatically providing information about key cattle behaviours such as the level of restlessness and the time spent ruminating and eating, proxy measurements that indicate the onset of heat events and overall welfare, at an individual animal level. This paper reports on an approach to the development of algorithms that classify key cattle states based on a systematic dimensionality reduction process through two feature selection techniques. These are based on Mutual Information and Backward Feature Elimination and applied on knowledge-specific and generic time-series extracted from raw accelerometer data. The extracted features are then used to train classification models based on a Hidden Markov Model, Linear Discriminant Analysis and Partial Least Squares Discriminant Analysis. The proposed feature engineering methodology permits model deployment within the computing and memory restrictions imposed by operational settings. The models were based on measurement data from 18 steers, each animal equipped with an accelerometer-based neck-mounted collar and muzzle-mounted halter, the latter providing the truthing data. A total of 42 time-series features were initially extracted and the trade-off between model performance, computational complexity and memory footprint was explored. Results show that the classification model that best balances performance and computation complexity is based on Linear Discriminant Analysis using features selected through Backward Feature Elimination. The final model requires 1.83 \u00b1 1.00 ms to perform feature extraction with 0.05 \u00b1 0.01 ms for inference with an overall balanced accuracy of 0.83.<\/jats:p>","DOI":"10.3390\/s22062323","type":"journal-article","created":{"date-parts":[[2022,3,21]],"date-time":"2022-03-21T01:37:17Z","timestamp":1647826637000},"page":"2323","source":"Crossref","is-referenced-by-count":15,"title":["Behavioural Classification of Cattle Using Neck-Mounted Accelerometer-Equipped Collars"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"http:\/\/orcid.org\/0000-0002-9811-9485","authenticated-orcid":false,"given":"Dejan","family":"Pavlovic","sequence":"first","affiliation":[{"name":"BioSense Institute, 21101 Novi Sad, Serbia"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-0927-0416","authenticated-orcid":false,"given":"Mikolaj","family":"Czerkawski","sequence":"additional","affiliation":[{"name":"Department of Electronic and Electrical Engineering, University of Strathclyde, Glasgow G1 1RD, UK"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-9450-1791","authenticated-orcid":false,"given":"Christopher","family":"Davison","sequence":"additional","affiliation":[{"name":"Department of Electronic and Electrical Engineering, University of Strathclyde, Glasgow G1 1RD, UK"}]},{"ORCID":"http:\/\/orcid.org\/0000-0001-6683-7178","authenticated-orcid":false,"given":"Oskar","family":"Marko","sequence":"additional","affiliation":[{"name":"BioSense Institute, 21101 Novi Sad, Serbia"}]},{"ORCID":"http:\/\/orcid.org\/0000-0001-5132-4572","authenticated-orcid":false,"given":"Craig","family":"Michie","sequence":"additional","affiliation":[{"name":"Department of Electronic and Electrical Engineering, University of Strathclyde, Glasgow G1 1RD, UK"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-6206-2229","authenticated-orcid":false,"given":"Robert","family":"Atkinson","sequence":"additional","affiliation":[{"name":"Department of Electronic and Electrical Engineering, University of Strathclyde, Glasgow G1 1RD, UK"}]},{"given":"Vladimir","family":"Crnojevic","sequence":"additional","affiliation":[{"name":"BioSense Institute, 21101 Novi Sad, Serbia"}]},{"ORCID":"http:\/\/orcid.org\/0000-0001-9093-5245","authenticated-orcid":false,"given":"Ivan","family":"Andonovic","sequence":"additional","affiliation":[{"name":"Department of Electronic and Electrical Engineering, University of Strathclyde, Glasgow G1 1RD, UK"}]},{"ORCID":"http:\/\/orcid.org\/0000-0001-6881-7728","authenticated-orcid":false,"given":"Vladimir","family":"Rajovic","sequence":"additional","affiliation":[{"name":"School of Electrical Engineering, University of Belgrade, 11000 Belgrade, Serbia"}]},{"ORCID":"http:\/\/orcid.org\/0000-0001-8642-0361","authenticated-orcid":false,"given":"Goran","family":"Kvascev","sequence":"additional","affiliation":[{"name":"School of Electrical Engineering, University of Belgrade, 11000 Belgrade, Serbia"}]},{"ORCID":"http:\/\/orcid.org\/0000-0001-9150-6805","authenticated-orcid":false,"given":"Christos","family":"Tachtatzis","sequence":"additional","affiliation":[{"name":"Department of Electronic and Electrical Engineering, University of Strathclyde, Glasgow G1 1RD, UK"}]}],"member":"1968","published-online":{"date-parts":[[2022,3,17]]},"reference":[{"key":"ref_1","unstructured":"AHDB Dairy (2022, February 17). AHDB Dairy Statistics. Available online: https:\/\/ahdb.org.uk\/dairy."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1017\/S1751731114000299","article-title":"Expression and detection of estrus in dairy cows: The role of new technologies","volume":"8","author":"Fricke","year":"2014","journal-title":"Animal"},{"key":"ref_3","unstructured":"Michie, C., Andonovic, I., Gilroy, M., Ross, D., Duthie, C.A., and Nicol, L. (2013, January 10\u201312). Oestrus Detection in Free Roaming Beef Cattle. Proceedings of the European Conference on Precision Livestock Farming\u2014EC-PLF 2013, Leuven, Belgium."},{"key":"ref_4","first-page":"498","article-title":"Estrus detection tools and their applicability in cattle: Recent and perspectival situation","volume":"12","author":"Roelofs","year":"2015","journal-title":"Anim. Reprod."},{"key":"ref_5","unstructured":"Afimilk\/NMR (2012). Silent Herdsman\/Better Performing Cows, NMR."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"7422","DOI":"10.3168\/jds.2016-11352","article-title":"Use of rumination and activity monitoring for the identification of dairy cows with health disorders: Part III. Metritis","volume":"99","author":"Stangaferro","year":"2016","journal-title":"J. Dairy Sci."},{"key":"ref_7","first-page":"124","article-title":"Cattle behaviour classification from collar, halter, and ear tag sensors","volume":"5","author":"Rahman","year":"2018","journal-title":"Inf. Process. Agric."},{"key":"ref_8","unstructured":"Zehner, N., Niederhauser, J.J., Nydegger, F., Grothmann, A., Keller, M., Hoch, M., Haeussermann, A., and Schick, M. (2012, January 8\u201312). Validation of a new health monitoring system (RumiWatch) for combined automatic measurement of rumination, feed intake, water intake and locomotion in dairy cows. Proceedings of the Information Technology, Automation and Precision Farming. International Conference of Agricultural Engineering\u2014CIGR-AgEng 2012: Agriculture and Engineering for a Healthier Life, Valencia, Spain."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.applanim.2019.04.009","article-title":"Are automated sensors a reliable tool to estimate behavioural activities in grazing beef cattle?","volume":"216","author":"Poulopoulou","year":"2019","journal-title":"Appl. Anim. Behav. Sci."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Hamilton, A.W., Davison, C., Tachtatzis, C., Andonovic, I., Michie, C., Ferguson, H.J., Somerville, L., and Jonsson, N.N. (2019). Identification of the rumination in cattle using support vector machines with motion-sensitive bolus sensors. Sensors, 19.","DOI":"10.3390\/s19051165"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1016\/j.applanim.2009.03.005","article-title":"Cow behaviour pattern recognition using a three-dimensional accelerometer and support vector machines","volume":"119","author":"Martiskainen","year":"2009","journal-title":"Appl. Anim. Behav. Sci."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.applanim.2018.12.003","article-title":"Classification of ingestive-related cow behaviours using RumiWatch halter and neck-mounted accelerometers","volume":"211","author":"Benaissa","year":"2019","journal-title":"Appl. Anim. Behav. Sci."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1016\/j.compag.2009.03.002","article-title":"Evaluation of three-dimensional accelerometers to monitor and classify behavior patterns in cattle","volume":"67","author":"Robert","year":"2009","journal-title":"Comput. Electron. Agric."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1016\/j.compag.2017.01.030","article-title":"Predicting bull behavior events in a multiple-sire pasture with video analysis, accelerometers, and classification algorithms","volume":"136","author":"Abell","year":"2017","journal-title":"Comput. Electron. Agric."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/j.compag.2014.10.018","article-title":"Behavioral classification of data from collars containing motion sensors in grazing cattle","volume":"110","author":"Handcock","year":"2015","journal-title":"Comput. Electron. Agric."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"104961","DOI":"10.1016\/j.compag.2019.104961","article-title":"Evaluation of pre-processing methods for the prediction of cattle behaviour from accelerometer data","volume":"165","author":"Riaboff","year":"2019","journal-title":"Comput. Electron. Agric."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"105179","DOI":"10.1016\/j.compag.2019.105179","article-title":"Development of a methodological framework for a robust prediction of the main behaviours of dairy cows using a combination of machine learning algorithms on accelerometer data","volume":"169","author":"Riaboff","year":"2020","journal-title":"Comput. Electron. Agric."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Kasfi, K.T., Hellicar, A., and Rahman, A. (2016, January 6). Convolutional Neural Network for Time Series Cattle Behaviour Classification. Proceedings of the Workshop on Time Series Analytics and Applications\u2014TSAA\u201916, Hobart, TAS, Australia.","DOI":"10.1145\/3014340.3014342"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1016\/j.compag.2018.12.023","article-title":"Classification of multiple cattle behavior patterns using a recurrent neural network with long short-term memory and inertial measurement units","volume":"157","author":"Peng","year":"2019","journal-title":"Comput. Electron. Agric."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Rahman, A., Smith, D., Hills, J., Bishop-Hurley, G., Henry, D., and Rawnsley, R. (2016, January 24\u201329). A comparison of autoencoder and statistical features for cattle behaviour classification. Proceedings of the 2016 International Joint Conference on Neural Networks (IJCNN), Vancouver, BC, Canada.","DOI":"10.1109\/IJCNN.2016.7727573"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Pavlovic, D., Davison, C., Hamilton, A., Marko, O., Atkinson, R., Michie, C., Crnojevi\u0107, V., Andonovic, I., Bellekens, X., and Tachtatzis, C. (2021). Classification of Cattle Behaviours Using Neck-Mounted Accelerometer-Equipped Collars and Convolutional Neural Networks. Sensors, 21.","DOI":"10.3390\/s21124050"},{"key":"ref_22","unstructured":"ITIN+HOCH (2022, February 17). RumiWatchSystem: Measurement System for Automatic Health Monitoring in Ruminants. Available online: https:\/\/www.rumiwatch.com\/."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1016\/j.neucom.2018.03.067","article-title":"Time Series FeatuRe Extraction on basis of Scalable Hypothesis tests (tsfresh\u2014A Python package)","volume":"307","author":"Christ","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_24","first-page":"1157","article-title":"An introduction to variable and feature selection","volume":"3","author":"Guyon","year":"2003","journal-title":"J. Mach. Learn. Res."},{"key":"ref_25","unstructured":"Fukunaga, K. (2013). Introduction to Statistical Pattern Recognition, Elsevier."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Jovi\u0107, A., Brki\u0107, K., and Bogunovi\u0107, N. (2015, January 25\u201329). A review of feature selection methods with applications. Proceedings of the 2015 38th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), Opatija, Croatia.","DOI":"10.1109\/MIPRO.2015.7160458"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2507","DOI":"10.1093\/bioinformatics\/btm344","article-title":"A review of feature selection techniques in bioinformatics","volume":"23","author":"Saeys","year":"2007","journal-title":"Bioinformatics"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"066138","DOI":"10.1103\/PhysRevE.69.066138","article-title":"Estimating mutual information","volume":"69","author":"Kraskov","year":"2004","journal-title":"Phys. Rev. E"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Ross, B.C. (2014). Mutual information between discrete and continuous data sets. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0087357"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Barber, D. (2012). Bayesian Reasoning and Machine Learning, Cambridge University Press.","DOI":"10.1017\/CBO9780511804779"},{"key":"ref_31","unstructured":"Murphy, K.P. (2012). Machine Learning: A probabilistic Perspective, MIT Press."},{"key":"ref_32","unstructured":"Bishop, C.M. (2006). Pattern Recognition and Machine Learning, Springer."},{"key":"ref_33","first-page":"126","article-title":"A gentle tutorial of the EM algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models","volume":"4","author":"Bilmes","year":"1998","journal-title":"Int. Comput. Sci. Inst."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"169","DOI":"10.3233\/AIC-170729","article-title":"Linear discriminant analysis: A detailed tutorial","volume":"30","author":"Tharwat","year":"2017","journal-title":"AI Commun."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1109\/34.908974","article-title":"PCA versus LDA","volume":"23","author":"Martinez","year":"2001","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"3526","DOI":"10.1039\/C8AN00599K","article-title":"Partial least squares-discriminant analysis (PLS-DA) for classification of high-dimensional (HD) data: A review of contemporary practice strategies and knowledge gaps","volume":"143","author":"Lee","year":"2018","journal-title":"Analyst"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1207\/s15328031us0304_4","article-title":"A beginner\u2019s guide to partial least squares analysis","volume":"3","author":"Haenlein","year":"2004","journal-title":"Underst. Stat."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1002\/cem.2609","article-title":"Partial least squares discriminant analysis: Taking the magic away","volume":"28","author":"Brereton","year":"2014","journal-title":"J. Chemom."},{"key":"ref_39","first-page":"2825","article-title":"Scikit-learn: Machine Learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"3021","DOI":"10.21105\/joss.03021","article-title":"Seaborn: Statistical data visualization","volume":"6","author":"Waskom","year":"2021","journal-title":"J. Open Source Softw."},{"key":"ref_41","unstructured":"ST Microelectronics (2022, March 10). UM2526: Introduction Getting Started with X-CUBE-AI Expansion Package for Artificial Intelligence (AI) UM2526 User Manual. Available online: https:\/\/www.st.com\/resource\/en\/user_manual\/dm00570145-getting-started-with-xcubeai-expansion-package-for-artificial-intelligence-ai-stmicroelectronics.pdf."},{"key":"ref_42","unstructured":"Intel\u00ae (2022, March 10). Intel\u00ae Intrinsics Guide. Available online: https:\/\/www.intel.com\/content\/www\/us\/en\/docs\/intrinsics-guide."},{"key":"ref_43","unstructured":"ST Microelectronics (2022, March 10). Datasheet\u2014STM32L476xx\u2014Ultra-Low-Power Arm\u00aeCortex\u00ae-M4. Available online: https:\/\/www.st.com\/resource\/en\/datasheet\/stm32l476je.pdf."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/6\/2323\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,27]],"date-time":"2024-07-27T13:24:46Z","timestamp":1722086686000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/6\/2323"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,17]]},"references-count":43,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2022,3]]}},"alternative-id":["s22062323"],"URL":"https:\/\/doi.org\/10.3390\/s22062323","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,17]]}}}