{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,7,11]],"date-time":"2024-07-11T13:08:27Z","timestamp":1720703307817},"reference-count":26,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2023,10,2]],"date-time":"2023-10-02T00:00:00Z","timestamp":1696204800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,10,2]],"date-time":"2023-10-02T00:00:00Z","timestamp":1696204800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001858","name":"VINNOVA","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100001858","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100018693","name":"HORIZON EUROPE Framework Programme","doi-asserted-by":"publisher","award":["01093026"],"id":[{"id":"10.13039\/100018693","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100009244","name":"Stockholm University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100009244","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Mach Learn"],"published-print":{"date-parts":[[2024,2]]},"abstract":"Abstract<\/jats:title>Automated fault diagnosis can facilitate diagnostics assistance, speedier troubleshooting, and better-organised logistics. Currently, most AI-based prognostics and health management in the automotive industry ignore textual descriptions of the experienced problems or symptoms. With this study, however, we propose an ML-assisted workflow for automotive fault nowcasting that improves on current industry standards. We show that a multilingual pre-trained Transformer model can effectively classify the textual symptom claims from a large company with vehicle fleets, despite the task\u2019s challenging nature due to the 38 languages and 1357 classes involved. Overall, we report an accuracy of more than 80% for high-frequency classes and above 60% for classes with reasonable minimum support, bringing novel evidence that automotive troubleshooting management can benefit from multilingual symptom text classification.<\/jats:p>","DOI":"10.1007\/s10994-023-06398-7","type":"journal-article","created":{"date-parts":[[2023,10,2]],"date-time":"2023-10-02T13:01:46Z","timestamp":1696251706000},"page":"843-861","update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Automotive fault nowcasting with machine learning and natural language processing"],"prefix":"10.1007","volume":"113","author":[{"ORCID":"http:\/\/orcid.org\/0000-0001-9188-7425","authenticated-orcid":false,"given":"John","family":"Pavlopoulos","sequence":"first","affiliation":[]},{"given":"Alv","family":"Romell","sequence":"additional","affiliation":[]},{"given":"Jacob","family":"Curman","sequence":"additional","affiliation":[]},{"given":"Olof","family":"Steinert","sequence":"additional","affiliation":[]},{"ORCID":"http:\/\/orcid.org\/0000-0001-7713-1381","authenticated-orcid":false,"given":"Tony","family":"Lindgren","sequence":"additional","affiliation":[]},{"ORCID":"http:\/\/orcid.org\/0000-0001-7879-4371","authenticated-orcid":false,"given":"Markus","family":"Borg","sequence":"additional","affiliation":[]},{"ORCID":"http:\/\/orcid.org\/0000-0002-7938-2747","authenticated-orcid":false,"given":"Korbinian","family":"Randl","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,10,2]]},"reference":[{"key":"6398_CR1","doi-asserted-by":"crossref","unstructured":"Adamopoulou, E. & Moussiades, L. (2020). An overview of chatbot technology. In IFIP international conference on artificial intelligence applications and innovations (pp. 373\u2013383). Springer.","DOI":"10.1007\/978-3-030-49186-4_31"},{"issue":"5","key":"6398_CR2","doi-asserted-by":"publisher","first-page":"3544","DOI":"10.1007\/s10664-020-09846-3","volume":"25","author":"EU Aktas","year":"2020","unstructured":"Aktas, E. U., & Yilmaz, C. (2020). Automated issue assignment: Results and insights from an industrial case. Empirical Software Engineering, 25(5), 3544\u20133589.","journal-title":"Empirical Software Engineering"},{"issue":"3","key":"6398_CR3","doi-asserted-by":"publisher","first-page":"306","DOI":"10.4271\/2017-01-0237","volume":"10","author":"J Biteus","year":"2017","unstructured":"Biteus, J., & Lindgren, T. (2017). Planning flexible maintenance for heavy trucks using machine learning models, constraint programming, and route optimization. SAE International Journal of Materials and Manufacturing, 10(3), 306\u2013315.","journal-title":"SAE International Journal of Materials and Manufacturing"},{"issue":"Jan","key":"6398_CR4","first-page":"993","volume":"3","author":"DM Blei","year":"2003","unstructured":"Blei, D. M., Ng, A. Y., & Jordan, M. I. (2003). Latent dirichlet allocation. Journal of Machine Learning Research, 3(Jan), 993\u20131022.","journal-title":"Journal of Machine Learning Research"},{"key":"6398_CR5","doi-asserted-by":"crossref","unstructured":"Borg, M. & Runeson, P. (2014) Changes, evolution, and bugs: Recommendation systems for issue management. In Recommendation systems in software engineering (pp. 477\u2013509). Springer.","DOI":"10.1007\/978-3-642-45135-5_18"},{"issue":"1","key":"6398_CR6","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1007\/s00779-021-01582-9","volume":"26","author":"S Borsci","year":"2022","unstructured":"Borsci, S., Malizia, A., Schmettow, M., Van Der Velde, F., Tariverdiyeva, G., Balaji, D., & Chamberlain, A. (2022). The chatbot usability scale: The design and pilot of a usability scale for interaction with ai-based conversational agents. Personal and Ubiquitous Computing, 26(1), 95\u2013119.","journal-title":"Personal and Ubiquitous Computing"},{"key":"6398_CR7","doi-asserted-by":"publisher","first-page":"106024","DOI":"10.1016\/j.cie.2019.106024","volume":"137","author":"TP Carvalho","year":"2019","unstructured":"Carvalho, T. P., Soares, F. A., Vita, R., Francisco, R., Basto, J. P., & Alcal\u00e1, S. G. (2019). A systematic literature review of machine learning methods applied to predictive maintenance. Computers & Industrial Engineering, 137, 106024.","journal-title":"Computers & Industrial Engineering"},{"key":"6398_CR8","doi-asserted-by":"crossref","unstructured":"Conneau, A., Khandelwal, K., Goyal, N., Chaudhary, V., Wenzek, G., Guzm\u00e1n, F., Grave, E., Ott, M., Zettlemoyer, L. & Stoyanov, V. (2019). Unsupervised cross-lingual representation learning at scale. arXiv preprint arXiv:1911.02116","DOI":"10.18653\/v1\/2020.acl-main.747"},{"key":"6398_CR9","unstructured":"Devlin, J., Chang, M. -W., Lee, K. & Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805"},{"key":"6398_CR10","doi-asserted-by":"publisher","first-page":"103678","DOI":"10.1016\/j.engappai.2020.103678","volume":"92","author":"O Fink","year":"2020","unstructured":"Fink, O., Wang, Q., Svensen, M., Dersin, P., Lee, W.-J., & Ducoffe, M. (2020). Potential, challenges and future directions for deep learning in prognostics and health management applications. Engineering Applications of Artificial Intelligence, 92, 103678.","journal-title":"Engineering Applications of Artificial Intelligence"},{"issue":"2","key":"6398_CR11","doi-asserted-by":"publisher","first-page":"405","DOI":"10.1093\/schbul\/sbaa126","volume":"47","author":"J Irving","year":"2021","unstructured":"Irving, J., Patel, R., Oliver, D., Colling, C., Pritchard, M., Broadbent, M., Baldwin, H., Stahl, D., Stewart, R., & Fusar-Poli, P. (2021). Using natural language processing on electronic health records to enhance detection and prediction of psychosis risk. Schizophrenia Bulletin, 47(2), 405\u2013414.","journal-title":"Schizophrenia Bulletin"},{"issue":"10","key":"6398_CR12","doi-asserted-by":"publisher","first-page":"1801","DOI":"10.2196\/21801","volume":"22","author":"JL Izquierdo","year":"2020","unstructured":"Izquierdo, J. L., Ancochea, J., Soriano, J. B., Savana COVID-19 Research Group. (2020). Clinical characteristics and prognostic factors for intensive care unit admission of patients with covid-19: Retrospective study using machine learning and natural language processing. Journal of Medical Internet Research, 22(10), 1801.","journal-title":"Journal of Medical Internet Research"},{"issue":"4","key":"6398_CR13","doi-asserted-by":"publisher","first-page":"1533","DOI":"10.1007\/s10664-015-9401-9","volume":"21","author":"L Jonsson","year":"2016","unstructured":"Jonsson, L., Borg, M., Broman, D., Sandahl, K., Eldh, S., & Runeson, P. (2016). Automated bug assignment: Ensemble-based machine learning in large scale industrial contexts. Empirical Software Engineering, 21(4), 1533\u20131578.","journal-title":"Empirical Software Engineering"},{"key":"6398_CR14","doi-asserted-by":"crossref","unstructured":"Joulin, A., Grave, E., Bojanowski, P. & Mikolov, T. (2016). Bag of tricks for efficient text classification. arXiv preprint arXiv:1607.01759","DOI":"10.18653\/v1\/E17-2068"},{"issue":"3","key":"6398_CR15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3439726","volume":"54","author":"S Minaee","year":"2021","unstructured":"Minaee, S., Kalchbrenner, N., Cambria, E., Nikzad, N., Chenaghlu, M., & Gao, J. (2021). Deep learning-based text classification: A comprehensive review. ACM Computing Surveys (CSUR), 54(3), 1\u201340.","journal-title":"ACM Computing Surveys (CSUR)"},{"issue":"4","key":"6398_CR16","doi-asserted-by":"publisher","first-page":"2609","DOI":"10.1007\/s10462-020-09910-w","volume":"54","author":"AG Nath","year":"2021","unstructured":"Nath, A. G., Udmale, S. S., & Singh, S. K. (2021). Role of artificial intelligence in rotor fault diagnosis: A comprehensive review. Artificial Intelligence Review, 54(4), 2609\u20132668.","journal-title":"Artificial Intelligence Review"},{"key":"6398_CR17","doi-asserted-by":"crossref","unstructured":"Qian, C., Zhu, J., Shen, Y., Jiang, Q. & Zhang, Q. (2022). Deep transfer learning in mechanical intelligent fault diagnosis: Application and challenge. Neural Processing Letters 1\u201323.","DOI":"10.1007\/s11063-021-10719-z"},{"key":"6398_CR18","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.jprocont.2020.11.005","volume":"97","author":"H Safaeipour","year":"2021","unstructured":"Safaeipour, H., Forouzanfar, M., & Casavola, A. (2021). A survey and classification of incipient fault diagnosis approaches. Journal of Process Control, 97, 1\u201316.","journal-title":"Journal of Process Control"},{"key":"6398_CR19","unstructured":"Sanh, V., Debut, L., Chaumond, J. & Wolf, T. (2019). Distilbert, a distilled version of bert: smaller, faster, cheaper and lighter. arXiv preprint arXiv:1910.01108"},{"key":"6398_CR21","unstructured":"Shaheen, Z., Wohlgenannt, G. & Filtz, E. (2020) Large scale legal text classification using transformer models. arXiv preprint arXiv:2010.12871"},{"key":"6398_CR22","doi-asserted-by":"publisher","first-page":"107864","DOI":"10.1016\/j.ress.2021.107864","volume":"215","author":"A Theissler","year":"2021","unstructured":"Theissler, A., P\u00e9rez-Vel\u00e1zquez, J., Kettelgerdes, M., & Elger, G. (2021). Predictive maintenance enabled by machine learning: Use cases and challenges in the automotive industry. Reliability Engineering & System Safety, 215, 107864.","journal-title":"Reliability Engineering & System Safety"},{"issue":"10","key":"6398_CR23","doi-asserted-by":"publisher","first-page":"12253","DOI":"10.1111\/lnc3.12253","volume":"11","author":"C Thorne","year":"2017","unstructured":"Thorne, C. (2017). Chatbots for troubleshooting: A survey. Language and Linguistics Compass, 11(10), 12253.","journal-title":"Language and Linguistics Compass"},{"key":"6398_CR24","doi-asserted-by":"publisher","first-page":"104504","DOI":"10.1016\/j.engappai.2021.104504","volume":"106","author":"R Vaish","year":"2021","unstructured":"Vaish, R., Dwivedi, U., Tewari, S., & Tripathi, S. M. (2021). Machine learning applications in power system fault diagnosis: Research advancements and perspectives. Engineering Applications of Artificial Intelligence, 106, 104504.","journal-title":"Engineering Applications of Artificial Intelligence"},{"key":"6398_CR25","doi-asserted-by":"publisher","unstructured":"Wang, W. & Gang, J. (2018). Application of convolutional neural network in natural language processing. In 2018 international conference on information systems and computer aided education (ICISCAE) (pp. 64\u201370). https:\/\/doi.org\/10.1109\/ICISCAE.2018.8666928","DOI":"10.1109\/ICISCAE.2018.8666928"},{"key":"6398_CR26","doi-asserted-by":"publisher","first-page":"152","DOI":"10.1016\/j.isatra.2021.02.042","volume":"119","author":"T Zhang","year":"2022","unstructured":"Zhang, T., Chen, J., Li, F., Zhang, K., Lv, H., He, S., & Xu, E. (2022). Intelligent fault diagnosis of machines with small & imbalanced data: A state-of-the-art review and possible extensions. ISA Transactions, 119, 152\u2013171.","journal-title":"ISA Transactions"},{"issue":"1","key":"6398_CR27","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s10033-021-00570-7","volume":"34","author":"Z Zhao","year":"2021","unstructured":"Zhao, Z., Wu, J., Li, T., Sun, C., Yan, R., & Chen, X. (2021). Challenges and opportunities of ai-enabled monitoring, diagnosis & prognosis: A review. Chinese Journal of Mechanical Engineering, 34(1), 1\u201329.","journal-title":"Chinese Journal of Mechanical Engineering"}],"container-title":["Machine Learning"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-023-06398-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10994-023-06398-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-023-06398-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,1,18]],"date-time":"2024-01-18T14:09:19Z","timestamp":1705586959000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10994-023-06398-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,2]]},"references-count":26,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,2]]}},"alternative-id":["6398"],"URL":"https:\/\/doi.org\/10.1007\/s10994-023-06398-7","relation":{},"ISSN":["0885-6125","1573-0565"],"issn-type":[{"value":"0885-6125","type":"print"},{"value":"1573-0565","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,2]]},"assertion":[{"value":"14 February 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 July 2023","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 August 2023","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 October 2023","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have extensively collaborated with the following institutions within the past 3 years: John Pavlopoulos: Department of Computer & Systems Sciences, Stockholm University [su.se], Department of Informatics, Athens University of Economics and Business [aueb.gr], Google [google.com], Ca\u2019Foscari [unive.it]; Alv Romell: Department of Computer Science, Lund University [lth.se], Strategic Product Planning and Advanced Analytics, Scania [scania.com]; Jacob Curman Department of Computer Science, Lund University [lth.se], Strategic Product Planning and Advanced Analytics, Scania [scania.com]; Olof Steinert Strategic Product Planning and Advanced Analytics, Scania [scania.com]; Tony Lindgren Department of Computer & Systems Sciences, Stockholm University [su.se], Strategic Product Planning and Advanced Analytics, Scania [scania.com]; Markus Borg Department of Computer Science, Lund University [lth.se]; Korbinian Randl Department of Computer & Systems Sciences, Stockholm University [su.se]","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participate"}},{"value":"Not applicable.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"Not applicable.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval"}},{"value":"The classifiers could in principle be used to assist the compilation of false claims. The class labels, however, are encoded and any released models classify indices and not class names.","order":6,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical consideration"}}]}}