{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,11,19]],"date-time":"2024-11-19T18:26:05Z","timestamp":1732040765186},"reference-count":48,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,8,27]],"date-time":"2021-08-27T00:00:00Z","timestamp":1630022400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,8,27]],"date-time":"2021-08-27T00:00:00Z","timestamp":1630022400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100005416","name":"norges forskningsr\u00e5d","doi-asserted-by":"publisher","award":["262848"],"id":[{"id":"10.13039\/501100005416","id-type":"DOI","asserted-by":"publisher"}]},{"name":"SINTEF AS"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Neural Comput & Applic"],"published-print":{"date-parts":[[2022,1]]},"abstract":"Abstract<\/jats:title>Depression is a common illness worldwide with potentially severe implications. Early identification of depressive symptoms is a crucial first step towards assessment, intervention, and relapse prevention. With an increase in data sets with relevance for depression, and the advancement of machine learning, there is a potential to develop intelligent systems to detect symptoms of depression in written material. This work proposes an efficient approach using Long Short-Term Memory (LSTM)-based Recurrent Neural Network (RNN) to identify texts describing self-perceived symptoms of depression. The approach is applied on a large dataset from a public online information channel for young people in Norway. The dataset consists of youth\u2019s own text-based questions on this information channel. Features are then provided from a one-hot process on robust features extracted from the reflection of possible symptoms of depression pre-defined by medical and psychological experts. The features are better than conventional approaches, which are mostly based on the word frequencies (i.e., some topmost frequent words are chosen as features from the whole text dataset and applied to model the underlying events in any text message) rather than symptoms. Then, a deep learning approach is applied (i.e., RNN) to train the time-sequential features discriminating texts describing depression symptoms from posts with no such descriptions (non-depression posts). Finally, the trained RNN is used to automatically predict depression posts. The system is compared against conventional approaches where it achieved superior performance than others. The linear discriminant space clearly reveals the robustness of the features by generating better clustering than other traditional features. Besides, since the features are based on the possible symptoms of depression, the system may generate meaningful explanations of the decision from machine learning models using an explainable Artificial Intelligence (XAI) algorithm called Local Interpretable Model-Agnostic Explanations (LIME). The proposed depression symptom feature-based approach shows superior performance compared to the traditional general word frequency-based approaches where frequency of the features gets more importance than the specific symptoms of depression. Although the proposed approach is applied on a Norwegian dataset, a similar robust approach can be applied on other depression datasets developed in other languages with proper annotations and symptom-based feature extraction. Thus, the depression prediction approach can be adopted to contribute to develop better mental health care technologies such as intelligent chatbots.<\/jats:p>","DOI":"10.1007\/s00521-021-06426-4","type":"journal-article","created":{"date-parts":[[2021,8,27]],"date-time":"2021-08-27T16:03:20Z","timestamp":1630080200000},"page":"721-744","update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":80,"title":["Deep learning for prediction of depressive symptoms in a large textual dataset"],"prefix":"10.1007","volume":"34","author":[{"ORCID":"http:\/\/orcid.org\/0000-0002-5215-1834","authenticated-orcid":false,"given":"Md Zia","family":"Uddin","sequence":"first","affiliation":[]},{"given":"Kim Kristoffer","family":"Dysthe","sequence":"additional","affiliation":[]},{"given":"Asbj\u00f8rn","family":"F\u00f8lstad","sequence":"additional","affiliation":[]},{"given":"Petter Bae","family":"Brandtzaeg","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2021,8,27]]},"reference":[{"key":"6426_CR1","unstructured":"WHO (2021) https:\/\/www-who-int.ezproxy.uio.no\/news-room\/fact-sheets\/detail\/suicide."},{"issue":"3","key":"6426_CR2","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1007\/s00406-005-0584-8","volume":"255","author":"H H\u00e4fner","year":"2005","unstructured":"H\u00e4fner H, Maurer K, Trendler G, an der Heiden W, Schmidt M (2005) The early course of schizophrenia and depression. Eur Arch Psychiatry Clin Neurosci 255(3):167\u2013173","journal-title":"Eur Arch Psychiatry Clin Neurosci"},{"issue":"1","key":"6426_CR3","doi-asserted-by":"publisher","first-page":"120","DOI":"10.1093\/schbul\/sbs136","volume":"40","author":"P Fusar-Poli","year":"2014","unstructured":"Fusar-Poli P, Nelson B, Valmaggia L, Yung AR, McGuire PK (2014) Comorbid depressive and anxiety disorders in 509 individuals with an at-risk mental state: impact on psychopathology and transition to psychosis. Schizophr Bull 40(1):120\u2013131","journal-title":"Schizophr Bull"},{"key":"6426_CR4","unstructured":"World Health Organization (2017) Depression and other common mental disorders: global health estimates (No. WHO\/MSD\/MER\/2017.2)"},{"key":"6426_CR5","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1146\/annurev-publhealth-031912-114409","volume":"34","author":"RC Kessler","year":"2013","unstructured":"Kessler RC, Bromet EJ (2013) The epidemiology of depression across cultures. Annu Rev Public Health 34:119\u2013138. https:\/\/doi.org\/10.1146\/annurev-publhealth-031912-114409","journal-title":"Annu Rev Public Health"},{"key":"6426_CR6","first-page":"1","volume-title":"Other common mental disorders: global health estimates","author":"WHO Depression","year":"2017","unstructured":"Depression WHO (2017) Other common mental disorders: global health estimates. World Health Organization, Geneva, pp 1\u201324"},{"issue":"8","key":"6426_CR7","doi-asserted-by":"publisher","first-page":"1308","DOI":"10.1017\/S0033291717002781","volume":"48","author":"AH Weinberger","year":"2018","unstructured":"Weinberger AH, Gbedemah M, Martinez AM, Nash D, Galea S, Goodwin RD (2018) Trends in depression prevalence in the USA from 2005 to 2015: widening disparities in vulnerable groups. Psychol Med 48(8):1308\u20131315","journal-title":"Psychol Med"},{"issue":"2","key":"6426_CR8","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1109\/MCI.2014.2307227","volume":"9","author":"E Cambria","year":"2014","unstructured":"Cambria E, White B (2014) Jumping NLP curves: a review of natural language processing research. IEEE Comput Intell Mag 9(2):48\u201357","journal-title":"IEEE Comput Intell Mag"},{"issue":"1\u20132","key":"6426_CR9","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1016\/S1071-5819(03)00052-1","volume":"59","author":"RW Picard","year":"2003","unstructured":"Picard RW (2003) Affective computing: challenges. Int J Human Comput Stud 59(1\u20132):55\u201364","journal-title":"Int J Human Comput Stud"},{"issue":"2","key":"6426_CR10","doi-asserted-by":"publisher","first-page":"102","DOI":"10.1109\/MIS.2016.31","volume":"31","author":"E Cambria","year":"2016","unstructured":"Cambria E (2016) Affective computing and sentiment analysis. IEEE Intell Syst 31(2):102\u2013107","journal-title":"IEEE Intell Syst"},{"key":"6426_CR11","doi-asserted-by":"publisher","DOI":"10.1109\/taffc.2019.2900240","author":"W Shangfei","year":"2019","unstructured":"Shangfei W, Guozhu P, Zhuangqiang Z, Zhiwei Xu (2019) Capturing emotion distribution for multimedia emotion tagging. IEEE Trans Affect Comput. https:\/\/doi.org\/10.1109\/taffc.2019.2900240","journal-title":"IEEE Trans Affect Comput"},{"key":"6426_CR12","doi-asserted-by":"publisher","first-page":"513","DOI":"10.3389\/fpsyg.2019.00513","volume":"10","author":"JM Havigerov\u00e1","year":"2019","unstructured":"Havigerov\u00e1 JM, Haviger J, Ku\u010dera D, Hoffmannov\u00e1 P (2019) Text-based detection of the risk of depression. Front Psychol 10:513","journal-title":"Front Psychol"},{"key":"6426_CR13","doi-asserted-by":"crossref","unstructured":"Tao J, Tan T (2005) Affective computing: a review. In: Proceedings of the international conference on affective computing and intelligent interaction, pp 981\u2013995","DOI":"10.1007\/11573548_125"},{"issue":"1","key":"6426_CR14","first-page":"17","volume":"5","author":"H Yang","year":"2012","unstructured":"Yang H, Willis A, De Roeck A, Nuseibeh B (2012) A hybrid model for automatic emotion recognition in suicide notes. Biomed Inform Insights 5(1):17\u201330","journal-title":"Biomed Inform Insights"},{"issue":"16","key":"6426_CR15","doi-asserted-by":"publisher","first-page":"6351","DOI":"10.1016\/j.eswa.2013.05.050","volume":"40","author":"B Desmet","year":"2013","unstructured":"Desmet B, Hoste VR (2013) Emotion detection in suicide notes. Expert Syst Appl 40(16):6351\u20136358","journal-title":"Expert Syst Appl"},{"key":"6426_CR16","doi-asserted-by":"crossref","unstructured":"Allouch M, Azaria A, Azoulay R, Ben\u2010Izchak E, Zwilling M, Zachor DA (2018) Automatic detection of insulting sentences in conversation. Paper presented at: Proceedings of the 2018 IEEE international conference on the science of electrical engineering in Israel (ICSEE); pp 1\u20134; IEEE.","DOI":"10.1109\/ICSEE.2018.8646165"},{"key":"6426_CR17","volume-title":"The social psychology of telecommunication","author":"S John","year":"1976","unstructured":"John S, Ederyn W, Bruce C (1976) The social psychology of telecommunication. Wiley, London"},{"key":"6426_CR18","doi-asserted-by":"crossref","unstructured":"Strapparava C, Mihalcea R (2008) Learning to identify emotions in text. Paper presented at: Proceedings of the 2008 ACM symposium on applied computing, pp 1556\u20131560; ACM","DOI":"10.1145\/1363686.1364052"},{"key":"6426_CR19","doi-asserted-by":"publisher","first-page":"75616","DOI":"10.1109\/ACCESS.2020.2987523","volume":"8","author":"Y Ding","year":"2020","unstructured":"Ding Y, Chen X, Fu Q, Zhong S (2020) A depression recognition method for college students using deep integrated support vector algorithm. IEEE Access 8:75616\u201375629. https:\/\/doi.org\/10.1109\/ACCESS.2020.2987523","journal-title":"IEEE Access"},{"key":"6426_CR20","doi-asserted-by":"crossref","unstructured":"Yildirim E, Avci E (2018) Classificationof groutability of sands by linear discriminant analysis. ZBORNIK RADOVA GEO-EXPO 2018, Oct. 2018.","DOI":"10.35123\/GEO-EXPO_2018_17"},{"key":"6426_CR21","doi-asserted-by":"publisher","unstructured":"Vannatta RA, LaVenia KN (2020) Linear discriminant analysis. In Atkinson P, Delamont S, Cernat A, Sakshaug JW, Williams RA (eds) SAGE research methods foundations. doi: https:\/\/doi.org\/10.4135\/9781526421036889610","DOI":"10.4135\/9781526421036889610"},{"key":"6426_CR22","unstructured":"Gardner-Lubbe S (2020) Linear discriminant analysis for multiple functional data analysis. J Appl Stat pp 1\u201317"},{"key":"6426_CR23","doi-asserted-by":"crossref","unstructured":"Uddin MZ, Torresen J (2019) Activity recognition using smartphone sensors, robust features, and recurrent neural network. In: 2019 13th international symposium on medical information and communication technology (ISMICT), May 2019.","DOI":"10.1109\/ISMICT.2019.8743759"},{"issue":"3","key":"6426_CR24","doi-asserted-by":"publisher","first-page":"664","DOI":"10.1109\/TBME.2015.2468589","volume":"63","author":"S Kiranyaz","year":"2016","unstructured":"Kiranyaz S, Ince T, Gabbouj M (2016) Real-time patient-specific ECG classification by 1-D convolutional neural networks. IEEE Trans Biomed Eng 63(3):664\u2013675","journal-title":"IEEE Trans Biomed Eng"},{"issue":"7","key":"6426_CR25","doi-asserted-by":"publisher","first-page":"1527","DOI":"10.1162\/neco.2006.18.7.1527","volume":"18","author":"GE Hinton","year":"2006","unstructured":"Hinton GE, Osindero S, Teh Y-W (2006) A fast learning algorithm for deep belief nets. Neural Comput 18(7):1527\u20131554","journal-title":"Neural Comput"},{"key":"6426_CR26","doi-asserted-by":"crossref","unstructured":"Deboeverie F, Roegiers S, Allebosch G, Veelaert P, Philips W (2016) Human gesture classification by brute-force machine learning for exergaming in physiotherapy. In: Proceedings of IEEE conference on computational intelligence and games (CIG), Santorini, pp 1\u20137","DOI":"10.1109\/CIG.2016.7860414"},{"key":"6426_CR27","doi-asserted-by":"crossref","unstructured":"Graves A, Mohamed A, Hinton G (2013) Speech recognition with deep recurrent neural networks. In: 2013 IEEE international conference on acoustics, speech and signal processing (ICASSP). IEEE, pp 6645\u20136649","DOI":"10.1109\/ICASSP.2013.6638947"},{"issue":"8","key":"6426_CR28","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735\u20131780","journal-title":"Neural Comput"},{"key":"6426_CR29","unstructured":"Zaremba W, Sutskever I, Vinyals O (2014) Recurrent neural network regularization. arXiv preprint arXiv: 1409.2329"},{"key":"6426_CR30","first-page":"115","volume":"3","author":"FA Gers","year":"2003","unstructured":"Gers FA, Schraudolph NN, Schmidhuber J (2003) Learning precise timing with LSTM recurrent networks. J Mach Learn Res 3:115\u2013143","journal-title":"J Mach Learn Res"},{"key":"6426_CR31","doi-asserted-by":"crossref","unstructured":"Sak H, Senior AW, Beaufays F (2014) Long short-term memory recurrent neural network architectures for large scale acoustic modeling. INTERSPEECH, pp 338\u2013342","DOI":"10.21437\/Interspeech.2014-80"},{"key":"6426_CR32","doi-asserted-by":"crossref","unstructured":"Kumari T, Mishra A (2020) Deep networks and deep learning algorithms. In: Artificial intelligence trends for data analytics using machine learning and deep learning approaches, pp 199\u2013214","DOI":"10.1201\/9780367854737-12"},{"key":"6426_CR33","doi-asserted-by":"crossref","unstructured":"Liu P, Wang J, Guo Z (2020) Multiple and complete stability of recurrent neural networks with sinusoidal activation function. IEEE Trans Neural Netw Learn Syst, pp 1\u201312","DOI":"10.1109\/TNNLS.2021.3105519"},{"key":"6426_CR34","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2019.08.004","author":"MZ Uddin","year":"2020","unstructured":"Uddin MZ, Hassan M, Alsanad A, Savaglio C (2020) A body sensor data fusion and deep recurrent neural network-based behavior recognition approach for robust healthcare. Inform Fusion. https:\/\/doi.org\/10.1016\/j.inffus.2019.08.004","journal-title":"Inform Fusion"},{"key":"6426_CR35","doi-asserted-by":"crossref","unstructured":"Govindasamy KA, Palanichamy N (2021) Depression detection using machine learning techniques on twitter data. In: 2021 5th international conference on intelligent computing and control systems (ICICCS), May 2021.","DOI":"10.1109\/ICICCS51141.2021.9432203"},{"key":"6426_CR36","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1016\/j.neucom.2021.02.019","volume":"441","author":"Y Dong","year":"2021","unstructured":"Dong Y, Yang X (2021) A hierarchical depression detection model based on vocal and emotional cues. Neurocomputing 441:279\u2013290","journal-title":"Neurocomputing"},{"key":"6426_CR37","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1016\/j.future.2013.12.015","volume":"35","author":"G Fortino","year":"2014","unstructured":"Fortino G, Parisi D, Pirrone V, Di Fatta G (2014) BodyCloud: a SaaS approach for community Body Sensor Networks. Futur Gener Comput Syst 35:62\u201379","journal-title":"Futur Gener Comput Syst"},{"key":"6426_CR38","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1016\/j.inffus.2014.03.005","volume":"22","author":"G Fortino","year":"2015","unstructured":"Fortino G, Galzarano S, Gravina R, Li W (2015) A framework for collaborative computing and multi-sensor data fusion in body sensor networks. Inform Fusion 22:50\u201370","journal-title":"Inform Fusion"},{"key":"6426_CR39","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1016\/j.jnca.2018.05.007","volume":"117","author":"Y Zhang","year":"2018","unstructured":"Zhang Y, Gravina R, Lu H, Villari M, Fortino G (2018) PEA: Parallel electrocardiogram-based authentication for smart healthcare systems. J Netw Comput Appl 117:10\u201316","journal-title":"J Netw Comput Appl"},{"key":"6426_CR40","doi-asserted-by":"publisher","unstructured":"Wang R, Hao Y, Yu Q, Chen M, Humar I, Fortino G (2021) Depression Analysis and Recognition based on Functional Near-infrared Spectroscopy. IEEE J Biomed Health Inform. doi: https:\/\/doi.org\/10.1109\/JBHI.2021.3076762. Epub ahead of print. PMID: 33929968.","DOI":"10.1109\/JBHI.2021.3076762"},{"key":"6426_CR41","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1016\/j.inffus.2018.10.009","volume":"51","author":"MM Hassan","year":"2019","unstructured":"Hassan MM, Alam MGR, Uddin MZ, Huda S, Almogren A, Fortino G (2019) Human emotion recognition using deep belief network architecture. Inform Fusion 51:10\u201318","journal-title":"Inform Fusion"},{"key":"6426_CR42","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2020.3027314","author":"E Tjoa","year":"2021","unstructured":"Tjoa E, Guan C (2021) A survey on explainable artificial intelligence (XAI): toward medical XAI. IEEE Trans Neural Netw Learn Syst. https:\/\/doi.org\/10.1109\/TNNLS.2020.3027314","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"issue":"1","key":"6426_CR43","doi-asserted-by":"publisher","first-page":"483","DOI":"10.1007\/s11205-012-9996-9","volume":"115","author":"N Wang","year":"2014","unstructured":"Wang N, Kosinski M, Stillwell DJ, Rust J (2014) Can well-being be measured using Facebook status updates? Validation of facebook\u2019s gross national happiness index. Soc Indic Res 115(1):483\u2013491","journal-title":"Soc Indic Res"},{"issue":"3","key":"6426_CR44","doi-asserted-by":"publisher","first-page":"263","DOI":"10.1007\/s10880-012-9337-9","volume":"20","author":"T Baines","year":"2013","unstructured":"Baines T, Baines T, Wittkowski A, Wittkowski A (2013) A systematic review of the literature exploring illness perceptions in mental health utilising the self-regulation model. J Clin Psychol Med Settin 20(3):263\u2013274","journal-title":"J Clin Psychol Med Settin"},{"issue":"4","key":"6426_CR45","doi-asserted-by":"publisher","first-page":"647","DOI":"10.1007\/s10578-019-00869-6","volume":"50","author":"JR Cohen","year":"2019","unstructured":"Cohen JR, So FK, Young JF, Hankin BL, Lee BA (2019) Youth depression screening with parent and self-reports: assessing current and prospective depression risk. Child Psychiatry Hum Dev 50(4):647\u2013660","journal-title":"Child Psychiatry Hum Dev"},{"issue":"2","key":"6426_CR46","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1037\/1040-3590.13.2.163","volume":"13","author":"JC Coyne","year":"2001","unstructured":"Coyne JC, Thompson R, Racioppo MW (2001) Validity and efficiency of screening for history of depression by self-report. Psychol Assess 13(2):163\u2013170","journal-title":"Psychol Assess"},{"key":"6426_CR47","doi-asserted-by":"publisher","first-page":"1236","DOI":"10.1109\/ICDM.2018.00165","volume":"2018","author":"AYL Sim","year":"2018","unstructured":"Sim AYL, Borthwick A (2018) Record2Vec: unsupervised representation learning for structured records. IEEE Int Confer Data Min 2018:1236\u20131241. https:\/\/doi.org\/10.1109\/ICDM.2018.00165","journal-title":"IEEE Int Confer Data Min"},{"issue":"5","key":"6426_CR48","doi-asserted-by":"publisher","first-page":"4404","DOI":"10.1109\/TIE.2020.2984443","volume":"68","author":"X Yuan","year":"2021","unstructured":"Yuan X, Li L, Shardt YAW, Wang Y, Yang C (2021) Deep learning with spatiotemporal attention-based LSTM for industrial soft sensor model development. IEEE Trans Industr Electron 68(5):4404\u20134414. https:\/\/doi.org\/10.1109\/TIE.2020.2984443","journal-title":"IEEE Trans Industr Electron"}],"container-title":["Neural Computing and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00521-021-06426-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00521-021-06426-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00521-021-06426-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,1,10]],"date-time":"2022-01-10T11:27:37Z","timestamp":1641814057000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00521-021-06426-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,27]]},"references-count":48,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,1]]}},"alternative-id":["6426"],"URL":"https:\/\/doi.org\/10.1007\/s00521-021-06426-4","relation":{},"ISSN":["0941-0643","1433-3058"],"issn-type":[{"value":"0941-0643","type":"print"},{"value":"1433-3058","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,27]]},"assertion":[{"value":"18 March 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 August 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 August 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}