Abstract
Studying the expression of vulnerability – the psychological state that arises in moments of uncertainty, risk, and emotional exposure – is key to understanding how individuals cope during time of crisis. In this study, we synthesize past theoretical and qualitative work on vulnerability and present a psycholinguistic dictionary featuring seven different lexicons commonly associated with vulnerability language: accusation, incompetence, lack of trust, riot, out-group speech, agency, and helplessness. To validate our dictionary, we apply the identified lexicons to three different datasets and then generate samples for evaluation by two independent human labelers. The comparison between the human-labeled and machine-generated results demonstrates the dictionary’s robustness, achieving a Cohen’s Kappa of 0.66 in inter-rater reliability among two labelers and an overall accuracy of 0.74 when treating human label as the ground truth. With the dictionary, we aim to provide a nuanced understanding and detection of vulnerability language on social media content and provide a foundation for text feature extraction for traditional machine learning methods.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Awoyemi, T., et al.: Emotional analysis of tweets about clinically extremely vulnerable COVID-19 groups. Cureus 14(9) (2022)
Boyd, R.L., Ashokkumar, A., Seraj, S., Pennebaker, J.W.: The Development and Psychometric Properties of liwc-22, pp. 1–47. University of Texas at Austin, Austin (2022)
Brown, B.: The power of vulnerability [ted talk] (2010)
Carley, L.R., Reminga, J., Carley, K.M.: Ora & netmapper. In: International Conference on Social Computing, Behavioral-Cultural Modeling and Prediction and Behavior Representation in Modeling and Simulation, vol. 3, p. 7. Springer, Cham (2018)
Delor, F., Hubert, M.: Revisiting the concept of ‘vulnerability’. Soc. Sci. Med. 50(11), 1557–1570 (2000)
Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)
Douglas, K.M., et al.: Understanding conspiracy theories. Polit. Psychol. 40, 3–35 (2019)
Downing, S.: On course: strategies for creating success in college and in life. Cengage Learning (2016)
Eichstaedt, J.C., et al.: Closed-and open-vocabulary approaches to text analysis: a review, quantitative comparison, and recommendations. Psychol. Methods 26(4), 398 (2021)
Greitzer, F.L., Kangas, L.J., Noonan, C.F., Dalton, A.C., Hohimer, R.E.: Identifying at-risk employees: modeling psychosocial precursors of potential insider threats. In: 2012 45th Hawaii International Conference on System Sciences, pp. 2392–2401. IEEE (2012)
Hopp, F.R., Fisher, J.T., Cornell, D., Huskey, R., Weber, R.: The extended moral foundations dictionary (EMFD): development and applications of a crowd-sourced approach to extracting moral intuitions from text. Behav. Res. Methods 53, 232–246 (2021)
Huang, B., Carley, K.M.: Disinformation and misinformation on Twitter during the novel coronavirus outbreak. arXiv preprint arXiv:2006.04278 (2020)
Jacoby, T.A.: A theory of victimhood: politics, conflict and the construction of victim-based identity. Millennium 43(2), 511–530 (2015)
Jensen, M.A., Atwell Seate, A., James, P.A.: Radicalization to violence: a pathway approach to studying extremism. Terror. Polit. Violence 32(5), 1067–1090 (2020)
Kay, C.S.: The targets of all treachery: delusional ideation, paranoia, and the need for uniqueness as mediators between two forms of narcissism and conspiracy beliefs. J. Res. Pers. 93, 104128 (2021)
Kelly, C.R.: Donald j. trump and the rhetoric of ressentiment. Q. J. Speech 106(1), 2–24 (2020)
Lewis, J.A., Hamilton, J.C., Elmore, J.D.: Describing the ideal victim: a linguistic analysis of victim descriptions. Curr. Psychol. 40, 4324–4332 (2021)
Magelinski, T., Ng, L., Carley, K.: A synchronized action framework for detection of coordination on social media. J. Online Trust Safety 1(2) (2022)
Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. IN: Advances in Neural Information Processing Systems, vol. 26 (2013)
Mohammad, S.M., Turney, P.D.: NRC Emotion Lexicon, vol. 2, p. 234. National Research Council, Canada (2013)
Ng, L.H.X., Cruickshank, I., Carley, K.M.: Coordinating narratives and the capitol riots on parler. arXiv preprint arXiv:2109.00945 (2021)
Nurse, J.R., et al.: Understanding insider threat: a framework for characterising attacks. In: 2014 IEEE Security and Privacy Workshops, pp. 214–228. IEEE (2014)
Olson, D.T.: The path to terrorist violence: a threat assessment model for radical groups at risk of escalation to acts of terrorism. Technical report, NAVAL POSTGRADUATE SCHOOL MONTEREY CA DEPT OF NATIONAL SECURITY AFFAIRS (2005)
Phadke, S., Samory, M., Mitra, T.: Pathways through conspiracy: the evolution of conspiracy radicalization through engagement in online conspiracy discussions. In: Proceedings of the International AAAI Conference on Web and Social Media, vol. 16, pp. 770–781 (2022)
Sasso, M.P., Giovanetti, A.K., Schied, A.L., Burke, H.H., Haeffel, G.J.: # sad: Twitter content predicts changes in cognitive vulnerability and depressive symptoms. Cogn. Ther. Res. 43, 657–665 (2019)
Schmidt, M.V., Sterlemann, V., Müller, M.B.: Chronic stress and individual vulnerability. Ann. N. Y. Acad. Sci. 1148(1), 174–183 (2008)
Solovev, K., Pröllochs, N.: Moral emotions shape the virality of COVID-19 misinformation on social media. In: Proceedings of the ACM Web Conference 2022, pp. 3706–3717 (2022)
Teng, X., Lin, Y.R., Chung, W.T., Li, A., Kovashka, A.: Characterizing user susceptibility to COVID-19 misinformation on Twitter. In: Proceedings of the International AAAI Conference on Web and Social Media, vol. 16, pp. 1005–1016 (2022)
van der Vegt, I., Mozes, M., Kleinberg, B., Gill, P.: The grievance dictionary: understanding threatening language use. Behav. Res. Methods, 1–15 (2021)
Xiao, S., Cheshire, C., Bruckman, A.: Sensemaking and the chemtrail conspiracy on the internet: insights from believers and ex-believers. Proc. ACM Hum.-Comput. Interact. 5(CSCW2), 1–28 (2021)
Zhao, Y., Da, J., Yan, J.: Detecting health misinformation in online health communities: incorporating behavioral features into machine learning based approaches. Inf. Process. Manag. 58(1), 102390 (2021)
Acknowledgements
This work was supported in part by ONR MURI Persuasion, Identity & Morality in Social-Cyber Environments award # N00014-21-12749 through a grant and the Center for Computational Analysis of Social and Organization Systems (CASOS). The views and conclusions contained in this document are those of the authors and should not be interpreted as representing official policies, either expressed or implied, of ONR Office or the U.S. government.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Hu, W., Jin, Z., Carley, K.M. (2023). Vulnerability Dictionary: Language Use During Times of Crisis and Uncertainty. In: Thomson, R., Al-khateeb, S., Burger, A., Park, P., A. Pyke, A. (eds) Social, Cultural, and Behavioral Modeling. SBP-BRiMS 2023. Lecture Notes in Computer Science, vol 14161. Springer, Cham. https://doi.org/10.1007/978-3-031-43129-6_11
Download citation
DOI: https://doi.org/10.1007/978-3-031-43129-6_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-43128-9
Online ISBN: 978-3-031-43129-6
eBook Packages: Computer ScienceComputer Science (R0)