Abstract
With the creation of word embeddings, research areas around natural language processing, such as sentiment analysis and machine translation, have improved. This has been made possible by the limitless amount of text data available on the internet and the usage of a simple, two-layer neural network. However, it remains to be seen if the domain knowledge used to train word embeddings have an impact on the task the embeddings are being used for, based on the domain knowledge of the task itself. In this paper, we extracted and cleaned text data from the Reddit database, followed by training a word embedding model that is based on the word2vec skip-gram model. Then, the features of this model were used to train a random forest classifier for classifying cyberbully comments. Our model was benchmarked with four pre-trained word embeddings, as well as hand-crafted feature extraction methods. The results show that the domain knowledge of word embeddings do play a part in the task it is being used for, as our model has a 2% improvement of precision over the next best score.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Mikolov, T., Chen, K., Dean, J., Corrado, G.: Efficient Estimation of Word Representations in Vector Space (2013)
Chavan, V.S., Shylaja, S.S.: Machine learning approach for detection of cyber-aggressive comments by peers on social media network. In: IEEE, pp. 2354–2358 (2015)
Reynolds, K., Kontostathis, A., Edwards, L.: Using machine learning to detect cyberbullying. In: IEEE, pp. 241–244 (2011)
Dadvar, M., de Jong, F.: Cyberbullying detection: a step toward a safer internet yard. In: WWW 2012 Companion, pp. 121–124 (2012)
Bengio, Y., Ducharme, R., Vincent, P., Janvin, C.: A neural probabilistic language model. J. Mach. Learn. Res. 1137–1155 (2003)
Turian, J., Ratinov, L.-A., Bengio, Y.: Word representations: a simple and general method for semi-supervised learning. In: ACL, pp. 384–394 (2010)
Mikolov, T., Yih, W.-T., Zweig, G.: Linguistic regularities in continuous space word representations. In: NAACL-HLT, pp. 746–751 (2013)
Collobert, R., Weston, J.: A unified architecture for natural language processing: deep neural networks with multitask learning. In: Proceedings of the 25th International Conference on Machine Learning, pp. 160–167 (2008)
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., Dean, J.: Distributed Representations of Words and Phrases and their Compositionality (2013)
Kenter, T., de Rijke, M.: Short text similarity with word embeddings. In: Proceedings of the 24th ACM International on Conference on Information and Knowledge Management, pp. 1191–1200 (2015)
Hu, B., Lu, Z., Li, H., Chen, Q.: Convolutional neural network architectures for matching natural language sentences. In: Advances in Neural Information Processing Systems, pp. 2042–2050 (2014)
Socher, R., Huval, B., Manning, C.D., Ng, A.Y.: Semantic compositionality through recursive matrix-vector spaces. In: Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pp. 1201–1211 (2012)
Pennington, J., Socher, R., Manning, C.D.: GloVe: global vectors for word representation. In: Empirical Methods in Natural Language Processing (EMNLP), pp. 1532–1543 (2014)
Zhao, R., Mao, K.: Cyberbullying detection based on semantic-enhanced marginalized denoising auto-encoder. In: IEEE, pp. 1–12 (2015)
Godin, F., Vandersmissen, B., De Neve, W., Van de Walle, R.: Multimedia Lab @ ACL W-NUT NER shared task: named entity recognition for Twitter microposts using distributed word representations. In: ACL (2015)
Acknowledgement
This project is partially funded by Fundamental Research Grant Scheme (FRGS) by Malaysia Ministry of Higher Education (Ref: FRGS/1/2017/ICT02/MMU/02/6).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Bin Abdur Rakib, T., Soon, LK. (2018). Using the Reddit Corpus for Cyberbully Detection. In: Nguyen, N., Hoang, D., Hong, TP., Pham, H., Trawiński, B. (eds) Intelligent Information and Database Systems. ACIIDS 2018. Lecture Notes in Computer Science(), vol 10751. Springer, Cham. https://doi.org/10.1007/978-3-319-75417-8_17
Download citation
DOI: https://doi.org/10.1007/978-3-319-75417-8_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-75416-1
Online ISBN: 978-3-319-75417-8
eBook Packages: Computer ScienceComputer Science (R0)