Application of Deep Learning Techniques on Document Classification | SpringerLink
Skip to main content

Application of Deep Learning Techniques on Document Classification

  • Conference paper
  • First Online:
Computational Collective Intelligence (ICCCI 2019)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 11683))

Included in the following conference series:

Abstract

Automatic assignment of documents into some of the categories is highly required for analysing the content of the documents. Thus, document classification plays a significant role in the field of machine learning, artificial intelligence, information extraction, natural language processing and many more. This problem of assigning a document to a particular category or class has been approached in several ways till date, and with numerous new technological advancements, this class of problem has interesting solutions. Apart from the processes related to text analysis and parsing methodologies, deep learning has offered a way to solve this classification scenario. In the present work, we represent a comparative study on some of the basic building blocks used in deep learning, each of which can be applied to get simpler models trying to assign a class of the available documents. The present comparative study shows how these components can vary the impact on the task. The evaluation of the models has been performed on a standard available dataset. The non-linearity provided by these deep learning models are useful in getting state-of-the-art results for text classification problem.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
JPY 3498
Price includes VAT (Japan)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
JPY 11210
Price includes VAT (Japan)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
JPY 14013
Price includes VAT (Japan)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Soumya George, K., Joseph, S.: Text classification by augmenting bag of words (BOW) representation with co-occurrence feature. IOSR J. Comput. Eng. 16(1), 34–38 (2014)

    Article  Google Scholar 

  2. Harish, B.S., Udayasri, B.: Document classification: an approach using feature clustering. In: Thampi, S., Abraham, A., Pal, S., Rodriguez, J. (eds.) Recent Advances in Intelligent Informatics. AISC, vol. 235, pp. 163–173. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-01778-5_17

    Chapter  Google Scholar 

  3. Lee, J.Y., Dernoncourt, F.: Sequential short-text classification with recurrent and convolutional neural networks. CoRR abs/1603.03827 (2016)

    Google Scholar 

  4. Zhang, X., Zhao, J.J., LeCun, Y.: Character-level convolutional networks for text classification. CoRR abs/1509.01626 (2015)

    Google Scholar 

  5. Kowsari, K., Brown, D.E., Heidarysafa, M., Meimandi, K.J., Gerber, M.S., Barnes, L.E.: HDLTex: hierarchical deep learning for text classification. In: 2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA), pp. 364–371 (2017)

    Google Scholar 

  6. Pennington, J., Socher, R., Manning, C.: Glove: global vectors for word representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1532–1543 (2014)

    Google Scholar 

  7. Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)

    Article  Google Scholar 

  8. Raffel, C., Ellis, D.P.W.: Feed-forward networks with attention can solve some long-term memory problems. CoRR abs/1512.08756 (2015)

    Google Scholar 

  9. Lin, Z., et al.: A structured self-attentive sentence embedding. CoRR abs/1703.03130 (2017)

    Google Scholar 

  10. Kim, Y.: Convolutional neural networks for sentence classification. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1746–1751 (2014)

    Google Scholar 

  11. Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. CoRR abs/1301.3781, pp. 1–12 (2013)

    Google Scholar 

  12. Yang, Z., Yang, D., Dyer, C., He, X., Smola, A., Hovy, E.: Hierarchical attention networks for document classification. In: 2016 Annual Conference of the North American Chapter of the Association for Computational Linguistics, pp. 1480–1489 (2016)

    Google Scholar 

  13. Das, P., Das, A.K.: Graph-based clustering of extracted paraphrases for labelling crime reports. Knowl.-Based Syst. (2019)

    Google Scholar 

  14. Das, P., Das, A.K., Nayak, J.: Feature selection generating directed rough-spanning tree for crime pattern analysis. Neural Comput. Appl. 1–17 (2018)

    Google Scholar 

  15. Harish, B.S., Manjunath, S., Guru, D.S.: Text document classification: an approach based on indexing (2019)

    Google Scholar 

  16. Jodha, R., Gaur Sanjay, B.C., Chowdhary, K.R.: Text classification using KNN with different feature selection methods. Int. J. Res. Publ. 8(1), 1–8 (2018)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Priyanka Das .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Manna, M., Das, P., Das, A.K. (2019). Application of Deep Learning Techniques on Document Classification. In: Nguyen, N., Chbeir, R., Exposito, E., Aniorté, P., Trawiński, B. (eds) Computational Collective Intelligence. ICCCI 2019. Lecture Notes in Computer Science(), vol 11683. Springer, Cham. https://doi.org/10.1007/978-3-030-28377-3_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-28377-3_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-28376-6

  • Online ISBN: 978-3-030-28377-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics