Abstract
We describe in this paper an automated method for assessing local coherence in short argumentative essays. We use ideas from Centering Theory to measure local coherence of essays’ paragraphs and compare it to human judgments on one analytical feature of essay quality called Continuity. Paragraphs which correspond to a discourse segment in our work and which are dominated by one prominent concept were deemed locally coherent according to Centering Theory. A dominance measure was proposed based on which local coherence was judged. Results on a corpus of 184 argumentative essays showed promising results. Our findings also suggest that focusing on nominal subject for detecting candidate concepts for a discourse segment’s central concept is sufficient, which confirms previous findings. Compared to previous approaches to assessing local discourse coherence in essays, our method is fully automated.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Burstein, J., Kukich, K., Wolff, S., Lu, C., Chodorow, M., Braden-Harder, L., Harris, M.D.: Automated Scoring Using A Hybrid Feature Identification Technique. In: Proceedings of ACL, pp. 206–210 (1998)
Burstein, J., Marcu, D., Knight, K.: Finding the WRITE Stuff: Automatic Identification of Discourse Structure in Student Essays. IEEE Intelligent Systems, 32–39 (January/February 2003)
Crossley, S.A., McNamara, D.S.: Cohesion, Coherence, and Expert Evaluations of Writing Proficiency. In: Proceedings of the 32nd Annual Conference of the Cognitive Science Society (2010)
Graesser, A.C., McNamara, D.S., Louwerse, M.M.: What do readers need to learn in order to process coherence relations in narrative and expository text. In: Sweet, A.P., Snow, C.E. (eds.) Rethinking Reading Comprehension, pp. 82–98. Guilford Publications, New York (2003)
Grosz, B.J., Sidner, C.L.: Attention, intentions, and the structure of discourse. Computational Linguistics 12(3), 175–204 (1986)
Grosz, B.J., Joshi, A.K., Weinstein, S.: Centering: A framework for modeling the local coherence of discourse. Computational Linguistics 21(2), 202–225 (1995)
Halliday, M.A.K., Hasan, R.: Cohesion in English. Longman, London (1976)
Jurafsky, D., Martin, J.H.: Speech and Language Processing. Prentice Hall (2009) ISBN: 0131873210
Landauer, T., McNamara, D., Dennis, S., Kintsch, W. (eds.): Latent Semantic Analysis: A Road to Meaning. Lawrence Erlbaum (1998) (2004)
McNamara, D.S., Kintsch, E., Butler-Songer, N., Kintsch, W.: Are good texts always better? Interactions of text coherence, background knowledge, and levels of understanding in learning from text. Cognition and Instruction 14(1), 1–43 (1996)
Miltsakaki, E., Kukich, K.: Evaluation of text coherence for electronic essay scoring systems. Natural Language Engineering 10(1) (2004)
Miltsakaki, E.: Dissociating discourse salience from information structure: Evidence from a centering study in Modern Greek and Japanese. In: Computational Linguistics in the Netherelands, CLIN 1999 (1999)
Mann, W.C., Thompson, S.: Rhetorical Structure Theory: Toward a Functional Theory of Text Organization. Text 8(3), 243–281 (1988)
Prasad, R., Dinesh, N., Lee, A., Miltsakaki, E., Robaldo, L., Joshi, A., Webber, B.: The Penn Discourse Treebank 2.0. In: Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008 (2008)
Shermis, M.D., Burstein, J.: Automated Essay Scoring: A Cross Disciplinary Perspective. Lawrence Erlbaum Associates, Mahwah (2003)
Wolf, F., Gibson, E.: Representing discourse coherence: a corpus-based study. Computational Linguistics 31, 249–287 (2005)
Burstein, J., Marcu, D., Knight, K.: Finding the WRITE Stuff: Automatic Identification of Discourse Structure in Student Essays. IEEE Intelligent Systems, 32–39 (January/February 2003)
Page, E.B.: The imminence of grading essays by computer. Phi Delta Kappan 48, 238–243 (1966)
Passonneau, R., Litman, D.: Discourse segmentation by human and automated means. Computational Linguistics 23(1), 103–139 (1997)
Versley, Y., Ponzetto, S.P., Poesio, M., Eidelman, V., Jern, A., Smith, J., Yang, X., Moschitti, A.: BART: A Modular Toolkit for Coreference Resolution. In: Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Rus, V., Niraula, N. (2012). Automated Detection of Local Coherence in Short Argumentative Essays Based on Centering Theory. In: Gelbukh, A. (eds) Computational Linguistics and Intelligent Text Processing. CICLing 2012. Lecture Notes in Computer Science, vol 7181. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-28604-9_37
Download citation
DOI: https://doi.org/10.1007/978-3-642-28604-9_37
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-28603-2
Online ISBN: 978-3-642-28604-9
eBook Packages: Computer ScienceComputer Science (R0)