This paper addressed a gap in research literature on rubrics by investigating how the formative use of rubrics of an automated writing evaluation (AWE) tool, the Writing Roadmap, along with a novel type of meta-cognitive activity, i.e., automated assessment, assisted EFL writing instruction. A one-year teaching experiment incorporating the use of the tool was undertaken at the tertiary level. A mixed-methods research approach in the form of questionnaires, interviews, and the participants' interim project reports was employed to evaluate the efficacy of the teaching experiment. The research demonstrated that formative use of AWE rubrics along with automated assessment mediated writing instruction via offering timely and objective assessment, aligning teaching and assessment goals, aiding the feedback process, increasing student-teacher interactions, and promoting learner autonomy.<\/p>","DOI":"10.4018\/ijcallt.2017040104","type":"journal-article","created":{"date-parts":[[2017,8,28]],"date-time":"2017-08-28T12:44:58Z","timestamp":1503924298000},"page":"58-74","source":"Crossref","is-referenced-by-count":8,"title":["Impact of AWE Rubrics and Automated Assessment on EFL Writing Instruction"],"prefix":"10.4018","volume":"7","author":[{"given":"Jinlan\u200e","family":"Tang","sequence":"first","affiliation":[{"name":"School of Online and Continuing Education, Beijing Foreign Studies University, Beijing, China"}]},{"given":"Yi'an","family":"Wu","sequence":"additional","affiliation":[{"name":"School of English and International Studies, Beijing Foreign Studies University, Beijing, China"}]}],"member":"2432","reference":[{"key":"IJCALLT.2017040104-0","doi-asserted-by":"publisher","DOI":"10.3200\/JOER.102.4.287-302"},{"key":"IJCALLT.2017040104-1","unstructured":"Beeth, M. E., Cross, L., Pearl, C., Pirro, J., Yagnesak, K., & Kennedy, J. (2001). A continuum for assessing science process knowledge in grades K-6. Electronic Journal of Science Education, 5(3). Retrieved July 21, 2017 from http:\/\/wolfweb.unr.edu\/homepage\/crowther\/ejse\/beethetal.html"},{"key":"IJCALLT.2017040104-2","doi-asserted-by":"publisher","DOI":"10.1007\/s11092-008-9068-5"},{"key":"IJCALLT.2017040104-3","unstructured":"Brookhart, S. (2014). How to create and use rubrics for formative assessment and grading. ASCD. Retrieved January 10, 2015 from http:\/\/www.ascd.org\/publications\/books\/112001\/chapters\/What-Are-Rubrics-and-Why-Are-They-Important%C2%A2.aspx"},{"key":"IJCALLT.2017040104-4","doi-asserted-by":"publisher","DOI":"10.1016\/j.asw.2004.07.001"},{"key":"IJCALLT.2017040104-5","author":"S.Brown","year":"1994","journal-title":"Assessing Learners in Higher Education"},{"key":"IJCALLT.2017040104-6","unstructured":"Brown, S., Race, P., & Smith, B. (1996). An assessment manifesto. 500 Tips on Assessment. Retrieved August 18, 2006 from http:\/\/www.city.londonmet.ac.uk\/deliberations\/assessment\/manifest.html"},{"key":"IJCALLT.2017040104-7","year":"2004","journal-title":"CCCC position statement on teaching, learning, and assessing writing in digital environments. NCTE (National Council of Teachers of English)"},{"issue":"2","key":"IJCALLT.2017040104-8","first-page":"94","article-title":"Beyond the design of automated writing evaluation: Pedagogical practices and perceived learning effectiveness in EFL writing classes.","volume":"12","author":"E. E.Chen","year":"2008","journal-title":"Language Learning & Technology"},{"key":"IJCALLT.2017040104-9","doi-asserted-by":"publisher","DOI":"10.3998\/mpub.770334"},{"key":"IJCALLT.2017040104-10","doi-asserted-by":"publisher","DOI":"10.1016\/j.asw.2015.08.002"},{"key":"IJCALLT.2017040104-11","year":"2008","journal-title":"Writing Roadmap"},{"key":"IJCALLT.2017040104-12","doi-asserted-by":"publisher","DOI":"10.1016\/j.asw.2008.12.003"},{"key":"IJCALLT.2017040104-13","doi-asserted-by":"publisher","DOI":"10.1016\/j.asw.2012.11.002"},{"key":"IJCALLT.2017040104-14","unstructured":"Ellis, R. (2007). Corrective feedback in theory, research and practice. Keynote speech presented at the Fifth International Symposium of ELT in China, Beijing, China."},{"key":"IJCALLT.2017040104-15","doi-asserted-by":"crossref","first-page":"28","DOI":"10.2307\/j.ctt4cgq0p.5","article-title":"The meaning of meaning: Is a paragraph more than an equation?","author":"P. F.Ericsson","year":"2006","journal-title":"Machine Scoring of Student Essays: Truth and Consequences"},{"key":"IJCALLT.2017040104-16","doi-asserted-by":"publisher","DOI":"10.1016\/S1060-3743(99)80110-6"},{"issue":"6","key":"IJCALLT.2017040104-17","first-page":"4","article-title":"Utility in a fallible tool: A multi-site case study of Automated Writing Evaluation.","volume":"8","author":"D.Grimes","year":"2010","journal-title":"The Journal of Technology, Learning, and Assessment"},{"key":"IJCALLT.2017040104-18","unstructured":"Heilman, M., & Tetreault, J. (2012). Using automated scoring to analyze student writing. Paper presented atGeorgetown University Round Table on Languages and Linguistics (GURT), Washington DC."},{"key":"IJCALLT.2017040104-19","first-page":"109","article-title":"Essay writing and the quality of feedback","author":"D.Hounsell","year":"1987","journal-title":"Student Learning: Research in Education and Cognitive Psychology"},{"key":"IJCALLT.2017040104-20","unstructured":"IELTS. (2015). Test taker performance 2015. Retrieved April 29, 2017 from https:\/\/www.ielts.org\/teaching-and-research\/test-taker-performance"},{"key":"IJCALLT.2017040104-21","unstructured":"Jin, Y. (2010). The formative assessment function of standardized language tests. In Proceedings oflecture at Beijing Jiaotong University, Beijing."},{"key":"IJCALLT.2017040104-22","doi-asserted-by":"publisher","DOI":"10.1080\/09695941003694441"},{"key":"IJCALLT.2017040104-23","doi-asserted-by":"publisher","DOI":"10.1016\/j.edurev.2007.05.002"},{"key":"IJCALLT.2017040104-24","doi-asserted-by":"publisher","DOI":"10.1016\/j.asw.2012.10.001"},{"key":"IJCALLT.2017040104-25","doi-asserted-by":"publisher","DOI":"10.1016\/j.sbspro.2013.04.141"},{"key":"IJCALLT.2017040104-26","author":"G. R.Lefrancois","year":"2004","journal-title":"Theories of Human Learning: What the Old Man Said (4thedition)"},{"key":"IJCALLT.2017040104-27","doi-asserted-by":"publisher","DOI":"10.1016\/j.asw.2015.07.003"},{"key":"IJCALLT.2017040104-28","doi-asserted-by":"publisher","DOI":"10.1016\/j.jslw.2014.10.004"},{"key":"IJCALLT.2017040104-29","unstructured":"Luft, J. (1998). Rubrics: Design and use in science teacher education. Paper presented at theAnnual Meeting of the Association for the Education of Teachers in Science."},{"key":"IJCALLT.2017040104-30","author":"K. A.Neuendorf","year":"2002","journal-title":"The Content Analysis Guidebook"},{"key":"IJCALLT.2017040104-31","first-page":"43","article-title":"Project essay grade: PEG","author":"E.Page","year":"2003","journal-title":"Automated Essay Scoring: A Cross-disciplinary Perspective"},{"key":"IJCALLT.2017040104-32","doi-asserted-by":"publisher","DOI":"10.1016\/j.lindif.2012.04.007"},{"key":"IJCALLT.2017040104-33","doi-asserted-by":"publisher","DOI":"10.1016\/j.edurev.2013.01.002"},{"key":"IJCALLT.2017040104-34","author":"J.Piaget","year":"1970","journal-title":"Structuralism"},{"key":"IJCALLT.2017040104-35","doi-asserted-by":"publisher","DOI":"10.1016\/j.asw.2012.10.005"},{"key":"IJCALLT.2017040104-36","doi-asserted-by":"publisher","DOI":"10.1016\/j.asw.2012.10.004"},{"key":"IJCALLT.2017040104-37","doi-asserted-by":"publisher","DOI":"10.1016\/j.asw.2010.01.003"},{"key":"IJCALLT.2017040104-38","unstructured":"Rich, C., Harrington, H., Kim, J., & West, B. (2008). Automated essay scoring in state formative and summative writing assessment. Paper presented at Annual Conference of American Educational Research Association, New York.."},{"issue":"1","key":"IJCALLT.2017040104-39","first-page":"96","article-title":"Computer-mediated corrective feedback and the development of L2 grammar","volume":"13","author":"S.Sauro","year":"2009","journal-title":"Language Learning & Technology"},{"key":"IJCALLT.2017040104-40","doi-asserted-by":"crossref","DOI":"10.4324\/9781410606860","author":"M. D.Shermis","year":"2003","journal-title":"Automated essay scoring: A cross-disciplinary perspective"},{"key":"IJCALLT.2017040104-41","first-page":"117","article-title":"How to integrate an automated writing assessment tool in the EFL classroom?","volume":"1","author":"J. L.Tang","year":"2014","journal-title":"Foreign Language Learning Theory and Practice"},{"key":"IJCALLT.2017040104-42","doi-asserted-by":"crossref","unstructured":"Tang, J. L., & Rich, C. (2011). Online technology-enhanced English language writing assessment in the Chinese classroom. Paper presented at Annual Conference of American Educational Research Association, New Orleans.","DOI":"10.1515\/cjal-2012-0029"},{"issue":"4","key":"IJCALLT.2017040104-43","first-page":"385","article-title":"Technology-enhanced English writing assessment in the classroom.","volume":"35","author":"J. L.Tang","year":"2012","journal-title":"Canadian Journal of Applied Linguistics"},{"issue":"4","key":"IJCALLT.2017040104-44","first-page":"53","article-title":"Using automated writing assessment in the college EFL classroom.","volume":"265","author":"J. L.Tang","year":"2012","journal-title":"Foreign Languages and Their Teaching"},{"key":"IJCALLT.2017040104-45","author":"L.Vygotsky","year":"1978","journal-title":"Mind in Society: The Development of Higher Psychological Processes"},{"key":"IJCALLT.2017040104-46","doi-asserted-by":"publisher","DOI":"10.1016\/j.asw.2013.11.008"},{"key":"IJCALLT.2017040104-47","doi-asserted-by":"publisher","DOI":"10.1080\/09588221.2012.655300"},{"key":"IJCALLT.2017040104-48","doi-asserted-by":"publisher","DOI":"10.1080\/15544800701771580"},{"key":"IJCALLT.2017040104-49","doi-asserted-by":"publisher","DOI":"10.1016\/j.jslw.2007.07.004"},{"key":"IJCALLT.2017040104-50","unstructured":"White, L., Hixson, N., D\u2019Brot, J., Perdue, J., Foster, S., & Rhudy, V. (2010). Research brief, impact of Writing Roadmap 2.0 on WESTEST 2 online writing assessment scores. Retrieved September 20, 2010 from http:\/\/wvde.state.wv.us\/oaa\/pdf\/research\/Research%20Brief%20-%20WRM2.0%20Impact%20FINAL%2001.27.10.pdf"},{"key":"IJCALLT.2017040104-51","doi-asserted-by":"publisher","DOI":"10.1016\/j.stueduc.2011.03.001"},{"key":"IJCALLT.2017040104-52","article-title":"Feedback? No, just give us the answers","author":"O.Wotjas","year":"1998","journal-title":"Times Higher Education Supplement"},{"key":"IJCALLT.2017040104-53","unstructured":"Wu, Y. A. (2011). Teacher change in the application of modern education technology in teaching English writing [Keynote speech]. Presented at 17th NAFEL Annual Conference, Beijing, November 4-5."},{"issue":"4","key":"IJCALLT.2017040104-54","first-page":"3","article-title":"Impact of integrating an automated assessment tool into English writing on university teachers.","volume":"146","author":"Y. A.Wu","year":"2012","journal-title":"Computer-Assisted Foreign Language Education"}],"container-title":["International Journal of Computer-Assisted Language Learning and Teaching"],"original-title":[],"language":"ng","link":[{"URL":"https:\/\/www.igi-global.com\/viewtitle.aspx?TitleId=188771","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,5,6]],"date-time":"2022-05-06T16:32:25Z","timestamp":1651854745000},"score":1,"resource":{"primary":{"URL":"https:\/\/services.igi-global.com\/resolvedoi\/resolve.aspx?doi=10.4018\/IJCALLT.2017040104"}},"subtitle":[""],"short-title":[],"issued":{"date-parts":[[2017,4,1]]},"references-count":55,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2017,4]]}},"URL":"https:\/\/doi.org\/10.4018\/ijcallt.2017040104","relation":{},"ISSN":["2155-7098","2155-7101"],"issn-type":[{"value":"2155-7098","type":"print"},{"value":"2155-7101","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,4,1]]}}}