主观题自动批阅研究进展、应用与挑战
谭红叶;郭亚鑫;李茹;
摘要(Abstract):
如何利用主观题自动批阅技术提升教学效果,是智慧教育中关键任务之一。本文回顾了作文、短答案这两种主观题自动批阅技术的研究现状,并从数据集质量、大规模应用场景、理解学习者等方面叙述了自动批阅系统未来面临的挑战。
关键词(KeyWords): 自动批阅;作文;短答案问题
基金项目(Foundation):
作者(Authors): 谭红叶;郭亚鑫;李茹;
DOI: 10.16453/j.cnki.ISSN2096-5036.2022.02.002
参考文献(References):
- [1] Page E.B.The Imminence of Grading Essays by Computer[J].Phi Delta Kappan,1966,47(5):238-243.
- [2] Mayfield E.Defensible Explanations for Algorithmic Decisions about Writing in Education[D].Pittsburgh:Carnegie Mellon University,2020:17-203.
- [3] Mathias S,Bhattacharyya P.Can Neural Networks Automatically Score Essay Traits?[C]//Proceedings of the Fifteenth Workshop on Innovative Use of NLP for Building Educational Applications. ACL,2020:85-91.
- [4] Yu L.,Yang P.,Penghe C.,et al. Radar Math:An Intelligent Tutoring System for Math Education[C]//Proceedings of 35th AAAI Conference on Artificial Intelligence.New York:AAAI,2021.
- [5] Loukina A,Madnani N,Cahill A,et al.Using PRMSE to evaluate automated scoring systems in the presence of label noise[C]//Proceedings of the Fifteenth Workshop on Innovative Use of NLP for Building Educational Applications.ACL,2020:18-29.
- [6] Uto M,Okano M. Robust Neural Automated Essay Scoring Using Item Response Theory[C]//Proceedings of the 21st International Conference on Artificial Intelligence in Education(AIED 2020).Ifrane:AIED,2020:549-561.
- [7] Amorim E,Canado M,Veloso A.Automated Essay Scoring in the Presence of Biased Ratings[C]//Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies. New Orleans:NAACL,2018,1:229-237.
- [8] Wu M,Mosse M,Goodman N,et al.Zero Shot Learning for Code Education:Rubric Sampling with Deep Learning Inference[J/OL].AAAI,2019,33:782-790.[2022-03-11].https://web.stanford.edu/~cpiech/bio/papers/zero Shot Code.pdf
- [9] Filighera A,Steuer T,Rensing C.Fooling Automatic Short Answer Grading Systems[C]//Proceedings of the 21st International Conference on Artificial Intelligence in Education(AIED 2020).Ifrane:AIED,2020:177-190.
- [10] Farag Y,Yannakoudakis H,Briscoe T.Neural Automated Essay Scoring and Coherence Modeling for Adversarially Crafted Input[C]//Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies.New Orleans:NAACL,2018:263-271.
- [11] Baker R,Nasiar N,Ocumpaugh J,et al.Affect-Targeted Interviews for Understanding Student Frustration[C]//Proceedings of the 22nd International Conference on Artificial Intelligence in Education(AIED 2021).Utrecht:AIED,2021:52-63.