汪维富,毛美娟,闫寒冰

• 1:华东师范大学教育信息技术学系
• 2:江西外语外贸职业学院电子商务学院
• 3:华东师范大学开放教育学院

摘要(Abstract)：

智能导师系统是运用人工智能技术模拟人类教师辅导行为,为学习过程提供自适应的交互反馈,是信息技术促进个性化学习的重要标志性产品。然而,在智能导师系统能否改进学业成就的问题上仍然存在着较大争议。为此,研究主要采用量化元分析方法,针对1990年以来国际上关于智能导师系统提升学业成就的58篇实证研究进行了综合分析。研究发现:智能导师系统对学业成就的平均效应量为0.492,具有中等的正向提升作用,能将第50个百分位的学生成就提高至约第68个百分位;在不同的学生特征、发表特征与研究设计特征中都发现了智能导师系统的正向促进作用,其中测试类型、持续时间与样本量对平均效应量具有显著的调节作用,本地测试的平均效应量大于标准化考试,实验处理时间越长的平均效应量越大,而样本量超过200后,平均效应量显著下降。建议国内教育技术领域扩大实证研究规模,建立规范、严谨的干预规范与实践指南,促进学科领域的健康发展。

关键词(KeyWords)： 智能导师系统;元分析;学业成就;个性化学习;计算机辅助教学;效应量;人工智能;认知辅导系统

Abstract:

Keywords:

基金项目(Foundation): 2018年度国家社会科学基金重大项目“信息化促进新时代基础教育公平的研究”(项目批准号:18ZDA335)

作者(Author): 汪维富,毛美娟,闫寒冰

DOI: 10.13541/j.cnki.chinade.2019.10.006

参考文献(References)：

• 李佳丽.2017.不同类型影子教育对小学生学业成绩的影响--及其对教育不均等的启示[J].教育科学（5):16-25.
• 李玉，柴阳丽，闫寒冰.2018.思维导图对学生学业成就的影响效应--近十年国际思维导图教育应用的元分析[J].中国远程教育（1):16-27,28.
• 刘珊珊，杨向东.2015.课外辅导对学生学业成绩影响效应的元分析[J].教育发展研究（22):55-64.
• 潘云鹤.2018.人工智能2.0与教育的发展[J].中国远程教育（5):7-10,46,81.
• 王珠珠.2018.教育信息化2.0：核心要义与实施建议[J].中国远程教育（7):5-8.
• 张志祯，张玲玲，罗琼菱子，郑葳.2019.人工智能教育应用的实然分析：教学自动化的方法与限度[J].中国远程教育（3):1-13,92.
• *Albacete,P.L.,&Vanlehn,K.A.(2000).Evaluating the Effectiveness of a Cognitive Tutor for Fundamental Physics Concepts.Proceedings of the 22nd Annual Meeting of the Cognitive Science Society,25-30.
• Anderson,J.R.,Corbett,A.T.,Koedinger,K.R.,&Pelletier,R.(1995).Cognitive tutors:lessons learned.Journal of the Learning Sciences,4(2),167-207.
• *Arbuckle,W.J.(2005).Conceptual understanding in a computer assisted Algebra I classroom.ProQuest Dissertations Publishing,University of Oklahoma,Norman.
• *Arnott,E.,Hastings,P.,&Allbritton,D.(2008).Research methods tutor:evaluation of a dialogue-based tutoring system in the classroom.Behavior Research Methods,40(3),694-698.
• *Arroyo,I.,Royer,J.M.,&Woolf,B.P.(2011).Using an intelligent tutor and math fluency training to improve math performance.International Journal of Artificial Intelligence in Education,21(1),135-152.
• *Baghaei,N.,Mitrovic,A.,&Irwin,W.(2007).Supporting collaborative learning and problem-solving in a constraint-based CSCL environment for UML class diagrams.International Journal of Computer-Supported Collaborative Learning,2(2),159-190.
• Bayraktar,S.(2001).A Meta-analysis of the Effectiveness of Computer-Assisted Instruction in Science Education,Journal of Research on Technology in Education,34(2),173-188.
• *Beal,C.R.,Arroyo,I.M.,Cohen,P.R.,&Woolf,B.P.(2010).Evaluation of animal watch:an intelligent tutoring system for arithmetic and fractions.Journal of Interactive Online Learning,9(1),64-77.
• Blok,H.,Oostdam,R.,Otter,M.E.,&Overmaat,M.(2002).Computer-assisted instruction in support of beginning reading instruction:a review.Review of Educational Research,72(1),101-130.
• Bloom,B.S.(1984).The 2 sigma problem:The search for methods of group instruction as effective as one-to-one tutoring.Educational Researcher,13(6),4-16.
• Burns,P.(1981).A quantitative synthesis of research findings relative to the pedagogical effectiveness of computer-assisted instruction in elementary and secondary schools.Dissertation Abstracts International,42,2946A.
• *Cabalo,J.V.,Jaciw,A.,&Vu,M.(2007).Comparative effectiveness of Carnegie Learning.s Cognitive Tutor Algebra I curriculum:A report of a randomized experiment in the Maui School District.Palo Alto,CA:Empirical Education,Inc.
• *Campuzano,L.,Dynarski,M.,Agodini,R.,&Rall,K.(2009).Effectiveness of reading and mathematics software products:Findings from two student cohorts.Washington,DC:U.S.Department of Education,Institute of Education Sciences.
• *Carlson,P.A.,&Miller,T.M.(1996).Beyond word processing:Using an interactive learning environment to teach writing.Brooks AFB,TX:Human Resources Directorate,Technical Training Research Division.
• *Chambers,B.,Abrami,P.,Tucker,B.,Slavin,R.E.,Madden,N.A.,&Cheung,A.,et al.(2008).Computer-assisted tutoring in success for all:reading outcomes for first graders.Journal of Research on Educational Effectiveness,1(2),120-137.
• Cohen,P.A.,Kulik,J.A.,&Kulik,C.L.C.(1982).Educational outcomes of tutoring:A meta-analysis of findings.American Educational Research Journal,19(2),237-248.
• Cohen,J.(1992).A power primer.PsychologicalBulletin,112(1):155-159.
• *Dolenc,K.,&Abersek,B.(2015).TECH8 intelligent and adaptive e-learning system:Integration into Technology and Science classrooms in lower secondary schools.Computers&Education,82,354-365.
• *Fletcher,J.D.(2011).DARPA Education Dominance Program:April2010 and November 2010 Digital Tutor assessments.Alexandria,VA:Institute for Defense Analysis.
• *Fossati,D.,Eugenio,B.D.,Brown,C.,&Ohlsson,S.(2008).Learning Linked Lists:Experiments with the iList System.International Conference on Intelligent Tutoring Systems,5091,80-89.
• *Fossati,D.,Di Eugenio,B.,Ohlsson,S.,Brown,C.,Chen,L.,&Cosejo,D.(2009).I learn from you,you learn from me:How to make iList learn from students.In:Dimitrova,V.,Mizoguchi,R.,Du Boulay,B.,&Graesser,A.(Eds.),Proceedings of The 14th International Conference on Artificial IntelligenceinEducation(pp.186-195)IOSPress,Brighton.
• Glass,G.V.,McGaw,B.,&Smith,M.L.(1981).Meta-analysis in social research.Beverly Hills,CA:Sage.
• *Graesser,A.C.,Jackson,G.T.,Mathews,E.C.,Mitchell,H.H.,Olney,A.,Ventura,M.,&Chipman,P.(2003a).Why/AutoTutor:A test of learning gains from a physics tutor with natural language dialog.Proceedings of the Twenty Fifth Annual Conference of the Cognitive Science Society,1-6.
• *Graesser,A.C.,Moreno,K.,Marineau,J.,Adcock,A.,Olney,A.,Person,N.,&the Tutoring Research Group(2003b).AutoTutor improves deep learning of computer literacy:Is it the dialogue or the talking head?Proceedings of artificial intelligence in education,47-54.
• *Graff,M.,Mayer,P.,&Lebens,M.(2008).Evaluating a web based intelligent tutoring system for mathematics at German lower secondary schools.Education and Information Technologies,13(3),221-230.
• Greenland,S.(1994).Invited commentary:a critical look at some popular meta-analytic methods.Am J Epidemiol,140(3),290-296.
• *Grubi?ic,A.,Stankov,S.,Rosic,M.,&?itko,B.(2009).Controlled experiment replication in evaluation of e-learning system.s educational influence.Computers&Education,53,591-602.
• *Hastings,P.,Arnott-Hill,E.,&Allbritton,D.(2010).Squeezing out gaming behavior in a dialog-based ITS.In V.Aleven,H.Kay,&J.Mostow(Eds.),Intelligent tutoring systems(pp.204-213),Berlin,Germany:Springer-Verlag.
• Hedges,L.V.,&Olkin,I.(1985).Statistical methods for meta-analysis.New York,NY:Academic Press.
• Ji,X.R.,Beerwinkle,A.,Wijekumar,K.K.,Lei,P.,Malatesha Joshi,R.,&Zhang,S.(2018).Using latent transition analysis to identify effects of an intelligent tutoring system on reading comprehension of seventh-grade students.Reading and Writing,31(9),2095-2113.
• *Johnson,B.G.,Phillips,F.,&Chase,L.G.(2009).An intelligent tutoring system for the accounting cycle:enhancing textbook homework with artificial intelligence.Journal of Accounting Education,27(1),30-39.
• Koedinger,K.R.,&Anderson,J.R.(1993).Effective use of intelligent software in high school math classrooms.Proceedings of the World Conference on AI in Education,1993,241-248.
• *Koedinger,K.R.,Aleven,V.,Heffernan,N.,Mclaren,B.,&Hockenberry,M.(2004).Opening the Door to Non-programmers:Authoring Intelligent Tutor Behavior by Demonstration.Intelligent Tutoring Systems.Springer Berlin Heidelberg.
• *Koedinger,K.R.,Anderson,J.R.,Hadley,W.H.,&Mark,M.A.(1997).Intelligent tutoring goes to school in the big city.International Journal of Artificial Intelligence in Education,8(1),30-43.
• Kroesbergen,E.H.,&Van Luit,J.E.H.(2003).Mathematics interventions for children with special educational needs:a meta-analysis.Remedial and Special Education,24(2),97-114.
• Kulik,J.A.,&Fletcher,J.D.(2016).Effectiveness of intelligent tutoring systems:a meta-analytic review.Review of Educational Research,86(1),42-78
• Kulik,C.C.,&Kulik,J.A.(1991).Effectiveness of computer-based instruction:An updated analysis.ComputersinHumanBehavior,7,75-94.
• Kulik,J.A.(1994).Meta-analytic studies of findings on computer-based instruction.In E.L.Baker&H.F.O.Neil Jr.(Eds.),Technology assessment in education and training(pp.9-33),Hillsdale,NJ:Erlbaum.
• Kulik,J.A.(2002).School mathematics and science programs benefit from instruction technology(Info Brief NSF 03-301).Washington,DC:National Science Foundation.
• *Lane,H.C.,&VanLehn,K.(2005).Teaching the tacit knowledge of programming to novices with natural language tutoring.Computer Science Education,15(3),183-201.
• *Lanzilotti,R.,&Roselli,T.(2007).An experimental evaluation of logiocando,an intelligent tutoring hypermedia system.International Journal of Artificial Intelligence in Education,17(1),41-56.
• *Le,N.T.,Menzel,W.,&Pinkwart,N.(2009).Evaluation of a constraint-based homework assistance system for logic programming.Proceedings of the 6th International Conference on Web-based Learning,Edinburgh,UK,367-379.
• *Long,Y.,&Aleven,V.(2017).Enhancing learning outcomes through self-regulated learning support with an open learner model.User Modeling and User-Adapted Interaction,27(1),55-88.
• Ma,W.,Adesope,O.O.,Nesbit,J.C.,&Liu,Q.(2014).Intelligent tutoring systems and learning outcomes:A meta-analysis.Journal of Educational Psychology,106(4),901-918.
• *McCarthy,K.S.,Likens,A.D.,Johnson,A.M.,Guerrero,T.A.,&Mcnamara,D.S.(2018).Metacognitive overload:positive and negative effects of metacognitive prompts in an intelligent tutoring system.International Journal of Artificial Intelligence in Education,28(3),420-438.
• *Mello,S.,Olney,A.,Williams,C.,&Hays,P.(2012).Gaze tutor:a gaze-reactive intelligent tutoring system.International Journal of Human-Computer Studies,70(5),377-398.
• *Mendicino,M.,&Heffernan,N.(2007).Comparing the learning from intelligent tutoring systems,non-intelligent computer-based versions,and traditional classroom instruction.ProQuest Dissertations Publishing,West Virginia University,Morgantown.
• *Mendicino,M.,Razzaq,L.,&Heffernan,N.T.(2009).A comparison of traditional homework to computer-supported homework.Journal of Research on Technology in Education,41(3),331-359.
• *Mills-Tettey,G.A.,Mostow,J.,Dias,M.B.,Sweet,T.M.,Belousov,S.M.,&Dias,M.F.,et al.(2009).Improving child literacy in Africa:experiments with an automated reading tutor.International Conference on Information and Communication Technologies and Development,6,129-138.
• *Mitrovic,A.,Martin,B.,Suraweera,P.,Zakharov,K.,Milik,N.,&Holland,J.(2009).Aspire:an authoring system and deployment environment for constraint-based tutors.International Journal of Artificial Intelligence in Education,19(2),155-188.
• *Mohammadzadeh,A.,&Sarkhosh,M.(2018).The Effects of Self-Regulatory Learning through Computer-Assisted Intelligent Tutoring System on the Improvement of EFL Learner.Speaking Ability.International Journal of Instruction,11(2),167-184.
• *Morgan,P.,&Ritter,S.(2002).An experimental study of the effects of Cognitive Tutor Alegbra I on student knowledge and attitude.Available from Carnegie Learning,Inc.
• *Mostow,J.,Nelson-Taylor,J.,&Beck,J.E.(2013).Computer-guided oral reading versus independent practice:comparison of sustained silent reading to an automated reading tutor that listens.Journal of Educational Computing Research,49(2),249-276.
• *Naser,S.(2009).Evaluating the effectiveness of the CPP-Tutor,an intelligent tutoring system for students learning to program in C++.Journal of Applied Sciences Research,5(1),109-114.
• *Nguyen,D.H.C.,Arch-Int,N.,&Arch-Int,S.(2018).FUSE:AFuzzy-Semantic Framework for Personalizing Learning Recommendations.International Journal of Information Technology&Decision Making,17(4),1173-1201.
• *Nye,B.D.,Pavlik,P.I.,Windsor,A.,Olney,A.M.,Hajeer,M.,&Hu,X.(2018).Skope-IT:overlaying natural language tutoring on an adaptive learning system for mathematics.International Journal of STEMEducation,5(1),1-20.
• Pane,J.F.,Griffin,B.A.,McCaffrey,D.F.,&Karam,R.(2013).Effectiveness of cognitive tutor algebra I at scale.Educational Evaluation and Policy Analysis,36(2),127-144.
• *Parvez,S.M.(2008).A pedagogical framework for integrating individual learning style into an intelligent tutoring system.[Unpublished manuscript],Lehigh University,Bethlehem.
• *Pek,P.K.,&Poh,K.L.(2005).Making decisions in an intelligent tutoring system.International Journal of Information Technology&Decision Making,4(02),207-233.
• *Pinkwart,N.,Ashley,K.,Lynch,C.,&Aleven,V.(2009).Evaluating an intelligent tutoring system for making legal arguments with hypotheticals.International Journal of Artificial Intelligence in Education,19(4),401-424.
• *Poulsen,R.(2004).Tutoring bilingual students with an automated reading tutor that listens:results of a two-month pilot study.Journal of Educational Computing Research,36(2),191-221.
• Ritter,G.W.,Barnett,J.H.,Denny,G.S.,&Albin,G.R.(2009).The effectiveness of volunteer tutoring programs for elementary and middle school students:A meta-analysis.Review of Educational Research,79(1),3-38.
• *Ritter,S.,Kulikowich,J.,Lei,P.W.,Mcguire,C.L.,&Morgan,P.(2007).What Evidence Matters?A randomized field trial of Cognitive Tutor Algebra I.International Conference on Supporting Learning Flow Through Integrative Technologies,13-20.
• Rosenshine,B.,&Meister,C.(1994).Reciprocal teaching:A review of the research.Review of Educational Research,64(4),479-530.
• *Serrano,M.A.,Vidal-Abarca,E.,&Ferrer,A.(2018).Teaching self-regulation strategies via an intelligent tutoring system(TuinLEC-web):Effects for low-skilled comprehenders.Journal of Computer Assisted Learning,34(5),515-525.
• *Shute,V.J.,&Glaser,R.(1990).A large-scale evaluation of an intelligent discovery world:Smithtown.Interactive Learning Environments,1(1),51-77.
• *Smith,J.E.(2001).The effect of the Carnegie Algebra Tutor on student achievement and attitude in introductory high school algebra.ProQuest Dissertations Publishing,Virginia Polytechnic Institute and State University,Blacksburg.
• Sosa,G.W.,Berger,D.E.,Saw,A.T.,&Mary,J.C.(2011).Effectiveness of computer-assisted instruction in statistics:A meta-analysis.Review of Educational Research,81(1),97-127.
• *Stankov,S.,Glavinic,V.,&Grubi?ic,A.(2004).What is our effect size:Evaluating the educational influence of a web-based intelligent authoring shell?Eighth IEEE International Conference on Intelligent Engineering Systems.545-550.
• Steenbergen-Hu,S.,&Cooper,H.(2013).A meta-analysis of the effectiveness of intelligent tutoring systems on K-12 students.mathematical learning.Journal of Educational Psychology,105(4),970-987.
• Steenbergen-Hu,S.,&Cooper,H.(2014).A meta-analysis of the effectiveness of intelligent tutoring systems on college students.academic learning.Journal of Educational Psychology,106(2),331-347.
• *Stylianou,D.A.&Shapiro,L.(2002).Revitalizing Algebra:the effect of the use of a cognitive tutor in a remedial course,Journal of Educational Media,27(3),147-171.
• *Suraweera,P.,&Mitrovic,A.(2002).KERMIT:A constraint-based tutor for database modeling.6th International Conference of ITSs,377-387.
• *Suraweera,P.,&Mitrovic,A.(2004).An Intelligent Tutoring System for Entity Relationship Modelling.International Journal of Artificial Intelligence in Education archive,14,375-417.
• Tamim,R.M.,Bernard,R.M.,Borokhovski,E.,Abrami,P.C.,&Schmid,R.F.(2011).What forty years of research says about the impact of technology on learning a second-order meta-analysis and validation study.Review of Educational Research,81(1),4-28.
• VanLehn,K.(2006).The behavior of tutoring systems.International Journal of Artificial Intelligence in Education,16(3):227-265.
• VanLehn,K.(2011).The relative effectiveness of human tutoring,intelligent tutoring systems,and other tutoring systems.Educational Psychologist,46(4),197-221.
• *Vanlehn,K.,Lynch,C.,Schulze,K.,Shapiro,J.A.,Shelby,R.,&Taylor,L.,et al.(2005).The Andes physics tutoring system:five years of evaluations.International Journal of Artificial Intelligence in Education,15(3),147-204.
• *Vidal-Abarca,&E.,Gilabert,R.,et al.(2014).TuinLEC,an intelligent tutoring system to improve reading literacy skills.Journal for the Study of Education and Development,37(1),25-56.
• *Weber,W.A.(2003,August 10).An Evaluation of the Reasoning Mind Program at Hogg Middle School.Retrieved December 23,2018,from http://www.reasoningmind.org/wp-content/uploads/2013/11/2003_Pilot_Independent_Evaluation.pdf
• What Works Clearinghouse.(2016).WWC Intervention Report for Cognitive Tutor.Retrieved December 12,2018,from http://ies.ed.gov/ncee/wwc/Intervention/818
• What Works Clearinghouse.(2017).WWC Version 4.0 Standards Handbook.Retrieved December 20,2018,http://ies.ed.gov/ncee/wwc/multimedia/40
• *Wijekumar,K.K.,Meyer,B.J.,&Lei,P.(2012).Large-scale randomized controlled trial with 4th graders using intelligent tutoring of the structure strategy to improve nonfiction reading comprehension.Educational Technology Research and Development,60(6),987-1013.
• *Woo,C.W.,Evens,M.W.,Freedman,R.,Glass,M.,Shim,L.S.,&Zhang,Y.,et al.(2006).An intelligent tutoring system that generates a natural language dialogue using dynamic multi-level planning.Artificial Intelligence in Medicine,38(1),25-46.
• Woolf,B.P.(2009).Building intelligent interactive tutors:student-centered strategies for revolutionizing e-learning.Telearn,59(5),337-379.
• *Zafar,A.,&Albidewi,I.(2015).Evaluation study of e LGuide:a framework for adaptive e-learning.Computer Applications in Engineering Education,23(4),542-555.
• *Zakharov,K.,Mitrovic,&A.,Ohlsson,S.(2005).Feedback Micro-engineering in EER-Tutor.International Conference on Artificial Intelligence in Education,IOS Press,718-725.