This project advances attention-aware cyberlearning as a new genre of learning technologies that automatically detect and respond to students’ attentional states. The exemplary implementation targets attentional lapses in the form of mind wandering (MW), a ubiquitous phenomenon where attention drifts away from task-related thoughts to task-unrelated thoughts. Considerable research has indicated that MW is highly frequent during complex comprehension tasks and is negatively correlated with performance outcomes. However, there is a dearth of systematic research on the incidence and impact of MW during learning with technology and technological solutions to combat MW have not yet been considered.
To address this, the proposed project blends the scientific goal of advancing basic research on MW during cyberlearning with the design goal of developing an attention-aware learning technology aimed at catching and combating wandering minds. Our exemplary technological innovation leverages emerging consumer-grade eye tracking (available as low as $99 per unit) and recent advances in mental state estimation to add an attention-aware computing layer to Guru, a cyberlearning technology for high-school biology. The attention-aware Guru will include an integrated eye tracker, an automated gaze-based MW detector, and intervention strategies to improve learning by mitigating the costs of MW. The research will be conducted in 9th grade biology classrooms in Northern Indiana, where the core technological components will be formatively studied, iteratively refined, and summatively evaluated. Generalizable insights will be identified at every stage of the project in order to promote transferability of the findings to future attention-aware technologies, thereby helping students learn to their fullest potential.
D’Mello, S. K. (2016). Giving Eyesight to the Blind: Towards attention-aware AIED, International Journal of Artificial Intelligence in Education, 26(2), 645-659.
Hutt, S., Mills, C., White, S., Donnelly, P. J. D’Mello, S. K. (2016). The Eyes Have It: Gaze-based Detection of Mind Wandering during Learning with an Intelligent Tutoring System. In T. Barnes, M. Chi, & M. Feng (Eds.) Proceedings of the 9th International Conference on Educational Data Mining (EDM 2016) (pp. 86-93). International Educational Data Mining Society.
Mills, C., D’Mello, S. K., Bosch, N., & Olney, A. (2015). Mind Wandering during Learning with an Intelligent Tutoring System. Proceedings of the 17th International Conference on Artificial Intelligence in Education (AIED 2015). Springer-Verlag: Berlin Heidelberg
Olney, A., D’Mello, S. K., Person, N., Cade, W., Hays, P., Williams, C., Lehman, B., & Graesser, A. C. (2012). Guru: A Computer Tutor that Models Expert Human Tutors. In S. Cerri, W. Clancey, G. Papadourakis, & K. Panourgia (Eds.) Proceedings of the 11th International Conference on Intelligent Tutoring Systems (pp. 256-261). Berlin Heidelberg: Springer-Verlag.
Digital Tools Evolving to Track Students' Emotions, Mindsets (Education Week)
Mind-wandering software knows when you've zoned out (New Scientist)
Mind-Wandering Software to End Daydreaming (International Business Times - London)
Sidney D'Mello (Principal Investigator)
James Brockmole (Co-Principal Investigator)
Myrthe Faber (postdoc - Psychology)
Caitlin Mills (graduate student - Psychology)
Phillip (Nigel) Bosch (graduate student - Computer Science)
Kristina Krasich (graduate student - Psychology)
Robert Bixler (graduate student - Computer Science)
Angela Stewart (graduate student - Computer Science)
Stephen Hutt (graduate student - Computer Science
Shelby White (research coordinator)
Disha Waghray (undergraduate research assistant)
John Gensic (Teacher consultant)
Matt Kloser (Faculty Advisor)
This research was supported by the National Science Foundation (NSF) (IIS 1523091). Any opinions, findings and conclusions, or recommendations expressed in this paper are those of the authors and do not necessarily reflect the views of the NSF.