key: cord-0046945-5bgll8ff
authors: Gauthier, Andrea; Porayska-Pomsta, Kaśka; Mareschal, Denis
title: Using Eye-Tracking and Click-Stream Data to Design Adaptive Training of Children’s Inhibitory Control in a Maths and Science Game
date: 2020-06-10
journal: Artificial Intelligence in Education
DOI: 10.1007/978-3-030-52240-7_19
sha: fb9db891097f64237b34de39e1e73f8d68085dc6
doc_id: 46945
cord_uid: 5bgll8ff

Computerised educational neuroscience interventions that train within-domain inhibitory control (IC) can improve children’s counterintuitive reasoning. However, the HCI or adaptive design of such environments often receive less attention. Eye-tracking and click data were used to compare four versions of an IC-training game in terms of their HCI design and potential for supporting adaptive feedback. Our results provide insights for developing an adaptive system to scaffold pupils’ transition towards using IC in un-cued, self-regulated scenarios.

Inhibitory control (IC) belongs to a set of cognitive skills, known as "executive functions", that are foundational to self-regulated learning (SRL) [1, 9, 18] . IC is key to maths and science learning where inhibition of pre-existing beliefs or superficial perceptions is necessary for learning and applying counterintuitive knowledge [7, 13, 14] . There is a keen interest in understanding IC as a component of SRL and in applying Educational Neuroscience (EdN) insights to educational practice. While it is standard to computerise EdN interventions, many of these ignore key principles and methods at the intersection of HCI and AIED. We argue that such principles may be critical to a successful delivery of EdN interventions.

We present work conducted as part of an EdN-focused project (funded by the Wellcome Trust and Education Endowment Foundation), in which we developed a trivia game-based environment for children to train IC skills through exercising "stop and think" behaviours on counterintuitive concepts in science and maths [16] . Our work examines the relationship between the delivery of diverse visual prompts, their interference with in-game cognitive tasks, and how such interference can be remedied adaptively to promote IC. As such, this work explicitly bridges EdN, HCI and AIED research.

"Stop & Think" (S&T ) is a trivia game-based learning environment that gives children, aged 7-10, structured opportunities to exercise IC on counterintuitive maths and science concepts [16] . The game has two modes: (1) TV-trivia show mode where a host character presents quiz questions, while three virtual contestants articulate the reasoning behind their answers through speech bubbles; (2) active engagement mode that trains IC by having pupils pause for a few seconds (henceforth-the S&T mechanic) before allowing them to answer each question, to encourage them to suppress intuitive thinking and adopt counterintuitive (but correct) concepts. A teacher-led version of this non-adaptive software was evaluated with 6672 children from 89 schools in England. Children played S&T as a whole class for 12 min., 3×/week, for 10 weeks, with a teacher acting as facilitator. The study revealed that training IC in this way improved counterintuitive reasoning and standardised exam scores [16] . We now investigate how the following HCI features might enhance S&T's IC training in a SRL scenario:

1. Mandatory interaction: indication of readiness. In line with the theory of planned behaviour [3] , an interaction mechanic where pupils must indicate their readiness to answer, may promote IC through metacognitive awareness. 2. Pre-attentive cues: motion and colour. Pre-attentive cues are processed by our visual systems prior to conscious attention to guide gaze [15] . Persistent motion may consistently grab attention [4, 15] . Colour has culturally relevant meanings [15, 17] that might guide attention, e.g. through the traffic light metaphor for "stop and go" types of activities [10] . 3. Game mechanics: reward systems. Tangible rewards relay performance information, which may promote IC and metacognitive competencies [8, 12] . Penalties create a sense of risk and contextualise the value of rewards [8, 11] , potentially assisting IC training by motivating pupils to stop and think longer to improve performance and earn greater rewards.

Four versions of S&T implement the above features ( Fig. 1) : Condition A (baseline) uses pulsating motion of a "Stop & Think" icon for four seconds during the S&T mechanic. The screen is 'locked' during this time, then the icon disappears and the screen becomes interactive. Condition B builds on A, adding mandatory interaction before the pupil can submit their answer. After the foursecond thinking time, the pulsating icon is replaced by a button that reads "I'm ready to answer!". Once pressed, the screen becomes interactive. Condition C also includes the mandatory interaction, but uses colour instead of motion to prompt IC behaviour. The common analogy of traffic lights is used on the S&T icon to represent (1) "Stop" (red) during question narration; (2) "Think" (amber) during the S&T mechanic (the "I'm ready" button pops beside the icon after four seconds); and (3) "Go" (green) when interaction is allowed (after the button is pressed). Condition D builds on C by integrating simple rewards (tokens for correct answers) and penalties (loss of bonus multiplier).

The efficacy of these four conditions at guiding IC was evaluated with children from two English primary schools. We used eye-tracking and click data to investigate which HCI design features encouraged the most consistent IC behaviour, then used these findings to suggest how the game might adapt to support IC. Procedure. Each pupil's participation lasted about 30 min, including an introduction, randomisation, eye-tracker calibration, 2-min video tutorial on how to play, and 12-min playtime. The eye-tracking station was set up on a laptop running Tobii Pro Studio with compact eye-tracker, in a quiet room.

Measures. Interaction (in-game performance, time spent stopping and thinking) and eye-tracking (fixation duration on areas of interest -AoI ) data were analysed using Kruskal-Wallis (KW ), Wilcoxon signed rank (W ), Bonferroniadjested Mann-Whitney U (U , for pair-wise comparisons), and Spearman correlations (rho). In Tobii Studio, recordings were parsed into four scenes for each task attempt, based on phases of interaction relevant to IC training: (1) Question narration, (2) Mandatory S&T time (first four seconds after narration), (3) Voluntary S&T time (after first four seconds, before "I'm ready" button is pressed), and (4) Activity (while they complete the task). AoI were set for (i) answer-objects (image/number options), (ii) question text box, and (iii) S&T icon. Fixation data were tallied for narration, mandatory, and voluntary S&T phases; as Condition A did not have a voluntary S&T phase, fixations were inevitably lower in this group, so they were excluded from fixation analyses.

In-game Performance. Groups achieved similar scores in maths (KW = 0.35, p = .951) and science (KW = 6.64, p = .084). Science scores were generally slightly higher than maths (W = 280.00, p = .081). 17/45 participants earned a score of zero on the maths portion of the game (simple addition of fractions), compared to only four pupils on the science (fish vs. mammals). 

To inform the design of adaptive support in the context of domain-specific IC training, this study explored how HCI design decisions impacted children's ingame IC behaviours along with their performance. We found that (1) long S&T times could either be indicative of IC behaviour (as seen in science tasks, in line with the literature [5, 16] ) or of confusion (as seen in maths); (2) mandatory interaction (i.e. "I'm ready" button) resulted in increased S&T time, supporting the hypothesis that integrating a mechanic that allows pupils to indicate their readiness to answer may encourage planning of interactions [3] ; (3) Symbolic colour and motion were both effective at promoting IC (B and C generated similar S&T times and fixations on answer objects); and (4) Rewards/penalties did not impact behaviours, perhaps because the scoring mechanic did not provide feedback on the IC behaviour itself. Feedback is crucial for meta-learning [2] , so future research should consider using more informative displays (like open learner models) to promote reflective thinking [6] . Our results also indicate three aspects of the game that might be adapted to support IC behaviours and aid children in transitioning to un-cued SRL scenarios: (i) mandatory S&T time, based on the player's average S&T time together with answer correctness as a measure to calibrate the optimal thinking time; (ii) difficulty of the content or level of support given to the pupil, but the system should differentiate between meaningful IC behaviour (as observed in science) and being 'lost' (maths); and (iii) visual cues (e.g. S&T icon), which might be scaffolded away once pupils display consistent IC behaviour. This work examined the links between delivery of the diverse visual prompts, their interference with in-game cognitive tasks, and how such interference can be remedied adaptively within a SRL game to promote IC, to explicitly bridge EdN, HCI, and AIED research.

Relations between inhibitory control and the development of academic skills in preschool and kindergarten: a meta-analysis

Gifts, ping-pong and loops? Linking feedback and learning

From intentions to actions: a theory of planned behavior

Moticons: detection, distraction and task

Inhibitory control and counterintuitive science and maths reasoning in adolescence

Reactions to inspectable learner models: seven year olds to university students

Interventions shown to aid executive function development in children 4 to 12 years old

What Video Games Have to Teach Us About Learning and Literacy

The potential for school-based interventions that target executive function to improve academic achievement: a review

Influence of school-based nutrition education program on healthy eating literacy and healthy food choice among primary school children

Fear of failing? The many meanings of difficulty in video games

Learning mechanics and game mechanics under the perspective of self-determination theory to foster motivation in digital game based learning

Magnitude comparison in preschoolers: what counts? Influence of perceptual variables

Overcoming intuitive interference in mathematics: insights from behavioral, brain imaging and intervention studies

Information Visualization: Perception for Design

Learning mechanics and game mechanics under the perspective of self-determination theory to foster motivation in digital game based learning

Points of view: color coding

Executive function: implications for education