key: cord-1026434-ijep4cgx
authors: Ruba, Ashley L.; Pollak, Seth D.
title: Children’s emotion inferences from masked faces: Implications for social interactions during COVID-19
date: 2020-12-23
journal: PLoS One
DOI: 10.1371/journal.pone.0243708
sha: 2dda47c49daf9df13479e804c1ff25bc1ba71f26
doc_id: 1026434
cord_uid: ijep4cgx

To slow the progression of COVID-19, the Centers for Disease Control (CDC) and the World Health Organization (WHO) have recommended wearing face coverings. However, very little is known about how occluding parts of the face might impact the emotion inferences that children make during social interactions. The current study recruited a racially diverse sample of school-aged (7- to 13-years) children from publicly funded after-school programs. Children made inferences from facial configurations that were not covered, wearing sunglasses to occlude the eyes, or wearing surgical masks to occlude the mouth. Children were still able to make accurate inferences about emotions, even when parts of the faces were covered. These data suggest that while there may be some challenges for children incurred by others wearing masks, in combination with other contextual cues, masks are unlikely to dramatically impair children’s social interactions in their everyday lives.

COVID-19 is one of the worst pandemics in modern history. To slow the spread of the virus, both the Centers for Disease Control and the World Health Organization have recommended wearing face coverings in public spaces. This recommendation has led to speculation and concern about the ramifications of mask wearing on emotion communication [1, 2] . Of particular concern for parents and teachers is how wearing masks might impact children's social interactions [3, 4] . While much research has documented how children infer emotions from facial configurations and how this ability predicts children's social and academic competence [5] [6] [7] , uncertain is how children make these inferences when part of the face is occluded by a mask. The current study explores how children draw emotional inferences from faces partially occluded by surgical masks and, as a comparison, sunglasses.

Paper and cloth "surgical" masks cover the lower half of the face, allowing the eyes, eyebrows, and forehead to remain visible. When asked to infer emotions from stereotypical facial configurations, adults tend to look at the eyes first and more frequently than other facial features (e.g., mouth, nose) [8] [9] [10] , although scan patterns vary across cultures [11, 12] . Adults

PLOS ONE | https://doi.org/10.1371/journal.pone.0243708 December 23, 2020 1 / 12 a1111111111 a1111111111 a1111111111 a1111111111 a1111111111 also show above-chance accuracy at inferring emotions from stereotypical facial configurations when only the eyes are visible [13] [14] [15] . (Note: Across most studies, "accuracy" refers to whether participants select the label/emotion typically associated with a particular facial configuration, such as "anger" for a face with furrowed brows and a tight mouth). Humans are particularly sensitive to eyes [16] , and thus, eye musculature may convey sufficient information for adults to make reasonably accurate emotional inferences, even when masks cover the mouth and nose. Nevertheless, focusing on the eyes alone may be insufficient for some emotion inferences [11, 17] . When facial configurations are ambiguous or subtle, adults (and children) shift their attention between the eyes and other facial features that may provide additional diagnostic information [18] . For instance, to make inferences about whether wide eyes indicate "fear" or "surprise," adults attend to both the eyes and the mouth [19, 20] . Adults also tend to fixate on specific facial features that characterize specific emotion stereotypes, such as the mouth for happiness and the nose for disgust [8] [9] [10] 21] . Inferring emotions from these characteristic facial features (e.g., labeling a smile as "happy") is also influenced by other parts of the face [10, [22] [23] [24] . In short, adults scan facial configurations in a holistic manner [19, 25] , allowing for information to be gleaned from the mouth, nose, and other parts of the face, which are not accessible when wearing a mask.

While this research suggests how adults infer emotions when parts of the face are obscured, much less is known about how this process emerges in early childhood [7] . In the first year of life, infants shift from configural to holistic processing of faces [26, 27] and demonstrate heightened attention to eyes associated with positive affective states [28] [29] [30] . By 3-years of age, children show above-chance accuracy at inferring emotions from the eyes alone [31] . However, compared to when other parts of the face are also visible, 5-to 10-year-olds are less accurate at inferring emotions from the eyes only [32] [33] [34] [35] , although results for specific emotions have been inconsistent across studies [32, 33] . One study even found that 3-to 4-year-olds were more accurate at inferring happiness, sadness, and surprise from faces when the eyes were covered by sunglasses [35] . With respect to emotion inferences with masks, only one study has obscured the mouth (with a dark circle). Roberson et al. (2012) found that 9-to 10-year-old children and adults showed more accurate emotion inferences for uncovered faces than when the mouth was covered. However, 3-to 8-year-olds did not show these impairments. Similarly, when facial configurations are presented within a background emotion context, 12-year-olds show heightened visual attention to faces compared to 4-and 8-year-olds [18] . Thus, there may be developmental differences in children's reliance on and use of specific facial features to make emotional inferences and the impact of mask wearing on these inferences.

The current study examines how 7-to 13-year-old children draw emotional inferences from facial configurations that are partially occluded. This age range was selected because there is a shift during this time in children's use of eye information to infer others' emotions [33, 35] . Facial configurations associated with different negative emotions (i.e., sadness, anger, fear) were presented via a Random Image Structure Evolution (RISE) paradigm [36] . Facial configurations were initially presented in a highly degraded format in which children only had access to partial facial information. In a dynamic sequence, the images became less degraded at regular intervals. After each interval, children selected from an array of emotion labels to indicate their belief about how the person displaying the facial configuration was feeling. Thus, this paradigm allows for the assessment of children's emotion inferences from incomplete through more complete facial information. This approach is more similar to daily experiences with the unfolding of others' emotions compared to a single presentation of a facial configuration at full intensity [37] .

We examined how children perceived others' emotions as partial information about the face was presented, to evaluate whether masks meaningfully changed the types of inferences children made. We included sunglasses as a comparison for other types of coverings that children regularly encounter on faces in their daily lives. Together, these results shed light on how mask wearing during COVID-19 might-or might not-influence children's inferences about others' emotions and their related social interactions.

Procedures were approved by the University of Wisconsin-Madison Institutional Review Board. To test a racially diverse sample of children, participants were recruited from publicly funded after-school programs associated with the Dane County (Wisconsin) Department of Human Services. The final sample included 81 7-to 13-year-old children (37 female, M = 9.86 years, SD = 1.84 years, range = 7.06-12.98 years). Parents identified their children as Black (53%, n = 43), White (41%, n = 33), and Multi-racial (6%, n = 5). Three additional children participated in the study but were excluded from final analyses due to missing or corrupt data files. A power analysis confirmed that this sample size would be sufficient to detect reliable differences in a within-subjects design, assuming a medium effect size (f = .25) at the .05 level [36] .

Stimuli, selected from the Matsumoto and Ekman (1988) database, were pictures of stereotypical facial configurations associated with sadness, anger, and fear posed by male and female models. These three emotions were selected given that adults tend to fixate predominantly on the eyes for these facial configurations, rather than other parts of the face (e.g., the mouth and nose, as with happiness and disgust) [8, 20] . Further, negative emotions are complex and rich in informational value [38] ; yet, these emotions have received limited empirical attention in the literature on emotion perception development [39] [40] [41] . Pictures were presented in unaltered format (i.e., with no covering) or digitally altered to be (a) covered with a surgical face mask that obscured the mouth and nose, or (b) covered with sunglasses that obscured the eyes and eyebrows (see Fig 1) . Pictures of each emotion (sad, anger, fear) paired with each covering type (none, mask, shades) were presented twice in a random order (i.e., 18 stimuli total). Half of the presentations were on male faces and half were on female faces.

Parents provided written consent and children provided verbal assent prior to participation. Children were tested in a modified Random Image Structure Evolution (RISE) paradigm [36] . RISE performs pairwise exchanges of pixels in an image until the target image dissolves into an unstructured random field. These exchanges are presented in reverse order such that participants begin viewing a random visual display that gradually transforms into a fully formed, clear image (see Fig 2) . Importantly, the RISE protocol holds the low-level perceptual attributes of the original image (e.g., luminance, color) constant.

Children viewed these image sequences on a high-resolution touch-sensitive color monitor. Faces were initially presented in a highly degraded format. At 14 regular 3.3-s intervals, the images became less degraded and easier to discern. After each interval, children were prompted to identify the emotion depicted on the face by selecting one of the following emotion labels: "happy," "sad," "angry," "surprised," "afraid," or "disgusted." Labels were presented in this order on the screen, and children touched a label to indicate their response. A total of 252 responses were collected for each child (i.e., 14 trials each of 18 stimuli). Responses were coded as "accurate" if the child selected the label/emotion typically associated with a particular facial configuration (i.e., "anger" for a face with furrowed brows).

All analyses were conducted in R [42] , and figures were produced using the package ggplot2 [43] . Alpha was set at p < .05. The raw data and analysis code are available on OSF: doi.org/10. 17605/OSF.IO/7FYX9. Children's accuracy scores were analyzed in a 3 (Emotion: sad / anger / fear) x 3 (Covering: none / mask / shades) x 14 (Trial: 1 to 14) repeated-measures ANCOVA with child Gender as a between-subjects factor and child Age as a covariate. All significant main effects and interactions are explored below. Fig 3) . Unsurprisingly, children became more accurate with each emotion as the images became less obscured. In earlier trials, there were few differences between the stimuli. In later trials, children were more accurate with facial configurations associated with sadness compared to anger and fear, and children were more accurate with facial configurations associated with anger compared to fear.

The primary question addressed by this study is whether masks meaningfully degraded children's ability to infer others' emotions. Fig 3) . Yet, the overall effect of face coverings on accuracy was relatively small, especially as children gained more visual information.

To explore the Emotion x Covering interaction, F(4, 284) = 3.58, p = .009, η p 2 = .04, paired ttests were conducted between each covering type, separated by emotion (Fig 4) . Further, to examine if children's performance was greater than chance (m = 1/6) for each emotion-covering pair, additional one-sample t-tests were conducted. Bonferroni-holm corrections were applied for multiple comparisons (reported p-values are corrected). Thus, across all emotions, children were less accurate with faces that wore a mask compared to faces that were not covered. However, children were only less accurate with faces that wore sunglasses compared to uncovered for two emotions: anger and fear. This suggests that children inferred whether the face displayed sadness from mouth shape alone, whereas the information from the eye region was necessary for forming inferences about anger and fear (see below). Ultimately, accuracy differences between the masks and shades did not significantly differ for any emotion. Thus, while both types of coverings negatively impacted children's emotion inferences, the strongest impairments were observed for facial configurations associated with fear.

What inferences did children make for each stimulus?. To further investigate why children did not reach above-chance responding for the anger-shades, fear-mask, and fear-shades stimuli, we examined children's responses to each stimulus. As seen in Fig 5, children tended to interpret facial configurations associated with fear as "surprised." This effect was particularly pronounced when the faces were covered by a mask. Children also tended to interpret facial configurations associated with anger as "sad" when the faces were covered by shades. In contrast, children interpreted facial configurations associated with sadness as "sad," regardless of covering.

The main effect of Age, F(1, 78) = 5.85, p = .018, η p 2 = .07, showed that accuracy improved as child age increased. The Age x Trial, F(6, 474) = 2.40, p = .027, η p 2 = .03, interaction was explored with a simple slopes analysis. This analysis revealed that older children showed enhanced performance over the course of the experiment compared to younger children (Fig 6) .

Although there was not a significant main effect of Gender 

These results highlight how children's social interactions may be minimally impacted by mask wearing during the COVID-19 pandemic. Positive social interactions are predicated on the 

ability to accurately infer and respond to others' emotions. In the current study, children's emotion inferences about faces that wore masks compared to when faces were not covered were still above chance. Masks seem to have the greatest effect on children's inferences about facial configurations associated with "fear," which were commonly identified as "surprised" when the mouth and nose were covered. Thus, although children may require more visual facial information to infer emotions with masks, children may reasonably infer whether someone wearing a mask is sad or angry, based on the eye region alone. In addition, children's accuracy with masked facial configurations did not significantly differ from their accuracy with facial configurations that wore sunglasses-a common accessory that children encounter in their everyday lives. Thus, it appears that masks do not negatively impact children's emotional inferences to a greater degree than sunglasses. In sum, children's ability to infer and respond to another person's emotion, and their resulting social interactions, may not be dramatically impaired by mask wearing during the COVID-19 pandemic. Furthermore, in everyday life, it is unlikely that children draw emotional inferences from facial configurations alone. For instance, the same facial configuration may be inferred as either "anger" or "disgust" depending on background context, body posture, and facial coloration [18, 44, 45] . In addition, dynamic facial configurations and faces that are vocalizing are scanned differently than silent, static pictures of faces [46] [47] [48] . Ultimately, facial configurations displayed in everyday life are more dependent on context, less consistent, and less specific than pictures of stereotyped emotions commonly used in laboratory tasks [37] . The current paradigm improves upon these standard laboratory tasks by assessing children's emotion inferences from incomplete facial information. However, the key to children's emotional inferences is the ability to learn about and navigate the tremendous variability inherent in human emotion [7, 49] . In everyday life, children may be able to use additional contextual cues to make reasonably accurate inferences about others' variable emotional cues, even if others are wearing masks.

Future research should take these considerations into account when designing and interpreting findings on mask wearing during the COVID-19 pandemic. While the current study assessed whether children made "accurate" emotion inferences, a single facial configuration can be interpreted in many ways that are "accurate" given a particular context [37] . Researchers could explore how children make emotion inferences from a wider variety of non-stereotyped emotional cues that are presented in context. Although we did not find many age effects in the current study, future research could also explore how younger children's social interactions are impacted by mask wearing, particularly infants who are actively learning about others' emotions [50] . To conclude, while there may be some loss of emotional information due to mask wearing, children can still infer emotions from faces, and likely use many other cues to make these inferences. This suggests that children, and adults, may be able to adapt to the new reality of mask wearing to have successful interactions during this unprecedented health crisis.

Conceptualization: Seth D. Pollak. 

Masks Keep Us Safe. They Also Hide Our Smiles

How face masks affect our communication

British Broadcasting Corporation (BBC) News. 2020

Are you happy or sad? How wearing face masks can impact children's ability to read emotions

Do Masks Impede Children's Development?

How Preschoolers' Social-Emotional Learning Predicts Their Early School Success: Developing Theory-Promoting, Competency-Based Assessments. Infant Child Dev

Emotion knowledge as a predictor of social behavior and academic competence in children at risk

The development of emotion reasoning in infancy and early childhood

Happy mouth and sad eyes: Scanning emotional facial expressions. Emotion

Diagnostic Features of Emotional Expressions Are Processed Preferentially

Transmission of facial expressions of emotion co-evolved with their efficient decoding in the brain: Behavioral and brain evidence

Cultural Confusions Show that Facial Expressions Are Not Universal

Culture modulates face scanning during dyadic social interactions

Islamic headdress influences how emotion is recognized from the eyes

Recognition of facial expressions is moderated by Islamic cues

Veiled emotions: The effect of covered faces on emotion perception and attitudes

The eyes as windows Into other minds: An integrative perspective

Mapping the emotional face. How individual face parts contribute to successful emotion recognition

Developmental changes in the primacy of facial cues for emotion recognition

Factors contributing to individual differences in facial expression categorisation

Transmitting and decoding facial expressions

Oxytocin Attenuates Neural Reactivity to Masked Threat Cues from the Eyes

Dynamic facial expressions of emotion transmit an evolving hierarchy of signals over time

Is there more in a happy face than just a big smile? Vis cogn

Can the eyes reveal a person's emotions? Biasing role of the mouth expression

Emotion recognition: The role of featural and configural face information

Do 7-month-old infants process independent features or facial configurations?

Evidence of a shift from featural to configural face processing in infancy

Pupillary responses reveal infants' discrimination of facial emotions independent of conscious perception

Unconscious discrimination of social cues from eye whites in infants

Genetic variation in CD38 and breastfeeding experience interact to impact infants' attention to social eye cues

Can children with autism read emotions from the eyes? The Eyes Test revisited

Children's ability to recognize emotions from partial and complete facial expressions

Facial expressions and ability to recognize emotions from eyes or mouth in children

Feeling happy versus feeling good: The Processing of discrete and global categories of emotional expressions by children and adults

Shades of emotion: What the addition of sunglasses or masks to faces reveals about the development of facial expression processing

Effects of early experience on children's recognition of facial displays of emotion

Emotional expressions reconsidered: Challenges to inferring emotion from human facial movements

Not all emotions are created equal: The negativity bias in socialemotional development

Do preverbal infants understand discrete facial expressions of emotion?

How do you feel? Preverbal infants match negative emotions to events

The development of negative event-emotion matching in infancy: Implications for theories in affective science

R: A language and environment for statistical computing

Austria: R Foundation for Statistical Computing

ggplot2: elegent graphics for data analysis

Angry, disgusted, or afraid? Studies on the malleability of emotion perception

Face color facilitates the disambiguation of confusing emotion expressions: Toward a social functional account of face color in emotion communication. Emotion

Supplemental Material for Eye Fixation Patterns for Categorizing Static and Dynamic Facial Expressions

Emotion in the voice influences the way we scan emotional faces. Speech Commun

Selective attention to the mouth of talking faces in monolinguals and bilinguals aged 5 months to 5 years

Probabilistic learning of emotion categories

Beyond language in infant emotion concept development