key: cord-0964116-r6va0851 authors: Pörschmann, Christoph; Lübeck, Tim; Arend, Johannes M. title: Impact of face masks on voice radiationa) date: 2020-12-03 journal: J Acoust Soc Am DOI: 10.1121/10.0002853 sha: 3852188fc965b7d870739adad27bf258958720d5 doc_id: 964116 cord_uid: r6va0851 With the COVID-19 pandemic, the wearing of face masks covering mouth and nose has become ubiquitous all around the world. This study investigates the impact of typical face masks on voice radiation. To analyze the transmission loss caused by masks and the influence of masks on directivity, this study measured the full-spherical voice directivity of a dummy head with a mouth simulator covered with six masks of different types, i.e., medical masks, filtering facepiece respirator masks, and cloth face coverings. The results show a significant frequency-dependent transmission loss, which varies depending on the mask, especially above 2 kHz. Furthermore, the two facepiece respirator masks also significantly affect speech directivity, as determined by the directivity index (DI). Compared to the measurements without a mask, the DI deviates by up to 7 dB at frequencies above 3 kHz. For all other masks, the deviations are below 2 dB in all third-octave frequency bands. In times of crisis, such as the COVID-19 pandemic, security measures affect human face-to-face communication in many different ways. Speech intelligibility is impaired by greater physical distances between interlocutors, resulting in increased masking by background noise and a lower direct-to-reverberant ratio (DRR) at the listener position. In addition, face masks covering the mouth and nose cause transmission loss, reducing the energy radiated by the speaker. Depending on the frequency characteristics of the transmission loss, this can affect speech intelligibility (Palmiero et al., 2016; Radonovich et al., 2010) . As the transmission loss of the masks may also vary with respect to the direction of radiation, the DRR could be further affected if, for example, the masks attenuate frontal sound radiation more than lateral radiation. Furthermore, other effects (e.g., lip reading) also strongly affect speech intelligibility (Matthews et al., 2002; Sumby and Pollack, 1954; Summerfield, 1992) . So far, the acoustic effects of face masks have only been investigated in a small number of studies. Radonovich et al. (2010) and Palmiero et al. (2016) evaluated the influence of respirator masks worn by healthcare workers on speech intelligibility. In these studies, the influence of masks on the speech transmission index (STI) was determined for certain room settings. Recently, Goldin et al. (2020) analyzed three medical masks and found a low-pass characteristic attenuating frequencies above 2 kHz. To further investigate to what extent the acoustic effects of face masks affect voice radiation and consequently speech intelligibility, we present full-spherical voice directivity measurements of a dummy head with a mouth simulator covered with six masks of different types, i.e., medical masks, filtering facepiece respirator masks, and cloth face coverings. We analyze the transmission loss caused by the masks as well as their influence on directivity. Although it is already clear that the transmission loss caused by the masks can reduce speech intelligibility, it has not yet been investigated how face masks affect speech directivity and, therefore, possibly also speech intelligibility. Resonances of vibrating structures of the mask or cases where the mask is not completely closed at the sides may lead to reduced frontal sound radiation compared to the lateral or rear radiation, impairing speech directivity. Accordingly, when a speaker inside a room faces a listener, the reverberant energy caused by sound radiation in all directions is decreased less than the direct sound energy, resulting in a reduced DRR at the listener position and possibly reduced speech intelligibility. Furthermore, the influence on the directivity could become relevant if the interlocutors do not look at each other directly but turn their heads slightly and thus radiate speech laterally, as is often observed in conversations. The directivity measurements were done with a HEAD acoustics HMS II.3 dummy head and mouth simulator (head width 14.0 cm; head height 22.5 cm; head length 20.0 cm). However, as a mouth simulator cannot reflect phonemedependent effects, there are distinct differences between the a) This paper is part of a special issue on "COVID-19 PANDEMIC ACOUSTIC EFFECTS." b) Electronic mail: christoph.poerschmann@th-koeln.de, ORCID: 0000-0003-0794-0444. c) Also at: Technical University of Berlin, Audio Communication Group, Berlin, Germany. radiation of a dummy head and the human voice. For example, the mouth opening's variable size plays an important role (Brandner et al., 2020) , as well as sound radiation of the nasal passage and the position of the voice excitation in the vocal tract. These phoneme-dependent effects are one important aspect of the dynamic voice directivity which has been analyzed in several studies, e.g., in Kocon and Monson (2018) , Katz and D'Alessandro (2007) , Monson et al. (2012) , and P€ orschmann and Arend (2020). While simulations could probably examine some aspects of voice radiation such as the mouth opening's variable size, other aspects such as the physical contact between the mask and the vibrating lips are much harder to analyze. Despite these differences, a dummy head's radiation generally covers typical spatial characteristics of human voice radiation (Halkosaari et al., 2005) and therefore provides a good approximation. Accordingly, we assume that the influence of the masks on voice radiation is comparable for a dummy head and human voice radiation. The measurements were performed in the anechoic chamber of TH K€ oln, sized 4.5 m  11.7 m  2.30 m (W  DÂH), with a lower boundary frequency of about 200 Hz. As shown in Fig. 1 , the HEAD acoustics HMS II.3 dummy head and mouth simulator was mounted on the VariSphear measurement system (Bernsch€ utz et al., 2010) , which rotated the dummy head along a virtual sphere to the respective direction. In each direction, the excitation signal was played back over the mouth simulator and captured at a fixed position at a distance of 2 m from the center of the dummy head with a Microtech Gefell M296S omnidirectional microphone. The loudspeaker (mouth simulator) of the HEAD acoustics HMS II.3 was driven by an Apart MB-150 amplifier. An RME Babyface was used as AD/DA converter and microphone amplifier. The excitation signal was an emphasized sine sweep (2 18 samples at a sampling rate of 48 kHz, length of 5.5 s). Impulse responses were measured for 2702 directions on a 44th order Lebedev sampling grid (Lebedev, 1977) . In post-processing, adaptive low-frequency extension for frequencies below 200 Hz was applied to the impulse responses (Xie, 2009 ). Subsequently, the frequency and phase response of the loudspeaker (mouth simulator) was compensated by inverse finite impulse response (FIR) filtering with a frontal impulse response measured without a mask at azimuth / ¼ 0 and elevation h ¼ 0 , corresponding to a free-field equalization of the measurements. Finally, the impulse responses were truncated and windowed to a length of 128 samples at a sampling rate of 48 kHz. Except for the reference directivity measurement of the mouth simulator without a mask, the measurement procedure was repeated twice for each of the following face masks: ( Modeatelier Scharn, Engelskirchen, Germany). (6) Cloth face covering: Hand-made with two layers of cotton (manufacturer: Stoffliebe, Gelsenkirchen, Germany). According to the World Health Organization (2020), these masks (or more generally mouth and nose covers) can be categorized as medical masks (1), filtering facepiece respirator masks (2, 3), or cloth face coverings (4, 5, 6). Figure 2 shows the dummy head with the six tested masks. Every mask was measured twice. In between, it was taken off and put on again. We calculated the signed difference between both measurements in dB averaged over all directions for frequencies below 8 kHz to analyze any possible deviations. The deviations were only about 0.5 to 0.8 dB, so we did not further investigate the effects of putting on and taking off the mask and simply refer to the first measurements in the following. However, the publicly available dataset contains all measurements. 1 In the remainder, the directivity is denoted as pðX; xÞ with respect to the direction X (/, h) and the angular frequency x ¼ 2pf , where f is the temporal frequency. / denotes the azimuth angle ranging from À180 to þ180 , and h the elevation ranging from À90 to 90 , where 90 is at the top, and À90 at the bottom. The transmission loss TðX; xÞ between the reference directivity p ref ðX; xÞ without a mask, and the directivity p mask ðX; xÞ with a mask, can be expressed as Figure 3 (left) shows the results for frontal sound radiation X 0 ¼ (/ ¼ 0 ; h ¼ 0 ). Up to 2 kHz, the transmission loss is relatively low and flat for most masks but increases rapidly for masks 2 and 3 above 2 kHz with peaks of about 15 dB between 3 kHz and 5 kHz. Mask 6 shows a completely different frequency-dependent shape of the transmission loss. It exhibits a similar increase above 2 kHz, but already relevant transmission loss at low frequencies and a first strong peak at about 900 Hz. For further analysis, we calculated T avg ðxÞ by averaging the transmission loss over all radiation directions, Q, Figure 3 (right) shows the results for the average transmission loss. In general, a similar trend can be observed as for the frontal sound radiation. However, for the medical respirator masks (masks 2 and 3), the peaks vary slightly with the radiation direction, and the shape of the curves becomes smoother and has less prominent peaks due to the averaging over direction. In contrast, for the other masks, the differences between Fig. 3 , left and right, are much smaller, indicating that the peaks are rather independent of direction. Masks 1, 4, 5, and 6 show two peaks at about 900 Hz and 4 kHz, whereas for mask 4 the peaks are below 3 dB, and for masks 1 and 5, they are below 6 dB. Mask 6 exhibits peaks of more than 10 dB. Furthermore, for mask 6, the transmission loss is already above 3 dB at low frequencies. This may be due to the structure of this mask consisting of two layers of thick cloth. To analyze the directivity in the horizontal and vertical plane, the 2702 measured impulse responses were of mask 6 can some differences be observed, e.g., of 1 dB in the 630 Hz band at 60 in the vertical plane (Fig. 5) . Above 1.25 kHz, the differences rise in magnitude with increasing frequency. As with the transmission loss, the filtering facepiece respirator masks (masks 2 and 3) exhibit the most prominent differences to the reference. In the 3.15 kHz band, which covers the same frequency range for which we observed the maximum transmission loss for the two masks, significant directivity variations occur. Furthermore, the directivities of masks 2 and 3 vary strongly for adjacent frequency bands. For example, the directivity at 4 kHz is much broader for mask 3 than for the other masks, while it is directed stronger to the front at 5 kHz. Please refer to the Appendix for a further illustration of the influence of the masks on sound radiation in the horizontal and vertical plane with respect to frequency. For a more detailed analysis of the directivity, we determined the DI for spherical sound radiation, which can be calculated as Àp=2 jpðX; xÞj 2 cos hdhd/ ; (3) where X m denotes the main direction of sound radiation. Usually, the direction with maximum magnitude of radiation of the human mouth is inclined slightly downwards (Marshall and Meyer, 1985) , which can also be seen in Fig. 5 . However, we compensated the measurements for the frontal direction (X 0 ), and furthermore, the frontal direction is included in all directivity plots. Therefore, we decided to calculate the DIs related to the main direction X m ¼ X 0 . Table I summarizes the DIs for the third-octave bands between 630 Hz and 8 kHz. Apart from masks 2 and 3, the differences of the DI to the reference remain below 1 dB for frequencies up to 4 kHz and below 2 dB for frequencies up to 8 kHz. Again, the two facepiece respirator masks, masks 2 and 3, have the largest influence. In particular, between 3.15 and 6.3 kHz, the DI varies significantly. The differences are most prominent in the 4 kHz band, exceeding 4 dB (mask 2) and 7 dB (mask 3). This is supported by Fig. 6 , which shows the DI with respect to frequency. In the frequency range from 3 to 5 kHz, the DI is significantly decreased by masks 2 and 3. At about 5 kHz the DI of mask 3 sharply rises towards high frequencies and is about 5 dB higher than the DI of all other measured datasets. The deviations of the DIs for the two facepiece respirator masks (masks 2 and 3) match the observations from Sec. III B, where we found the largest directivity variations for the same masks at the same frequencies (Figs. 4 and 5) , and also the findings from Sec. III A, where we found the most considerable transmission loss for the corresponding masks in similar frequency regions. This paper presented measurements and analyses of sound radiation from a dummy head and mouth simulator wearing various face masks, i.e., medical masks, filtering facepiece respirator masks, and cloth face coverings. As discussed in Sec. II, a dummy head reproduces the typical spatial structure of human voice radiation, even though several aspects of human voice radiation like, e.g., the dynamic directivity, cannot be considered. All examined masks result in a noticeable transmission loss at frequencies above 2 kHz. Thus, the transmission loss of the masks affects relevant frequency components of speech transmission, and therefore certainly impairs speech intelligibility. While in the frontal direction for the facepiece respirator masks (masks 2 and 3) the transmission loss increases strongly above 3 kHz by up to 15 dB, for the medical mask and most of the cloth face coverings, the transmission loss remains below 6 dB for frequencies above 3 kHz. An exception is a hand-made cloth face covering (mask 6), which consists of two thick layers of cotton, showing a much higher transmission loss already at low frequencies. Our results are in line with the results of Goldin et al. (2020) . The study analyzed three different masks and determined an attenuation from 4 to 6 dB for a simple medical mask and an attenuation of 12 dB up to 18 dB for the higher protective N95 masks in the frequency range between 3 and 7 kHz. The analysis of the directivity showed that the masks affect speech directivity differently. Both tested facepiece respirator masks lead to an increase of the DI by up to 7 dB between 3 and 5 kHz, and one of them to an increased DI for 5 dB above 5 kHz. The other masks show only a weak influence on the directivity, affecting the DI by a maximum of 1 dB for frequencies up to 4 kHz and 2 dB for frequencies up to 8 kHz. The DI can be directly related to the DRR, for which Larsen et al. (2008) determined just-noticeable differences (JNDs) of about 2-3 dB in rooms with a DRR of 0 or þ10 dB and JNDs of about 6-8 dB in rooms with a DRR of À10 or þ20 dB. For some frequency bands, the change of the DI caused by the facepiece respirator masks is in the range of the JND. Therefore, the facepiece respirator masks might impair speech intelligibility in rooms. However, as the DRR is a broadband measure, it is hard to predict how a decrease of the DI in specific frequency bands affects speech intelligibility. It can be assumed that especially phonemes incorporating significant energy in the affected frequency range might show degraded intelligibility. The datasets from this study can be applied in follow-up studies similar to Figures 7 and 8 show the transmission loss with respect to frequency in the horizontal and vertical plane for a frequency range of 400 Hz to 10 kHz. The figures illustrate the directional dependency of the transmission loss and support the observations from Secs. III A and III C. In particular, masks 2, 3, and 6 exhibit notable transmission loss, as indicated by the deep blue color. The datasets will be Entwurf und Aufbau eines variablen sph€ arischen Mikrofonarrays f€ ur Forschungsanwendungen in Raumakustik und Virtual Audio A pilot study on the influence of mouth configuration and torso on singing voice directivity The effect of simulated room acoustic parameters on the intelligibility and perceived reverberation of monosyllabic words and sentences Color online) Transmission loss TðxÞ in the vertical plane with respect to frequencies from 400 Hz to 10 kHz How do medical masks degrade speech perception Directivity of artificial and human speech Directivity measurements of the singing voice Horizontal directivity patterns differ between vowels extracted from running speech Prediction of speech intelligibility using pseudo-binaural room impulse responses On the minimum audible difference in direct-to-reverberant energy ratio Spherical quadrature formulas exact to orders 25-29 The directivity and auditory impressions of singers Extraction of visual features for lipreading Horizontal directivity of low-and high-frequency energy in speech and singing Speech intelligibility assessment of protective facemasks and airpurifying respirators Analyzing the directivity patterns of human speakers Diminished speech intelligibility associated with certain types of respirators worn by healthcare workers Visual contribution to speech intelligibility in noise Lipreading and audio-visual speech perception Fourier Acoustics-Sound Radiation and Nearfield Acoustical Holography Advice on the use of masks in the context of COVID-19: Interim guidance On the low frequency characteristics of head-related transfer function