key: cord-0746443-o4ve0odv authors: Andreyeva, Tatiana; Sun, Xiaohan title: Universal School Meals in the US: What Can We Learn from the Community Eligibility Provision? date: 2021-07-30 journal: Nutrients DOI: 10.3390/nu13082634 sha: 48fa3680a7d7e5d24ff9555c45e071f4de97be80 doc_id: 746443 cord_uid: o4ve0odv Changes in school meal programs can affect well-being of millions of American children. Since 2014, high-poverty schools and districts nationwide had an option to provide universal free meals (UFM) through the Community Eligibility Provision (CEP). The COVID-19 pandemic expanded UFM to all schools in 2020–2022. Using nationally representative data from the Early Childhood Longitudinal Study: Kindergarten Class of 2010–2011, we measured CEP effects on school meal participation, attendance, academic achievement, children’s body weight, and household food security. To provide plausibly causal estimates, we leveraged the exogenous variation in the timing of CEP implementation across states and estimated a difference-in-difference model with child random effects, school and year fixed effects. On average, CEP participation increased the probability of children’s eating free school lunch by 9.3% and daily school attendance by 0.24 percentage points (p < 0.01). We find no evidence that, overall, CEP affected body weight, test scores and household food security among elementary schoolchildren. However, CEP benefited children in low-income families by decreasing the probability of being overweight by 3.1% (p < 0.05) and improving reading scores of Hispanic children by 0.055 standard deviations. UFM expansion can particularly benefit at-risk children and help improve equity in educational and health outcomes. On a typical school day, almost 30 million students eat lunch served through the National School Lunch Program (NSLP) and 14.8 million students have breakfast via the School Breakfast Program [1] . Most of these meals-85% for breakfast, 74% for lunch [1] are served free or at reduced prices, targeting children at greater risk for food insecurity and poor diet. All school meals must meet USDA nutrition standards [2] that ensure all children's access to nutritious foods. Participation in the NSLP has been linked to improvements in children's dietary intake and health, with most significant gains observed among nutritionally-disadvantaged low-income children [3] [4] [5] . As school meals are almost universal (99% of US public schools and 83% of private schools participate in NSLP [6] ), any changes in school nutrition have potential to affect the diets of millions of American children. Increasing evidence suggests that the quality of diet can impact academic achievement, school attendance, long-life income, and health [7, 8] , so changes in school nutrition have implications far beyond dietary outcomes. In 2010, the Healthy, Hunger-Free Kids Act (HHFKA) initiated a number of changes in the school meal programs, including the establishment of the Community Eligibility Provision (CEP) that was intended to increase school meal participation and improve food security among children in high-poverty communities. Despite widespread access to the NSLP, many eligible low-income students (from 16% in elementary schools to 36% in high schools) did not participate due to common stigmatization, access to competitive foods and other barriers [9, 10] . CEP allowed the provision of universal free meals (UFM) in highpoverty schools if ≥40 percent of students in the prior year could be directly certified for of Education [30] . The sample had children from 41 states for the period of 2011-2016, including 9 CEP pilot states (FL, GA, IL, MA, MD, MI, NY, OH and WV). Data on school-level CEP eligibility and participation in all states in SY 2014-2015 and SY 2015-2016 were obtained from the Food Research and Action Center (FRAC) and the Center on Budget and Policy Priorities (CBPP) [31, 32] . To define CEP eligibility and participation for pilot states during SY 2011-2014, we collected administrative data from State Departments of Education and another researcher studying CEP [19] . As the ECLS-K:2011 did not include school names and did not collect data on CEP, additional steps were necessary to enable a link between the ECLS-K:2011 with administrative data on school CEP eligibility and participation. School names were collected from external data sources, including the Common Core of Data (CCD) for public schools and the Private School Universe Survey (PSS) for private schools [33, 34] . The ECLS-K:2011 included CCD and PSS identifiers, which were used to locate each school by name and location to enable a merge with administrative data on CEP. The merge used a fuzzy matching function in STATA based on school, school district, and state names. All matching results were manually checked. The study population was elementary schoolchildren (K through 5th grade) that attended kindergarten in 2010-2011. As CEP eligible schools and/or school districts were not required to participate in CEP, participation decisions were choices that could be correlated with unobservable factors also affecting school and child-level outcomes. Reverse causality is another threat in that a school/district's performance on certain outcomes could affect its decision to participate in CEP. To demonstrate the point on potential selection bias into CEP, Table 1 demonstrates significant differences in the observable mean characteristics of schools that chose to participate in CEP and non-participating schools, including those that were eligible but selected not to participate. To account for potential selection bias and consistent with previous economic research [18, 19] , the analytic sample in this study was limited to children attending schools that participated in CEP at any point in our data in 2011-2016, excluding children in CEP ineligible (i.e., higher income) schools/districts and CEP eligible schools/districts that did not participate in CEP within two years of its nationwide implementation. The study included multiple outcomes of the CEP effects, including school meal participation, school attendance, academic achievement, child's body weight, and household food security. School meal participation was assessed based on two measures: (1) school administrators' reported percentage of children eligible for free or reduced-price lunchreferred below as free school meals, and (2) parental reports of their child's receiving free school lunch. Attendance was reported by school administrators as a percent of enrolled children attending school on an average day. Academic achievement included assessments of a student's proficiency in reading, math and science that were measured by direct child cognitive assessment scale scores using the Item Response Theory (IRT) procedures. The test performance metrics were transformed into z-scores normalized using grade-by-year means and variances of each subject. The child's height and weight, which were measured by the ECLS-K:2011 study's personnel, were used to construct age-and gender-specific BMI percentiles and z-scores. Indicators for child overweight (BMI percentile: 85.0-94.99) and overweight/obesity (BMI percentile: 85.0 and above) were used to assess children's BMI status. Finally, household food security was assessed based on parental responses to the 10-item version of the USDA's adult food security measure. Three binary outcomes were created, including an indicator of a food secure household (<3 affirmative responses to 10 food security items), one for low food security (3-5 affirmative responses), and one for very low food security (≥6 affirmative responses). Adult food security was used as a measure of household food security given few reports of food disruptions among children and a very small sample size for child food security. The main independent variable was an indicator for whether a child attended a CEPparticipating school during the academic year. Socio-demographic controls at the child and household-level included the child's gender, race/ethnicity, household income below the 200% federal poverty level, primary language at home other than English, and mother's education. Child's birth weight was used as a covariate in BMI models only. At the school level, percentage of poverty in a school district and the duration of CEP participation were added as covariates. The identification strategy was based on the variation in the timing of state CEP eligibility, which was set independently of school districts by the US Department of Agriculture [12] . The different timing of CEP adoption allowed the use of a difference-in-difference model to identify causality. Assuming random nature of the USDA's selection of pilot states and that early implementation upon eligibility had no more benefits than later im-plementation, the difference-in-difference model can measure the causal effect of CEP by comparing early to late CEP-adopting schools. The model was specified as: where Y jt is the outcome for child j in year t, CEP jt is a dichotomous measure of whether a child's school participated in CEP in year t, X jt is a vector of child, family, and schoollevel covariates for child j in year t, µ s is a school fixed effect for time-invariant school characteristics, γ t is a year fixed effect, π j represents a child random effect to control for time-invariant heterogeneity at the child level, and ε jt is the error term. β 1 captures a causal estimate of the CEP effects under the assumption that the CEP adoption time is exogenous. This means that both the school's adoption time and the adoption time within students was random. A Hausman test was conducted to test the validity of the child random-effects model by comparing the child random-effects and fixed-effects models, with results favoring the random-effects model. Robust standard errors were clustered at the child level. All models were estimated using a linear probability model based on the distribution of residuals that were almost equally and randomly distributed centering around zero for all outcomes. As CEP launched as a pilot in three states in school year (SY) 2011-2012, CEP jt was set to 0 for all children in school year 2010-2011 (kindergarten). The duration of the pre-and post-CEP period varied depending on the child's state and the timing of CEP adoption. Children residing in pilot states that implemented CEP earlier than the rest of the country had a longer exposure to CEP, beginning in the 1st to 5th grade. Children residing in the states that adopted CEP in SY 2014-2015 had up to two years of the program exposure, in 4th and 5th grades only. We also tested the difference between CEP early adopters (adoption before 2014-2015) and late adopters (2015-2016). The key assumption of the difference-in-difference model is the parallel trends, which implies that the trends of change in the control group would be the same as the trends of change in the treatment group in the absence of the policy [35] . For example, if outcomes in the treatment group were improving faster than in the control group before the policy change, the difference-in-difference model would overestimate the policy effect. This study tested the parallel trends assumption using an event study framework to account for the variation in the timing of the policy change (i.e., CEP eligibility), which is consistent with prior economic research on CEP [18, 19] . Specifically, the model in equation (1) was re-estimated by including a set of indicators to capture the years before and after the CEP introduction. The leads and lags of the CEP indicators included one year, two years and three or more years prior to the CEP adoption, and similar periods following the policy change. The results in Supplementary Materials Figures S1-S3 for the full sample show that the coefficients in the years prior to the CEP adoption were not statistically different from zero, supporting the parallel trends assumption. We conducted a variety of tests to check robustness of our results. One sensitivity analysis tested the hypothesis that children could switch schools to get access to UFM, which would have violated our model's assumption that the adoption time within students was exogenous and unrelated to unobserved characteristics of the children. To test this hypothesis, we limited the sample to students whose change in the CEP status was due to their school's change rather than students switching schools. Specifically, 42% of children in our analytic sample changed their CEP participation status by changing schools-due to moving, a school switch, or the school district design of separate K-2 and 3-5 schools. At the same time, 58% students had the change because their school implemented CEP. Additional sensitivity analyses included estimation of generalized linear models, alternative outcomes (e.g., BMI percentile instead of BMI z-score), estimating a Beta regression for attendance outcomes, using two datapoints DID model by grade, comparing regression with or without panel weights, and school covariates instead of school fixed effects (which did not pass the Hausman test). We further tested sensitivity of our results by re-estimating model (1) using child fixed effects instead of child random effects. Results for the child fixed effects models were similar with the main results presented. Additional sensitivity analysis included the exclusion of children with extreme values on BMI z-scores. To assess heterogeneity in the effects of CEP participation across children, the study included several subgroup analyses: i.e., by household income, child's race/ethnicity, prior receipt of free/reduced price school meals, and language at home other than English. The analytic sample of children in CEP-participating schools included around 2500 children (all sample size numbers were rounded to the nearest 50 per the ECLS-K:2011 disclosure requirements). Table 2 presents descriptive statistics for the study outcomes and covariates for children attending elementary schools that participated in CEP at any point during 2011-2016 (our analytic sample) and children from schools not on CEP during this period. Results show significant disparities in the characteristics of children based on their school CEP participation status, including higher rates of economically-disadvantaged children, racial/ethnic minorities, children speaking non-English at home, and children attending high-poverty, urban schools in the CEP group. Further, children in elementary schools that adopted CEP by 2015-2016 were more likely to have lower academic achievement, participate in school meal programs, and have higher rates of obesity and household food insecurity than their peers in non-participating schools. These large differences highlight the importance of restricting the analytic sample in this CEP study to children in CEP schools only. Reading proficiency z-score Table 3 . The full sample results are shown in Column 1, suggesting a statistically significant increase in school meal participation and receipt of free school lunch, as well as improved school attendance, but no measurable changes in other outcomes. Specifically, CEP increased access to free school lunch by 2.4 percentage points (p < 0.01). Based on parental reports, CEP increased the probability of children getting free school lunch by 9.3% (p < 0.01). Furthermore, CEP also improved school attendance by increasing the percent of students attending daily by 0.24 percentage points (p < 0.01). Models for academic achievement outcomes did not pass the parallel trend assumption and are therefore not reported, but no significant results were identified in the full analytic sample. CEP was found to have no effect on body weight outcomes and household food security among elementary schoolchildren in 2011-2016. Sub-group analyses revealed important heterogeneity in the CEP effects across children of diverse backgrounds, with several results indicating a larger and more significant effect on children from less-advantaged families. For example, children from low-income families (Column 2) that could be affected by UFM if not previously participating in the free school meal programs, had a reduction in the probability of being overweight by 3.1% (p < 0.05). This result was in addition to improved school meal participation and school attendance also seen in the full sample, with estimated effects of the equivalent magnitude. The sub-sample of Hispanic children (Column 3) showed a marginally significant CEP-attributable increase in reading scores, on average by 0.055 standard deviations (p < 0.1). Math and science scores, however, were not affected, while all models of academic achievement for Hispanic children passed the parallel trend test. Furthermore, among children not receiving free/reduced price lunch before CEP, we saw a particularly large increase in the probability of a child's receiving free school meals, by 40.7% (p < 0.01), but other outcomes were not significant. Finally, the only significant result for children whose primary language at home was not English was increased school attendance, by 0.436 percentage points (p < 0.05). For all sub-groups, there was no evidence that CEP affected household food security in a significant way. Our sensitivity analyses showed results that were consistent with the results of the full sample or the main specification model. According to the regulations for restricted-use data produced by the Institute of Education Sciences Data Security Office, all sample sizes are rounded to the nearest 50. *** p < 0.01; ** p < 0.05; * p < 0.1. Statistically significant coefficients are bolded. All regressions include child random effects, school fixed effects, year fixed effects, and child-, and family-level covariates (child's gender, race/ethnicity, household income below the 200% federal poverty level, primary language at home other than English, mother's education, school-level time varying covariates (school district % of poverty, duration of CEP participation). BMI-based models also include child's birth weight. N reports child-year observations. This study finds that the adoption of CEP and UFM in the early years of the program's life has increased school meal participation and students' receipt of free school meals, improved school attendance, and had additional academic and health benefits for several sub-groups of at-risk children. Hispanic children were shown to particularly gain from CEP by having higher reading scores, while children from low-income families had a lower risk of being overweight with the adoption of CEP in their schools. We find no evidence that CEP affected household food security. Results are robust across multiple model specifications in our national sample of elementary schoolchildren in 2011-2016. The findings of improved participation in school meals and greater use of free meals are consistent with data from prior studies, including two recent systematic reviews on the effects of CEP and UFM [36, 37] . The magnitude of results in our national sample is, however, more modest, potentially due to our study design or the sample of younger elementary schoolchildren. Our research and prior studies confirm that CEP achieves its primary goal of increasing school meal participation and expanding reach for the School Breakfast Program and the National School Lunch Program [17] [18] [19] [20] [21] 23, 36, 37] . We find evidence for improvements in school meal participation based on data from two independent sources, including school administrators and parents, which makes the findings more reliable. It is encouraging that the improvements seen in the school meal reach are particularly large for children who did not receive free/reduced-price school meals prior to the CEP adoption in their schools. It is possible these children were eligible, but did not participate due to stigma, lack of knowledge or administrative burdens [10, 38] . CEP has removed these barriers for children and their families. The observed improvement in school attendance is modest at 0.24 percentage points in the percent of children attending school, which fits mixed results on this outcome in the literature. Results vary from lower absences among elementary schoolchildren, but not middle-schoolers [24] , to reduced poor attendance only among economically disadvantaged children in the second (but not first) year of the CEP implementation [22] , and increased absences across grades [23] . School absenteeism is an important predictor of student achievement, high school and college graduation rates, adult income, and health [39, 40] . Even modest improvements in attendance with CEP render important supports to the program's wider impacts outside of the direct effect on school meal participation. Future studies should continue assessments of the CEP effects on attendance and related long-term outcomes. Our results on academic achievement are distinct from previous state-specific studies. It is possible that high heterogeneity in our sample of 41 states can explain the model's failure to confirm the parallel trend assumption for test scores, except for results among Hispanic children that are likely to be residing more narrowly in the Western and Southwestern states. Our sample size was too small to conduct state-or region-specific analyses. We tried an alternative model using school covariates and state covariates for region and political affiliation instead of school fixed effects, the results were very similar to our preferred model. It is important, however, that reading scores of Hispanic children were shown to increase with CEP participation even in the short term. The observed increase of a 0.055 standard deviation in the grade-adjusted reading z-scores is similar to the findings from other studies, including a 0.059 standard deviation increase for English Language Arts and 0.083 for math among non-poor students in NYC [18] and a 0.05 standard deviation increase in math in a national study [19] . Longer-term studies might be able to capture additional effects that improved access to nutritious school meals could bring to academic outcomes. Finally, our study did not identify significant changes in household food security after the CEP's adoption, which would have been a major accomplishment of the UFM expansion. Relatively few families in the ECLS-K:2011 sample reported major disturbances in having continuous access to food, especially among children, so our statistical power could be limited. It is possible that the use of adult food security as a measure of household food insecurity was not sensitive enough to capture spillovers from children's access to free school meals. There are no studies yet of the CEP effects on family finances [37] and future research should focus specifically on the effects of CEP expansion on food and nutrition security, including during and after the COVID-19 pandemic. This study is based on a nationally representative longitudinal sample of children with objective measures of key outcomes, including academic achievement and BMI, and survey data on school meal participation, attendance and household food security. To our knowledge, this is the first study that combines such a wide variety of outcomes in the CEP impact analysis. The longitudinal nature of the ECLK:2011 panel with geographic identifiers in its restricted-use version enable the use of a difference-in-difference model to estimate plausibly causal estimates of the CEP effects on a national sample of elementary schoolchildren. Along with its strengths, the study is subject to several important limitations. First, the study is limited to elementary schoolchildren who had the lowest non-participation rates among eligible students prior to CEP [9] and might benefit less from the CEP's adoption than middle-or high schoolchildren. Failure to support the parallel trend assumption for key outcomes is another concern. Conducting a national study with large heterogeneity across states could explain some of our challenges in estimating the CEP effects as well as more modest estimated effects for some findings. The sample size in several sub-group analyses was small, which might have affected the results. Future research should study the effects of CEP and UFM, especially during and after COVID-19, on household food security and child nutrition. Our study did not have data on dietary effects of impacts of CEP expansion, which could be positive [5] and should be directly investigated in future research. Finally, studies of the CEP effects in older children are needed. This paper provides evidence that CEP participation in its early years increased school meal participation and attendance in elementary schools, without adverse effects on student academic achievement and body weight outcomes. Expanding access to UFM appears to particularly benefit at-risk children, including gains in reading scores for Hispanic children and reduced risk of being overweight among children from low-income families. The COVID-19 pandemic led to the UFM implementation across all schools, irrespective of student incomes [41] , which could lead to broader adoption of CEP in the long term. Two states (CA and ME) have recently passed legislation to make UFM a permanent program [42, 43] . Our work suggests that access to UFM, without disruptions of remote learning during the COVID-19 pandemic, will likely benefit children's nutrition security and academic achievement, particularly among children from economically-vulnerable families. Future research should further investigate how UFM expansion can improve diet and reduce health and education disparities among American children. Supplementary Materials: The following are available online at https://www.mdpi.com/article/10 .3390/nu13082634/s1, Figure S1 : Event Study, Results: Daily school attendance (%), Full Sample, Figure S2 : Event Study, Results: School % of eligible for free or reduced-price lunch, Full Sample, Figure S3 : Event Study, Results: Child's receipt of complete school lunches for free or reduced price, Full Sample. The study received approval of the Institutional Review Board (IRB) at the University of Connecticut to work with restricted-use ECLS-K data, protocol #H19-048. All analyses were with secondary data. Informed Consent Statement: Not applicable, secondary data analysis. The ECLS-K data is available through the National Center for Education Statistics at the US Department of Education. Child Nutrition Tables-National Level Annual Summary Tables: FY 1969-2020 National School Lunch Program and School Breakfast Program: Nutrition Standards for All Foods Sold in School as Required by the Healthy, Hunger-Free Kids Act of 2010. Final rule and interim final rule Effectiveness of school food environment policies on children's dietary behaviors: A systematic review and meta-analysis The impact of the national school lunch program on child health: A nonparametric bounds analysis Do school food programs improve child dietary quality? Committee on Nutrition Standards for Foods in Schools. Nutrition Standards for Foods in Schools: Leading the Way toward Healthier Youth Critical connections: Health and academics Physical activity, diet and other behavioural interventions for improving cognition and school achievement in children and adolescents with obesity or overweight School Nutrition Dietary Assessment Study IV, Summary of Findings; US Department of Agriculture Competitive foods, discrimination, and participation in the National School Lunch Program National School Lunch Program and School Breakfast Program: Eliminating Applications Through Community Eligibility as Required by the Healthy, Hunger-Free Kids Act of 2010. Final rule Community Eligibility Provision: Planning and Implementation Guidance; Fall Community Eligibility Adoption Rises for the 2015-2016 School Year, Increasing Access to School Meals Characteristics of School Districts Offering Free School Meals to All Students Through the Community Eligibility Provision of the National School Lunch Program; ERR-255 Community Eligibility: The Key to Hunger-Free Schools.School Year 2020-2021 Community Eligibility Provision Evaluation; Nutrition Assistance Program Report; US Department of Agriculture, Food and Nutrition Service Impact of the Community Eligibility Provision on meal counts and participation in Pennsylvania and Maryland National School Lunch Programs Let them eat lunch: The impact of universal free meals on student performance Universal access to free school meals and student achievement: Evidence from the Community Eligibility Provision Community eligibility provision and other provisions for universal free meals at school: Impact on student breakfast and lunch participation in California public schools Community Eligibility and Child Well-Being. USDA RIDGE Project Summaries Universal access to free school meals through the Community Eligibility Provision is associated with better attendance for low-income elementary school students in Wisconsin Free lunch for all! The effect of the Community Eligibility Provision on academic outcomes Universal free meals associated with lower meal costs while maintaining nutrition quality Paying for Free Lunch: The Impact of CEP Universal Free Meals on Revenues, Spending, and Student Health Schoolwide free meals and student discipline: Effects of the Community Eligibility Provision Estimating the Effects of Universal Free School Meal Enrollment on Child Health: Evidence from the Community Eligibility Provision in Georgia Schools Essays on the Economic Determinants of Health. Dissertation Early Childhood Longitudinal Studies (ECLS) Program, Kindergarten Class of Community Eligibility Provision 2014-15 Data; Provided by FRAC Per Request Community Eligibility Provision 2015-16 Data; Provided by FRAC Per Request Common Core of Data (CCD) America's Public School The effects of congestion charging on road traffic casualties: A causal analysis using difference-in-difference estimation Impact of the Community Eligibility Provision of the Healthy, Hunger-Free Kids Act on student nutrition, behavior, and academic outcomes: 2011-2019 Universal School Meals and Associations with Student Participation, Attendance, Academic Performance, Diet Quality, Food Security, and Body Mass Index: A Systematic Review Factors Associated with School Meal Participation and the Relationship between Different Participation Measures-Final Report Evaluating the relationship between student attendance and achievement in urban elementary and middle schools: An instrumental variables approach School absenteeism in children and adolescents Continuing Appropriations Act, 2021 and Other Extensions Act, P.L. 116-159 An Act to Address Student Hunger through Expanding Access to Free School Meals, LD1679 California 2021-22 State Budget. Build Back Boldly We used a nationally representative panel of U.S. children from the Early Childhood Longitudinal Study, Kindergarten Class of 2010-2011 (ECLS-K:2011), which selected children from public and private schools attending full-or part-day kindergarten in 2010-2011. ECLS-K:2011 focused on children's early school experiences, beginning with kindergarten entry and through the fifth grade, with data collection in the fall and spring of kindergarten, first grade and second grade, and the spring of third, fourth and fifth grades. The study included parent, teacher, school administrator, and child-level data on children's cognitive and social development, home environment, test scores, child's health, body weight and height, and behavior [30] .We used child assessment, parent-, teacher-and school administrator-reported data from all six spring waves. To enable linkages between the school's location and child-level outcomes, we used a restricted version of the ECLS-K:2011 with geographic identifiers, which was provided by the National Center for Education Statistics at the US Department Acknowledgments: The authors appreciate helpful feedback from Michael W. Long and gratefully acknowledge the advice of Timothy Moore and Joochul Lee of UConn's Statistical Consulting Services. The authors thank the Food Research and Action Center (FRAC), Krista Ruffini and state departments of education for sharing their CEP eligibility and participation data. The authors declare no conflict of interest.