The Treatment Effect of the City Connects Intervention on Exiting Limited English Proficiency Status

Abstract

The City Connects intervention is motivated by the belief that out-of-school factors act as barriers to student thriving in cognitive and non-cognitive domains. It seeks to address these barriers first by identifying each student’s strengths and needs and then by providing a tailored set of prevention, intervention, and enrichment programs. Underlying the program is the assumption that provision of high-quality resources and individualized services will enable children to be cognitively, socio-emotionally, and physically prepared to thrive in school. This study’s purpose was to estimate the effects of the City Connects intervention on English learners’ (EL) likelihood of exiting Limited English Proficiency (LEP) status. ELs comprise a student subpopulation most at-risk to fail academically, and exposure to the program was hypothesized to improve their likelihood of exiting LEP status earlier than otherwise. A series of one- and two-level discrete-time event history analyses were conducted on the main analytic sample as well as two sub-samples. As participation in City Connects is at the school-level, school-level matching was used for sub-samples 1 and 2, and propensity score weights were applied at the student-level for all three samples. Additionally, hazard probabilities, survival probabilities, cumulative hazard rates, and median lifetimes were estimated. Lastly, a sensitivity analysis was conducted to examine whether effects were robust to unobserved selection bias. The results indicated that ELs participating in the City Connects intervention were significantly more likely to exit LEP status earlier than their peers in comparison schools. The median time in LEP status in City Connects schools was shorter and translated into a gain of at least one half of a year in grade in mainstream classes. Also, all the fitted models indicated that approximately 10 percent more City Connects students exited LEP status by the end of fifth grade than comparison students. Findings highlight the impact of the City Connects intervention, as ELs entering mainstream classes earlier could translate into important academic and non-academic gains, such as improved academic achievement and increased self-confidence.