LINC PROJECTS

The goal of this project is to identify the impact of participating in ReHire Colorado or CW STEP on future outcomes, including employment, earnings, benefit receipt, and other costs/benefits relevant for calculating the programs’ Marginal Value of Public Funds.

This project seeks to answer the following questions: 

• What is the causal impact of access to the ReHire Colorado Program on future outcomes?

• What is the causal impact of participation in the ReHire Colorado Program on future outcomes?

• What is the causal impact of participation in the CW STEP program on future outcomes?

This project will inform Colorado’s efforts to increase college attainment by supporting students’
needs for food and related human services. Many college students struggle with food insecurity,
and evidence increasingly suggests that food insecurity can act as a barrier to postsecondary
success. Colorado state agencies and postsecondary institutions are looking for ways to expand
student participation in the Supplemental Nutrition Assistance Program (SNAP) to ensure that
students receive nutritional support, and to advance equity in postsecondary education.

Using linked administrative data, researchers will conduct four studies to inform Colorado’s
decision making:
● A quantitative description of current and historical rates of SNAP eligibility and
participation among college students, and variation in SNAP participation across
institutions and student characteristics. This will include analyses of the share of
students who are eligible for SNAP because they receive TANF benefits and the rate of
SNAP participation among those students.
● A quantitative analysis of the relationship between SNAP participation and student
outcomes, using quasi-experimental methods to compare academic outcomes for SNAP
participants to SNAP-eligible non-participants. Having a rich array of baseline measures
on participants and eligible non-participants, including those from students’ college
applications, is critical to appropriately implement our quasi-experimental approach.
● A quantitative simulation of how SNAP participation and student outcomes might change
under four different approaches to expanding SNAP participation.
● A mixed-methods description of the ways in which postsecondary institutions are
implementing basic needs services to increase SNAP participation, and an exploration of
which practices are associated with high rates of SNAP take-up among eligible students.

This project builds on an earlier phase of this work. 

Poverty at the caregiver and community levels are risk factors for child maltreatment, but not all
caregivers in poverty face allegations of neglect. There is a critical need for research to identify
what puts some caregivers in contact with the child welfare system while others in seemingly
similar situations do not have similar contact. This project will examine the potential role
of income volatility in this problem and the potential mitigating protective factors when income
volatility is taking place, such as increased housing stability and TANF participation. The results
of this study will help identify potential target populations for child maltreatment prevention
programs that specifically address financial instability and neglect.

This project will assess the impact of the Imagination Library Colorado (ILCO) Book Program on kindergarten readiness scores. Because the state of Colorado does not collect student-level kindergarten-readiness data, a statewide study is not possible. Instead, we will target a small number of school districts that have a large number of ILCO book program participants residing in their catchment areas to share data through LINC. The evaluation will compare ILCO program graduates to demographically similar students at the same school district who have not participated in the ILCO program.

The primary goal of this project, as outlined by the legislation (HB 22-1326), is to study
the health impacts of felonizing fentanyl possession. Specifically, we aim to assess
changes in fentanyl-related overdose rates, both fatal and nonfatal, among individuals
charged with drug-related crimes compared to those without drug-related crimes, and to
individuals with opiate misuse or use disorder not charged with drug-related crimes.
Additionally, we will evaluate the initiation and retention rates of evidence-based
treatments for opiate use disorder across these groups.

Secondary objectives include examining the differential effects of criminal penalties on
marginalized populations and ensuring that future policy changes incorporate the
perspectives of those with lived experience.

The goal of this project is to expand the evidence base on interventions to prevent homelessness among youth and young adults involved in the child welfare system. To do so, this project evaluates the Colorado Pathways to Success (Pathways) comprehensive service model, an intensive, coach-like case management model for youth and young adults in foster care. The Pathways model is described in detail in the project design report, which has been approved by the Office of Planning, Research, and Evaluation (OPRE), Administration for Children and Families (ACF), U.S. Department of Health and Human Services (HHS). The project design report is available on OPRE’s website here.

The first LINC project – Youth at Risk of Homelessness Project, Phase 1 – included only primary data collection and child welfare data. 

The significant focus on improving Colorado’s early childhood landscape (e.g., Universal Preschool, new state department) has raised the need for reliable data on the early care and education (ECE) workforce. This need for comprehensive, streamlined, quality data on the ECE workforce is continuing previous ECE workforce data projects that resulted in a Colorado 2019 Snapshot Report and a data dashboard. This project is designed to continue tracking and analyzing information on the ECE professional workforce. This phase will add refreshed data from CDEC for 2023 to the dashboard tol expand our understanding of the ECE workforce over time.

The Colorado Lab, in collaboration with Colorado Equitable Economic Mobility Initiative and Trendlines Colorado, has launched the Colorado Wages and Outcomes Results Coalition (Colorado WORC) to measure learner outcomes and equity gaps. This four-year initiative aims to build stronger evidence of effectiveness for a cohort of training and postsecondary providers operating in Colorado, with the goal of launching in 2023. This project represents the first phase of work to achieve this goal: creating a provider-level and program-specific dashboards to identify if participants in workforce training programs are experiencing improved employment and earnings. This will help providers understand how they can improve their own program offerings to support those they serve.

This project will extend the learnings from the first phase of work that improved our understanding of the prevalence of youth homelessness in Denver. The first phase showed that each system uniquely contributed to the prevalence rates of youth homelessness and that any single system was insufficient to accurately capture these experiences. This project will deepen our understanding of characteristics and histories associated with homelessness as older youth (i.e., ages 18 to 24) in order to better identify prevention strategies and opportunities for cross-system partnership to support these youth.

Colorado state agencies and postsecondary institutions are looking for ways to expand student participation in the Supplemental Nutrition Assistance Program (SNAP) to ensure that students receive nutritional support, and to advance equity in postsecondary education. This project will inform Colorado’s efforts to increase college attainment by supporting students’ needs for food and related human services. Specifically, the project team will examine current and historical rates of SNAP application and participation among college students, and variation in SNAP participation across institutions and student characteristics. These analyses will provide a benchmark for a quantitative simulation of how SNAP participation might change under several different approaches to expanding SNAP participation. They also will help to characterize participation rates at postsecondary institutions that are implementing basic needs services to increase SNAP participation.

This is the second phase of work on a larger HUD-funded project to estimate the prevalence of youth homelessness. The goal of this phase is to explore the characteristics of youth experiencing homelessness including educational, child welfare, and juvenile justice experiences using the identified population from the first phase of work. By further exploring the characteristics and experiences of youth who experience homelessness, we hope to aid partner organizations in better identifying and serving this population. 

Phase I of this project was a pilot that connected Metro-Denver Homeless Initiative, Trails Child Welfare, and Denver Public Schools data, which informed this proposed project. Specifically, we learned that each of those local data sets substantially contributed to the estimates (i.e., there was not a lot of overlap in the youth identified for each system). 

The purpose of this project is to create a more comprehensive description of the experiences and characteristics of individuals living in poverty and whether certain experiences and characteristics serve as risk or protective factors for child welfare involvement. This information will be used to inform a state-level strategy for policy and practice improvements with the goal of mitigating risk for child welfare involvement.

The Colorado Department of Early Childhood (CDEC) has contracted with the Butler Institute for Families at the University of Denver to conduct an evaluation assessing whether the revised Colorado Shines Quality Rating and Improvement System (QRIS) framework has the right standards in place to measure quality and to identify opportunities for improvement of the framework. To complement the collection of primary data from stakeholder groups (e.g., families,providers, coaches, quality navigators, QRIS rating/verification team), the Butler team will use this LINC project to understand how the QRIS quality indicators relate to early care and education (ECE) workforce outcomes that should be improved (e.g., higher wages, lower turnover) when programs move up in quality. This will inform CDEC’s consideration of where to improve the QRIS system to ensure it is effectively supporting programs to make quality improvements that matter most.

Working in partnership with the Colorado Evaluation and Action Lab (Colorado Lab), Brodsky Research and Consulting (BRC) is leading the evaluation of Colorado Child Care Assistance Program (CCCAP) policy stimulus-funded activities. This project isaimed at learning how particular policies, funded by stimulus funds, were implemented in The Colorado Child Care Assistance Program (CCCAP), as well as the implications and perception of these policies by key stakeholders. Specific policies of focus are increased absence policy for preschool-age children, enrollment-based payment policy for infants and toddlers, increased provider rates, decreased family co-payments, and expanded family eligibility. This LINC project will be examining changes to CCCAP enrollment, participation, and utilization by both providers and families (comparing before-policy-implementation to after-policy-implementation). Findings from this evaluation will be shared with state decision makers in order to inform any necessary adjustments to these policies moving forward.

The Colorado Teacher Salary Increase Pilot provided a higher wage to lead and assistant teachers working in Colorado child care centers where at least 40 percent of children served are receiving Colorado Child Care Assistance Program (CCCAP) subsidies. Given that funding was not available to serve all teachers, a subset of eligible centers was randomly selected to receive the funds for the wage increase. The wage increase will be evaluated to assess its effects on Early Care and Education (ECE) teacher recruitment, retention, and economic well-being.

 The program’s goal is to help understand the effects of supplying livable wages for ECE teachers, including the potential implication for a “cliff effect,” meaning the financial loss when a wage increase results in reduced eligibility for public assistance programs like Supplemental Nutrition Assistance Program (SNAP). The outcomes of the program will help inform whether and how changes in public funding streams may be made to help Colorado’s ECE centers pay teachers livable wages, and how these funding streams might interact with other public assistance funding streams.

Building on three prior phases of work, this project continues to respond to the state’s need for reliable data on the Early Care and Education (ECE) workforce to inform strategic recruitment and retention investments. This phase seeks to expand further on these efforts by incorporating updated data to remain responsive to the changing policy and economic landscapes.

In addition, this phase seeks to incorporate new public assistance data from Colorado Child Care Assistance Program (CCCAP) and Supplemental Nutrition Assistance Program (SNAP) to further contextualize the experience of the ECE workforce. It is not currently known how much this particular workforce population depends on critical public assistance programs to make ends meet financially. It is also not certain whether these ECE workforce professionals access these benefits programs when they are eligible.

To continuously strengthen their work to protect the fundamental right to parent, the Office of Respondent Parents’ Counsel (ORPC) partnered with the Colorado Evaluation and Action Lab (Colorado Lab) to build evidence for the interdisciplinary team model of parent representation. Together, the ORPC and the Colorado Lab are moving the model through the Steps to Building Evidence. As part of the evidence-building strategy, the project team will focus on a preliminary exploration of outcomes of the interdisciplinary team model using LINC, including who receives interdisciplinary team representation and understanding the value of interdisciplinary team representation for case outcomes around keeping kids safely at home. This work aligns with federal and state priorities and illustrates the value of the interdisciplinary model from a system and legislative perspective.

Project Materials

The goal of this project is to evaluate the labor market impact of Colorado’s Equal Pay for Equal Work Act. In particular, the researchers are interested in understanding how wages and employment responded to the requirement that all online job postings must include salary information starting January 2021. There will be a particular focus on recent graduates and enrollees at Colorado-based higher education institutions.

The results of this project would help policymakers in Colorado and elsewhere forecast the effects of increasing pay transparency, improve enforcement of pay transparency laws, and provide empirical evidence on the benefits of giving college graduates clear information on the expected salaries in different careers.

This project will produce comprehensive, streamlined, quality data on the early care and education (ECE) workforce able to inform high-priority policy decisions. This builds upon an earlier LINC project that exclusively examined data within the CDHS Office of Early Childhood data systems. While these data greatly improved our knowledge on the ECE workforce, there remained significant gaps in knowledge critical for understanding sector differences and informing the rollout of the recently-funded universal Pre-K effort. The current LINC project will integrate key information from new LINC partners to fill in the data gaps identified in the previous work, including:

• Post-secondary pathways pursued by prospective and working ECE professionals
• Turnover within the ECE field and where professionals go when they leave the field
• Compensation by ECE professional roles and disparities by key subgroups

This work will result in a refreshed annual ECE Workforce Snapshot Report, an updated ECE workforce data dashboard, and the piloting of My Colorado Journey pathways for prospective ECE professionals.

The Federal Department of Health and Human Services, Office of Planning Research, and Evaluation is funding a multi-state evaluation of interventions designed to prevent homelessness among youth exiting foster care. This LINC project seeks to evaluate the Colorado Pathways to Success program that provides a comprehensive service model, an intensive, coach-like case management model for youth and young adults in foster care.

This project has multiple phases and anticipates expanding to include data from other LINC partners to evaluate youth outcomes such as homeless services, labor and employment records, and higher education records. This first phase of work will connect the research study data collected through surveys with child welfare records to assess baseline information for youth enrolled in the study in the early months of recruitment and to obtain a statewide look at the descriptive picture of youth in foster care who would be eligible for the Colorado Pathways to Success program.

The subsequent phases of the research study to examine youth outcomes will be accomplished annually through December 2026.

Crossover youth are the young people with two types of court cases: (1) dependency and neglect and (2) juvenile justice. Using LINC, the crossover youth project will connect child welfare and court system records to help meet federal reporting requirements and inform policies and practices aimed at serving crossover youth. This LINC project will yield:

• Demographic and geographic descriptions (e.g., age, gender, race/ethnicity, judicial district, county).
• Point-in-time and annual numbers of youth in congregate care with a dependency & neglect (D&N) case, delinquency case, or both; clear information on why youth are in out-of-home care at a given point in time.
• Point-in-time and annual numbers of youth in family-like placements with a D&N case, delinquency case, or both.

This work will inform the implementation of the federal Family First Prevention Services Act and Colorado SB 18-154 Crossover Youth Plans.

LINC is supporting a project to estimate homelessness among youth ages 14-24 by connecting data from multiple state and local systems. The first phase of work involved a descriptive analysis of linked local and state administrative data in the Denver area and will be used to better understand the extent to which these systems identify and serve Denver’s youth homelessness population. The research team used 5 years of longitudinal data to describe the characteristics and experiences associated with homelessness. This project is funded by the U.S. Department of Housing and Urban Development and conducted in partnership with the Center for Policy Research.

The next phase of this work will focus on using the approach of the Denver project at a statewide level. The researchers will also expand the Denver project to look at characteristics of youth experiencing homelessness. The project team will develop a Best Practice Guide for using integrated administrative data sources to produce rigorous and efficient estimates of youth homelessness.

Project Materials

This LINC project came from the leadership of human services in the state and a deep commitment to preventing future homelessness among youth aging out of the foster care system. 

This priority project inspired the onboarding of the Metro Denver Homelessness Initiative as a LINC partner so the state could have a view into the intersection of child welfare and homeless experiences in the largest metro area of the state. An initial analysis of these data shows that a sizeable proportion of adults experiencing homelessness had previous involvement in the child welfare system, indicating that further study of potential prevention strategies may be fruitful.

Project Materials

Denver Collaborative Partnership is taking an upstream preventative approach to serving youth who run away and their families. A rapid response team is meeting the youth and families where they are and connecting them to evidence-based services (e.g., Multi-Systemic Therapy, Functional Family Therapy) aimed at preventing juvenile justice involvement and the need for out-of-home care. The Colorado Evaluation and Action Lab conducted an evaluation of this effort funded by Pay for Success and used LINC to connect the appropriate data for the baseline information on youth involved in the evaluation.

Project Materials

In 2019, the Colorado state legislature passed Senate Bill 19-228 to address the opioid crisis and authorized a LINC project focused on understanding the prevalence of perinatal substance exposure and identifying prevention opportunities within and outside of healthcare systems. This demand for knowledge refocused the LINC leadership team’s energy toward addressing a common data sharing barrier—utilizing information on substance use and treatment for research and evaluation purposes without disclosing sensitive personal information. The LINC team sought and received guidance from the Center of Excellence for Protected Health Information, funded by the Substance Abuse and Mental Health Services Administration, on how LINC can receive such data for approved projects. LINC is now implementing this guidance and is able to onboard data partners who would like to better understand issues related to substance use and prevention.

Project Materials

Governor Jared Polis holds a strong commitment to expanding quality pre-K opportunities for young children and recognizes that a high-quality early care and education (ECE) workforce is essential to fulfilling this goal. The state had no centralized information on the ECE workforce to guide its plans to roll out investments, such as the size of the workforce, where teacher shortages existed, qualifications earned by educators, and recruitment and turnover rates. Using LINC, the Office of Early Childhood was able to partner with the Colorado Evaluation and Action Lab to connect data from the state’s workforce registry, background check, and early care provider systems to produce the first comprehensive look at the ECE workforce in Colorado. These data are now available in an interactive dashboard and a statewide snapshot report that will be routinely updated. 

A second phase LINC project is in development that will propose to add wage data as well as data on post-secondary pathways from the Colorado Departments of Labor and Employment and Higher Education.

Project Materials