Early Care and Education Leadership Study (ExCELS), United States, 2022 (ICPSR 38706)
Version Date: Jun 28, 2023 View help for published
Principal Investigator(s): View help for Principal Investigator(s)
United States Department of Health and Human Services. Administration for Children and Families. Office of Planning, Research and Evaluation
https://doi.org/10.3886/ICPSR38706.v1
Version V1 (see more versions)
You are currently viewing an older version of this data collection. A more recent version may be available by selecting (see more versions)
Additional information about this collection can be found in Version History.
2023-06-28 ICPSR data undergo a confidentiality review and are altered when necessary to limit the risk of disclosure. ICPSR also routinely creates ready-to-go data files along with setups in the major statistical software formats as well as standard codebooks to accompany the data. In addition to these procedures, ICPSR performed the following processing steps for this data collection:
- Created variable labels and/or value labels.
- Checked for undocumented or out-of-range codes.
Alternate Title View help for Alternate Title
Summary View help for Summary
The Early Care and Education Leadership Study (ExCELS) was funded by the Office of Planning, Research, and Evaluation within the Administration for Children and Families in the U.S. Department of Health and Human Services. The project team was led by Mathematica and the Institute for Early Education Leadership and Innovation at the University of Massachusetts Boston.
The project included a descriptive study with the following goals: (1) establish a measure of early care and education (ECE) leadership in center-based settings that serve children birth through age five (not yet in kindergarten) that meets standards for reliability and validity to support its intended use and (2) examine empirical support for the associations among key constructs and outcomes in the theory of change of ECE leadership for quality improvement. Research questions focused on understanding the three key elements that define what leadership in center-based ECE settings looks like: (1) who leaders are, (2) what individuals bring to leadership, and (3) what ECE staff do as leaders.
From February through July 2022, the study team recruited 132 ECE centers across four states that served children from birth through age 5 (who are not yet in kindergarten), and that were supported by Head Start grants or Child Care and Development Fund (CCDF) subsidies. From March through August 2022, the study team conducted phone interviews to collect center characteristics and learn about the center's staffing structure and leadership positions, and distributed surveys to center managers and teaching staff in recruited centers.
The User's Guide for this study can be obtained by selecting "Documentation Only" from the Download tab on this study homepage. The User's Guide and all ExCELS documentation will download in one zip file.
Citation View help for Citation
Export Citation:
Funding View help for Funding
Subject Terms View help for Subject Terms
Geographic Coverage View help for Geographic Coverage
Restrictions View help for Restrictions
Access to these data requires an application and signed Restricted Data Use Agreement. Details, including the Restricted Data Use Agreement, are provided via the online application.
Distributor(s) View help for Distributor(s)
Time Period(s) View help for Time Period(s)
Date of Collection View help for Date of Collection
Data Collection Notes View help for Data Collection Notes
Acknowledgments:
Gretchen Kirby, Project Director, Mathematica
Lizabeth Malone, Co-Project Investigator, Mathematica
Anne Douglass, Co-Project Investigator, Institute for Early Education Leadership and Innovation at the University of Massachusetts Boston
Study Purpose View help for Study Purpose
The Early Care and Education Leadership Study (ExCELS) had three aims:
- To fill the definitional and measurement gaps to understand what leadership looks like, as defined by who participates in leadership in center-based early care and education (ECE) settings and the ways in which leaders can improve quality experiences for children in those settings
- To develop a new measure of ECE leadership
- To identify actionable leadership development initiatives and methods of evaluating them
Study Design View help for Study Design
Recruitment occurred through mass mailing of study materials to centers (March and May 2022) and individualized center recruitment via email and phone follow-up that went though July 2022.
During recruitment, primary site leaders (PSL) who expressed interest participated in a brief engagement interview via phone call to collect information on a center's characteristics and determine their center's study eligibility. Upon confirming eligibility and center participation, within one week of completing the engagement interview, a staffing structure and leadership positions (SSLP) interview was conducted with PSLs by phone. Rosters of all teaching staff in classrooms serving children from birth through age 5 and contact information for center managers were also collected at the end of each SSLP interview. SSLP interviews were conducted from March through August 2022.
At each center, up to three center managers received a center manager survey, a 25-minute self-administered, web-based survey with a paper option. Center manager respondents were provided with a token of appreciation for survey completion. All teaching staff included on the center's roster received a teaching staff survey, a 60-minute, self-administered, web-based survey, with a paper option. Teaching staff survey respondents were provided with both a pre-pay token of appreciation and one upon survey completion. Data collection for both the center manager and teaching staff survey was completed by the end of August 2022.
Sample View help for Sample
The Early Care and Education Leadership Study (ExCELS) used a purposive sample. The research team selected four states to sample centers for the descriptive study and aimed to recruit at least 120 centers within those states for the study. The purposive sample focused on centers funded by Head Start or CCDF that were located in urban and suburban areas. A center was defined as a specific physical location with at least two classrooms primarily providing early care and education (ECE) services for children from birth through age 5 (not yet in kindergarten). States were selected using the following criteria:
- Strength of administrator qualifications in licensing, credentialing, and Quality Rating and Improvement System (QRIS) criteria, as of June 2018
- Funding to support access and quality
- Stringency of licensing requirements as minimum standards for quality to reflect the regulatory environment
- Geographic diversity
Once states were selected for the study based on sampling criteria, sampling lists of early care and education (ECE) centers were constructed by pulling information from the Head Start Enterprise System, public websites about community-based centers, and a state Department of Education's list of centers in that state. Researchers conducted varying levels of outreach to over 3,000 centers to ultimately have 132 eligible, participating centers.
Once centers were deemed eligible, survey respondents were selected, including staff in formal manager roles (center directors or managers) who were responsible for daily operations and the education program in each center and all teaching staff from each center in classrooms serving children from birth through age 5.
One to three managers per center were selected to receive the center manager survey, depending upon center size. The manager had to spend some time at the center to be eligible to complete the survey. All teaching staff in classrooms serving children from birth through age 5, including lead, head, or co-teachers and assistant teachers, were selected for the teaching staff survey.
Time Method View help for Time Method
Universe View help for Universe
Center managers and teaching staff (lead, head, co-teacher and assistant teachers) in center-based early care and education (ECE) settings (that is, settings serving children from birth through age 5, not yet in kindergarten) that were receiving funding through Child Care and Development Fund (CCDF) subsidies and/or from Head Start grants.
Unit(s) of Observation View help for Unit(s) of Observation
Data Type(s) View help for Data Type(s)
Mode of Data Collection View help for Mode of Data Collection
Description of Variables View help for Description of Variables
Each data file includes item-level data from the interviews or surveys and composite variables created from the instruments.
Center-level data file: The center-level data file includes data from the engagement interview and the staffing structure and leadership positions (SSLP) interview. More specifically, it includes data on center-level ExCELS leadership scores, staff counts, leadership positions, center characteristics, and center-level scores from The Essential 0-5 Survey (on center culture, climate, and communication; Ehrlich et al. 2018).
Center manager survey data file: The center manager survey data file includes data on center characteristics, background characteristics, leadership elements, and staff outcomes.
Teaching staff survey data file: The teaching staff survey data file includes data on background characteristics, leadership elements, and staff outcomes.
Response Rates View help for Response Rates
The Early Care and Education Leadership Study (ExCELS) descriptive study sample included all 132 recruited, eligible centers that completed a staffing structure and leadership positions (SSLP) interview. Not all centers completed all survey data collection activities. Eight centers withdrew from further data collection after the SSLP interview and before staff could be invited to complete the surveys. Two additional centers withdrew from data collection after the center manager survey data collection. None of these 10 centers provided teaching staff rosters. Therefore, 122 centers participated in all data collection activities (that is, completed the SSLP interview and received invitations to the center manager and teaching staff surveys). To examine the technical properties of the leadership item set, the research team established an analytic complete target for a center of at least 50 percent for the response rate on the teaching staff surveys (with at least two completed teaching staff surveys) and at least the primary site leader (PSL) completing a center manager survey. This goal was met by 110 centers.
Across all centers that received survey invitations, the response rate was 92 percent for center managers and 88 percent for teaching staff. Considering the response rates within a center, center manager surveys were completed in 121 centers--107 centers had all center managers complete a survey, with 119 having at least the PSL complete the survey. Teaching staff surveys were completed in 122 centers--94 centers had 80 percent or more of their teaching staff complete a survey (with at least two completes). At least 50 percent of teaching staff completed a survey in 119 centers.
Presence of Common Scales View help for Presence of Common Scales
The Essential 0-5 Survey. Ehrlich, S.B., D.M. Pacchiano, A.G. Stein, M.R. Wagner, S. Luppescu, S. Park, E. Frank, H. Lewandowski, and C. Young. "Organizing Early Education for Improvement: Testing a New Survey Tool." University of Chicago Consortium on School Research and the Ounce of Prevention Fund, 2018.
Stress scale from the Survey of Organization Functioning (Institute of Behavior Research 2005)
HideOriginal Release Date View help for Original Release Date
2023-06-28
Version History View help for Version History
2023-06-28 ICPSR data undergo a confidentiality review and are altered when necessary to limit the risk of disclosure. ICPSR also routinely creates ready-to-go data files along with setups in the major statistical software formats as well as standard codebooks to accompany the data. In addition to these procedures, ICPSR performed the following processing steps for this data collection:
- Created variable labels and/or value labels.
- Checked for undocumented or out-of-range codes.