||Constantly review data in both formal and informal ways.
Conduct an annual data review at the same time each year.
- This ensures that program leaders are consistently aware of what actually makes their program effective. Staying up-to-date on data insights not only allows leaders to work with tutors on the ground to make direct improvements, but also helps them maintain a clear understanding of which model design elements are most essential to the program’s success.
Tell a clear story about the program’s impact so far.
- This allows program leaders to consistently update their understanding of how effective each element of the program’s model design actually is.
- Annual data reviews are critical for programs looking to innovate, allowing leaders to distinguish among model design changes that preserve what matters most and ones that abandon the core of what makes the program effective.
- For programs seeking to scale up, an annual data review provides an opportunity to standardize core parts of a program so that it can be easily and faithfully replicated at scale.
Disaggregate student data (by race, gender, IEP status, home language, etc.) to ensure equity.
- Programs seeking to scale up and continuously generate new demand must be able to articulate the difference they have already made in their communities. This story is what gets a program’s “foot in the door” with new partners at every level, from individual schools to entire school districts and statewide departments of education.
Consider conducting rigorous evaluations.
- By reviewing data through demographic breakdowns, programs can identify opportunities for improvement and identify training needs to ensure tutors can effectively serve all students.
Train tutors to review actual student work, not just quantitative student performance data.
- Rigorous evaluations will provide evidence about what aspects of a program work and don’t work. These insights can improve efficacy and/or reduce costs.
- Well-designed evaluations can provide definitive evidence that a tutoring intervention helps students and can increase the demand and the likelihood programs receive external funding.
- Analyzing student work will enable tutors to identify why students struggled with specific tasks or answered specific questions incorrectly. Tutors can pinpoint access issues, precision errors, and misconceptions; this information can then inform the structure, content, and facilitation of future sessions.