- Intervention: A volunteer tutoring program for at-risk readers in early elementary school.
- Key Findings: Randomized controlled trial shows that this low-cost intervention has sizable positive impacts on students’ reading ability.
Description of the Intervention
Developed in 1992 in Oregon, SMART (Start Making a Reader Today) recruits community volunteers to tutor low-performing K-2 students in reading. The program operates statewide, serving approximately 11,000 students in 260 elementary schools each year. The Oregon business community provides significant financial assistance to the program, and many of the volunteer tutors are recruited from the business community.
Volunteers receive minimal training (1-2 hour orientation and introduction to reading strategies), and are encouraged to use their own judgment when tutoring. The program also provides volunteers with a handbook describing four reading strategies a volunteer can use with the student: 1) reading to the student; 2) reading along with the student; 3) reading a passage and having the student re-read it; and 4) asking the child questions during reading.
Teachers identify students at-risk of reading failure to participate in the program. These students attend 30-minute sessions twice a week during school hours, and can take home two books per month to build a home library.
Each school has a part-time SMART coordinator with no formal training in elementary reading instruction who manages the logistics of the program. In the version of SMART that was rigorously evaluated, each student participated in tutoring for six months in both first and second (but not third) grade.
The program, which has primarily been paid for by donations, costs $300 per child per year (2004 dollars), making it a very low-cost intervention. Click here for the SMART website.
EVIDENCE OF EFFECTIVENESS
This program was evaluated in one randomized controlled trial of 127 first-graders at risk of reading failure from six elementary schools in a diverse range of communities, who were randomly assigned to an intervention group that received SMART or a control group that did not. Intervention group students participated in SMART for six months per year in both first and second grade. They received an average of 37 hours of one-on-one tutoring over the two years.
47% of the students were white, 30% were African American, 10% were Native American, and the remainder were Asian American or Latino.
At the 2-year follow-up, the SMART group outperformed the control group on all reading outcomes, specifically:
- In word identification, the average SMART group student scored in the 29th percentile nationally compared to a 21st percentile average score for the control group (i.e., an effect size of 0.44 standard deviations).
- In word comprehension, the average SMART group student scored in the 31st percentile nationally compared to a 19th percentile average score for the control group (i.e., an effect size = 0.43 standard deviations).
- The average SMART group student correctly read 62 words of a second-grade reading passage in one minute compared to an average of 46 words for the control group (i.e., an effect size of 0.53 standard deviations).
- In passage comprehension, the average SMART group student scored in the 28th percentile nationally compared to a 22nd percentile average score for the control group (i.e., an effect size = 0.32 standard deviations). This effect approached, but did not quite reach, statistical significance at the .05 level.
Discussion of Study Quality (Click here for a glossary of terms)
- The study included a two-year follow-up.
- The study measured outcomes using an intention-to-treat analysis.
- There were no significant differences between SMART students and control students prior to the intervention.
- Standardized outcome measures were used to measure reading progress (e.g. Woodcock Reading Mastery Test-Revised), and the staff collecting outcome data were blind as to students’ group assignment.
- The study evaluated SMART in a diverse range of communities and typical classroom settings, providing evidence of its real-world effectiveness as a statewide program.
- Study Limitations: This study had moderately high attrition due to students moving out of the district (outcome data were collected for 66% of the original sample at the two-year follow-up). Statistical tests suggest that the attrition did not result in any observable differences between the SMART and control groups that might undermine the randomization. However, the study results should be treated with caution because it is possible that the attrition may have resulted in unobservable differences between the two groups, leading to inaccurate estimates of SMART’s impact. Also, although this is a well-designed randomized controlled trial whose results are reinforced by findings of effectiveness for other one-on-one tutoring programs (e.g., tutoring with Lindamood Phonemic Sequencing), we would caution that this is the only such trial of SMART, and additional trials are needed to confirm the program’s effectiveness.
(Click on linked authors’ names for their contact information)