Printer Friendly

Measuring Critical Education Processes and Outcomes: Illustration from a Cluster Randomized Trial in the Democratic Republic of the Congo.

To read the full text of this article, click here:

Author(s): Halpin, Peter F.; Torrente, Catalina

Using reliable and valid measures of students' outcomes which are sensitive to change is critical for obtaining interpretable and therefore useful results from evaluations of school-based interventions. While measurement development for use in experimental evaluations receives a great deal of attention in the U.S., it lags behind in low-income countries. The Early Grade Math Assessment (EGMA, RTI, 2009) and Early Grade Reading Assessment (EGRA, RTI, 2009b) were developed by RTI international to provide snapshots of students' emerging math and reading abilities in low-income countries. The assessments use a series of discrete sub-tests (e.g., number identification, quantity discrimination, phonemic awareness, familiar/unfamiliar word decoding) and are increasingly employed by governments and Non-Governmental Organizations (NGOs) to diagnose the status of children's abilities and to fine tune interventions to meet the academic needs of children. As the popularity of evidence-based practices grows, EGMA and EGRA are also being used in experimental evaluations of school-based interventions. However, the use of multiple sub-test scores may inflate the risk of capitalizing on chance and undermine power to detect intervention impacts. The goals of the study are to describe and discuss the authors' conceptual and analytical approaches to developing valid and internally consistent measures of social-emotional processes and academic outcomes for use in a cluster randomized trial of Opportunities for Equitable Access to Quality Basic Education (OPEQ) in the Democratic Republic of the Congo (DRC). First, the authors present their approach to developing summary scores of children's early math and reading abilities. Second, they present psychometric analyses used to refine, reduce, and examine the underlying structure of scales intended to measure children's perceptions of school quality and socio-emotional well being. The analyses in this paper illustrate approaches to measuring children's academic outcomes, perceptions of school quality, and socio-emotional well being, as part of an impact evaluation in the Democratic Republic of the Congo. As such, they contribute to advances in devising more reliable and valid instruments to inform the development of increasingly effective educational interventions in diverse parts of the world. These findings provide a model for future use of evaluative educational instruments in low-income countries, and confirm the importance of critically evaluating such instruments for use in new populations.

ERIC Descriptors: Foreign Countries; Outcome Measures; Outcomes of Education; Cluster Grouping; Randomized Controlled Trials; Test Validity; Test Reliability; Well Being; Scores; Educational Quality; Elementary School Students; Grade 2; Grade 3; Grade 4; Mathematics Tests; Reading Tests; Nonverbal Ability; Reading Ability; Psychometrics; Student Attitudes

Publisher: Society for Research on Educational Effectiveness. 2040 Sheridan Road, Evanston, IL 60208. Tel: 202-495-0920; Fax: 202-640-4401; e-mail:; Web site:

Source: Society for Research on Educational Effectiveness

ERIC Number: ED562783

Peer reviewed

Record Type: Non-Journal

Pages: 6

Abstractor: ERIC

Publication Type: Reports - Research

Education Level: Elementary Education; Grade 2; Primary Education; Early Childhood Education; Grade 3; Grade 4; Intermediate Grades
COPYRIGHT 2014 U.S. Department of Education
No portion of this article can be reproduced without the express written permission from the copyright holder.
Copyright 2014 Gale, Cengage Learning. All rights reserved.

Article Details
Printer friendly Cite/link Email Feedback
Author:Halpin, Peter F.; Torrente, Catalina
Publication:ERIC: Reports
Article Type:Report
Geographic Code:6ZAIR
Date:Jan 1, 2014
Previous Article:Replicating the Effects of a Scaled-Up, Teacher-Scaffolded Voluntary Summer Reading Program.
Next Article:Navigating Middle Grades: Role of School Context in Students' Social Adaptation and Experiences.

Terms of use | Privacy policy | Copyright © 2019 Farlex, Inc. | Feedback | For webmasters