Printer Friendly

IRR (Inter-Rater Reliability) of a COP (Classroom Observation Protocol)--A Critical Appraisal.

ERIC Descriptors: Classroom Observation Techniques; Interrater Reliability; Correlation; Psychometrics; Physical Environment; Classroom Environment; Probability; Federal Programs; Learner Engagement; Criticism; Item Analysis; Program Evaluation; Literacy; Poverty; Urban Areas; Reading Programs

To read the full text of this article, click here: http://www.eric.ed.gov/ERICWebPortal/contentdelivery/servlet/ERICServlet?accno=ED532904

Notwithstanding broad utility of COPs (classroom observation protocols), there has been limited documentation of the psychometric properties of even the most popular COPs. This study attempted to fill this void by closely examining the item and domain-level IRR (inter-rater reliability) of a COP that was used in a federally funded striving readers program. A combination of reliability measures (e.g., joint-probability of agreement, Cohen's kappa, polychoric correlation and intra-class correlation coefficients) was selected dependent upon which were appropriate given the scale of each item set. Results indicate that most items in physical environment, cognitive demand and students' class engagement can be assessed with moderate reliability. Items in classroom climate and instructional modes yielded mixed estimates. Recommendations were provided for possible improvement of similar instruments. (Contains 12 tables.)

COPYRIGHT 2012 U.S. Department of Education
No portion of this article can be reproduced without the express written permission from the copyright holder.
Copyright 2012 Gale, Cengage Learning. All rights reserved.

Article Details
Printer friendly Cite/link Email Feedback
Author:Rui, Ning; Feldman, Jill M.
Publication:ERIC: Reports
Article Type:Abstract
Geographic Code:1USA
Date:Jan 1, 2012
Words:230
Previous Article:Boosting Early Development: The Mixed Effects of Kindergarten Enrollment Age.
Next Article:Effect of Training in Math Metacognitive Strategy on Fractional Achievement of Nigerian Schoolchildren.
Topics:

Terms of use | Privacy policy | Copyright © 2019 Farlex, Inc. | Feedback | For webmasters