Adding Standards and Procedures to the What Works Clearinghouse Handbook on the Transparency, Openness, and Reproducibility of Effectiveness Research on Education Practices, Products, Programs, and Policies

The credibility of What Works Clearinghouse study and effectiveness ratings are threatened by the prevalence of questionable research practices (e.g., selective non-reporting of results) in the bodies of evidence that the Clearinghouse reviews. Internationally accepted standards for reporting and interpreting the results of systematic reviews of evidence—including the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) and Grading of Recommendations Assessment, Development and Evaluation (GRADE)—recommend that reviews take steps to mitigate bias associated with these questionable research practices. To mitigate the effects of these questionable research practices, we propose that WWC adopt procedures and standards related to transparent, open, and reproducible research practices promoted by the Institute for Education Sciences (IES).