An Analysis of the Higher-Order Thinking Requirements of an End-of-Course ELA Assessment

Author

Timothy J. Dowd, Seton Hall UniversityFollow

Date of Award

Spring 5-3-2023

Degree Type

Dissertation

Degree Name

EdD Education Leadership, Management and Policy

Department

Education Leadership, Management and Policy

Advisor

Christopher Tienken, Ed.D.

Committee Member

Armand Lamberti, Ed.D.

Committee Member

Leslie Solis-Stovall, Ed.D.

Keywords

higher order thinking, cognitive complexity, summative assessment, Webb’s Depth of Knowledge, Bloom’s Revised Taxonomy, the Hess Cognitive Rigor Matrix

Abstract

Higher-order thinking has been promoted in the American classroom for several decades. Summative assessments have the dual role of ascertaining the student’s proficiency and also providing them with opportunities to employ various cognitive behaviors and to offer them with opportunities to demonstrate their ability to think in complex ways. The creators of one such summative assessment, the North Carolina End-of-Course English II Test, claim that their test provides up to 40% of its items at the higher-order of thinking. The purpose of this convergent mixed-methods study was to investigate how the language found in the released items on the North Carolina End-of-Course English II (Grade 10) Assessment compares with the language that promotes higher-order thinking found in the research literature. The qualitative component of this study focused on analyzing the language found in the questions and items on the NCEOC English II Assessment and how that language compared with the language used in the Hess Cognitive Rigor Matrix and the Webb Alignment Tool. The quantitative component of this student involved determining the frequency and percentage of assessment items that promote higher-order thinking. Four consultant coders, employing a double-rater read-behind consensus model to ensure inter-rater reliability, coded each of the 53 released items from the assessment according to its cognitive behavior and its thinking complexity. The study found that an overwhelming majority of the items on the NCEOC English II Assessment did not promote higher-order thinking.

Recommended Citation

Dowd, Timothy J., "An Analysis of the Higher-Order Thinking Requirements of an End-of-Course ELA Assessment" (2023). Seton Hall University Dissertations and Theses (ETDs). 3104.
https://scholarship.shu.edu/dissertations/3104