By immediately responding to achievement progress data, teachers can improve students’ performance by using curriculum-based measurement. However, teachers are prone to make biased judgments about the students providing the data.
1. Introduction
Teachers are increasingly turning to curriculum-based measurement (CBM) as a tool for monitoring student development in fundamental academic domains like arithmetic, reading, spelling, and writing. In most cases, it comprises employing brief, routinely administered standardized tests to gauge pupils’ advancement toward a long-term objective
[1]. However, the effectiveness of CBM for raising student achievement appears to be mixed
[2][3][4][5], despite the fact that it provides teachers with a strong framework for making judgments based on evidence regarding whether students need help, instructions need to be revised, or teaching objectives need to be adjusted
[6]. Research has shown that teachers have difficulty using progress data to inform and guide their instruction
[7][8]. The interpretation of progress data is impacted by a number of factors, which is one reason why CBM alone does not result in better teaching
[9][10][11][12]. These factors may be related to the lack of attention teachers devote to relevant aspects of the graph
[13], may be connected with characteristics of the progress data itself or its presentation, or may belong to characteristics of the to-be-judged students. For example, refs.
[9][11][12] found that high data variability results in relative overestimation of current trends. Ref.
[14] could show that the presence of a trend line, which visually depicts the linear component of progress data points, reduces judgment errors. Moreover, ref.
[11] demonstrated that pre-service teachers judged progress data of reading fluency obtained from girls more positively than the same data obtained from boys.
2. Gender Bias in Curriculum-Based Measurement
2.1. Curriculum-Based Measurement
Curriculum-based measurement is a general term for assessment systems that track a student’s progress in learning within a particular academic subject. In order to determine whether students have achieved a learning goal or instead require extra support, it is necessary to frequently evaluate their abilities
[15].
CBM entails the frequent administration of brief measures of performance in a chosen academic domain of interest (such as reading, writing, or mathematics). A graph showing the student’s learning trajectory over a set time period is typically used to depict the student’s achievement. The graph can be used by teachers to assess the efficacy of a lesson plan, a student’s mastery of a subject, or whether a student is expected to perform in accordance with pre-set learning objectives. CBM can be a useful tool for teachers to raise students’ performance by systematically responding to accomplishment data with instructional adjustments. However, when employing CBM, teachers frequently struggle to enhance their education
[2][3][4][5][8]. Although CBM graphs are constructed to facilitate teachers’ understanding of their students’ progress, their comprehension appears to be challenging
[8][16]. One probable explanation for teachers’ lack of adequate response to the presentation of progress data is their inability to read and understand data accurately
[17][18]. Even using computer software designed to help teachers analyze graphs by presenting statistics like the graph’s linear trend does not produce an adequate grasp of the progress data. Moreover, teachers frequently do not use these statistics
[16]. Instead, they rely on visual assessment of the data more frequently
[14]. Visual inspection, on the other hand, is prone to inaccuracy
[19][20], and as a result, teachers make errors when evaluating visible progress data. For instance, ref.
[12] presented teachers with CBM graphs and assessed their ability to grasp information from them. They found that teachers were prone to ignore the relevant information and to focus on rather marginal details. Similar results were revealed by
[13] who examined teachers’ eye movements when judging CBM graphs. The quality of data interpretation seems also to depend on the intensive support of teachers by researchers. Without such support, teachers are likely to use CBM data inconsistently and inappropriately
[21]. According to
[22], merely providing teachers with students’ data will not necessarily result in their using it, as long as they do not believe in the importance of these data.
2.2. Origins of CBM
CBM was invented in the 1970s by Deno and Mirkin
[23]. It was developed within the field of special education with the aim of allowing teachers to formatively evaluate their instructional programs by successively using probes to test their students’ basic academic skills, so that they were able to describe the students’ growth in academic achievement. The invention of CBM was followed by a 5-year program of research conducted at the Institute for Research on Learning Disabilities at the University of Minnesota
[24]. Since CBM offers a system for monitoring students’ attainment of academic goals and evaluating instructional programs, its use has been formalized among school districts in the United States. Today, U.S.-based norms and data management are available on internet platforms, e.g.,
www.aimsweb.com (accessed on 10 December 2023).
2.3. Different Content Domains
CBM was developed initially to help teachers at the primary school level increase the achievement of students struggling to learn basic skills in reading, writing, and arithmetic
[15]. Since many students struggle with reading
[25], one of the first domains where CBM was applied was reading. Reading CBM often consists of oral reading fluency
[6], where students read aloud from a passage for a limited time (e.g., 1 min). To do this, students need to use a variety of different literacy skills, for instance, decoding, vocabulary, and comprehension
[26]. Teachers score reading CBM by first counting the total amount of words attempted in 1 min, then counting the total number of errors, and finally subtracting the total number of errors from the total number of words, yielding the words read correctly (WRC) score
[6].
As with reading, math is a skill that is essential for success in life. In parallel to reading CBM, math CBM has been developed to assess computation e.g.,
[27], with the majority of research and development focused on the primary school level
[28]. Math CBM is conducted by having students answer computational problems for a certain amount of time (e.g., 2 min;
[29]). When scoring math CBM, usually the number of correct digits is used
[6].
2.4. Biases in Interpreting Progress Data
When teachers use CBM data to judge student achievement, several causes of bias have been discovered. For instance, when progress data are highly variable, teachers find it challenging to predict the rate of progress accurately
[9][12][30]. Ref.
[30] could show that teachers tended to overestimate student progress when data variability was high. Similar results were obtained by
[9][12]. They could show that pre-service teachers tended to overestimate the current trend. This result could be explained by the participants’ proclivity to identify trends in random patterns. Peaks in achievement in progress data with a high level of random variability may imply that those children will perform better than students with the same trend but a lower amount of random variability and hence lower peaks.
2.5. A Gender Bias in CBM
Girls typically outperform boys in reading competency across countries and languages e.g.,
[31][32][33][34][35]. In math, gender differences are also likely to occur. Boys continue to outperform girls in math, with a wider disparity among the highest achievers, despite gender gaps in job market involvement and educational attainment narrowing
[36][37].
Despite the relative advantage of boys in math, several studies in different countries have shown that, on average and across domains, girls outperform boys e.g.,
[37]. Compared to boys, girls are more likely to display high-achieving developmental patterns e.g.,
[38].
Differences between boys and girls in achievement are usually reflected in differences in teachers’ assessment of their achievement
[39]. However, gender-related differences in assessment might also arise from bias that is not based on achievement or skills. Boys’ lower reading proficiency levels and their relatively higher math successes are discussed as being partially the product of a bias due to teachers’ gender stereotypes, which hold that reading is more appropriate for girls than for boys e.g.,
[40], whereas math is better suited for boys than for girls
[35][41]. Gender stereotypes among teachers conform to stereotypes about student motivation and working habits
[42][43].
2.6. Gender Stereotypes as a Source of Gender Bias
Stereotypes can be defined as “shared […] beliefs about traits that are characteristic of members of a social category”
[44] (p. 14). Thus, they are the result of categorizing individuals into groups based on supposed commonality. Stereotypes can serve as norms, affecting expectations and behavior toward members of a particular social group, and as schemas, enhancing social interactions with strangers
[45]. These expectations are activated when a target is classified as belonging to a specific group
[46][47].
According to dual process theories of social judgment e.g.,
[48], people’s evaluations of other people take place along a continuum of two simultaneous processes. On one end of the spectrum, judgments are, quick, effortless, automatic, and based on social categories (e.g., “girl”, “boy”, “immigrant”); on the other end of the spectrum, it is assumed that a slow, laborious, voluntarily initiated process will outweigh and enrich the automatic process by incorporating all pertinent information about the subject of the judgment.
If a person exhibits salient characteristics that are consistent with a certain stereotype, or if the judging person is unsure about the proper interpretation of the other person’s behavior, the use of stereotypical categories becomes more likely
[49][50].
Gender stereotypes in particular cause female students to be seen as less talented than male students in all areas of science, whereas male students are considered inferior to female students in the domain of languages
[51].