ArticlePDF Available

Rethinking Scale: Moving Beyond Numbers to Deep and Lasting Change

Authors:

Abstract

The issue of “scale” is a key challenge for school reform, yet it remains undertheorized in the literature. Definitions of scale have traditionally restricted its scope, focusing on the expanding number of schools reached by a reform. Such definitions mask the complex challenges of reaching out broadly while simultaneously cultivating the depth of change necessary to support and sustain consequential change. This article draws on a review of theoretical and empirical literature on scale, relevant research on reform implementation, and original research to synthesize and articulate a more multidimensional conceptualization. I develop a conception of scale that has four interrelated dimensions: depth, sustainability, spread, and shift in reform ownership. I then suggest implications of this conceptualization for reform strategy and research design.
Arkansas Leadership Academy, Adapted June 2006
RETHINKING SCALE: MOVING BEYOND NUMBERS TO DEEP AND LASTING CHANGE
Cynthia E. Coburn
Educational Researcher
August/September 2003, Vol. 32, No. 6, pp. 3-12
OVERVIEW
! Four interrelated dimensions of scale: depth, sustainability, spread and transfer of
ownership are filters through which leaders should view change. The goal is not simply
change, but lasting change.
1. Depth: Nature of change
! Does the change go deep into the organization’s beliefs?
! Individual beliefs?
! Does the change have an impact on the classroom or is it simply a surface
change?
! Who is responsible for the change?
2. Sustainability: Endurance over time
! How long will the change endure?
! What strategies are in place to assure sustainability of the change?
3. Spread: Norms, principles, beliefs understood by greater numbers of people
! How widespread is the change?
! Who is involved in the change?
! Who should be involved?
! Who will benefit from the change?
4. Ownership: Shifts in reform ownership (knowledge and authority) to implementers
! Who “owns” the process?
Arkansas Leadership Academy, Adapted June 2006
APPLICATION OF RETHINKING SCALE TO EDUCATION REFORM EFFORTS
TO CHANGE CLASSROOM PRACTICES
! Depth
Deep change…change that goes beyond surface structures or procedures (such as changes
in materials, classroom organization…) to alter teachers’ beliefs, norms of social interaction,
and pedagogical principles as enacted in the curriculum. By teachers’ beliefs (we mean)
underlying assumptions about how students learn, the nature of subject matter,
expectations for students, or what constitutes effective instruction. Capturing depth may
require in-depth interviewing and classroom observation, refocused on such indicators as
the nature of instructional tasks, discourse patterns in the classroom, and teachers’
conceptions of knowledge and learning…systematic collection of student work samples…use
of teacher logs.
! Sustainability
The concept of scale has meaning over time. The distribution and adoption of an innovation
are only significant if its use can be sustained in original and even subsequent schools.
Schools that successfully implement reforms find it difficult to sustain them in the face of
competing priorities, changing demands, and teacher and administrator turnover.
Externally-developed school reforms may be especially vulnerable to this problem because
implementation typically involves a short-term influx of resources, professional
development, and other forms of assistance to facilitate implementation that dissipates over
time as external developers turn their attention to other sites. (We need) strategies for
providing schools with the tools they will need to sustain the reform, especially after the
initial influx of resources dissipates. Because classrooms are situated in and inextricably
linked to the broader school and system, teachers are better able to sustain change when
there are mechanisms in place at multiple levels of the system to support their efforts. We
know a lot about challenges to sustainability in the early year of reform. But how do these
challenges different as reforms mature and initial energy, personnel, and funding dissipate?
Arkansas Leadership Academy, Adapted June 2006
Spread (Breadth)
Spreading of reform to greater numbers of classrooms and schools…must involve the spread
of underlying beliefs, norms and principles. Spread at the school level not only involves the
reform moving to more and more classrooms, but also reform principles or norms of social
interaction becoming embedded in school policy and routines. This type of spread may be
especially important for reforms that challenge conventional or institutionalized approaches
to teaching and learning in significant ways. Recasting spread to include spread of norms
and principles within suggests that the district’s role may be important beyond the support
it provides to schools…the district may be a strategic site for spread itself…creating
knowledgeable leaders who can influence policy, procedures, professional development and
values.
! Ownership
…buy-in or acceptance (is different from) a shift in knowledge of and authority for the
reform. If the leader is the only one who owns the change, it is unlikely that it will be
sustained past the leader’s tenure. It is the old notion that people will support what they
help to create. As the change process progresses, it is important that ownership for the
change transfer to those who must implement it. With the shift in ownership, analysis of the
change process would also shift to the implementers of change. One of the key
components of taking a reform to scale, them, is creating conditions to shift authority and
knowledge of the reform from external actors to teachers, schools, and districts.
Development of the capacity to provide reform-related professional development or other
structures for ongoing teacher and administrator learning may be a central feature for
shifting authority and ownership for the reform. Shift in reform ownership also requires
transferring substantive and strategic decision-making from the reform organization to
district and school leaders. This shift requires that reformers cultivate deep, reform-
centered knowledge among key leadership and model ways to draw upon that knowledge in
ongoing decision-making. Shift in ownership may require that schools and districts develop
Arkansas Leadership Academy, Adapted June 2006
the capacity to generate continued funding for reforms. Shift in reform ownership may be a
central element in sustaining and spreading reform in the face of shifting priorities, changes
in funding, and challenges to policy coherence. Placing reform ownership as a central
element of scale raises the priority for directing reform attention and resources to strategies
that have the potential for enabling schools and districts to assume ownership for the
reform over time. The more challenging a reform is to a teachers’ existing beliefs and
practices, or the more aspects of classroom practice or levels of the system it engages, the
more it may need well-elaborated materials and sustained, ongoing professional
development to achieve depth. Reforms of this nature may require more effort on the part
of reformers to work with multiple levels of the system to encourage normative coherence
and sustainability. The more ambitious the reform, the more challenging it may be to
simultaneously achieve spread, sustainability and depth.
... Institutional acceptance and routine develop when collaborative structures are established [18]. As an indicator of success, Coburn [25] specifies: ...
... • spread (i.e., quantitative dissemination), • depth (shift of persuasion and pedagogical attitudes), • sustainability and shift in reform ownership (i.e., identification), both supporting long-term intrinsic motivation [19,25]. ...
... In line with the identified challenges when implementing new approaches in schools [16,27,28], which have also been reported recently for the introduction of BLS lessons [11][12][13]29], a closer examination behind the curtains seems expedient. As usual in design research, and as postulated by Coburn [25], a qualitative analysis and dialogue with practitioners is the method-of-choice to differentiate the content of existing quantitative findings and add in-depth information. ...
Article
Full-text available
This qualitative study aims to analyse the personal qualification, attitudes and the pedagogical concepts of German teachers as experts in their profession regarding basic life support (BLS) education in secondary schools. Thirteen (n = 13) secondary school teachers participated in semi-structured expert interviews and were interviewed for at least 20 to 60 min regarding BLS student education. Interviews were semi-structured with guiding questions addressing (1) personal experience, (2) teacher qualification for BLS and (3) implementation factors (e.g., personal, material and organisational). Audio-recorded interviews were analysed by content analysis, generating a coding system. School teachers provided a heterogeneous view on implementation-related processes in BLS education. Many teachers were educated in first aid, acknowledge its importance, but had no experience in teaching BLS. They want to assure being competent for teaching BLS and need tailored trainings, materials, pedagogical information and the incorporation into the curriculum. Also, the management of time constraints, unwilling colleagues, or young students being overwhelmed were commonly mentioned considerations. Concluding, teachers reported to be willing to teach BLS but a stepwise implementation framework incorporating practice-oriented qualification and educational goals is missing.
... To accomplish change at scale-a favorite word, I know, of the ed-tech imaginary-the movement against online proctoring can address the depth of educators' beliefs and practices; the sustainability of changes over time; the spread of changes throughout an institution; and a shift in ownership over the new ideas from external to internal sources (Coburn 2003). Remember that changing an individual's understanding requires resources and support (Spillane et al. 2002). ...
... Combine these additional resources and support with the elements for achieving deep change at scale (Coburn 2003), and the project of ridding online proctoring from campuses appears daunting. ...
... At the same time, the Office of the Provost and deans decided to publicly oppose online proctoring, and though the administrators did not ban the technology, they did strongly recommend faculty not use it (Silverman et al. 2021). In the months that followed, the staff at the Hub for Teaching and Learning Resources (the Hub) worked to implement the reform through a combination of depth, sustainability, spread, and shift (Coburn 2003). See Figure 2 for how the University tried to accomplish the different dimensions of reform implementation. ...
Article
Full-text available
A future with ubiquitous academic surveillance is not sealed, not yet. In this essay, I discuss how online proctoring companies sell their technology with stories inspired by the ed-tech imaginary. Educators and higher education institutions, in turn, often repeat these narratives, as evidenced by the ways the technology is framed as a neutral, familiar tool for facilitating assessments. I propose a possible path toward abolishing online proctoring by authoring counter-narratives. I identify two spaces for constructing counter-narratives. First, we can apply a cognitive perspective to policy implementation to shift individual educators’ understanding of online proctoring through dissonance-producing institutional resources. Second, we can build collective partnerships between administrators, staff, faculty, and students to achieve deep change in our assessment practices. This potential path forward is guided by dual commitments: to reject online proctoring and the intersectional harms endured by students forced to use the technology; and to uproot the underlying pedagogies of policing and punishment that support online proctoring and replace them with pedagogies of educational dignity. I end my essay with a call to adopt an abolitionist approach to ridding education of online proctoring. By exercising abolitionist principles of refusal and care, along with a rejection of reform as an acceptable middle ground, we can move closer to creating the kinds of learning environments and relationships that cultivate students’ educational dignity.
... While there has been increasing consensus about what characterizes highquality mathematics teaching (Hiebert & Grouws, 2007), school systems all over the world still work hard to develop strategies and structures to implement instructional approaches for high-quality teaching into large numbers of classrooms (Ahl et al., 2023;Coburn, 2003;Century & Cassata, 2016;Maaß et al., 2019;. A recent review on implementation research in mathematics education outlined that current publications have been dominated by qualitative case studies on teachers' reform enactment or effectiveness studies, whereas "planning and design aspects of such projects were rarely reported" (Ahl et al., 2023, p. 2). ...
... (1) program coherence in a shared vision of high-quality teaching (Cobb & Jackson, 2021) and (2) openness for context-specific adaptations (Morony, 2023). Whereas early conceptualizations of implementation tended to favor top-down approaches from research towards practice, evaluated in terms of implementation fidelity (as historically described in Century & Cassata, 2016), more recent conceptualizations have emphasized the needed shift in reform ownership (Coburn, 2003) and necessary adaptation processes by all stakeholders (Penuel & Fishman, 2012;. In particular, the 4 10.1163/26670127-bja10020 | Prediger AND Selter Implementation and Replication Studies in Mathematics Education (2024) 1-35 discourse on implementation research, even in countries beyond Germany (Ahl et al., 2023). ...
... One first step of (1) constructing agency over the innovation (Coburn, 2003) is that all actors (teachers, facilitators, state leaders, PD module designers, and educational authorities) need to gain agency over these five principles by appropriating them for their work and interpreting them within a shared vision, but with flexibility for different contexts. For these processes, we have developed structures in our implementation architecture on several levels (Figures 1 and 2) to stimulate reflection and cooperation in participant-oriented and competence-oriented manners. ...
Article
Full-text available
Large-scale implementation programs for mathematics education innovations should combine several implementation strategies and span over several levels: the mathematics classroom level, the teacher professional development ( PD ) level, and the facilitator PD level, as well as over the systemic contexts on each of these levels. In this paper, we present the strategies and program architecture of the German nationwide 10-year implementation program QuaMath, which aims at developing the quality of mathematics classrooms and teacher PD in cooperation with the federal states, 400 PD facilitators, and, prospectively, 10000 schools. Given the spread of intended implementation and the depth of the targeted instructional innovations, we also outline the general philosophy of establishing shared visions with all stakeholders and support their productive adaptations at the same time. This philosophy also underpins the planned implementation design research in the program. The impact sheet to this article can be accessed at 10.6084/m9.figshare.25507138 .
... One dimension of scale is that of spread (Coburn, 2003), and in the context of intervention research, one question often lingers: Will the practices of an intervention endure once the program has ended? Interview data revealed that in fact the teacher moves discussed promote spread over time and across contexts. ...
Article
Full-text available
This mixed-methods study explores the relationship between early elementary students’ domain-specific vocabulary knowledge and their ability to comprehend grade-level reading passages on unfamiliar science topics. Specifically, this study used (a) structural equation modeling (SEM) to examine the extent to which students’ networks of domain-specific vocabulary knowledge in Grades 1 and 2 mediated the effects of a Tier 1 content-based literacy intervention on domain-specific reading comprehension scores in Grade 2 (N = 2,156); and (b) quantitative survey and qualitative interview data from teachers (N = 48) to surface new themes about teacher vocabulary instruction that might suggest potential explanations for the SEM findings. SEM analysis revealed that students’ domain-specific vocabulary knowledge in first and second grade explained 69% of the treatment effect on a domain-specific reading comprehension outcome. Results from the quantitative survey also indicated that treatment group teachers reported providing more incidental exposures to vocabulary than control teachers (effect size = .54), and qualitative analyses revealed that teachers with high incidental exposures tended to provide expanded opportunities for their students to engage with words and to connect words to topics. Findings from this mixed-method study paint a more complete picture of (a) the important role domain-specific vocabulary knowledge plays in facilitating reading comprehension transfer in the domain of science, and (b) what teachers do during vocabulary instruction to promote transfer in domain-specific reading comprehension.
Chapter
Improving a country’s high-quality talent requires a strong educational foundation for children and youth. Globally, science, technology, engineering, and mathematics (STEM) education is viewed as essential for preparing students to compete in the economy of the twenty-first century and has become the driving-force behind many educational movements (Akcan et al., 2023; Blackley & Howell, 2015; Freeman et al., 2019). Be aware, STEM is not a separate education reform movement from other science education reform efforts; rather, it is an emphasis that stresses a multidisciplinary approach for better preparing all students in STEM subject areas and increasing the number of post-secondary graduates who are prepared for STEM occupations (Conference Board of Canada, 2013; National Research Council (U.S.A), 2013). STEM education reforms vary globally as not all reform efforts use similar strategies or have similar goals (Freeman et al., 2019; Mudaly & Chirikure, 2023; Wilson, 2013). Some occur through top-down approaches and are in response to policy and often impose changes on classroom teachers, leading to failed reform efforts (Coburn, 2003).
Chapter
New realities of the twenty-first century demand individuals with different competencies than those considered appropriate for success in the past. Enhancing scientific literacy and preparing students with global workforce skills to ensure successful careers in STEM fields will require new approaches to teaching STEM topics in K-12 classrooms, given that STEM education is an important aspect in K-12 teaching and learning. Therefore, curriculum should aim to engage best practices for incorporating integrative STEM education across science, technology, and mathematics subjects at the K-12 levels. Identifying effective strategies to ensure continuity and supports necessary for successful transition from elementary to specialized high school STEM courses and subsequent post-secondary pathways is warranted. Educators need to consider how to develop applied and transferable STEM skills such as creativity, innovativeness, opportunity identification, cultural awareness, collaboration, and problem solving. Challenging students to solve real world problems using approaches such as project-based learning, case studies, inquiry, engineering design, integrating digital technologies to extend learning, computational thinking, science and language instruction, and culturally relevant pedagogies have potential to enhance learning and academic achievement of all students in STEM education. Curriculum reform must be accompanied by sustained and effective professional development for teachers focusing on integrative STEM education in order to prepare students for success in STEM.
Chapter
In this book we outline and stress the importance of STEM education as it is critical to and supportive of many education reforms being undertaken today, from adoption of international standards to better teacher preparation, to enhanced coordination across the entire K–12 education system. Moreover, STEM education is linked to economic prosperity and thus requiring students to have a strong education foundation for competing in the economy of the twenty-first century and beyond; an imperative to train and prepare a diverse STEM-literate workforce with the capability to understand and comprehend global STEM challenges (Merchant & Khanbilvardi, 2011). A major goal of the STEM agenda is to improve the proficiency of all students in STEM, regardless of whether they choose to pursue STEM careers or post-secondary studies, while fostering 21st century skills identified as being crucial for success. In Canada and other jurisdictions, such as Ireland (Department of Education and Skills, 2017), STEM education policy development (DeCoito, 2016) highlight the important of policy priorities for schools (detailed in Chap. 6). We believe that STEM education policy development should be a priority for future educational reforms in order to provide a conceptual framework for schools that can be used for curriculum planning and pedagogical supports for STEM integration.
Article
This article aims to contribute to the body of knowledge developed by mathematics education research on the implementation of innovative TPD devices, i.e. organized systems of arrangements for professional development of mathematics teachers, that emphasize their collaborative work and have a strong bottom-up dimension, as well as to the development of analysis and modelling tools to guide and report on such research. More specifically, drawing on the systemic, institutional and ecological perspective of the anthropological theory of the didactic, we study the dynamics of implementation of such a device, which appeared in France in 2017, paying particular attention to the role played by institutional networks in its dynamics. To do this, we use concepts from the theory of hypergraphs and show their usefulness for modelling the dynamics at stake, a usefulness which, we assume, is not limited to this case study. The impact sheet to this article can be accessed at 10.6084/m9.figshare.25507258 .
Article
Full-text available
Education policy faces a familiar public policy challenge: Local implementation is difficult. In this article we develop a cognitive framework to characterize sense-making in the implementation process that is especially relevant for recent education policy initiatives, such as standards-based reforms that press for tremendous changes in classroom instruction. From a cognitive perspective, a key dimension of the implementation process is whether, and in what ways, implementing agents come to understand their practice, potentially changing their beliefs and attitudes in the process. We draw on theoretical and empirical literature to develop a cognitive perspective on implementation. We review the contribution of cognitive science frames to implementation research and identify areas where cognitive science can make additional contributions.
Article
Full-text available
Recent research on the relationship between instructional policy and classroom practice suggests that teachers interpret, adapt, and even transform policies as they put them into place. This paper extends this line of research, using an in-depth case study of one California elementary school to examine the processes by which teachers construct and reconstruct multiple policy messages about reading instruction in the context of their professional communities. Drawing primarily on institutional and sensemaking theory, this paper puts forth a model of collective sensemaking that focuses on the ways teachers co-construct understandings of policy messages, make decisions about which messages to pursue in their classrooms, and negotiate the technical and practical details of implementation in conversations with their colleagues. It also argues that the nature and structure of formal networks and informal alliances among teachers shape the process, with implications for ways in which messages from the policy environment influence classroom practice. Finally, the paper explores the role school leaders play in shaping the sensemaking process.
Article
Full-text available
Success for All (SFA) is a whole-school reform model that organizes resources to focus on prevention and early intervention to ensure that students succeed in reading throughout the elementary grades. In this article we use qualitative data gathered in extensive interviews and observations in two SFA schools to examine how teachers respond to SFA and how their beliefs, experiences, and programmatic adaptations influence implementation. We found that teachers fell into four distinct categories ranging from strong support for SFA to resistance. Support for the reform did not directly correlate with teachers' personal characteristics such as experience level, gender, or ethnic background. Moreover, teachers' levels of support for SFA did not necessarily predict the degree of fidelity with which they implemented it. Almost all teachers made adaptations to the program, in spite of the developers' demands to closely follow the model. Teachers supported the continued implementation of SFA because they believed it was beneficial for students. At the same time many teachers felt that the program constrained their autonomy and creativity. Implications of this study for the future successful implementation of SFA and other externally developed reform models are discussed.
Article
In recent years national, state, and local education reformers have paid increasing attention to two ideas about school reform. The first centers on ensuring more ambitious instruction for all students. The second has to do with crafting more coherent and closely aligned policies to support this ambitious instruction. This article explores these two popular reform ideas from the perspective of classroom teaching. We examine nine elementary school teachers’ responses to their local school district's efforts to press more ambitious ideas about literacy instruction. We argue that although the policy alignment strategy may be effective in changing surface-level aspects of teaching, it may be considerably less effective in reforming other difficult-to-reach dimensions of classroom practice (i.e., task and discourse). Further, we highlight the difficulties involved in figuring out the extent to which these recent reforms find their way into classroom practice.
Article
This article focuses on mathematical tasks as important vehicles for building student capacity for mathematical thinking and reasoning. A stratified random sample of 144 mathematical tasks used during reform-oriented instruction was analyzed in terms of (a) task features (number of solution strategies, number and kind of representations, and communication requirements) and (b) cognitive demands (e.g., memorization, the use of procedures with [and without] connections to concepts, the “doing of mathematics”). The findings suggest that teachers were selecting and setting up the kinds of tasks that reformers argue should lead to the development of students’ thinking capacities. During task implementation, the task features tended to remain consistent with how they were set up, but the cognitive demands of high-level tasks had a tendency to decline. The ways in which high-level tasks declined as well as factors associated with task changes from the set-up to implementation phase were explored.
Article
School improvement efforts often create controversies and conflicts that can make success difficult if not impossible to achieve. This article suggests that differences in the theories of action held by different people and organizations involved in reform efforts may be a critical source of these conflicts. An analysis of the first 2 years of the ATLAS Communities Project - a collaboration of the Coalition of Essential Schools, Education Development Center, Harvard Project Zero, and the School Development Program - shows how differences in the theories of action of these organizations contributed to significant disagreements over a number of key issues related to the process of change, the nature of the curriculum, and the shape of personal and organizational development. As a result, despite considerable funding, broad initial agreements, and good relationships at the highest levels, it was extremely difficult to make decisions and carry work out in a collaborative and efficient manner.
Article
IF; A longitudinal study of teachers in four districts across the state of Texas, we used a survey, interviews, and observations to examine changes in teacher practices related to the adoption of the new literature-based basal reader programs. Through surveys we collected the views of over 250 teachers statewide and focused on 14 teachers for a mon in-depth examination. We present our results in two stages: Year 1 was the baseline year before the adoption of the new programs, and Year 2 was the first year of the adoption. The survey and interview data suggested that in Year 1 almost all teachers were satisfied with the quality of instruction they provided students and had not made significant program modifications. However, we found major differences in teachers' practices; these differences were displayed on a continuum from those who did not use a basal but developed their own literature units, to those who used the basal including the teachers' manuals, to those who supplemented the basal with additional skills instruction, to the teacher who used only skills worksheets. In Year 2, we found some adjustments in practices. Some teachers did nor use the new basal at all, continuing in their literature only or skills only programs. Some teachers adopted the new basal with new methods of instruction; others adopted the new basal, but imported their old instructional methods; still others continued to use the old basals. We found that teachers' epistemological orientations were determining factors in how they responded to changes in teaching contest and how they adapted their practices to the new programs. Using Belenky et, al's (1988) ways of knowing framework, we found that most teachers worked within the same epistemological framework in Years 1 and 2. Additionally, we found that there was little staff development in any of the districts to support teachers' implementations of the new programs.
Article
In 1991, the New;eu American Schools Development Corporation (NASDC) was created in order to create "break-the-mold" models for a "new, generation of American schools". NASDC sought to achieve this goal by funding eleven different design teams including the ATLAS Communities Project-a collaboration of the Coalition of Essential Schools, the School Development Program, Harvard Project Zero, and the Education Development Center While schools associated with ATLAS and the other design teams showed some signs of progress In the first few years of their work, there has been little evidence that these positive outcomes have been achieved by "breaking the mold." In fact, the NASDC strategy and the ATLAS collaboration may have exacerbated basic renditions that make it difficult for schools and organizations to explore new ideas and develop innovative practices. By drawing on studies of innovation in business organizations, this paper argues that rather than trying to create "break-the-mold" school designs, reformers should aim to create the conditions that allow for a better balance between efforts to explore new ideas that may be successful in the future and the further expansion of practice that have been successful In the past.