WorldCat Identities

Stecher, Brian M.

Works: 134 works in 353 publications in 1 language and 17,624 library holdings
Genres: Case studies 
Roles: Author, Contributor, Editor
Classifications: LB2806.22, 379.154
Publication Timeline
Most widely held works by Brian M Stecher
How to focus an evaluation by Brian M Stecher( Book )

38 editions published between 1987 and 1996 in English and held by 947 WorldCat member libraries worldwide

Making sense of test-based accountability in education( Book )

13 editions published in 2002 in English and held by 333 WorldCat member libraries worldwide

This book was written in response to school policymaking's growing emphasis on testing. During the 1990s, a number of states implemented educational accountability systems that assigned consequences for students, teachers, or schools on the basis of student test scores. The 2001 reauthorization of the Elementary and Secondary Education Act (the "No Child Left Behind NCLB act of 2001") makes such test-based accountability a requirement for all 50 states. The goal of the law is ". . . to ensure that all children have a fair, equal, and significant opportunity to obtain a high-quality education and reach, at a minimum, proficiency on challenging state academic achievement standards and state academic assessments." The purpose of this book is to help educators and educational policymakers understand test-based accountability so they can use it effectively in the service of this goal. States have considerable flexibility in developing their accountability systems, so long as those systems have at their core an appropriate feedback mechanism. Data on student achievement are collected annually and compared with a specific target. Failure to attain the target leads to successively harsher sanctions for schools, including ultimately reconstitution; success leads to recognition and financial rewards. when combined with greater flexibility from federal regulations and parental options to obtain supplemental educational services or move students from less-successful schools, these test-based incentives are supposed to lead to improvement for all schools
The effects of the Washington State education reform on schools and classrooms : initial findings( Book )

12 editions published in 2000 in English and held by 293 WorldCat member libraries worldwide

A number of states are implementing standards-based school accountability systems in efforts to improve student achievement. Washington state's Education Reform Act is an example of such a reform. It mandated the creation of academic standards, called the Essential Academic Learning Requirements (EALRs), a state assessment system, called the Washington Assessment of Student Learning (WASL), and an accountability mechanism, which is still under development. Researchers from RAND and the University of Colorado, Boulder are studying the implementation and impact of the Washington reforms on school and classroom practices, focusing on the subjects of writing and mathematics. The surveys revealed a picture of districts and schools in transition, with many changes occurring but not uniformly across classrooms or schools. Also, not all aspects of the reform were equally salient. Classroom changes appeared to be consistent with the EALRs, although local educators appeared to be responding most to the highly-visible WASL scores and making curriculum changes primarily in the WASL-tested subjects. Classroom-based assessment was not as widely understood or endorsed as the EALRs and WASL. Finally, the surveys paint a mixed picture about the relationship between school practices and WASL scores. On the one hand, after controlling for student background factors, WASL scores were higher in schools where teachers reported alignment between their curriculum and the EALRS and where teachers reported that they understood the EALRs and WASL. some of the responses raised questions about the meaningfulness of WASL scores and score gains as indicators of attainment of the standards. Most teachers believed that test preparation was responsible for the majority of score gains. Many teachers thought that the WASL was not appropriate for the grade levels at which it was administered. These issues deserve further scrutiny as the accountability system is developed
Organizational improvement and accountability : lessons for education from other sectors( Book )

13 editions published between 2003 and 2004 in English and held by 258 WorldCat member libraries worldwide

The No Child Left Behind Act (NCLB) is a performance-based accountability system built around student test results. The accountability system comprises explicit educational goals, assessments for measuring the attainment of goals and judging success, and consequences (rewards or sanctions). But the mechanisms through which the system is intended to work are not well understood. The authors examined five accountability models: two from the manufacturing sector (the Malcolm Baldrige National Quality Award Program and the Toyota Production System (TPS)), a performance incentive model used in the evaluation of job training programs for the poor, accountability in the legal sector, accountability in health care as shown by clinical practice guidelines, use of statistical risk-adjustment methods, and the public reporting of health performance measures. Although education faces unique challenges, the authors conclude that educators can learn much from these other sectors. The Baldrige, TPS, and the clinical practice guidelines suggest the importance of focused institutional self-assessment, understanding school and district operations as a production process, being able to develop and apply a knowledge base about effective practice, and empowering participants in the process to contribute to improvement efforts. The job training and risk-adjustment models and the legal and health care accountability models provide specific guidance on how to enhance system-wide accountability in education by broadening performance measures; making sure performance goals are fair to all students and schools; developing standards of practice in promising areas; and encouraging professional accountability
Improving Perkins II performance measures and standards : lessons learned from early implementers in four states by Rand Corporation( Book )

7 editions published between 1994 and 1995 in English and held by 249 WorldCat member libraries worldwide

The Carl D. Perkins Vocational and Applied Technology Education Act of 1990 required states to develop outcome-based accountability systems built around statewide performance measures and standards. States were given considerable flexibility in selecting outcomes to be measured, the measurement tools, and the standards; their systems were to be in place by the fall of 1992. To assess the progress states have made in the first three years, the authors examined the programs in four states that were among the first to begin implementation. Substantial progress has been made in implementing the measures and standards in these states, although there is wide variation in how they are being implemented. However, as of 1994, little attention had been paid to translating the resulting data into program improvements. Thus, much work remains before the programs function as the lawmakers envisioned. The authors identify a number of factors that reduce the likelihood of state programs functioning as federal lawmakers envision, and the authors suggest specific steps state and federal policymakers should take to improve implementation, including better coordination among accountability requirements in federal and state education and training initiatives
Toward a culture of consequences : performance-based accountability systems for public services by Brian M Stecher( Book )

15 editions published in 2010 in English and Undetermined and held by 235 WorldCat member libraries worldwide

Performance-based accountability systems (PBASs), which link incentives to measured performance as a means of improving services to the public, have gained popularity. While PBASs can vary widely across sectors, they share three main components: goals, incentives, and measures. Research suggests that PBASs influence provider behaviors, but little is known about PBAS effectiveness at achieving their performance goals or about government and agency experiences. This document summarizes a study that examined nine PBASs in five sectors: child care, education, health care, public health emergency preparedness, and transportation. In the right circumstances, a PBAS can be an effective strategy for improving service delivery. Optimum circumstances include having a widely shared goal, unambiguous observable measures, meaningful incentives for those with control over the relevant inputs and processes, few competing interests, and adequate resources to design, implement, and operate the PBAS. However, these conditions are rarely fully realized, so it is difficult to design and implement PBASs that are uniformly effective. PBASs represent a promising policy option for improving the quality of service-delivery activities in many contexts. The evidence supports continued experimentation with and adoption of this approach in appropriate circumstances. Even so, PBAS design and its prospects for success depend on the context in which it will operate. Also, ongoing system evaluation and monitoring are integral components of a PBAS; they inform refinements that improve system functioning over time
Using alternative assessments in vocational education by Brian M Stecher( Book )

7 editions published between 1996 and 1997 in English and Undetermined and held by 194 WorldCat member libraries worldwide

This volume covers a study of the utility of alternative (i.e., non-multiple choice) forms of student assessment for vocational education, the primary objective of which was to describe various alternative assessments currently available and offer criteria for choosing among them. Six operational programs were used as case studies; each employs one or more constructed-response measures, and together they represent a range of assessment options. Each was critically reviewed based on descriptive materials, research literature, interviews, and, in four cases, site visits. The evaluation focused on comparing the different assessments' quality (reliability, validity, fairness), feasibility (cost, time, complexity, credibility), and potential usefulness for vocational educators. Design and implementation issues important to any decisions about using alternative assessments were determined (e.g., the need to clarify the assessment's purpose), as well as related issues (e.g., the relative advantages of low versus high stakes, voluntary versus mandatory participation). Illustrations are given of how vocational educators can use this review as an aid in determining the usefulness of the alternatives for a particular situation
Pain and gain : implementing No Child Left Behind in three states, 2004-2006( Book )

5 editions published in 2008 in English and held by 182 WorldCat member libraries worldwide

The Implementing Standards-Based Accountability "ISBA" study was designed to examine the strategies that states, districts, and schools are using to implement standards-based accountability under the No Child Left Behind Act "NCLB" and how these strategies are associated with classroom practices and student achievement in mathematics and science. This monograph presents the final results of the ISBA project. It contains descriptive information regarding the implementation of NCLB in California, Georgia, and Pennsylvania from 2003-2004 through 2005-2006. It is a companion to MG-589-NSF, Standards-Based Accountability Under No Child Left Behind "2007", and updates those findings with an additional year of data, permitting further analyses of state-to-state differences and longer-term trends. This study suggests that school improvement efforts might be more effective if they were responsive to local conditions and customized to address the specific causes of failure and the capacity of the schools in question
Performance assessments in science : hands-on tasks and scoring guides by Brian M Stecher( Book )

6 editions published in 1996 in English and held by 171 WorldCat member libraries worldwide

In 1992, rand received a grant from the National Science Foundation to study the technical quality of performance assessments in science and to evaluate their feasibility for use in large-scale testing programs. The specific goals of the project were to assess the reliability and validity of hands-on science testing and to investigate the cost and practicality of these types of measures for large-scale assessment. The purpose of this monograph is to make the science tasks and scoring guides developed as part of the project available to other researchers and educational practitioners. This collection of measures is designed to provide researchers with a basic set of tasks they can build upon when studying student performance in science and investigating alternative approaches to science assessment. For this reason, information is reported about the conditions under which the tasks were administered and the reliability of the scoring guides (inter-reader correlations). The tasks should also be useful to practitioners in their discussions about measuring student performance in science, the types of activities that may be used in future state and national assessment systems, and the changes that need to take place in staff development. The document contains a complete description of each task used in the study, including the shell (or testing blueprint) from which the task was developed and copies or photos of the task booklet, the materials or apparatus that accompanied the task, the scoring guide, and the form used to record scores. The task topics studied include incline, force, friction, pendulum, lever, classification of animals, classification of materials, acids and bases--vinegar, acids and bases--alien, radiation, rate of cooling, heat, temperature, erosion and pollution. Contains nine tables and nine references. (Author/MVL)
Issues in building an indicator system for mathematics and science education by Brian M Stecher( Book )

4 editions published in 1996 in English and held by 164 WorldCat member libraries worldwide

In recent years, policymakers have shown renewed interest in the development of educational indicators hoping that specific quantitative indices will help them monitor the status of the educational system, understand its failures and successes, and build more effective remedies for perceived problems. This document is the final report of a study of the feasibility of developing a patchwork indicator system for science and mathematics education based on existing data sources covering achievement, secondary curriculum, and teacher workforce. This report summarizes the results of the patchwork exercise and offers recommendations for improving mathematics and science indicators. Contains 70 references. (Mkr)
Reauthorizing No Child Left Behind : facts and recommendations by Brian M Stecher( Book )

9 editions published in 2010 in English and Undetermined and held by 151 WorldCat member libraries worldwide

This report synthesizes findings and draws lessons about the implementation and results of the "No Child Left Behind Act of 2001" ("nclb") based primarily on two longitudinal studies funded by the U.S. Department of Education. Progress to date suggests that "NCLB's" ambitious goal of having 100 percent of U.S. students proficient in reading and mathematics by 2014 will not be met. In addition, the flexibility provided to states by the law has resulted in the establishment of a different accountability system in every state, each with different academic standards, levels of student proficiency, and teacher requirements. Parents have not responded in great numbers either to school choice or to receiving supplemental educational services options. Should Congress reauthorize "nclb", the authors recommend that it consider making the following changes to the law: promote more-uniform academic standards and teacher qualification requirements across states, set more-appropriate improvement targets, broaden the measures of student learning beyond multiple-choice tests in reading and mathematics to include more subjects and tests of higher-thinking and problem-solving skills, focus improvement efforts on all schools while continuing to offer parental choice, and provide incentives for highly qualified teachers to teach in low-performing schools. Appendices include: (1) Data Sources for This Report; and (2) Abstracts of Reports. Individual chapters contain footnotes. (Contains 1 figure.) [This paper was written with Paul Steinberg. This paper was prepared for the U.S. Department of Education. For the companion report, "What Can We Learn from the Implementation of "No Child Left Behind"? Research Brief", see ed509398.]
Working smarter to leave no child behind : practical insights for school leaders by Brian M Stecher( Book )

3 editions published in 2003 in English and held by 126 WorldCat member libraries worldwide

Accountability based on student test results is the heart of the No Child Left Behind Act, which assumes that schools can solve their problems if given proper incentives and technical assistance, and that parents should have educational alternatives if the schools fail to do so. This paper discusses evidence on accountability systems, describes the act's accountability model and its underlying assumptions, and offers educators specific recommendations for effective operation in an era of accountability
Profile of the Santa Monica-Malibu Unified School District by Brian M Stecher( Book )

4 editions published in 2000 in English and held by 123 WorldCat member libraries worldwide

This briefing, prepared in response to a request from a Santa Monica citizens' group, uses publicly available data to describe important features of the Santa Monica-Malibu Unified School District (SM-MUSD) in comparison to three sets of districts: (1) five districts similar to SM-MUSD in total enrollment and student demographics, (2) four districts with the highest student test scores in the state, and (3) the average from Los Angeles County as a whole. It finds that SM-MUSD has similar resources and uses them similarly to the districts identified as most comparable, and that SM-MUSD students are doing well in comparison to students in these districts, although they lag behind students in the highest-achieving districts in the state. The analysis found no serious shortcomings or deficiencies. The greatest limitation of this profile is the lack of data on the district's instructional program and an emphasis on quantity rather than quality. Although the state does not collect data to fill these gaps, such information could be gathered by motivated districts or communities
External audiences for test-based accountability : the perspectives of journalists and foundations by Laura S Hamilton( Book )

5 editions published in 2004 in English and held by 119 WorldCat member libraries worldwide

The No Child Left Behind Act (NCLB) requires states to adopt test-based accountability systems designed to promote improved achievement by setting clear goals for student learning, measuring students' progress toward those goals, and holding educators accountable for this progress through the dissemination of results and the imposition of rewards, sanctions, and assistance. Although much has been written about the law, little has been written about the interaction of NCLB with external audiences that do not have formal connections with the schools. This study focuses on two key external audiences that are involved in public education and that frequently use data from schools and districts in their work--print journalists and foundation program officers. The authors use insights from conversations with journalists and program officers to identify ways to improve the utility of information from test-based accountability systems. They summarize the data needs of the two groups and the problems they encounter when trying to interpret test results and offer advice to the producers of performance reports and analyses (states, school districts, and researchers) and to the external consumers of those reports (journalists and program officers) on how to enhance the utility of the information
Local accountability in vocational education : a theoretical model and its limitations in practice by Brian M Stecher( Book )

7 editions published in 1992 in English and held by 117 WorldCat member libraries worldwide

A study sought to determine the extent to which local accountability systems exist in vocational education and to describe the nature of the underlying relationships between such programs and their constituents. Data were collected through interviews from two local vocational education programs in each of five states (California, Florida, Michigan, Ohio, and Oklahoma) and their state departments of education. Four major conclusions were reached: (1) there is widespread evidence of functioning local accountability systems in vocational programs; (2) these systems can be described in terms of goals, measures, information feedback loops, and change mechanisms and the relationships between those components; (3) the quality of these components and the relationships between them account for much of the variation in local accountability systems and limitations in the components interfere with the overall effectiveness of the accountability system; and (4) many practical constraints that reduce the effectiveness of the components in local systems can be identified. Examples of the practical constraints included: (1) goals that were ineffective because they were so broad or vague that it was difficult to know when they were achieved, goals that were not supported by relevant constituencies, and no stated priorities among goals; (2) measures that were ineffective because they were not consonant with or sufficient to encompass goals, of adequate technical quality, or not meaningful to constituents; and (3) feedback that is deficient because of insufficient communication, inaccurate communication, or a high rate of communication with very little useful content. (CML)
Analyzing the operation of performance-based accountability systems for public services by Frank A Camm( Book )

10 editions published in 2010 in English and held by 111 WorldCat member libraries worldwide

Empirical evidence of the effects of performance-based public management is scarce. This report describes a framework used to organize available empirical information on one form of performance-based management, a performance-based accountability system (PBAS). Such a system identifies individuals or organizations that must change their behavior for the performance of an activity to improve, chooses an implicit or explicit incentive structure to motivate these organizations or individuals to change, and then chooses performance measures tailored to inform the incentive structure appropriately. The study focused on systems in the child-care, education, health-care, public health emergency preparedness, and transportation sectors, mainly in the United States. Analysts could use this framework to seek empirical information in other sectors and other parts of the world. Additional empirical information could help refine existing PBASs and, more broadly, improve decisions on where to initiate new PBASs, how to implement them, and then how to design, manage, and refine them over time
Competency-based education in three pilot programs : examining implementation and outcomes by Jennifer L Steele( Book )

2 editions published in 2014 in English and held by 101 WorldCat member libraries worldwide

"In 2011, the Bill & Melinda Gates Foundation created the Project Mastery grant program to support competency-based education initiatives in large school systems that serve a high proportion of disadvantaged youth. Competency-based education meets students where they are academically, provides students with opportunities for choice, and awards credit for evidence of learning, not for the time students spend studying a subject. The Foundation asked RAND to evaluate these efforts in terms of implementation, students' experiences, and student performance. This report presents final results from that evaluation, offering an overview of competency-based education and the Project Mastery grant projects and describing the implementation of competency-based educational features under each project. The report concludes with six lessons for policy, partnerships, and practice."--"Abstract" on web page
Measuring hard-to-measure student competencies : a research and development plan by Brian M Stecher( Book )

2 editions published in 2014 in English and held by 95 WorldCat member libraries worldwide

Efforts to prepare students for college, careers, and civic engagement have traditionally emphasized academic skills, but a growing body of research suggests that interpersonal and intrapersonal competencies, such as communication and resilience, are important predictors of postsecondary success and citizenship. One of the major challenges in designing educational interventions to support these outcomes is a lack of high-quality measures that could help educators, students, parents, and others understand how students perform and monitor their development over time. This report provides guidelines to promote thoughtful development of practical, high-quality measures of interpersonal and intrapersonal competencies that practitioners and policymakers can use to improve valued outcomes for students
Deregulating school aid in California : How districts responded to flexibility in Tier 3 categorical funds in 2010-2011( Book )

2 editions published in 2012 in English and held by 88 WorldCat member libraries worldwide

California's system of school finance is highly regulated and prescriptive. A large share of state funding is allocated through categorical programs, that is, programs whose funding is contingent upon districts using the money in a particular way or for a particular purpose. In 2008-09, the strings were taken off 40 of those programs, collectively known as the Tier 3 programs, as part of a budget deal that also reduced the funding for those programs. The authors conducted a survey of 350 California school district chief financial officers (CFOs) between April and August of 2011 to see how district leaders responded to this sudden, limited fiscal flexibility and the conditions that shaped their decisions
moreShow More Titles
fewerShow Fewer Titles
Audience Level
Audience Level
  Kids General Special  
Audience level: 0.38 (from 0.02 for Toward a c ... to 0.62 for Profile of ...)

How to focus an evaluation
Alternative Names
Stecher, Brian.

Stecher, Brian 1946-

English (161)

Making sense of test-based accountability in educationOrganizational improvement and accountability : lessons for education from other sectorsImproving Perkins II performance measures and standards : lessons learned from early implementers in four statesToward a culture of consequences : performance-based accountability systems for public servicesUsing alternative assessments in vocational educationPain and gain : implementing No Child Left Behind in three states, 2004-2006Performance assessments in science : hands-on tasks and scoring guidesIssues in building an indicator system for mathematics and science education