Foundations of Program Evaluation heralds a thorough exploration of the field of program evaluation--looking back on its origins. By summarizing, comparing, and contrasting the work of seven major theorists of program evaluation, this book provides an important perspective on the current state of evaluation theory and provides suggestions for ways of improving its practice. Beginning in Chapter Two, the authors develop a conceptual framework to analyze how successfully each theory meets the specific criteria of its framework. Each subsequent chapter is devoted to the presentation of the theoretical and practical advice of a significant theorist--Michael Scriven, Donald Campbell, Carol Weiss, Joseph Wholey, Robert Stake, Lee Cronbach, and Peter Rossi.
First published in 1994, this text is designed to be used by graduate-level social work students in courses on evaluation and program design. Over the course of 20 years and 6 editions, the goals of the book have remained the same: to prepare students to participate in evaluative activitieswithin their organizations; to prepare students to become critical producers and consumers of professional evaluative literature; and to prepare students for more advanced evaluation courses and texts. Grinnell, Gabor, and Unrau aim to meet these objectives by presenting a unique approach that isrealistic, practical, applied, and user-friendly. While a majority of textbooks focus on program-level evaluation, some recent books present case-level evaluation methods but rely on inferentially powerful -- but difficult-to-implement -- experimental baseline designs. This text assumes that neitherof these approaches adequately reflects the realities of the field or the needs of students and beginning practitioners. Instead, Program Evaluation for Social Workers offers a blend of the two that demonstrates how they can complement one another. The integration of case-level and program-levelapproaches provides an accessible, adaptable, and realistic framework for students to more easily grasp and implement in the real-world.
Core Concepts and Examples for Discussion and Analysis
Author: Dean T. Spaulding
Publisher: John Wiley & Sons
An updated guide to the core concepts of program evaluation This updated edition of Program Evaluation in Practice covers the core concepts of program evaluation and uses case studies to touch on real-world issues that arise when conducting an evaluation project. This important resource is filled with illustrative examples written in accessible terms and provides a wide variety of evaluation projects that can be used for discussion, analysis, and reflection. The book addresses foundations and theories of evaluation, tools and methods for collecting data, writing of reports, and the sharing of findings. The discussion questions and class activities at the end of each chapter are designed to help process the information in that chapter and to integrate the information from the other chapters, thus facilitating the learning process. As useful for students as it is for evaluators in training, Program Evaluation in Practice is a must-have text for those aspiring to be effective evaluators. Includes expanded discussion of basic theories and approaches to program evaluation Features a new chapter on objective-based evaluation and a new section on ethics in program evaluation Provides more detailed information and in-depth description for each case, including evaluation approaches, fresh references, new readings, and the new Joint Committee Standards for Evaluation
Over the course of 20 years and eight editions, the goals of the book have remained the same: to prepare students to participate in evaluative activities within their organizations, become beginning critical producers and consumers of the professional evaluative literature, and reap the benefits of more advanced evaluation courses and texts. The authors aim to meet these objectives by presenting a unique approach that is realistic, practical, applied, and user friendly. Unlike other textbooks on the market, Program Evaluation for Social Workers presents both program-level evaluation and case-level evaluation methods; assuming that neither of these two distinct approaches alone adequately reflects the realities of the field, the book demonstrates how they can instead complement each other. This integration of approaches provides an accessible, adaptable, and realistic framework for students and beginning practitioners to more easily grasp and implement in the real world.
Now in its sixth edition, this popular student-friendly introduction to program evaluation provides social workers with a sound conceptual understanding of how to use basic evaluation techniques in the evaluation of their cases (case-level) and programs (program-level). Eminently approachable, straightforward, and practical, this edition includes the fundamental tools that are needed in order for social workers to fully appreciate and understand how case- and program-level evaluations will help them to increase their effectiveness as contemporary data-driven practitioners.
Evaluation is a controversial and little-understood strategy of public governance, control, and decision making. As early as classical antiquity, scholars were summoned to court to counsel kings. Public policy and program evaluation is a recent addition to the great chain of attempts to use the brainpower of scholars and scientists to further the interests of the state. Evaluation scholars are asked to provide retrospective assessments of the implementation, output, and outcome of government measures in order to effect deeper understanding and well-grounded decisions on the part of those in charge of government operations. Evaluation is the process of distinguishing the worthwhile from the worthless, the precious from the useless; evaluation implies looking backward in order to be able to steer forward better. Written from a political science perspective, Public Policy and Program Evaluation provides an overview of the possibilities and limits of public sector evaluation. Evert Vedung examines evaluation as a mechanism for monitoring, systematizing, and grading government activities and their results so that public officials, in their future-oriented work, will be able to act as responsibly, creatively, and efficiently as possible. Topics discussed include: "Evaluation, Rationality, and Theories of Public Management"; "Models of Evaluation"; "Internal or External Evaluation"; "Impact Assessment as Tryout and Social Experimentation"; "Process Evaluation and Implementation Theory"; "The Eight-Problems Approach to Evaluation"; and "Uses and Users of Evaluation." All evaluation rests upon the idea that perceptions, opinions, intentions, judgments—in short, everything concerned with the world of human consciousness—play such interesting roles in political and administrative action that their functions are worth investigating. Through experience, humans may learn from past actions. The interventions of the modern state are so extensive, their execu
Comprehensive yet accessible, this book provides a practical introduction to the skills, attitudes, and methods required to assess the worth and value of human services offered in public and private organizations in a wide range of fields. Readers are introduced to the need for such activities, the methods for carrying out evaluations, and the essential steps in organizing findings into reports. The book focuses on smaller projects carried out by an internal evaluator (i.e., on the work of people who are closely associated with the service to be evaluated), and is designed to help program planners, developers, and evaluators to work with program staff members who might be threatened by program evaluation. Features case studies and short profiles of individual program evaluators engaged in conducting evaluations in private service agencies, foundations, universities, and federal, state, and local governments. Program Evaluation: An Overview. Planning an Evaluation. Selecting Criteria and Setting Standards. Developing Measures. Ethics in Program Evaluation. The Assessment of Need. Monitoring the Operation of Programs. Single Group, Nonexperimental Outcome Evaluations. Quasi-Experimental Approaches to Outcome Evaluation. Using Experiments to Evaluate Programs. Analysis of Costs and Outcomes. Qualitative Evaluation Methods. Evaluation Reports: Interpreting and Communicating Findings. How to Encourage Utilization. For Program Evaluators, Program Planners, Program Administrators, Public Administrators in all types of human services--Criminal Justice, Corrections, Public Health, Public Administration, Community Nursing, Educational Administration, Substance Abuse Program Administration, Social Work, etc.
Reflecting the latest developments in the field, The Practice of Health Program Evaluation, Second Edition provides readers with effective methods for evaluating health programs, policies, and health care systems, offering expert guidance for collaborating with stakeholders involved in the process. Author David Grembowski explores evaluation as a three-act play: Act I shows evaluators how to work with decision makers and other groups to identify the questions they want answered; Act II covers selecting appropriate evaluation designs and methods to answer the questions and reveal insights about the program’s impacts, cost-effectiveness, and implementation; and Act III discusses making use of the findings. Packed with relevant examples and detailed explanations, the book offers a step-by-step approach that fully prepares readers to apply research methods in the practice of health program evaluation.
Culturally Responsive and Strengths-Focused Applications
Author: Stewart I. Donaldson
Category: Business & Economics
Introduction to Theory-Driven Program Evaluation provides a clear guide for practicing evaluation science, and numerous examples of how these evaluations actually unfold in contemporary practice. A special emphasis is placed how to conduct theory-driven program evaluations that are culturally responsive and strengths-focused. In this thoroughly revised new edition, author Stewart I. Donaldson provides a state-of-the art treatment of the basics of conducting theory-driven program evaluations. Each case follows a three-step model: developing program impact theory; formulating and prioritizing evaluation questions; and answering evaluation questions. The initial chapters discuss the evolution and popularity of theory-driven program evaluation, as well as step-by-step guide for culturally responsive and strengths-focused applications. Succeeding chapters provide actual cases and discuss the practical implications of theory-driven evaluation science. Reflections, challenges, and lessons learned across numerous cases from practices are discussed. The volume is of significant value to practicing evaluators, professors of introductory evaluation courses and their students, advanced undergraduate and graduate students, and serves as a text or a supplementary text for a wide range of evaluation and applied research courses. It is also of great interest to those interested in the connections between work and health, well-being, career development, human service organizations, and organizational improvement and effectiveness.
Core Concepts and Examples for Discussion and Analysis
Author: Dean T. Spaulding
Publisher: John Wiley & Sons
The lack of teaching cases in program evaluation is often cited as a gap in the field. This ground-breaking book fills this gap, covering the essentials of program evaluation as it is used in education and with a wide variety of evaluation projects to be discussed, analyzed, and reflected upon. The book covers the essentials of program evaluation, including foundation and types of evaluation, tools for collecting data, writing of reports, and sharing of findings. Individual cases cover classroom instruction, community-based program, teacher training, professional development, a secondary-school based program, after-school program, reading achievement, school-improvement grant, and confidentiality. Each case is structured to include learning objectives, program description, evaluation plan, summary of evaluation activities and findings, key concepts, discussion questions, class activities, and suggested reading. As useful for students as it is for evaluators in training, Program Evaluation in Practice is a must-have for those aspiring to become effective evaluators.
This book offers a straightforward, practical introduction to evaluation for beginners and practitioners. It shows how to identify appropriate forms and approaches, using an original framework. The authors examine the role of evaluation in program development, and offer techniques for involving stakeholders in the planning process and for disseminating the evaluation findings. They use references to recent research and international examples.
Theory-Driven Evaluation and the Integrated Evaluation Perspective
Author: Huey T. Chen
Publisher: SAGE Publications
Category: Social Science
The Second Edition of Practical Program Evaluation shows readers how to systematically identify stakeholders’ needs in order to select the evaluation options best suited to meet those needs. Within his discussion of the various evaluation types, Huey T. Chen details a range of evaluation approaches suitable for use across a program’s life cycle. At the core of program evaluation is its body of concepts, theories, and methods. This revised edition provides an overview of these, and includes expanded coverage of both introductory and more cutting-edge techniques within six new chapters. Illustrated throughout with real-world examples that bring the material to life, the Second Edition provides many new tools to enrich the evaluator’s toolbox. “In this eminently readable book, Chen presents a strong matrix framework for conceptualizing a full range of evaluation strategies and approaches… The writing is exceptionally clear, accessible to novice evaluators, and, because it is fair-minded and principled, of relevance to seasoned evaluators as well.” —Jennifer Greene, University of Illinois at Urbana-Champaign "Professor Chen's Second Edition of Practical Program Evaluation sets a new standard for providing a variety of systematic frameworks for conducting high quality program evaluations. The readers will come away with a detailed understanding of both conventional and cutting-edge approaches. It is a must-read for practicing program evaluators, evaluation scholars, and students of evaluation." —Stewart I. Donaldson, Claremont Graduate University "Chen brings decades of evaluation and experience to this new edition. He continues his innovative and pragmatic thinking about evaluation, including identifying, constructing, and testing theories that can work in practice. Dr. Chen shows how to blend formative and summative evaluation, process and outcome evaluation, theory and action, and much more.” —R. Burke Johnson, University of South Alabama “Dr. Chen’s latest effort offers evaluators a thoughtful expansion on the topics addressed in Practical Program Evaluation (2005) in terms of program theory, logic modeling, and his evaluation typology. New chapters gleaned from the field reveal solution sets for overcoming challenges in a variety of contexts while still balancing scientific and stakeholder needs. This new work provides a solid foundation for the further development of an evaluator’s acumen.” —Gregg M. Gascon, Ohio State University “Chen has the best conceptual framework, and the quality of his writing and analysis are superb. He takes the reader through the essential steps in evaluation, with particularly valuable treatment of stakeholder involvement.” —Mario A. Rivera, University of New Mexico
This book discusses the crucial place that assumptions hold in conceptualizing, implementing, and evaluating development programs. It suggests simple ways for stakeholders and evaluators to 1) examine their assumptions about program theory and environmental conditions and 2) develop and carry out effective program monitoring and evaluation in light of those assumptions. A survey of evaluators from an international development agency reviewed the state of practice on assumptions-aware evaluation. This 2nd edition has been updated with further illustrations, case studies, and frameworks that have been researched and tested in the years since the first edition. Regardless of geography or goal, development programs and policies are fueled by a complex network of implicit ideas. Stakeholders may hold assumptions about purposes, outcomes, methodology, and the value of project evaluation and evaluators—which may or may not be shared by the evaluators. A major barrier to viable program evaluations is that development programs are based on assumptions that often are not well articulated. In designing programs, stakeholders often lack clear outlines for how implemented interventions will bring desired changes. This lack of clarity masks critical risks to program success and makes it challenging to evaluate such programs. Methods that have attempted to address this dilemma have been popularized as theory of change or other theory‐based approaches. Often, however, theory-based methods do not sufficiently clarify how program managers or evaluators should work with the assumptions inherent in the connections between the steps. The critical examination of assumptions in evaluation is essential for effective evaluations and evaluative thinking. "How does one think evaluatively? It all begins with assumptions. Systematically articulating, examining, and testing assumptions is the foundation of evaluative thinking... This book, more than any other, explains how to build a strong foundation for effective interventions and useful evaluation by rigorously working with assumptions." —Michael Quinn Patton, PhD. Author of Utilization-Focused Evaluation and co-editor of THOUGHTWORK: Thinking, Action, and the Fate of the World, USA. "This updated edition presents us with a new opportunity to delve into both the theoretical and practical aspects of paradigmatic, prescriptive, and causal assumptions. We need to learn, and apply these insights with the deep attention they deserve." —Zenda Ofir, PhD. Independent Evaluator, Richard von Weizsäcker Fellow, Robert Bosch Academy, Berlin, Germany. Honorary Professor, School of Public Leadership, Stellenbosch University, South Africa. “This thought-provoking book explains why assumptions are an essential condition within the theories and methodologies of evaluation; and how assumptions influence the ways that evaluators approach their work...It will enrich the ways that evaluators develop their models, devise their methodologies, interpret their data, and interact with their stakeholders.” —Jonny Morell, Ph.D., President, 4.669... Evaluation and Planning, Editor Emeritus, Evaluation and Program Planning
Praised by instructors and students alike, PROGRAM EVALUATION, 6th Edition helps your students evaluate services and programs that they will encounter in their professional practice. In the process of learning evaluation techniques and skills, students will become proficient at critically analyzing evaluation studies conducted by others. The authors present and simplify all the essentials needed for a critical appreciation of evaluation issues and methodology. The text's clear writing style and clear presentation of concepts, as well as its hands-on and applied focus, guide students on how to gather evidence and demonstrate that their interventions and programs are effective in improving clients' lives. This edition's up-to-date coverage includes a greater number of references to current literature, emphasizing that consulting the literature is an important step in recognizing, developing, and evaluating evidence-based practice or research-informed practice. Important Notice: Media content referenced within the product description or the product text may not be available in the ebook version.
A Practical Overview Based on Research and Experience
Author: David A. Payne
Publisher: Springer Science & Business Media
Drawing upon experiences at state and local level project evaluation, and based on current research in the professional literature, Payne presents a practical, systematic, and flexible approach to educational evaluations. Evaluators at all levels -- state, local and classroom -- will find ideas useful in conducting, managing, and using evaluations. Special user targets identified are state department of education personnel and local school system administrative personnel. The volume can be used by those doing evaluation projects `in the field', or as a text for graduate courses at an introductory level. The book begins with an overview of the generic evaluation process. Chapter Two is devoted to the criteria for judging the effectiveness of evaluation practice. Chapter Three addresses the all important topic of evaluation goals and objectives. Chapters Four, Five and Six basically are concerned with the approach, framework, or design of an evaluation study. Chapter Four contains a discussion of four major philosophical frameworks or metaphors and the implications of these frameworks for conducting an evaluation. Chapters Five and Six describe predominantly quantitative and qualitative designs, respectively. Design, implementation and operational issues related to instrumentation (Chapter Seven), management and decision making (Chapter Eight), and reporting and utilization of results (Chapter Nine) are next addressed. The final chapter of the book (Chapter Ten) considers the evaluation of educational products and materials.
Head Start. Bilingual education. Small class size. Social promotion. School funding. Virtually every school system in America has had to face these issues over the past thirty years. Advocates and dissenters have declared confidently that "the research" is on their side. But is it? In the first book to bring together the recent history of educational policy and politics with the research evidence, Timothy Hacsi presents the illuminating, often-forgotten stories of these five controversial topics. He sifts through the complicated evaluation research literature and compares the policies that have been adopted to the best evidence about what actually works. He lucidly explains what the major studies show, what they don't, and how they have been misunderstood and misrepresented. Hacsi shows how rarely educational policies are based on solid research evidence, and how programs that sound plausible simply do not satisfy the complex needs of real children.
Comprehensive yet accessible, this text provides a practical introduction to the skills, attitudes, and methods required to assess the worth and value of human services offered in public and private organizations in a wide range of fields. Students are introduced to the need for such activities, the methods for carrying out evaluations, and the essential steps in organizing findings into reports. The text focuses on the work of people who are closely associated with the service to be evaluated, and is designed to help program planners, developers, and evaluators to work with program staff members who might be threatened by program evaluation.