Rather than argue the validity of either the quantitative or the qualitative approach, most of the noted contributors to this volume conclude that both. Methods to understand whether such programs actually work. Quantitative methods and practices world bank training by shahidur r. Yet there is a need to put the theory into practice in a hands on fashion for practitioners. Evaluation of education for sustainability programs. First published in 2011, it has been used widely across the development and academic communities. Handbook on impact evaluation quantitative methods and practices shahidurr. The second edition of the impact evaluation in practice handbook is a comprehensive and accessible introduction to impact evaluation for policymakers and development practitioners. Quantitative methods for policy research and evaluation. Handbook on impact evaluation quantitative methods and. Handbook on impact evaluation quantitative methods and practices. This book offers an accessible introduction to the topic of impact evaluation and its practice in development.
Evaluation is an integral part of any education for sustainability program and the evaluation plan should be developed in the planning or design phase of the program. Quantitative methods and practices makes a valuable contribution in this area by providing, for policy and research audiences, a comprehensive overview of steps in designing and evaluating programs amid uncertainand potentially confounding conditions. Quantitative methods and practices por khandker shahidur. Impact evaluation methodologies impact evaluation workshop, lilongwe, dec. Critically analyze impact evaluation research in economics and public health and gauge the validity of causal estimates understand evaluation design, including methods for designing randomizedcontrolled field trials learn how to develop meaningful hypotheses that are amenable to evaluation and test them. This2009versionofthehandbookonplanning,monitoringandevaluatingfor developmentresultsaimstosupportundpinbecomingmoreresultsorientedand.
Quantitative methods and practices makes a valuable contribution in this area by providing, for policy and research audiences, a comprehensive overview of steps in. The impact evaluation in practice handbook is a comprehensive and accessible introduction to impact evaluation for policymakers and development practitioners. See all 7 formats and editions hide other formats and editions. Impact assessments 18 quantitative impact assessment. Handbook on impact evaluation with stata examples st. It then focuses on the experimental design of an impact evaluation, highlighting its strengths and shortcomings, followed by discussions on. Samad 2010 the international bank for reconstruction and development. Choosing appropriate designs and methods for impact. Evaluation researchers, traditionally considered to be users of quantitative methods, are now actively exploring the qualitative aspects of the performance of the programmes they are evaluating. Final project and presentations text and materials required textbook handbook on impact evaluation. Yet there is a need to put the theory into practice in a handson fashion for practitioners. There are a number of key reasons for evaluating programs including. A note on the impact evaluation of public policies. Everyday low prices and free delivery on eligible orders.
For the present discussion, it will be helpful to define the quantitative approach to impact analysis as one that relies on the counterfactual definition of causality a more defensible ver. Additional attention was drawn to the issue recently by a. Before turning to the main impact evaluation methods it is worth. Samad 2010 the international bank for reconstruction and development the world bank. In this report we describe the policy evaluation framework and the different counterfactual. The success case method scm involves identifying the most and least successful cases in a program and examining them in detail. Theorybased impact evaluation strengths for gathering better evidence a key strength of this approach is its flexibility to combine different methods of data collection and analysis to triangulate multiple sources of qualitative and quantitative evidence, including local knowledge and perceptions. The second edition of the impact evaluation in practice handbook is a comprehensive and accessible introduction to impact evaluation for policy makers and development practitioners. Handbook of training evaluation and measurement methods. Integrating theory and practice kindle edition by quinn, patton michael. Quantitative methods and practices public programs are designed to reach certain goals and beneficiaries. The book incorporates realworld examples to present practical. The formal literature on impact evaluation methods and practices is large, with a few useful overviews. The qualitative method of impact analysis better evaluation.
Quantitative methods and practices this book provides a comprehensive overview of steps in designing and evaluating programs amid uncertain and potentially confounding conditions. Recent developments in the econometrics of program evaluation. Download it once and read it on your kindle device, pc, phones or tablets. Abstract impact evaluation provides information about the impacts produced by an intervention. Different methods of randomization concerns with randomization randomized impact evaluation in practice difficulties with randomization questions 4. Qualitative research methods in program evaluation. Quantitative methods and practices world bank training series khandker, shahidur r. The formal literature on impact evaluation methods and practices is large, with a few. Quantitative methods and practices exercises 2009 bangladesh.
Just as quantitative methods are well suited for some types of questions, qualitative methods are particularly well suited to other, specific types of questions. Different impact evaluation methodologies differ in how they construct the counterfactual counterfactual. The mediumterm impact of the primary education stipend in rural bangladesh. Public programs are designed to reach certain goals and beneficiaries. The limitations of an exclusive reliance on quant or qual evaluation approaches 3 1. This acclaimed book by shahidur khandker is available. Download and read free online handbook on impact evaluation. Yet there is a need to put the theory into practice in a handson fashion for. The impact of the full range of development interventions can be assessed projects, programmes, sector wide support and donor country strategies and macro economic growth and programme aid support using qualitative or quantitative approaches or a mix. Overview of impact evaluation page 2 an impact evaluation should only be undertaken when its intended use can be clearly identified and when it is likely to be able to produce useful findings, taking into account the availability of resources and the timing of decisions about the programme or policy under investigation. The impact of macroeconomic policies on poverty and income distribution. Quantitative and qualitative methods in impact evaluation. A note on concepts and methods 1 by kene ezemenari anders rudqvist k. Quantitative and qualitative methods in impact evaluation and measuring results 1 1 introduction there has been a renewed interest in impact evaluation1 in recent years amongst development agencies and donors.
Samad richard palmerjones school of international development, university of east anglia, uk correspondence r. In class problems to be discussed and solved in groups 4. Qualitative research and evaluation methods for those in music education trying to present all approaches to research as reasonable and viable options, patton provides a biasfree presentation of appropriate terminology. Matching methods are gaining visibility in impact evaluation because they use rigorous statistical techniques to build a control unprotected group of sites for comparison that are as similar as.
Quantitative methods and practices, world bank publications, the world bank, number 2693. Surveys are the dominant tool for data collection, often administered as part of tracer studies and. Quantitative methods and practices by khandker shahidur. This approach was developed by robert brinkerhoff to assess the impact of organisational interventions, such as training and coaching, though the use of scm is not limited to this context. Qualitative and quantitative methods in evaluation research. While the book is geared principally towards development practitioners and policymakers designing prospective impact evaluations, we trust that it will be a valuable resource for students and others interested in using impact evaluation. A study of research methodology used in evaluations of. Quantitative methods and practices world bank training series by shahidur r. Qualitative methods quantitative impact evaluation often leaves us with reduced form results sometimes difficult to understand what aspects of the intervention worked and why qualitative methods allow us to delve more deeply into select areas of impact through. Introduction the basic organizing principle for any good evaluation of an intervention is to ask the. The literature on impact evaluation offers detailed assessments of approaches, methods, and tools for various kinds of impact analysis, including the analysis of gender impacts.
It can be undertaken of a programme or a policy, or upstream work such as capacity building, policy advocacy and support for an enabling environment. This new, third model of jack phillipss primary handbook of training evaluation and measurement methods reveals the reader not solely how one can design, implement, and assess the effectiveness of hrd packages, nevertheless the best approach to lastly measure their return on funding roi. Quantitative methods and practices, by khandker, shahidur r. Methods to understand whether such programs actually work, as well as the level and, isbn 97808280284 buy the handbook on impact evaluation. Theorybased impact better evidence evaluation in action.
The end of the book chapter 9 includes a lengthy discussion of qualitative. The benefits of a mixed methods approach 4 part ii. Macromicro evaluation techniques and tools, world bank publications, the world bank, number 6586, march. It then focuses on the experimental design of an impact evaluation, highlighting its strengths and shortcomings, followed by discussions on various non. Section iv addresses some general concerns about impact evaluation, introducing them as myths and explaining why impact evaluation is less complicated than often assumed.
1528 1196 1022 1501 900 859 153 361 124 696 1110 444 1295 9 1164 1266 298 1453 686 1557 994 776 631 474 1637 1504 387 945 1422 106 357 874 152 1059 936 1424 272 683 1171 355