Running Randomized Evaluations

Running Randomized Evaluations
  • Author : Rachel Glennerster,Kudzai Takavarasha
  • Publisher : Princeton University Press
  • Pages : 480
  • Relase : 2013-11-24
  • ISBN : 9781400848447

Running Randomized Evaluations Book Review:

This book provides a comprehensive yet accessible guide to running randomized impact evaluations of social programs. Drawing on the experience of researchers at the Abdul Latif Jameel Poverty Action Lab, which has run hundreds of such evaluations in dozens of countries throughout the world, it offers practical insights on how to use this powerful technique, especially in resource-poor environments. This step-by-step guide explains why and when randomized evaluations are useful, in what situations they should be used, and how to prioritize different evaluation opportunities. It shows how to design and analyze studies that answer important questions while respecting the constraints of those working on and benefiting from the program being evaluated. The book gives concrete tips on issues such as improving the quality of a study despite tight budget constraints, and demonstrates how the results of randomized impact evaluations can inform policy. With its self-contained modules, this one-of-a-kind guide is easy to navigate. It also includes invaluable references and a checklist of the common pitfalls to avoid. Provides the most up-to-date guide to running randomized evaluations of social programs, especially in developing countries Offers practical tips on how to complete high-quality studies in even the most challenging environments Self-contained modules allow for easy reference and flexible teaching and learning Comprehensive yet nontechnical

Running Randomized Evaluations

Running Randomized Evaluations
  • Author : Rachel Glennerster,Kudzai Takavarasha
  • Publisher : Princeton University Press
  • Pages : 480
  • Relase : 2013-11-24
  • ISBN : 9780691159270

Running Randomized Evaluations Book Review:

A comprehensive guide to running randomized impact evaluations of social programs in developing countries This book provides a comprehensive yet accessible guide to running randomized impact evaluations of social programs. Drawing on the experience of researchers at the Abdul Latif Jameel Poverty Action Lab, which has run hundreds of such evaluations in dozens of countries throughout the world, it offers practical insights on how to use this powerful technique, especially in resource-poor environments. This step-by-step guide explains why and when randomized evaluations are useful, in what situations they should be used, and how to prioritize different evaluation opportunities. It shows how to design and analyze studies that answer important questions while respecting the constraints of those working on and benefiting from the program being evaluated. The book gives concrete tips on issues such as improving the quality of a study despite tight budget constraints, and demonstrates how the results of randomized impact evaluations can inform policy. With its self-contained modules, this one-of-a-kind guide is easy to navigate. It also includes invaluable references and a checklist of the common pitfalls to avoid. Provides the most up-to-date guide to running randomized evaluations of social programs, especially in developing countries Offers practical tips on how to complete high-quality studies in even the most challenging environments Self-contained modules allow for easy reference and flexible teaching and learning Comprehensive yet nontechnical

Running Randomized Evaluations

Running Randomized Evaluations
  • Author : Rachel Glennerster,Kudzai Takavarasha
  • Publisher :
  • Pages : 467
  • Relase : 2013
  • ISBN : 0691159246

Running Randomized Evaluations Book Review:

"The popularity of randomized evaluations among researchers and policymakers is growing and holds great promise for a world where decision making will be based increasingly on rigorous evidence and creative thinking. However, conducting a randomized evaluation can be daunting. There are many steps, and decisions made early on can have unforeseen implications for the life of the project. This book, based on more than a decade of personal experience by a foremost practitioner and a wealth of knowledge gathered over the years by researchers at J-PAL, provides both comfort and guidance to anyone seeking to engage in this process."--Esther Duflo, codirector of J-PAL and coauthor of "Poor Economics" "Randomized impact evaluations, pioneered by Rachel Glennerster and her colleagues, have emerged as a powerful new tool in the fight against poverty. This book gives us a critical guide for how to actually do them. It is required reading for students, professionals, and researchers committed to using evidence to guide policy."--Dean Karlan, coauthor of "More Than Good Intentions" "I have been searching for a book to train my students, research assistants, and field staff to design and implement social policy experiments. My search is over. "Running Randomized Evaluations" provides practical guidance covering all stages of an experiment--wisdom that previously could be acquired only by working directly for an evaluation expert."--Jeffrey B. Liebman, John F. Kennedy School of Government, Harvard University "Impact evaluation is a key resource for improving development effectiveness, yet until now it was inaccessible to people--policymakers, NGO staff, and development professionals of all kinds. Oftentimes, we get stuck in the theoretical discourse and philosophical debate and miss the chance to talk about the practical toolkit needed to actually do impact evaluation. "Running Randomized Evaluations" will significantly contribute to accelerate advancements in the field by making the tools of the trade accessible and user-friendly. This is a must-read guide for policymakers, practitioners, and donors alike."--Jodi Nelson, Bill and Melinda Gates Foundation

Impact Evaluation in Practice, Second Edition

Impact Evaluation in Practice, Second Edition
  • Author : Paul J. Gertler,Sebastian Martinez,Patrick Premand,Laura B. Rawlings,Christel M. J. Vermeersch
  • Publisher : World Bank Publications
  • Pages : 364
  • Relase : 2016-09-12
  • ISBN : 9781464807800

Impact Evaluation in Practice, Second Edition Book Review:

The second edition of the Impact Evaluation in Practice handbook is a comprehensive and accessible introduction to impact evaluation for policy makers and development practitioners. First published in 2011, it has been used widely across the development and academic communities. The book incorporates real-world examples to present practical guidelines for designing and implementing impact evaluations. Readers will gain an understanding of impact evaluations and the best ways to use them to design evidence-based policies and programs. The updated version covers the newest techniques for evaluating programs and includes state-of-the-art implementation advice, as well as an expanded set of examples and case studies that draw on recent development challenges. It also includes new material on research ethics and partnerships to conduct impact evaluation. The handbook is divided into four sections: Part One discusses what to evaluate and why; Part Two presents the main impact evaluation methods; Part Three addresses how to manage impact evaluations; Part Four reviews impact evaluation sampling and data collection. Case studies illustrate different applications of impact evaluations. The book links to complementary instructional material available online, including an applied case as well as questions and answers. The updated second edition will be a valuable resource for the international development community, universities, and policy makers looking to build better evidence around what works in development.

Natural Experiments in the Social Sciences

Natural Experiments in the Social Sciences
  • Author : Thad Dunning
  • Publisher : Cambridge University Press
  • Pages : 358
  • Relase : 2012-09-06
  • ISBN : 9781107017665

Natural Experiments in the Social Sciences Book Review:

The first comprehensive guide to natural experiments, providing an ideal introduction for scholars and students.

Handbook of Program Evaluation for Social Work and Health Professionals

Handbook of Program Evaluation for Social Work and Health Professionals
  • Author : Michael J. Smith
  • Publisher : Oxford University Press
  • Pages : 386
  • Relase : 2010-01-21
  • ISBN : 9780195158434

Handbook of Program Evaluation for Social Work and Health Professionals Book Review:

By integrating both evaluation and research methods and assuming no previous knowledge of research, this book makes an excellent reference for professionals working in social work and health settings who are now being called upon to conduct or supervise program evaluation and may need a refresher on research methods.

Failing in the Field

Failing in the Field
  • Author : Dean Karlan,Jacob Appel
  • Publisher : Princeton University Press
  • Pages : 176
  • Relase : 2018-12-18
  • ISBN : 9780691183138

Failing in the Field Book Review:

All across the social sciences, from development economics to political science, researchers are going into the field to collect data and learn about the world. Successful randomized controlled trials have brought about enormous gains, but less is learned when projects fail. In Failing in the Field, Dean Karlan and Jacob Appel examine the taboo subject of failure in field research so that researchers might avoid the same pitfalls in future work. Drawing on the experiences of top social scientists working in developing countries, this book describes five common categories of failures, reviews six case studies in detail, and concludes with reflections on best (and worst) practices for designing and running field projects, with an emphasis on randomized controlled trials. Failing in the Field is an invaluable “how-not-to” guide to conducting fieldwork and running randomized controlled trials in development settings.

The Goldilocks Challenge

The Goldilocks Challenge
  • Author : Mary Kay Gugerty,Dean Karlan
  • Publisher : Oxford University Press
  • Pages : 256
  • Relase : 2018-04-02
  • ISBN : 9780199366101

The Goldilocks Challenge Book Review:

The social sector provides services to a wide range of people throughout the world with the aim of creating social value. While doing good is great, doing it well is even better. These organizations, whether nonprofit, for-profit, or public, increasingly need to demonstrate that their efforts are making a positive impact on the world, especially as competition for funding and other scarce resources increases. This heightened focus on impact is positive: learning whether we are making a difference enhances our ability to address pressing social problems effectively and is critical to wise stewardship of resources. Yet demonstrating efficacy remains a big hurdle for most organizations. The Goldilocks Challenge provides a parsimonious framework for measuring the strategies and impact of social sector organizations. A good data strategy starts first with a sound theory of change that helps organizations decide what elements they should monitor and measure. With a theory of change providing solid underpinning, the Goldilocks framework then puts forward four key principles, the CART principles: Credible data that are high quality and analyzed appropriately, Actionable data will actually influence future decisions; Responsible data create more benefits than costs; and Transportable data build knowledge that can be used in the future and by others. Mary Kay Gugerty and Dean Karlan combine their extensive experience working with nonprofits, for-profits and government with their understanding of measuring effectiveness in this insightful guide to thinking about and implementing evidence-based change. This book is an invaluable asset for nonprofit, social enterprise and government leaders, managers, and funders-including anyone considering making a charitable contribution to a nonprofit-to ensure that these organizations get it "just right" by knowing what data to collect, how to collect it, how it can be analyzed, and drawing implications from the analysis. Everyone who wants to make positive change should focus on the top priority: using data to learn, innovate, and improve program implementation over time. Gugerty and Karlan show how.

Developmental Evaluation

Developmental Evaluation
  • Author : Michael Quinn Patton
  • Publisher : Guilford Press
  • Pages : 375
  • Relase : 2010-06-14
  • ISBN : 9781606238868

Developmental Evaluation Book Review:

Developmental evaluation (DE) offers a powerful approach to monitoring and supporting social innovations by working in partnership with program decision makers. In this book, eminent authority Michael Quinn Patton shows how to conduct evaluations within a DE framework. Patton draws on insights about complex dynamic systems, uncertainty, nonlinearity, and emergence. He illustrates how DE can be used for a range of purposes: ongoing program development, adapting effective principles of practice to local contexts, generating innovations and taking them to scale, and facilitating rapid response in crisis situations. Students and practicing evaluators will appreciate the book's extensive case examples and stories, cartoons, clear writing style, "closer look" sidebars, and summary tables. Provided is essential guidance for making evaluations useful, practical, and credible in support of social change.

Impact Evaluation of Development Interventions

Impact Evaluation of Development Interventions
  • Author : Howard White,David A. Raitzer
  • Publisher : Asian Development Bank
  • Pages : 216
  • Relase : 2017-12-01
  • ISBN : 9789292610593

Impact Evaluation of Development Interventions Book Review:

Impact evaluation is an empirical approach to estimating the causal effects of interventions, in terms of both magnitude and statistical significance. Expanded use of impact evaluation techniques is critical to rigorously derive knowledge from development operations and for development investments and policies to become more evidence-based and effective. To help backstop more use of impact evaluation approaches, this book introduces core concepts, methods, and considerations for planning, designing, managing, and implementing impact evaluation, supplemented by examples. The topics covered range from impact evaluation purposes to basic principles, specific methodologies, and guidance on field implementation. It has materials for a range of audiences, from those who are interested in understanding evidence on "what works" in development, to those who will contribute to expanding the evidence base as applied researchers.

Handbook of Economic Field Experiments

Handbook of Economic Field Experiments
  • Author : Anonim
  • Publisher :
  • Pages :
  • Relase : 2017
  • ISBN : OCLC:1295580899

Handbook of Economic Field Experiments Book Review:

Field Experiments

Field Experiments
  • Author : Alan S. Gerber,Donald P. Green
  • Publisher : W W Norton & Company Incorporated
  • Pages : 492
  • Relase : 2012
  • ISBN : 0393979954

Field Experiments Book Review:

A brief, authoritative introduction to field experimentation in the social sciences. Written by two leading experts on experimental methods, this concise text covers the major aspects of experiment design, analysis, and interpretation in clear language. Students learn how to design randomized experiments, analyze the data, and interpret the findings. Beyond the authoritative coverage of the basic methodology, the authors include numerous features to help students achieve a deeper understanding of field experimentation, including rich examples from the social science literature, problem sets and discussions, data sets, and further readings.

The Oxford Handbook of Professional Economic Ethics

The Oxford Handbook of Professional Economic Ethics
  • Author : George F. DeMartino,Deirdre N. McCloskey
  • Publisher : Oxford University Press
  • Pages : 688
  • Relase : 2016-01-04
  • ISBN : 9780190269975

The Oxford Handbook of Professional Economic Ethics Book Review:

For over a century the economics profession has extended its reach to encompass policy formation and institutional design while largely ignoring the ethical challenges that attend the profession's influence over the lives of others. Economists have proven to be disinterested in ethics. Embracing emotivism, they often treat ethics a matter of mere preference. Moreover, economists tend to be hostile to professional economic ethics, which they incorrectly equate with a code of conduct that would be at best ineffectual and at worst disruptive to good economic practice. But good ethical reasoning is not reducible to mere tastes, and professional ethics is not reducible to a code. Instead, professional economic ethics refers to a new field of investigation-a tradition of sustained and lively inquiry into the irrepressible ethical entailments of academic and applied economic practice. The Oxford Handbook of Professional Economic Ethics explores a wide range of questions related to the nature of ethical economic practice and the content of professional economic ethics. It explores current thinking that has emerged in these areas while widening substantially the terrain of economic ethics. There has never been a volume that poses so directly and intensively the question of the need for and content of professional ethics for economics. The Handbook incorporates the work of leading scholars and practitioners, including academic economists from various theoretical traditions; applied economists, beyond academia, whose work has direct and immense social impact; and philosophers, professional ethicists, and others whose work has addressed the nature of "professionalism" and its implications for ethical practice.

Poor Economics

Poor Economics
  • Author : Abhijit Banerjee,Esther Duflo
  • Publisher : PublicAffairs
  • Pages : 320
  • Relase : 2012-03-27
  • ISBN : 9781610391603

Poor Economics Book Review:

The winners of the Nobel Prize in Economics upend the most common assumptions about how economics works in this gripping and disruptive portrait of how poor people actually live. Why do the poor borrow to save? Why do they miss out on free life-saving immunizations, but pay for unnecessary drugs? In Poor Economics, Abhijit V. Banerjee and Esther Duflo, two award-winning MIT professors, answer these questions based on years of field research from around the world. Called "marvelous, rewarding" by the Wall Street Journal, the book offers a radical rethinking of the economics of poverty and an intimate view of life on 99 cents a day. Poor Economics shows that creating a world without poverty begins with understanding the daily decisions facing the poor.

Randomized Control Trials in the Field of Development

Randomized Control Trials in the Field of Development
  • Author : Florent Bédécarrats,Isabelle Guérin,François Roubaud
  • Publisher : Oxford University Press
  • Pages : 448
  • Relase : 2020-09-17
  • ISBN : 9780192635532

Randomized Control Trials in the Field of Development Book Review:

In October 2019, Abhijit Banerjee, Esther Duflo, and Michael Kremer jointly won the 51st Sveriges Riksbank Prize in Economic Sciences in Memory of Alfred Nobel "for their experimental approach to alleviating global poverty." But what is the exact scope of their experimental method, known as randomized control trials (RCTs)? Which sorts of questions are RCTs able to address and which do they fail to answer? The first of its kind, Randomized Control Trials in the Field of Development: A Critical Perspective provides answers to these questions, explaining how RCTs work, what they can achieve, why they sometimes fail, how they can be improved and why other methods are both useful and necessary. Bringing together leading specialists in the field from a range of backgrounds and disciplines (economics, econometrics, mathematics, statistics, political economy, socioeconomics, anthropology, philosophy, global health, epidemiology, and medicine), it presents a full and coherent picture of the main strengths and weaknesses of RCTs in the field of development. Looking beyond the epistemological, political, and ethical differences underlying many of the disagreements surrounding RCTs, it explores the implementation of RCTs on the ground, outside of their ideal theoretical conditions and reveals some unsuspected uses and effects, their disruptive potential, but also their political uses. The contributions uncover the implicit worldview that many RCTs draw on and disseminate, and probe the gap between the method's narrow scope and its success, while also proposing improvements and alternatives. Without disputing the contribution of RCTs to scientific knowledge, Randomized Control Trials in the Field of Development warns against the potential dangers of their excessive use, arguing that the best use for RCTs is not necessarily that which immediately springs to mind. Written in plain language, this book offers experts and laypeople alike a unique opportunity to come to an informed and reasoned judgement on RCTs and what they can bring to development.

Impact Evaluation

Impact Evaluation
  • Author : Markus Frölich,Stefan Sperlich
  • Publisher : Cambridge University Press
  • Pages : 419
  • Relase : 2019-02-28
  • ISBN : 9781107042469

Impact Evaluation Book Review:

In recent years, interest in rigorous impact evaluation has grown tremendously in policy-making, economics, public health, social sciences and international relations. Evidence-based policy-making has become a recurring theme in public policy, alongside greater demands for accountability in public policies and public spending, and requests for independent and rigorous impact evaluations for policy evidence. Frlich and Sperlich offer a comprehensive and up-to-date approach to quantitative impact evaluation analysis, also known as causal inference or treatment effect analysis, illustrating the main approaches for identification and estimation: experimental studies, randomization inference and randomized control trials (RCTs), matching and propensity score matching and weighting, instrumental variable estimation, difference-in-differences, regression discontinuity designs, quantile treatment effects, and evaluation of dynamic treatments. The book is designed for economics graduate courses but can also serve as a manual for professionals in research institutes, governments, and international organizations, evaluating the impact of a wide range of public policies in health, environment, transport and economic development.

School Meals, Educational Achievement, and School Competition

School Meals, Educational Achievement, and School Competition
  • Author : Christel Vermeersch,Michael Kremer
  • Publisher : World Bank Publications
  • Pages : 51
  • Relase : 2005
  • ISBN :

School Meals, Educational Achievement, and School Competition Book Review:

Vermeersch and Kremer examine the effects of subsidized school meals on school participation, educational achievement, and school finance in a developing country setting. They use data from a program that was implemented in 25 randomly chosen preschools in a pool of 50. Children's school participation was 30 percent higher in the treatment group than in the comparison group. The meals program led to higher curriculum test scores, but only in schools where the teacher was relatively experienced prior to the program. The school meals displaced teaching time and led to larger class sizes. Despite improved incentives, teacher absenteeism remained at a high level of 30 percent. Treatment schools raised their fees, and comparison schools close to treatment schools decreased their fees. Some of the price effects are caused by a combination of capacity constraints and pupil transfers that would not happen if the school meals were ordered in all schools. The intention-to-treat estimator of the effect of the randomized program incorporates those price effects, and therefore it should be considered a lower bound on the effect of generalized school meals. This insight on price effects generalizes to other randomized program evaluations. This paper--a product of the Poverty Reduction and Economic Management 2, Africa Technical Families--is part of a larger effort in the region to increase our understanding of the impact of programs aimed at reaching the Millennium Development Goals.

Chronicles from the Field

Chronicles from the Field
  • Author : Robert M. Townsend,Sombat Sakunthasathien,Rob Jordan
  • Publisher : MIT Press
  • Pages : 135
  • Relase : 2013-04-12
  • ISBN : 9780262019071

Chronicles from the Field Book Review:

Running since 1997 and continuing today, the Townsend Thai Project has trackedmillions of observations about the economic activities of households and institutions in rural andurban Thailand. The project represents one of the most extensive datasets in the developing world. Chronicles from the Field offers an account of the design and implementation ofthis unique panel data survey. It tells the story not only of the origins and operations of theproject but also of the challenges and rewards that come from a search to understand the process ofa country's economic development. The book explains the technical details of data collection andsurvey instruments but emphasizes the human side of the project, describing the culture shock feltby city-dwelling survey enumerators in rural villages, the "surprising, eye-opening, andinspiring" responses to survey questions, and the never-ending resourcefulness of the surveyteam. The text is supplemented by an epilogue on research findings and policy recommendations and anappendix that contains a list and abstracts of published and working papers, organized by topic,using data from the project. Social and economic policies are too often skewed by politicalconsiderations. The Townsend Thai Project offers another basis for policy: accurate measurementbased on thoroughly collected data. From this, a clear template emerges for understanding povertyand alleviating it.

Experimental Conversations

Experimental Conversations
  • Author : Timothy N. Ogden
  • Publisher : MIT Press
  • Pages : 400
  • Relase : 2017-01-06
  • ISBN : 9780262336857

Experimental Conversations Book Review:

Discussions of the use and limits of randomized control trials, considering the power of theory, external validity, gaps in knowledge, and what issues matter. The practice of development economics has undergone something of a revolution as many economists have adopted new methods to answer perennial questions about the effectiveness of anti-poverty programs. In this book, prominent development economists discuss the use and impact of one of the most significant of these new methods, randomized control trials (RCTs) and field experiments. In extended interviews conducted over a period of several years, they explain their work and their thinking and consider the broader issues of how we learn about the world and how we can change it for the better. These conversations offer specialists and nonspecialists alike a unique opportunity to hear economists speak in their own words, free of the confines of a particular study or econometric esoterica. The economists describe how they apply research findings in the way they think about the world, revealing their ideas about the power of theory, external validity, gaps in knowledge, and what issues matter. Also included are interviews with RCT observers, critics, sponsors, consumers, and others. Each interview provides a brief biography of the interviewee. Thorough annotations offer background and explanations for key ideas and studies referred to in the conversations. Contributors Abhijit Banerjee, Nancy Birdsall, Chris Blattman, Alex Counts, Tyler Cowen, Angus Deaton, Frank DeGiovanni, Esther Duflo, Pascaline Dupas, Xavi Gine, Rachel Glennerster, Judy Gueron, Elie Hassenfeld, Dean Karlan, Michael Kremer, David McKenzie, Jonathan Morduch, Lant Pritchett, Jonathan Robinson, Antoinette Schoar, Dean Yang

Carrots and Sticks

Carrots and Sticks
  • Author : Ian Ayres
  • Publisher : Bantam
  • Pages : 240
  • Relase : 2010-09-21
  • ISBN : 9780553907827

Carrots and Sticks Book Review:

Could you lose weight if you put $20,000 at risk? Would you finally set up your billing software if it meant that your favorite charity would earn a new contribution? If you’ve ever tried to meet a goal and came up short, the problem may not have been that the goal was too difficult or that you lacked the discipline to succeed. From giving up cigarettes to increasing your productivity at work, you may simply have neglected to give yourself the proper incentives. In Carrot and Sticks, Ian Ayres, the New York Times bestselling author of Super Crunchers, applies the lessons learned from behavioral economics—the fascinating new science of rewards and punishments—to introduce readers to the concept of “commitment contracts”: an easy but high-powered strategy for setting and achieving goals already in use by successful companies and individuals across America. As co-founder of the website stickK.com (where people have entered into their own “commitment contracts” and collectively put more than $3 million on the line), Ayres has developed contracts—including the one he honored with himself to lose more than twenty pounds in one year—that have already helped many find the best way to help themselves at work or home. Now he reveals the strategies that can give you the impetus to meet your personal and professional goals, including how to • motivate your employees • create a monthly budget • set and meet deadlines • improve your diet • learn a foreign language • finish a report or project you’ve been putting off • clear your desk Ayres shares engaging, often astounding, real-life stories that show the carrot-and-stick principle in action, from the compulsive sneezer who needed a “stick” (the potential loss of $50 per week to a charity he didn’t like) to those who need a carrot with their stick (the New York Times columnist who quit smoking by pledging a friend $5,000 per smoke . . . if she would do the same for him). You’ll learn why you might want to hire a “professional nagger” whom you’ll do anything to avoid—no, your spouse won’t do!—and how you can “hand-tie” your future self to accomplish what you want done now. You’ll find out how a New Zealand ad exec successfully “sold his smoking addiction,” and why Zappos offered new employees $2,000 to quit cigarettes. As fascinating as it is practical, as much about human behavior as about how to change it, Carrots and Sticks is sure to be one of the most talked-about books of the year.