Course Content: The course will
cover impact evaluation theory (causal inference, experimental design
and basic statistics) as well as methods (randomization,
difference-in-difference, regression discontinuity, and propensity
score matching). The curriculum will be very applied, with weekly case
studies of field research drawn from the international development
literature. Discussions of methods will include issues related to
research ethics and the protection of human subjects. At the end of the
course, students will have the opportunity to present their own impact
evaluation research projects and get feedback from CEGA faculty
members.
Learning Outcomes: The primary
objective of the course is to provide participants with the ability to
1) distinguish research-based “best practices” from those that have not
been rigorously evaluated; and 2) understand the value and practice of
impact evaluation within the development community. For more
motivated students, who are considering conducting an impact evaluation
of a program, facilitators will provide references to technical
resources (e.g. textbooks on sample design and software for power
calculations) and guidelines for developing a rigorous study.
Methods of Instruction: During
class, facilitators will present the main concepts in short lectures
structured around case studies (suggested readings from the
literature), which will also serve as the basis for class discussion
and small group activities. Lectures will discuss the strongest (most
rigorous) evaluation methods and the shortcomings of weak evaluation
methods. Case studies will highlight research from Africa, Asia, and
South America as well as the U.S. and will cover programs related to
health, governance, education, and agriculture. Group work will provide
hands-on experience with research design and data analysis.
Audience: Both undergraduate
and graduate students may participate in the course. It is expected
that students will have basic knowledge of statistics and quantitative
analysis. Again, the curriculum is very applied and will be useful for
students engaged in international development
field projects or social entrepreneurship.
Grading: As with other DeCal
courses, those who attend class and participate in discussion will
pass. Students who miss two days of lecture (not including the
Sep. 8 introduction) will be in danger of failing the course.
Also, for every lecture that a student misses, the student will need to
submit a one-page summary/reaction to the lecture slides or referenced
papers (posted below). Depending on time availability, class
size, and students’
interests, group presentations will take place in the final two weeks
of class.
Schedule: September 8: Introduction to
impact evaluation in international development
Banerjee, Abhijit et. al.. Making
Aid Work. The MIT Press. 2007.
Duflo, Esther. Scaling
Up and Evaluation. Annual World Bank Conference on Development
Economics, 2004.
September 15: Randomized
Evaluations 1: Introduction, methodology, and the basic
econometrics
(Case Study: conditional cash transfers in Mexico)
September 22: Randomized
Evaluations II: Applications
(Case Studies: housing vouchers in the US, microfinance in South
Africa, and agriculture in
Kenya )
October 13: Regression
Discontinuity
(Case Studies: scholarship program for girls in Kenya, educational
finance in Chile)
Unpublished results from follow-up on a
girl’s merit scholarship program. For a description
of the intervention, see Kremer, Michael et al. Incentives
to Learn. NBER Working Paper
#10971. 2004.
October 20: External Validity
(Case Studies: anti-corruption programs in Indonesia and Brazil, &
community-based monitoring
of health clinics in Uganda)