A Beginner’s Guide to Randomized Evaluations in Development Economics

E Seul Choi ; Booyuel Kim

E Seul Choi, Graduate Student, Department of Economics, Seoul National University, Seoul 08826, Republic of Korea codnsznzn@gmail.com
Booyuel Kim, Corresponding author, Assistant Professor, KDI School of Public Policy and Management, Sejong 30149, Republic of Korea, Tel: +82-44-550-1023 bkim@kdischool.ac.kr

JEL Classification: C93

Abstract

We present a practical guide to randomized impact evaluation in Development Economics for people who are interested in starting a field experiment for the first time. We provide an overview of the important steps in planning and implementing a randomized evaluation from beginning to end. The steps include issues such as research question development, local partner institution, institutional review board, pre-analysis plan, samplesize calculation, random sampling, randomization, survey implementation, data entry, and data analysis.

Keywords:

Impact evaluation, Randomized Controlled Trial (RCT), Potential outcome model

References

Angrist, J. D., and J. S. Pischke. “The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics.” The Journal of Economic Perspectives 24 (No. 2 2010): 3-30. [https://doi.org/10.1257/jep.24.2.3]
Baird, S., J. H. Hicks, M. Kremer, and E. Miguel. “Worms at Work: Public Finance Implications of a Child Health Investment.” Working Paper, 2012, Unpublished.
Banerjee, A. V., and E. Duflo. “The Experimental Approach to Development Economics.” Annual Review of Economics (No. 1 2009): 151-78. [https://doi.org/10.1146/annurev.economics.050708.143235]
Duflo, E., R. Glennerster, and M. Kremer. Using Randomization in Development Economics Research: A Toolkit. Center for Economic Policy Research (CEPR) Discussion Paper No. 6059, 2007. [https://doi.org/10.3386/t0333]
Finkelstein, A., S. Taubman, H. Allen, J. Gruber, J. Newhouse, B. Wright, K. Baicker, and the Oregon Health Study Group. The short run impact of extending public health insurance to low income adults: evidence from the first year of The Oregon Medicaid Experiment – Analysis Plan. 2010. Available at http://www.nber.org/oregon/documents/analysis-plan/analysis-plan-oneyear-2010-12-01.pdf, . [https://doi.org/10.3386/w17190]
Glennerster, R., and K. Takavarasha. Running Randomized Evaluations: a Practical Guide. Princeton: Princeton University Press, 2013. [https://doi.org/10.2307/j.ctt4cgd52]
Grootaert, C., D. Narayan, and V. N. Jones, and M. Woolcock. Measuring Social Capital: An Integrated Questionnaire. World Bank Working Paper No. 18, 2004. [https://doi.org/10.1596/0-8213-5661-5]
Kim, B. “Short-Term Impacts of a Cash Transfer Program for Girls’ Education on Academic Outcomes: Evidence from a Randomized Evaluation in Malawian Secondary Schools.” Seoul Journal of Economics 29 (No. 4 2016): 553-72.
Kim, B. Essays on Education and Health in Developing Countries. Columbia University Academic Commons, 2014. Available at: http://dx.doi.org/10.7916/D8C53J55.
Kim, B., H. Kim, and C. Pop-Eleches. Peer Effects in the Demand for Male Circumcision: Evidence from Secondary Schools in Malawi. AEA RCT Registry, 2016, Unpublished. [https://doi.org/10.1257/rct.1366-1.0]
Leamer, E. “Sensitivity Analyses Would Help.” American Economic Review 75 (No. 3 1985): 308-13.
Lee, D. “Training, Wages, and Sample Selection: Estimating Sharp Bounds on Treatment Effects.” Review of Economic Studies 76 (No. 3 2009): 1071–102. [https://doi.org/10.1111/j.1467-937X.2009.00536.x]
Miguel, E., and M. Kremer. “Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities.” Econometrica 72 (No. 1 2004): 159-217. [https://doi.org/10.1111/j.1468-0262.2004.00481.x]
Rubin, D. “Estimating Causal Effects of Treatments in Randomized and Nonrandomized Studies.” Journal of Educational Psychology 66 (No. 5 1974): 688-701. [https://doi.org/10.1037/h0037350]
Thomas, D., E. Frankenberg, and J. P. Smith. “Lost but Not Forgotten: Attrition and follow-up in the Indonesia Family Life Survey.” Journal of Human Resources 36 (No. 3 2001): 556–92. [https://doi.org/10.2307/3069630]
Thomas, D., F. Witoelar, E. Frankenberg, B. Sikoki, J. Strauss, C. Sumantri, and W. Suriastini. “Cutting the Costs of Attrition: Results from the Indonesia Family Life Survey.” Journal of Development Economics 98 (No. 1 2012): 108–23. [https://doi.org/10.1016/j.jdeveco.2010.08.015]