XML

Seoul Journal of Economics - Vol. 29 , No. 4

[ Article ]
Seoul Journal of Economics - Vol. 29, No. 4, pp. 529-552
Abbreviation: SJE
ISSN: 1225-0279 (Print)
Print publication date 30 Nov 2016
Received 04 Oct 2016 Revised 12 Oct 2016 Accepted 13 Oct 2016

A Beginner’s Guide to Randomized Evaluations in Development Economics
E Seul Choi ; Booyuel Kim
E Seul Choi, Graduate Student, Department of Economics, Seoul National University, Seoul 08826, Republic of Korea (codnsznzn@gmail.com)
Booyuel Kim, Corresponding author, Assistant Professor, KDI School of Public Policy and Management, Sejong 30149, Republic of Korea, Tel: +82-44-550-1023 (bkim@kdischool.ac.kr)

JEL Classification: C93


Abstract

We present a practical guide to randomized impact evaluation in Development Economics for people who are interested in starting a field experiment for the first time. We provide an overview of the important steps in planning and implementing a randomized evaluation from beginning to end. The steps include issues such as research question development, local partner institution, institutional review board, pre-analysis plan, samplesize calculation, random sampling, randomization, survey implementation, data entry, and data analysis.


Keywords: Impact evaluation, Randomized Controlled Trial (RCT), Potential outcome model

References
1. Angrist, J. D., and J. S. Pischke. “The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics.” The Journal of Economic Perspectives 24 (No. 2 2010): 3-30.
2. Baird, S., J. H. Hicks, M. Kremer, and E. Miguel. “Worms at Work: Public Finance Implications of a Child Health Investment.” Working Paper, 2012, Unpublished.
3. Banerjee, A. V., and E. Duflo. “The Experimental Approach to Development Economics.” Annual Review of Economics (No. 1 2009): 151-78.
4. Duflo, E., R. Glennerster, and M. Kremer. Using Randomization in Development Economics Research: A Toolkit. Center for Economic Policy Research (CEPR) Discussion Paper No. 6059, 2007.
5. Finkelstein, A., S. Taubman, H. Allen, J. Gruber, J. Newhouse, B. Wright, K. Baicker, and the Oregon Health Study Group. The short run impact of extending public health insurance to low income adults: evidence from the first year of The Oregon Medicaid Experiment – Analysis Plan. 2010. Available at http://www.nber.org/oregon/documents/analysis-plan/analysis-plan-oneyear-2010-12-01.pdf.
6. Glennerster, R., and K. Takavarasha. Running Randomized Evaluations: a Practical Guide. Princeton: Princeton University Press, 2013.
7. Grootaert, C., D. Narayan, and V. N. Jones, and M. Woolcock. Measuring Social Capital: An Integrated Questionnaire. World Bank Working Paper No. 18, 2004.
8. Kim, B. “Short-Term Impacts of a Cash Transfer Program for Girls’ Education on Academic Outcomes: Evidence from a Randomized Evaluation in Malawian Secondary Schools.” Seoul Journal of Economics 29 (No. 4 2016): 553-72.
9. Kim, B. Essays on Education and Health in Developing Countries. Columbia University Academic Commons, 2014. Available at: http://dx.doi.org/10.7916/D8C53J55.
10. Kim, B., H. Kim, and C. Pop-Eleches. Peer Effects in the Demand for Male Circumcision: Evidence from Secondary Schools in Malawi. AEA RCT Registry, 2016, Unpublished.
11. Leamer, E. “Sensitivity Analyses Would Help.” American Economic Review 75 (No. 3 1985): 308-13.
12. Lee, D. “Training, Wages, and Sample Selection: Estimating Sharp Bounds on Treatment Effects.” Review of Economic Studies 76 (No. 3 2009): 1071–102.
13. Miguel, E., and M. Kremer. “Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities.” Econometrica 72 (No. 1 2004): 159-217.
14. Rubin, D. “Estimating Causal Effects of Treatments in Randomized and Nonrandomized Studies.” Journal of Educational Psychology 66 (No. 5 1974): 688-701.
15. Thomas, D., E. Frankenberg, and J. P. Smith. “Lost but Not Forgotten: Attrition and follow-up in the Indonesia Family Life Survey.” Journal of Human Resources 36 (No. 3 2001): 556–92.
16. Thomas, D., F. Witoelar, E. Frankenberg, B. Sikoki, J. Strauss, C. Sumantri, and W. Suriastini. “Cutting the Costs of Attrition: Results from the Indonesia Family Life Survey.” Journal of Development Economics 98 (No. 1 2012): 108–23.