Relationship of Forecast Encompassing to Composite Forecasts with Simulations and an Application
JEL Classification: C52, C53, C12, C15
Abstract
This paper examines the role of forecast-encompassing principles in model-specification searches through the use of linear composite forecasts. Based on the results of the pairwise forecast-encompassing test, this paper outlines a conceptual framework to provide some useful insights on cross-model evaluations in econometrics and the selection of predictors in composite forecasts. Second, it offers three different ways of performing the encompassing test and compares their finite sample performance through a Monte Carlo simulation study. Test results guide researchers to choose component forecasts and thus to avoid blind pooling in the combining regression.
Keywords:
Choice of forecasts, Composite forecasts, Forecast-encompassing test, Monte-Carlo simulation, Nonnested hypothesesAcknowledgments
The authors would like to thank anonymous referees for helpful comments, and the corresponding author would like to thank the Korea Research Foundation for financial assistance through BK21 funding.
References
- Andrews, D. W. K. “Heteroscedasticity and Autocorrelation Consistent Covariance Matrix Estimation.” Econometrica 59 (No. 3 1991): 817-58. [https://doi.org/10.2307/2938229]
- Armstrong, J. S. “Combining Forecasts: The End of the Beginning of the Beginning of the End.” International Journal of Forecasting 5 (1989): 585-8. [https://doi.org/10.1016/0169-2070(89)90013-7]
- Bates, J. M., and Granger, C. W. J. “The Combination of Forecasts.” Operational Research Quarterly 20 (1969): 451-68. [https://doi.org/10.1057/jors.1969.103]
- Bunn, D. W. “Forecasting with More than One Model.” Journal of Forecasting 8 (1989): 161-6. [https://doi.org/10.1002/for.3980080302]
- Charemza, W. W. “Large Econometric Models of an Eastern European Economy, A Critique of the Methodology.” Economic Modelling 8 (1991): 45-62. [https://doi.org/10.1016/0264-9993(91)90021-F]
- Chong, Y. Y., and Hendry, D. F. “Econometric Evaluation of Linear Macroeconometric Models.” Review of Economic Studies 53 (No. 4 1986): 671-90. [https://doi.org/10.2307/2297611]
- Clemen, R. T. “Combining Forecasts: A Review and Annotated Bibliography.” International Journal of Forecasting 5 (1989): 559-83. [https://doi.org/10.1016/0169-2070(89)90012-5]
- Cooper, J. P., and Nelson, C. R. “The Ex-Ante Prediction Performance of the St. Louis and FRB-MIT-PENN Econometric Models, and Some Results on Composite Predictions.” Journal of Money, Credit, and Banking 7 (No. 1 1975): 1-32. [https://doi.org/10.2307/1991250]
- Davidson, R., and MacKinnon, J. “Several Tests for Model Specification in the Presence of Alternative Hypotheses.” Econometrica 49 (No. 3 1981): 781-93. [https://doi.org/10.2307/1911522]
- Diebold, F. X. “Forecast Combination and Encompassing: Reconciling Two Divergent Literatures.” International Journal of Forecasting 5 (1989): 589-92. [https://doi.org/10.1016/0169-2070(89)90014-9]
- Fair, R. C., and Shiller, R. J. “Comparing Information in Forecasts from Econometric Models.” American Economic Review 80 (No. 3 1990): 375-89.
- Fisher, G., and McAleer, M. “On the Interpretation of the Cox Test in Econometrics.” Economics Letters 4 (1979): 145-50. [https://doi.org/10.1016/0165-1765(79)90225-8]
- Fisher, P. G., and Wallis, K. F. “The Historical Tracking Performance of U.K. Macroeconometric Models, 1978-85.” Economic Modelling 8 (1990): 45-62. [https://doi.org/10.1016/0264-9993(90)90020-5]
- Gaver, K., and Geisel, M. “Discriminating Among Alternative Models: Bayesian and Non-Bayesian Methods.” In P. Zarembka (ed.), Frontiers in Econometrics. NY: Academic Press, 1974.
- Granger, C. W. J. “Combining Forecasts-Twenty Years Later.” Journal of Forecasting 8 (1989): 167-73. [https://doi.org/10.1002/for.3980080303]
- Granger, C. W. J., and Ramanathan, R. “Improved Methods of Forecasting.” Journal of Forecasting 3 (1984): 197-204. [https://doi.org/10.1002/for.3980030207]
- Hallman, J., and Kamstra, M. “Combining Algorithms Based on Robust Estimation Techniques and Co-Integrating Restrictions.” Journal of Forecasting 8 (1989): 189-98. [https://doi.org/10.1002/for.3980080305]
- Hendry, D. F. “Econometric Modelling: The Consumption Function in Retrospect.” Scottish Journal of Political Economy 30 (No. 3 1983): 193-200. [https://doi.org/10.1111/j.1467-9485.1983.tb01014.x]
- Hendry, D. F., and Richard, J. F. “The Econometric Analysis of Economic Time Series (with Discussions).” International Statistical Review 51 (1983): 111-63. [https://doi.org/10.2307/1402738]
- Kang, H. “Unstable Weights in the Combination of Forecasts.” Management Science 32 (1986): 683-95. [https://doi.org/10.1287/mnsc.32.6.683]
- Kennedy, P. “Non-Nested Hypothesis Tests: A Diagrammatic Exposition.” Australian Economic Papers 28 (No. 52 1989): 160-5. [https://doi.org/10.1111/j.1467-8454.1989.tb00466.x]
- Liang, K. Y., and Ryu, K. “Selecting the Form of Combining Regressions Based on Recursive Prediction Criteria.” In J. C. Lee, W. O. Johnson, and A. Zellner (eds.), Modelling and Prediction Honoring Seymour Geisser. Spriner-Verlag, 1996.
- McAleer, M. H. “Specification Tests for Separate Models: A Survey.” In M. L. King, and D. E. A. Goles (eds.), Specification Analysis in the Linear Model. London: Routledge & Kegan, pp. 146-95, 1987.
- Mizon, G. E., and Richard, J. F. “The Encompassing Principle and Its Application of Non-Nested Hypotheses.” Econometrica 54 (No. 3 1986): 657-78. [https://doi.org/10.2307/1911313]
- Nelson, C. R. “The Prediction Performance of the FRB-MIT-PENN Model of the U.S. Economy.” American Economic Review 62 (No. 5 1972): 902-17.
- Newbold, P., and Granger, C. W. J. “Experience with Forecasting Univariate Time Series and the Combination of Forecasts (with Discussions).” Journal of the Royal Statistical Society, Series A 137 (1974): 131-49. [https://doi.org/10.2307/2344546]
- Newey, W. K., and West, K. D. “A Simple Positive Semi-Definite, Heteroscedasticity and Autocorrelation Consistent Covariance Matrix.” Econometrica 55 (No. 3 1987): 703-8. [https://doi.org/10.2307/1913610]
- Wallis, K. F. “Macroeconomic Forecasts: A Philosophical Basis and Some Current Issues.” International Journal of Forecasting 5 (1989): 605-9. [https://doi.org/10.1016/0169-2070(89)90018-6]
- White, H. “A Heteroscedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroscedasticity.” Econometrica 48 (No. 3 1980): 817-38. [https://doi.org/10.2307/1912934]
- Winkler, R. L. “Combining Forecasts: A Philosophical Basis and Some Current Issues.” International Journal of Forecasting 5 (1989): 605-9. [https://doi.org/10.1016/0169-2070(89)90018-6]