Search arXiv⌕ Search
Home/Archive/arXiv

arXiv · 1807.06993

Cross Validation Based Model Selection via Generalized Method of Moments

Junpei Komiyama·Hajime Shimao
View original source ↗Read source document ↗Export metadata ↓

Abstract

Structural estimation is an important methodology in empirical economics, and a large class of structural models are estimated through the generalized method of moments (GMM). Traditionally, selection of structural models has been performed based on model fit upon estimation, which take the entire observed samples. In this paper, we propose a model selection procedure based on cross-validation (CV), which utilizes sample-splitting technique to avoid issues such as over-fitting. While CV is widely used in machine learning communities, we are the first to prove its consistency in model selection in GMM framework. Its empirical property is compared to existing methods by simulations of IV regressions and oligopoly market model. In addition, we propose the way to apply our method to Mathematical Programming of Equilibrium Constraint (MPEC) approach. Finally, we perform our method to online-retail sales data to compare dynamic market model to static model.

Explore related subjects

econ.EMstat.ME

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Junpei Komiyama, Hajime Shimao. 2018-07-18. Cross Validation Based Model Selection via Generalized Method of Moments. https://arxiv.org/abs/1807.06993

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Nonparametric Identification of First-Price Auction with Unobserved Competition: A Density Discontinuity Framework

We consider nonparametric identification of independent private value first-price auction models, in which the analyst only observes winning bids. Our benchmark model assumes an exogenous number of bidders N. We show that, if the bidders observe N, the resulting discontinuities in the winning bid density can be used to identify the distribution of N. The private value distribution can be nonparametrically identified in a second step. This extends, under testable identification conditions, to the case where N is a number of potential buyers, who bid with some unknown probability. Identification also holds in presence of additive unobserved heterogeneity drawn from some parametric distributions.

econ.EM↗
arXiv2026

Welfare at Risk: Distributionally Robust Bounds for Policy Evaluation

This paper develops a framework to study how the welfare effects of policy interventions are distributed across individuals when those effects are not directly observed. We bound the superquantile of individual welfare changes by the superquantile of conditional average welfare changes, which is typically identified, revealing how gains and losses are spread across the population. We also bound the share of the population whose welfare loss from the policy exceeds any given threshold --- a distribution-free counterpart to average cost--benefit analysis, closer to a poverty-rate measure of policy harm than to a mean welfare effect. We further extend both bounds to allow for ambiguity in the analyst's knowledge of the distribution of observable characteristics: a non-robust bound estimated on one population can be systematically overoptimistic when applied to a different target population, while the robust version, with its ambiguity radius chosen commensurate with the shift, restores a valid guarantee. We illustrate the method in generalized Roy models with subjective participation costs, bounding not only the distribution of welfare changes in the overall population but also, in a result new to this literature, the entire distribution of welfare (and of participation costs) among those who select into treatment --- the treatment-on-the-treated distribution, not merely its mean. We connect these results to the multi-outcome IV framework of \cite{Heckman_Urzua_Vytlacil_2006_REStat}, showing our robust bounds are immune to the instrument-sensitivity problem they document

econ.EM↗
arXiv2026

Corrected Forecast Combinations

This paper proposes corrected forecast combinations when the original combined forecast errors are serially dependent. Motivated by the classic Bates and Granger (1969) example, we show that combined forecast errors can be strongly autocorrelated and that a simple correction, which adds a fraction of the previous combined error to the next-period combined forecast, can deliver sizable improvements in forecast accuracy, often exceeding the original gains from combining. We formalize the approach within the conditional-risk framework of Gibbs and Vasnev (2024), in which the combined error decomposes into a predictable component (measurable at the forecast origin) and an innovation. We then link this correction to efficient estimation of combination weights under time-series dependence via GLS, allowing joint estimation of weights and an error-covariance structure. Using the U.S. Survey of Professional Forecasters for major macroeconomic indices across various subsamples (including pre/post-2000, GFC, and COVID), we find that a parsimonious correction of the mean forecast with a coefficient around 0.5 is a robust starting point and often yields material improvements in forecast accuracy. The benefits of correction diminish rapidly as the information becomes stale, largely disappearing at the four-quarter horizon or when the correction relies on an older lagged forecast error. For optimal-weight forecasts, the correction substantially mitigates the forecast combination puzzle by turning poorly performing out-of-sample optimal-weight combinations into competitive forecasts.

econ.EM↗