Search arXiv⌕ Search

arXiv · 2611.06266

Online Bayesian Inference for a Dirichlet Process Mixture of Binary Logit Models

Abstract

Flexible travel behaviour models for preference heterogeneity have largely remained within the batch-estimation paradigm. The growing availability of continuously collected behavioural data, for example from smartphone applications, highlights the need for methods that update posterior inference on such heterogeneity as new observations arrive. This study proposes an online Bayesian inference method for a Dirichlet process mixture of binary logit models. The main challenge is to update the posterior as observations arrive while allowing the latent cluster structure to expand and historical cluster assignments to be revised. We develop a sequential Monte Carlo sampler using a sequence of Pólya--Gamma-augmented partial-data posteriors, local particle-weight corrections, and recursively maintained sufficient statistics. Each observation's contribution can be added, removed, or replaced in these summaries, supporting both sequential coefficient updating and rejuvenation that revisits historical cluster assignments. The simulation study shows that observation-by-observation sequential updating yields final posterior summaries close to those obtained by batch Markov chain Monte Carlo. Sensitivity analyses further demonstrate trade-offs between posterior approximation accuracy and computational cost as the number of particles and rejuvenation settings are varied. An illustrative empirical application shows how the method tracks posterior evolution and produces observation-specific provisional posterior summaries with low latency as real-world trip records are processed sequentially. The proposed approach provides a methodological foundation for online inference in travel behaviour models with parameter heterogeneity and for future extensions to richer choice structures, low-latency decision support, and online anomaly screening.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Hajime Watanabe, Charisma F. Choudhury, Stephane Hess. 2026-11-04. Online Bayesian Inference for a Dirichlet Process Mixture of Binary Logit Models. https://arxiv.org/abs/2611.06266

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Model fit vs prediction performance: contrasting fixed-coefficient models with mixture models

Mixture models such as mixed logit and latent class routinely achieve large gains in fit on panel data, yet several studies have found that these gains do not carry over to out-of-sample prediction. This paper explains why, building on the distinction between population-level and person-level prediction familiar from statistics. The panel log-likelihood of a mixture is exactly the cumulative score of forecasts that condition each choice on the person's earlier choices. Models are instead usually validated and applied with unconditional forecasts, which use only the estimated distribution of tastes and are scored by the cross-sectional log-likelihood. The difference between the two log-likelihoods, which we call choice consistency, comes from reproducing the dependence between a person's choices, and unconditional forecasts cannot use it. Decomposing the fit gain into choice consistency and heterogeneity, we show that when the assumed mixing distribution cannot reproduce this dependence exactly, pursuing choice consistency distorts the estimated heterogeneity, so that a mixture may predict single choices worse than a model without mixing. In two case studies, on revealed preference and stated choice data, choice consistency accounts for more than 90% of the fit gain for each of the fourteen panel mixtures. In our data, the part of the fit gain that helps to forecast single choices shrinks as people make more choices, and with many choices per person it becomes negative, leaving the mixture worse than a model without mixing. Mixtures forecast single choices clearly better only when the forecast can condition on the person's own earlier choices, which is often not possible in practice. For forecasting, the score of a panel mixture on single choices should therefore be reported alongside its fit, which requires only one further evaluation of the likelihood.

econ.EM↗

Willingness-to-pay space and preference space: a unified treatment of equivalence, heterogeneity and interpretation

A growing number of choice modelling studies estimate their models "in willingness-to-pay (WTP) space", yet often treat this as a different model that fits better (or worse) than "preference space", and misread what its parameters represent. This note brings together and makes precise insights that have mostly been stated only in scattered places, organising them around a single condition for two specifications to be the same model. WTP space is a reparameterisation, and with non-random coefficients the two spaces give identical likelihoods, WTP estimates and standard errors. With deterministic heterogeneity in cost sensitivity, or non-linearity, WTP must still be computed as a ratio of partial derivatives, although a simple normalisation recovers a directly estimated WTP at a reference point. With random heterogeneity, latent class models are equivalent in the two spaces, while other mixtures are equivalent only when the implied distributions match, as with full-covariance lognormals, and independence is not a neutral assumption.

econ.EM↗

Unobserved Consideration and Consumer Welfare

Can welfare effects of price change be identified when consumers' consideration sets are heterogeneous and unobserved? We establish that the welfare distribution is the same functional of structural choice probabilities under stable but limited consideration as under full consideration. The result permits unrestricted income-effects, preference heterogeneity, and dependence between preferences and consideration. Within this class, limited consideration admits a full-consideration representation preserving choice-probabilities and money-metric compensation: consideration/preferences can remain unidentified while demand and welfare are identified. When consideration sets contract as prices rise, the welfare distribution can be bounded using demand and a bound on choice-set attrition.

econ.EM↗