On $φ$-families of probability distributions

Abstract

We generalize the exponential family of probability distributions. In our approach, the exponential function is replaced by a $φ$-function, resulting in a $φ$-family of probability distributions. We show how $φ$-families are constructed. In a $φ$-family, the analogue of the cumulant-generating function is a normalizing function. We define the $φ$-divergence as the Bregman divergence associated to the normalizing function, providing a generalization of the Kullback-Leibler divergence. A formula for the $φ$-divergence where the $φ$-function is the Kaniadakis' $κ$-exponential function is derived.