Kybernetika 44 no. 1, 95-112, 2008

Extensions of the parametric families of divergences used in statistical inference

Václav Kůs, Domingo Morales and Igor Vajda

Abstract:

We propose a simple method of construction of new families of $\phi$-divergences. This method called convex standardization is applicable to convex and concave functions $\psi(t)$ twice continuously differentiable in a neighborhood of $t=1$ with nonzero second derivative at the point $t=1$. Using this method we introduce several extensions of the LeCam, power, $\chi^a$ and Matusita divergences. The extended families are shown to connect smoothly these divergences with the Kullback divergence or they connect various pairs of these particular divergences themselves. We investigate also the metric properties of divergences from these extended families.