INFERENCE FOR NORMAL MIXTURES IN MEAN AND VARIANCE
Jiahua Chen, Xianming Tan, Runchu Zhang · 2008
Abstract: A finite mixture of normal distributions in both mean and variance pa-rameters is a typical finite mixture in the location and scale families. Because the likelihood function is unbounded with any sample size, the ordinary maximum like-lihood estimator is not consistent. Applying a penalty to the likelihood function to control the estimated component variances is anticipated to restore the optimal properties of the likelihood approach. Yet this proposal lacks practical guidelines, has not been indisputably justified, and has not been investigated in the most gen-eral setting. In this paper, we present a new and solid proof of consistency when the putative number of components is equal to, and when it is larger than, the true number of components. We also provide conditions on the required size of the penalty and study the invariance properties. The finite sample properties of the new estimator are also demonstrated through simulations and an example from genetics. Key words and phrases: Bernstein inequality, invariant estimation, mixture of nor-mal distributions, penalized maximum likelihood, strong consistency. 1. Introduction. Finite