Bayesian Variable Selection and Model Averaging in High-Dimensional Multinomial Nonparametric Regression
Paul Yau, Robert Kohn, Sally Ann Wood · Journal of Computational and Graphical Statistics · 2003
This article presents a Bayesian method for estimating nonparametrically a highdimensional multinomial regression model. The regression functions are expressed as sums of main effects and interactions and our approach is able to select the significant components entering the model. Each of the main effects and interactions is written as a linear combination of basis terms with a variance components type prior on the regression coefficients. The conditional class probabilities are estimated using both variable selection and model averaging. Our approach can also be used for classification and gives results that are comparable to modern classification methods, but at the same time the results are highly interpretable to the practitioner. All computation is carried out using Markov chain Monte Carlo simulation.