Learning and inference in hierarchical models with singularities
Шун-ичи Амари, Tomoko Ozeki, Hyeyoung Park · Systems and Computers in Japan · 2003
Abstract When we infer the underlying rule which generates a large amount of data, we assume a family of hierarchical statistical models and estimate an appropriate model and its parameters. In this case, the parameter space of the model usually includes singularities, and interesting phenomena, different from those appearing in conventional inference theory, are observed. In this paper, we review the studies of singular models in learning and inference which are being extensively developed in Japan, and elucidate the mechanisms of strange behavior by using simple models. © 2003 Wiley Periodicals, Inc. Syst Comp Jpn, 34(7): 34–42, 2003; Published online in Wiley InterScience ( www.interscience.wiley.com ). DOI 10.1002/scj.10353