Sidestepping the combinatorial explosion: Towards a processing model based on discriminative learning
R. Harald Baayen, Peter Hendrix, Prado Mart · 2010
Arnon and Snider (2010) documented frequency effects for compositional 4-grams independently of the frequen-cies of lower-order n-grams. They argue that compre-henders apparently store frequency information about multi-word units. We show that n-gram frequency effects can emerge in a parameter-free computational model driven by naive discriminative learning, trained on a sample of 300,000 4-word phrases from the British National Corpus. The discriminative learning model is a full decomposition model, associating orthographic input features straightforwardly with meanings. The model does not make use of separate representations for derived or inflected words, nor for compounds, nor for phrases. Nevertheless, frequency effects are correctly predicted for all these linguistic units. Naive discrimina-tive learning provides the simplest and most economical explanation for frequency effects in language processing, obviating the need to posit counters in the head for, and the existence of, hundreds of millions of n-gram repre-sentations. Keywords: naive discriminative learning; Rescorla-Wagner equations; n-gram frequency effects; computational modeling