Language Combinatorics: A Sentence Pattern Extraction Architecture Based on Combinatorial Explosion
Michal E. Ptaszynski, Rafał Rzepka, Kenji Araki, Yoshio Momouchi · Hokkaido University Collection of Scholarly and Academic Papers (Hokkaido University) · 2011
A “sentence pattern” in modern Natural Language Processing is often considered as a subsequent string of words (n-grams). However, in many branches of linguistics, like Pragmatics or Corpus Linguistics, it has been noticed that simple n-gram patterns are not sufficient to reveal the whole sophistication of grammar patterns. We present a language independent architecture for extracting from sentences more sophisticated patterns than n-grams. In this architecture a “sentence pattern” is considered as n-element ordered combination of sentence elements. Experiments showed that the method extracts significantly more frequent patterns than the usual n-gram approach.