A Functional Database Framework for Querying Very Large Multi-Layer Corpora

Roman Schneider · Publication Server of the Institute for German Language (Institute for German Language) · 2011

Linguistic query systems are special purpose IR applications. We present a novel state-of-the-art approach for the efficient exploitation of very large linguistic corpora, combining the advantages of relational database management systems (RDBMS) with the functional MapReduce programming model. Our implementation uses the German DEREKO reference corpus with multi-layer linguistic annotations and several types of text-specific metadata, but the proposed strategy is language-independent and adaptable to large-scale multilingual corpora.

Read the paper · More papers on PaperTik