Google for the linguist on a budget
András Kornai, Péter Halácsy · SZTAKI Publication Repository (Hungarian Academy of Sciences) · 2008
In this paper, we present GLB, yet another open source and free system to create and exploit linguistic corpora gathered from the web.A simple, robust web crawl algorithm, a multi-dimensional information retrieval tool, and a crude parallelization mechanism are proposed, especially for researchers working in resource-limited environments.