Parallel Creation of Gigaword Corpora for Medium Density Languages - an Interim Report
Péter Halácsy, András Kornai, Pèter Németh, Dániel Varga · 2008
For increased speed in developing gigaword language resources for medium resource density languages we integrated several FOSS tools in the HUN* toolkit.While the speed and efficiency of the resulting pipeline has surpassed our expectations, our experience in developing LDC-style resource packages for Uzbek and Kurdish makes clear that neither the data collection nor the subsequent processing stages can be fully automated.