A broad-coverage collection of portable NLP components for building shareable analysis pipelines
Richard Eckart de Castilho, Iryna Gurevych · 2014
Due to the diversity of natural language processing (NLP) tools and resources, combining them into processing pipelines is an important issue, and sharing these pipelines with others remains a problem.We present DKPro Core, a broad-coverage component collection integrating a wide range of third-party NLP tools and making them interoperable.Contrary to other recent endeavors that rely heavily on web services, our collection consists only of portable components distributed via a repository, making it particularly interesting with respect to sharing pipelines with other researchers, embedding NLP pipelines in applications, and the use on high-performance computing clusters.Our collection is augmented by a novel concept for automatically selecting and acquiring resources required by the components at runtime from a repository.Based on these contributions, we demonstrate a way to describe a pipeline such that all required software and resources can be automatically obtained, making it easy to share it with others, e.g.