RDF PRO : an extensible tool for building stream-oriented RDF processing pipelines

Francesco Corcoglioniti, Marco Rospocher, Marco Amadori, Michele Mostarda · 2014

Abstract. We present RDFPRO (RDF Processor), an open source Java command line tool and embeddable library that offers a suite of stream-oriented, highly optimized processors for common tasks such as data filtering, RDFS inference, smushing and statistics extraction. RDFPRO processors are extensible by users and can be freely composed to form complex pipelines to efficiently process RDF data in one or more passes. We show how RDFPRO model and multi-threaded design al-low processing billions of triples in few hours in a typical Linked Open Data inte-gration scenario, and discuss relevant implementation aspects and lessons learnt. 1

Read the paper · More papers on PaperTik