Fast JSON parser using metaprogramming on GPU

Krzysztof Kaczmarski, Jakub Narębski, Stanislaw Piotrowski, Piotr Przymus · 2022 IEEE 9th International Conference on Data Science and Advanced Analytics (DSAA) · 2022

We demonstrate a new idea of a parallel GPU JSON parser, which is able to optimize the parsing and initial transformation process through metaprogramming. It outperforms other well-known solutions like simdjson, Pandas, as well as cuDF– which also works on GPU. The resulting data is ready to be further processed in common data frame formats and may be incorporated by RAPIDS, Apache Arrow or Pandas. Our parser can therefore be a part of an industrial Extract-Transform-Load workflow.

Read the paper · More papers on PaperTik