Benchmarking Deep Neural Network Inference Performance on Serverless Environments With MLPerf
Unai Elordi, Luis Unzueta, Jon Goenetxea, S. Sánchez, Ignacio Arganda‐Carreras, Oihana Otaegui · IEEE Software · 2020
We provide a novel decomposition methodology from the current MLPerf benchmark to the serverless function execution model. We have tested our approach in Amazon Lambda to benchmark the processing capabilities of OpenCV and OpenVINO inference engines.