Introduction to Spark and Spark MLlib
Butch Quinto · Apress eBooks · 2020
Spark is a unified big data processing framework for processing and analyzing large datasets. Spark provides high-level APIs in Scala, Python, Java, and R with powerful libraries including MLlib for machine learning, Spark SQL for SQL support, Spark Streaming for real-time streaming, and GraphX for graph processing. 2 Spark was founded by Matei Zaharia at the University of California, Berkeley’s AMPLab and was later donated to the Apache Software Foundation, becoming a top-level project on February 24, 2014. 3 The first version was released on May 30, 2017. 4