Optimizing PySpark and PySpark Streaming
Raju Kumar Mishra · Apress eBooks · 2017
Spark is a distributed framework for facilitating parallel processing. The parallel algorithms require computation and communication between machines. While communicating, machines send or exchange data. This is also known as shuffling. These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.