The Spark High-Level APIs
Alfonso Antolínez García · Apress eBooks · 2023
Spark SQL, dataframes, and datasets are Spark high-level API components intended for structured data manipulation, allowing Spark to automatically improve storage and computation performance. Structured data is information organized into standardized structure of schema, which makes it accessible and analyzable without further treatment. Examples of structured data are database tables, Excel sheets, RDBMS tables, Parquet files, and so on.