Data Management and Visualization
Mohammad Khorasani, Mohamed Abdou, Javier Hernández Fernández · Apress eBooks · 2022
As with any web application, the management of data is an integral part of the undertaking. Coupled with the rise in big data, we are constantly in need of developing techniques that can manage the sheer magnitude of our data in an efficient and robust manner. In this chapter, we will address some of the key methods used to manage big data. Namely, we will cover encoding large multimedia files and dataframes into bytes data that can then be stored more robustly on database systems or in memory. Subsequently, we will demonstrate the utility of Streamlit’s in-house caching capabilities that can be used to cache data, function executions, and objects in order to drastically reduce execution time on reruns of our application. Finally, we will cover techniques to mutate dataframes and tables in our application on demand.