Working with Datasets: Experience from Research Projects
Florin Pop, Ciprian Dobre, Elena‐Simona Apostol, Radu‐Ioan Ciobanu, Ciprian‐Octavian Truică, Ion-Dorinel Filip, Cătălin Negru · 2021
Our society is undergoing a data explosion. To deal with these Big Data Sets both scientists and experts from industries are creating models, methods, techniques, algorithms for efficient analysis, sometimes in real-time and with different constraints. The main objective of this paper is to present several examples of datasets used in different research projects and initiatives handled by people from Distributed Systems group of University Politehnica of Bucharest. Each use-case describes the datasets and corresponding models and technologies used for processing and managing them. The use-cases refer to satellite images and services using them, Data Capsule - the model of handling datasets in Cloud/Edge platforms, meta-data catalog used for datasets harvesting, mobile device mobility datasets, data related with e-health services, and Big Data techniques for AI-based flow analysis.