Multimodal Data Representation and Processing Based on Algebraic System of Aggregates
Yevgeniya S. Sulema, Etienne E. Kerre · 2020
One of the possible ways toward solving the task of multimodal data analysis is presenting data sets describing the same object as a complex data structure called an aggregate introduced in the Algebraic System of Aggregates (ASA). This chapter discusses operations on multimodal data and relations between them, which enable complex representation of multiple multimodal data sequences obtained with respect to time in order to compose multi-images and process them. It pays special attention to multimodal data synchronization by using both crisp and fuzzy approaches. Operations on aggregates include arithmetical operations, logical operations, and ordering operations. Relations in ASA include relations between tuple elements, relations between tuples, and relations between aggregates. Mathematical models of data synchronization will enable further development of algorithms as well as software for multimodal data processing.