Automated Data Cleansing through Meta-Learning
Ian Gemp, Georgios Theocharous, Mohammad Ghavamzadeh · Proceedings of the AAAI Conference on Artificial Intelligence · 2017
Data preprocessing or cleansing is one of the biggest hurdles in industry for developing successful machine learning applications. The process of data cleansing includes data imputation, feature normalization and selection, dimensionality reduction, and data balancing applications. Currently such preprocessing is manual. One approach for automating this process is metalearning. In this paper, we experiment with state of the art meta-learning methodologies and identify the inadequacies and research challenges for solving such a problem.