Massively Parallel Feature Extraction Framework Application in Predicting Dangerous Seismic Events
Marek Grzegorowski · Annals of Computer Science and Information Systems · 2016
In this paper we introduce an automated mechanism for knowledge discovery from data streams.As a part of this work, we also present a new approach to the creation of classifiers ensemble based on a wide variety of models.Furthermore, we describe an innovative, highly scalable feature extraction and selection framework designed to work with the MapReduce programming model and the application of designed framework to build an ensemble of classifiers which takes into account both the quality and the diversity of individual models.The effectiveness of the solution has been verified through a participation in an open data mining competition which concerned the problem of predicting periods of increased seismic activity causing lifethreatening accidents in coal mines.The submitted solution obtained the highest AUC score of all the solutions uploaded by 106 participating research teams.