Gaussian Mixture Models Use-Case
Ryan Maas, Jeremy Hyrkas, O. Grace Telford, Magdalena Bałazińska, Andrew J. Connolly, Bill Howe · 2015
In our work with scientists, we find that Gaussian Mixture Modeling is a common type of analysis applied to increasingly large datasets. We implement this algorithm in the Myria shared-nothing relational data management system, which performs the computation in memory. We study resulting memory utilization challenges and implement several optimizations that yield an efficient and scalable solution. Empirical evaluations on large astronomy and oceanography datasets confirm that our Myria approach scales well and performs up to an order of magnitude faster than Hadoop.