Faster, larger, easier
Chengwei Wang, Infantdani Abel Rayan, Karsten Schwan · 2012
Flume [1] is a widely used open-source real-time data processing framework. We have proposed, in a Middleware'12 research track paper [2], a middleware named VScope for troubleshooting complex big data systems like Flume. This poster introduces the recent evolution from Flume Old Generation (OG) to Flume New Generation (NG) [4], and research improvements in VScope to address the system management challenges.