Design Approach to Big data Systems in Developing and Maintaining the Information Security Systems
Mani Sarma Vittapu · IOSR Journal of Computer Engineering · 2016
Data is accumulating from almost all aspects of our everyday lives that it becomes huge and multistructured and has hidden useful information.The challenges with Big Data include capture, curation, storage, search, sharing, transfer, analysis, and visualization.Big Data provides materials for mining hidden patterns to support innovation mostly by data mining.The interaction research with Big Data support methods for innovation is rare at present.Knowledge discovered by data mining is novel and quantitative.However, it still lacks a uniform knowledge management model to support the innovation process effectively.The fact shows that since there emergence, big data techniques are changing very fast.In this paper, developing and maintaining the information security system to illustrate how those big data systems evolve and also describes some key design factors and challenges for future big data systems.Proposed design generic systems that can provide near real-time analytic services for many netease applications, such as spam detection, game log analysis and social community mining.No solutions can address all big data problems, especially when data size keeps increasing, more complex user requirements need to handle, the emergence of new hardware violates the old design and the old system becomes too complicated for maintenance.We face a series of technical challenges that have not been well addressed by both academic community and industry.