Mail Scheme Log Processing Based on ELK
Bu Yun · Proceedings of the 2018 International Conference on Network, Communication, Computer Engineering (NCCE 2018) · 2018
With the continuous development of Internet technology, how to deal with and analyze a large number of data has become a hot spot.The mail system generates a large number of logs every day, and the traditional technology is not efficient in handling huge log data and is unable to make use of the information in the log.Proposing an information processing architecture based on ELK for mail logs to solve these problems.It ex-tracts information from logs by regular expressions, and define the concept of mail events, modeling data and storing them in graph database.The graph database is stored with the original graph of the data.When dealing with a large number of network relationships, it avoids the consumption of data connection in the traditional relational database.The experiment proves that the scheme can realize real-time processing and modeling storage of large moduli data and meet the needs of mail system.