Distributed log collection for business processes based on ELK architecture
Yize Zong · 2023
When it comes to executing service solutions in a distributed environment, the service solution is considered as a workflow split into many sub-processes that are scheduled to run independently and autonomously on each processing engine. Each organization’s machines have its own set of limitations. They can't write too much code or rebuild the system, so they'll have to rely on a lightweight, low-code strategy to expand the service solution’s process activities to collect valuable logs. As a result, we created a log collection system for the case, as mentioned earlier. The listener class is used to insert some functional code that sends the logs to the messaging middleware. Then, the service call records, or log data, are transmitted to the central administration platform. The ELK (Elasticsearch, Logstash, Kibana) framework, commonly used in log analysis nowadays, is then used to perform real-time data processing. Finally, the logs are visually displayed to provide intuitive feedback on log information and to make system maintenance and adjustment easier.