Log Sinks and Big Data Analytics along with User Experience Monitoring to Tell a Fuller Story (ADPBD)
Vidroha Debroy, Senecca Miller, Mark Blake, Alex Hibbard, Cody Beavers · Proceedings/Proceedings of the ... International Conference on Software Engineering and Knowledge Engineering · 2022
Understanding and continually improving the user experience is critical to the success of web applications, especially those that are business-driven.There exist a multitude of tools to monitor user activities on a website, which then provide metrics to help developers and company leadership understand where their users experience pain-points.However, all tools suffer from their own limitations and ultimately it is important for companies to have as much control (as possible) over all data collected by third-party tools, and be able to make decisions related to its storage, retention, processing, etc., in an agile manner.At Dottid, we use a third-party tool to understand and enhance the user experience on our web application, recently however, we ran into a problem regarding failed logins that required us to architect a solution ourselves, since the tool cannot address this issue for us.The solution leverages log collection and big data analytics and its architecture has paved the way for us to build more actionable insights than if we were using the tool as-is.We transparently share our experiences, and the details of our solution and rationale, with the goal of benefiting others, and promoting further industry-academic collaboration, in this space.