MCTK: a Multi-modal Conversational Troubleshooting Kit for supporting users in web applications
Giulio Antonio Abbo, Pietro Crovari, Sara Pidò, Pietro Pinoli, Franca Garzotto · 2022
Conversational Interfaces for user assistance are becoming persuasive. Today, though, most chatbots are not integrated into the application in which they are placed, but only superimposed, with no communication between the conversational and the graphical interface. We propose Multi-modal Conversational Troubleshooting Kit (MCTK), a Python package to easily integrate a conversational agent for troubleshooting in web applications. MCTK is multi-modal: once the system recognizes the problem the user is encountering, the textual solution in the chat is coupled with visual hints in the GUI. On top of that, MCTK is easy to configure and offers separation of concerns: dialogue designers can work on the conversation without the necessity of modifying the code, and vice versa.