Evaluation of Bayesian networks used for diagnostics
K. Wojtek Przytula, Debasis Dash, Don Thompson · 2004
Bayesian networks have been very useful as models for computerized diagnostic assistants, as evidenced by numerous citations in the literature. However. a number of important practical problems in the application of Bayesian networks to diagnostics have still not been properly addressed. One of these is the evaluation of Bayesian network models. The quality of a model determines the quality of diagnostic recommendations obtained using that model. Thus, comprehensive analysis and evaluation of Bayesian models provides a fm basis for estimation of performance of diagnostic tools based on these models. Our approach to Bayesian network evaluation relies on the use of Monte Carlo simulation and the efficient visualization of simulation results. This technique allows us to identify the critical elements of Bayesian models that are responsible for incorrect diagnosis. In this way we can point to components that lack strong observations and therefore cannot be diagnosed convincingly. We can identify strongly coupled components that implicate each other and therefore cannot be effectively separated in diagnosis. We can also identify components whose failures are consistently misinterpreted as failures of other components. TABLE OF CONTENTS