Evaluation of Semantic Service Discovery—A Survey and Directions for Future Research
Ulrich Küster, Holger Lausen, Birgitta König‐Ries · Birkhäuser Basel eBooks · 2008
In recent years a huge amount of effort, and money has been invested in the area of semantic service discovery and presented approaches have become more sophisticated and mature. Nevertheless surprisingly little effort is being put into the evaluation of these approaches. We argue that the lack of established and theoretically well-founded methodologies and test beds for comparative evaluation of semantic service discovery is a major blocker of the advancement of the field. To lay the ground for a comprehensive treatment of this problem we discuss the applicability of well-known evaluation methodologies from information retrieval and provide an exhaustive survey of the current evaluation approaches.