airt: Evaluation of Algorithm Collections Using Item Response Theory
Sevvandi Kandanaarachchi · 2020
An evaluation framework for algorithm portfolios using Item Response Theory (IRT). We use continuous and polytomous IRT models to evaluate algorithms and introduce algorithm characteristics such as stability, effectiveness and anomalousness (Kandanaarachchi, Smith-Miles 2020) .