Detection and Elimination of Systematic Labeling Bias in Code Reviewer Recommendation Systems
K. Ayberk Tecimer, Eray Tüzün, Hamdi Dibeklioğlu, Hakan Erdogmus · Evaluation and Assessment in Software Engineering · 2021
Reviewer selection in modern code review is crucial for effective code reviews. Several techniques exist for recommending reviewers appropriate for a given pull request (PR). Most code reviewer recommendation techniques in the literature build and evaluate their models based on datasets collected from real projects using open-source or industrial practices. The techniques invariably presume that these datasets reliably represent the “ground truth.”