A Bug's New Life: Creating Refute Questions from Filtered CS1 Student Code Snapshots
Nimisha Agarwal, Viraj Kumar, Arun Raman, Amey Karkare · 2023
In an introductory programming (CS1) context, a Refute question asks students for a counter-example which proves that a given code fragment is an incorrect solution for a given task. Such a question can be used as an assessment item to (formatively) develop or (summatively) demonstrate a student's abilities to comprehend the task and the code well enough to recognize a mismatch. These abilities assume greater significance with the emergence of generative AI technologies capable of writing code that is plausible (at least to novice programmers) but not always correct.