Evaluation of Systems Programming Exercises through Tailored Static Analysis

Evaluation of Systems Programming Exercises through Tailored Static Analysis

연구 분야: Verification

학회: SIGCSETS 2025: Proceedings of the 56th ACM Technical Symposium on Computer Science Education V. 1

In large programming classes, it takes a significant effort from teachers to evaluate exercises and provide detailed feedback. In systems programming, test cases are not sufficient to assess exercises, since concurrency and resource management bugs are difficult to reproduce. This paper presents an experience report on static analysis for the automatic evaluation of systems programming exercises. We design systems programming assignments with static analysis rules that are tailored for each assignment, to provide detailed and accurate feedback. Our evaluation shows that static analysis can identify a significant number of erroneous submissions missed by test cases.