Advances in Automatic Software Testing: Test-Comp 2025

Advances in Automatic Software Testing: Test-Comp 2025

연구 분야: Verification

학회: International Conference on Fundamental Approaches to Software Engineering

The 7th edition of the Competition on Software Testing (Test-Comp 2025) provides an overview and comparative evaluation of automatic test-suite generators for C programs. The experimental evaluation was performed on a benchmark set of 11 226 test-generation tasks for C programs. Each test-generation task consisted of a program and a test specification. The test specifications included error coverage (generate a test suite that exhibits a bug) and branch coverage (generate a test suite that executes as many program branches as possible). Test-Comp 2025 evaluated 20 software systems for test generation that are all freely available. This included 13 test-suite generators that participated with active support from teams led by 12 different representatives from 8 countries (actively maintained software systems, participation in competition jury). Test-Comp 2025 had 1 new participant ( ) and 2 re-entries (ESBMC-INCR, ESBMC-KIND). The evaluation included also 7 test-generation tools from previous years.