The Impact of Model Simulation on Semantic Conceptual Model Quality for Novice Modelers

The Impact of Model Simulation on Semantic Conceptual Model Quality for Novice Modelers

연구 분야: Strategies

학회: Software and Systems Modeling

Conceptual modeling is crucial for information systems development, yet novice modelers often struggle with ensuring a high semantic quality, leading to flawed system designs. This study investigates the impact of Feedback-enabled Interactive Rapid Prototyping (FIRP) simulation on novice modelers’ ability to identify and correct semantic errors in conceptual models. We analyzed data from 39 master-level students who used the MERODE prototyper in a FIRP simulation environment. We examined the relationship between testing effort, measured by event invocations and model coverage, and the likelihood of students identifying seeded semantic mistakes and providing correct solutions, using logistic regression. Logistic regression analyses revealed a statistically significant positive correlation between testing effort and the detection of specific behavioral constraint violations that resulted in deadlocks. However, the relationship was not consistent across all mistake types. FIRP simulation is particularly effective in helping novice modelers identify behavioral constraint violations that disrupt system workflows, i.e., those leading to deadlocks. Active model exploration through FIRP enhances error detection, highlighting its potential as a valuable tool for conceptual modeling education. However, the effectiveness varies with the type of semantic error, suggesting the need for tailored simulation strategies.