Teaching Simulation as a Research Method in Empirical Software Engineering

2025-01-08

AI Summary

A significant gap exists in empirical software engineering education, specifically the absence of a dedicated pedagogical framework for teaching simulation-based research methods. Method: This study proposes the first teaching framework tailored to simulation methodology in empirical software engineering. Grounded in educational design principles, analysis of empirical research paradigms, and reflective teaching practice, it defines hierarchical learning objectives and integrates case-based instruction, simulation laboratories, and research-project-driven learning. It further introduces reusable pedagogical guidelines and modular course materials. Contribution/Results: The framework has been implemented in graduate courses across multiple universities. Empirical evaluation demonstrates substantial improvement in students’ competencies in designing, conducting, and critically evaluating simulation-based empirical studies. By systematically embedding simulation methodology into software engineering education, this work addresses a longstanding curricular void and advances methodological training in empirical software engineering.

Technology Category

• Search and Optimization: Sampling/Simulation-based Search
• Cognitive Modeling & Cognitive Systems: Simulating Human Behavior
• Multiagent Systems: Agent-Based Simulation and Emergent Behavior

Application Category

• Web Mining and Content Analysis: Web data generation and simulation
• User Modeling, Personalization and Recommendation: User modeling and simulation for interactive and conversational systems
• Search and Retrieval-Augmented AI: Web evaluation methodologies and metrics

Abstract

The chapter supports educators and postgraduate students in understanding the role of simulation in software engineering research based on the authors' experience. This way, it includes a background positioning simulation-based studies in software engineering research, the proposition of learning objectives for teaching simulation as a research method, and presents our experience when teaching simulation concepts and practice. For educators, it further provides learning objectives when teaching simulation, considering the current state of the art in software engineering research and the necessary guidance and recommended learning activities to achieve these objectives. For students, it drives the learning path for those interested in learning this method but had no opportunity to engage in an entire course on simulation in the context of empirical research.

Problem

• Software Engineering Education
• Simulation Methodology
• Application in Software Development

Innovation

• Simulation Methodology
• Software Engineering Education
• Teaching Strategies