Problem
Research questions and friction points this paper is trying to address.
software testing
critical testing literacy
puzzle-based learning
pedagogy
education
Learning Critical Testing Literacy Through Puzzles: an Experience Report
🤖 AI Summary
This study addresses the persistent challenge of insufficient development of critical testing literacy in software testing education. Building upon a cognitive model of the critical tester, it proposes P4TEST—a pedagogical framework centered on puzzle-driven learning activities structured around a “do–debrief–reflect” cycle—and introduces an open-source web application enabling customizable workshops. Through 13 semi-structured workshops employing think-aloud protocols, written reflections, and behavioral observation, the research finds that puzzles effectively stimulate experimental learning: students tend to converge on solutions, whereas professionals engage in more sustained exploration. Think-aloud protocols foster immediate reasoning, while reflective writing enhances metacognition. The findings validate puzzles as an effective vehicle for teaching software testing and offer a scalable, practice-oriented paradigm for testing education.
📝 Abstract
In this paper, we report our experiences and takeaways from workshops using puzzles to learn CTL.
Background: Software testing is important yet difficult to teach. We introduced a BoK of puzzle-based learning activities to teach CTL, based on a model of critical tester's cognition, leading to the pedagogical framework P4TEST. We conducted thirteen workshops with students, testers, teachers, and primary school pupils to assess puzzle-based teaching of critical testing literacy.
Experience: Across eleven workshops, we used a semi-structured approach, varying puzzles, materials, and timing. In two additional workshops, we introduced workbooks and think-aloud sessions to gather more data on the learning experience.
Observations: Participants consistently perceived themselves as experimenting while solving puzzles. Students tended to converge on solutions, while professionals continued exploring. Emotions were visible in behaviour but hard to surface through written reflection alone. Think-aloud sessions revealed immediate reasoning; written reflections elicited more meta-cognitive reflection. The theme Sensemaking / reflection-in-action captured how participants framed problems, navigated dead ends, and shifted strategies.
Reflections: Puzzles are not the intervention: the entire sequence of solving, debriefing, and reflecting is. Designing that sequence more deliberately is the work ahead. We also developed an open-source web application with built-in analytics to customise workshops.
Innovation
Methods, ideas, or system contributions that make the work stand out.
puzzle-based learning
critical testing literacy
P4TEST framework
think-aloud protocol
software testing education
🔎 Similar Papers
No similar papers found.
