Adaptive Scaffolding in Block-Based Programming via Synthesizing New Tasks as Pop Quizzes

Adaptive Scaffolding in Block-Based Programming via Synthesizing New Tasks as Pop Quizzes

Abstract

Block-based programming environments are increasingly used to introduce computing concepts to beginners. However, novice students often struggle in these environments, given the conceptual and open-ended nature of programming tasks. To effectively support a student struggling to solve a given task, it is important to provide adaptive scaffolding that guides the student towards a solution. We introduce a scaffolding framework based on pop quizzes presented as multi-choice programming tasks. To automatically generate these pop quizzes, we propose a novel algorithm, PQuizSyn. More formally, given a reference task with a solution code and the student’s current attempt, PQuizSyn synthesizes new tasks for pop quizzes with the following features: (a) Adaptive (i.e., individualized to the student’s current attempt), (b) Comprehensible (i.e., easy to comprehend and solve), and (c) Concealing (i.e., do not reveal the solution code). Our algorithm synthesizes these tasks using techniques based on symbolic reasoning and graph-based code representations. We show that our algorithm can generate hundreds of pop quizzes for different student attempts on reference tasks from Hour of Code: Maze Challenge [11] and Karel [9]. We assess the quality of these pop quizzes through expert ratings using an evaluation rubric. Further, we have built an online platform for practicing block-based programming tasks empowered via pop quiz based feedback, and report results from an initial user study.

Grafik Top
Authors
  • Ghosh, Ahana
  • Tschiatschek, Sebastian
  • Devlin, Sam
  • Singla, Adish
Grafik Top
Shortfacts
Category
Paper in Conference Proceedings or in Workshop Proceedings (Paper)
Event Title
Artificial Intelligence in Education: 23rd International Conference, AIED 2022
Divisions
Data Mining and Machine Learning
Subjects
Kuenstliche Intelligenz
Event Location
Durham, UK
Event Type
Conference
Event Dates
27.-31.07.2022
Series Name
Artificial Intelligence in Education: 23rd International Conference, AIED 2022, Durham, UK, July 27–31, 2022, Proceedings, Part I
ISSN/ISBN
978-3-031-11644-5
Page Range
pp. 28-40
Date
27 July 2022
Export
Grafik Top