Understanding Student Interaction with AI-Powered Next-Step Hints: Strategies and ChallengesGlobal
This program is tentative and subject to change.
Automated feedback generation plays a crucial role in enhancing personalized learning experiences in computer science education. Among different types of feedback, next-step hint feedback is particularly important, as it provides students with actionable steps to progress towards solving programming tasks. This study investigates how students interact with an AI-driven next-step hint system in an in-IDE learning environment. We gathered and analyzed a dataset from 34 students solving Kotlin tasks, containing over 6 million lines of code and detailed hint interaction logs. We applied process mining techniques and identified 16 common interaction scenarios, along with analyzing transitions between specific actions. Semi-structured interviews with 6 students revealed strategies for managing unhelpful hints, such as adapting partial hints or modifying code to generate multiple variations of the same hint. These findings, combined with our publicly available dataset, offer valuable opportunities for future research and provide key insights into student behavior with hint systems, helping to improve hint design for enhanced learning support.
This program is tentative and subject to change.
Thu 19 FebDisplayed time zone: Central Time (US & Canada) change
13:40 - 15:00 | |||
13:40 20mTalk | Assessing Student Proficiency in Foundational Developer Tools Through Live Checkoffs Papers | ||
14:00 20mTalk | Understanding Student Interaction with AI-Powered Next-Step Hints: Strategies and ChallengesGlobal Papers Anastasiia Birillo JetBrains Research, Aleksei Rostovskii JetBrains Research, Yaroslav Golubev JetBrains Research, Hieke Keuning Utrecht University | ||
14:20 20mTalk | Personalized Exam Prep (PEP): Scaling No-Stakes, No-LLM Dialogue-Based Assessments in a Large CS Course Papers | ||
14:40 20mTalk | Fine-Tuning Open-Source Models as a Viable Alternative to Proprietary LLMs for Explaining Compiler MessagesGlobal Papers Lorenzo Lee Solano University of New South Wales, Sydney, Charles Koutcheme Aalto University, Juho Leinonen Aalto University, Alexandra Vassar University of New South Wales, Sydney, Jake Renzella University of New South Wales, Sydney | ||