This program is tentative and subject to change.

Timely and high-quality feedback is essential for effective learning in programming courses; yet, providing such support at scale remains a challenge. While AI-based systems offer scalable and immediate help, their responses can occasionally be inaccurate or insufficient. Human instructors, in contrast, may bring more valuable expertise but are limited in time and availability. To address these limitations, we present a hybrid help framework that integrates AI-generated hints with an escalation mechanism, allowing students to request feedback from instructors when AI support falls short. This design leverages the strengths of AI for scale and responsiveness while reserving instructor effort for moments of greatest need. We deployed this tool in a data science programming course with 82 students. We observe that out of the total 673 AI-generated hints, students rated 146 (22%) as unhelpful. Among those, only 16 (11%) of the cases were escalated to the instructors. A qualitative investigation of instructor responses showed that those feedback instances were incorrect or insufficient roughly half of the time. This finding suggests that when AI support fails, even instructors with expertise may need to pay greater attention to avoid making mistakes. We will publicly release the tool for broader adoption and enable further studies in other classrooms. Our work contributes a practical approach to scaling high-quality support and informs future efforts to effectively integrate AI and humans in education.

This program is tentative and subject to change.

Fri 20 Feb

Displayed time zone: Central Time (US & Canada) change

10:40 - 12:00
AI in the Classroom: Reflection, Help-Seeking, and Other MiraclesPapers at Meeting Room 260-267
10:40
20m
Talk
A ''watch your replay videos'' Reflection Assignment on Comparing Programming without versus with Generative AI: Learning about Programming, Critical AI Use and Limitations, and Reflection
Papers
Sarah Magz Fernandez University of Maine, Greg L Nelson University of Maine
11:00
20m
Talk
Closing the Loop: An Instructor-in-the-Loop AI Assistance System for Supporting Student Help-Seeking in Programming EducationERT Best Paper
Papers
Tung Phung MPI-SWS, Heeryung Choi University of Minnesota, Mengyan Wu University of Michigan - Ann Arbor, Christopher Brooks University of Michigan, Sumit Gulwani Microsoft, Adish Singla Max Planck Institute for Software Systems
11:20
20m
Talk
Enhancing Student Engagement and Learning in Database Programming Through Active Learning Strategies
Papers
Ignacio Marco-Pérez Universidad de La Rioja, Beatriz Pérez Universidad de La Rioja
11:40
20m
Talk
Owlgorithm: Supporting Self-Regulated Learning in Competitive Programming through LLM-Driven Reflection
Papers
Juliana Nieto Universidad Nacional de Columbia, Erin Kramer Purdue University, Peter Kurto Purdue University, Ethan Dickey Purdue University, Andres Mauricio Bejarano Posada Purdue University