Characterizing the Relationship Between Generative AI, Student Behavior, and Learning Outcomes in Upper-Level CS Education: A Case Study in an Undergraduate Machine Learning Course (SIGCSE TS 2026 - ACM Student Research Competition)

Who

Anha Khan, Romina Mahinpei, Maryam Hedayati, Victoria Dean, Ruth Fong

Track

SIGCSE TS 2026 ACM Student Research Competition

Time Zone

The program is currently displayed in (GMT-06:00) Central Time (US & Canada).

Use conference time zone: (GMT-06:00) Central Time (US & Canada)Select other time zone

The GMT offsets shown reflect the offsets at the moment of the conference.

Time Band

By setting a time band, the program will dim events that are outside this time window. This is useful for (virtual) conferences with a continuous program (with repeated sessions).
The time band will also limit the events that are included in the personal iCalendar subscription service.

Display full programSpecify a time band

Save

When

Thu 19 Feb 2026 15:00 - 17:00 at Hall 1 - Posters - ACM Student Research Competition Posters

Abstract

As generative artificial intelligence (genAI) tools become embedded in educational workflows, it is essential to understand how students use such systems for learning beyond introductory programming. This work investigates the relationship between students’ genAI usage and conceptual understanding of mathematical and algorithmic principles in an undergraduate machine learning course with 136 students. We develop and deploy a course-specific, custom-interfaced large language model (LLM), CubBot, to examine 1. how students interact with genAI in an upper-level CS course via an analysis of anonymized chat logs, and 2. how genAI usage relates to students’ conceptual understanding and learning outcomes via a randomized, controlled assessment comparing performance with and without CubBot access. This research contributes to the growing body of work on genAI-supported education by providing one of the first empirical investigations of genAI’s relationship with conceptual learning in an upper-level computer science course.

Anha Khan

Princeton University

United States

Romina Mahinpei

Princeton University

Maryam Hedayati

Princeton University

United States

Victoria Dean

Princeton University

United States

Ruth Fong

Princeton University

United States

Time Zone

The program is currently displayed in (GMT-06:00) Central Time (US & Canada).

Use conference time zone: (GMT-06:00) Central Time (US & Canada)Select other time zone

The GMT offsets shown reflect the offsets at the moment of the conference.

Time Band

Display full programSpecify a time band

Save

Session Program

Thu 19 Feb
Displayed time zone: Central Time (US & Canada) change

15:00 - 17:00	ACM Student Research Competition PostersACM Student Research Competition at Hall 1 - Posters

15:00 2h Talk		Undergraduate Students' Struggles in Computer Science ACM Student Research Competition Sai Nakirikanti Georgia Institute of Technology, Idel Martinez-Ramos Georgia Institute of Technology, Betsy Disalvo Georgia Institute of Technology
15:00 2h Talk		Improving Privilege Levels and Memory Protection for Teaching in Embedded Xinu ACM Student Research Competition Spencer Christensen Marquette University, Spencer O'Brien Marquette University
15:00 2h Talk		Why Do Some US States Offer More Computer Science Courses Than Others? A Mixed-Methods Analysis of Access Gaps ACM Student Research Competition Pranavi Kamana University of Maryland, Nooshya Roshanian University of Maryland, Mahi Thakkar University of Maryland
15:00 2h Talk		Emerging AI and the Need for a Novel Evaluation Framework in Undergraduate Computer Science Education ACM Student Research Competition Rudraksh Chaudhry University of Massachusetts, Amherst, Emily Nutwell University of Massachusetts, Amherst
15:00 2h Talk		Ungraded Assignments in Introductory Computing: A Report ACM Student Research Competition Yehya Sleiman Tellawi University of Illinois - Urbana Champaign, Abhishek Umrawal University of Illinois Urbana-Champaign
15:00 2h Talk		Reading Proficiency and Performance in Introductory CS: A Lexile Level Based Analysis of Cognitive Load and Assessment Outcome ACM Student Research Competition Elizabeth Thomas-Cappello University of Albany, SUNY
15:00 2h Talk		Characterizing the Relationship Between Generative AI, Student Behavior, and Learning Outcomes in Upper-Level CS Education: A Case Study in an Undergraduate Machine Learning Course ACM Student Research Competition Anha Khan Princeton University, Romina Mahinpei Princeton University, Maryam Hedayati Princeton University, Victoria Dean Princeton University, Ruth Fong Princeton University
15:00 2h Talk		Personalized Coding Problem Generation Using Open-source Small Language Models ACM Student Research Competition Oscar Jimenez Rodriguez Ithaca College
15:00 2h Talk		“Born Accessible” Visualizers for Scheme Program State ACM Student Research Competition Jacob Bell Grinnell College, Anna Deschamps Grinnell College, Eva Kapoor Grinnell College, Salyan Karki Grinnell College, Julian Kim Grinnell College, Nicole Moreno Gonzalez Grinnell College, William Pitchford Grinnell College, Elene Sturua Grinnell College, Charles Wade Grinnell College
15:00 2h Talk		Adaptive Uncertainty-Aware Fusion for Robust Multimodal Learning ACM Student Research Competition Cy Xie De Anza college
15:00 2h Talk		Debugging Boredom: The Quest for Joy in Computer Science Education ACM Student Research Competition Jessica Yauney Stanford University
15:00 2h Talk		Teaching Middle School Learners AI Hallucinations Through Chatbot Design ACM Student Research Competition Deniz Ozturk North Carolina State University
15:00 2h Talk		Too Late to Succeed? Demographic Trends and Academic Performance in Introductory Computing ACM Student Research Competition Victoria Phelps UC Berkeley, Sahana Bharadwaj University of California, Berkeley, Zihao Huang UC Berkeley, Aananya Lakhani UC Berkeley, Oindree Chatterjee University of California, Berkeley, Heidy Hernandez UC Berkeley, Jordan Schwartz UC Berkeley, Anneliese Galler UC Berkeley, Stacey Yoo UC Berkeley
15:00 2h Talk		Automated Assessment Tools: Feedback to and from StudentsGlobal ACM Student Research Competition Matthew James Francis Moloughney Cardiff University
15:00 2h Talk		Impact of Computing Education by School Type and County on K-12 Students’ AI Literacy ACM Student Research Competition Ally Fu University of Maryland College Park
15:00 2h Talk		Teacher Capacity as a Catalyst: Examining a Research-Practice Partnership’s Impact ACM Student Research Competition Karanjot Kaur The University of Texas at Austin
15:00 2h Talk		Label-Free Evaluation of Retrieval-Augmented Generation in a University Policy Chatbot ACM Student Research Competition Lusine Hayrapetyan California State University, San Bernardino
15:00 2h Talk		Adaptable Metrics to Assess and Improve Introductory CS ACM Student Research Competition Yuan Garcia Harvey Mudd College, Florence Rui Lin Harvey Mudd College, Jenny Ngo Harvey Mudd College, Edward Donson Harvey Mudd College
15:00 2h Talk		Pedagogical Process Models of Undergraduate Computing Tutors ACM Student Research Competition Esse Ciego University of Florida, Skyler Steiert University of Florida, Amanpreet Kapoor University of Florida, USA
15:00 2h Talk		Applying Universal Design for Learning to Undergraduate Computer Science Education ACM Student Research Competition Hia Ghosh University of Massachusetts, Amherst
15:00 2h Talk		MerryQuery in the Loop: How Students Use and Perceive a GenAI-Powered Assistant in an Introductory Programming Course ACM Student Research Competition Benyamin Tabarsi North Carolina State University
15:00 2h Talk		Visualizing and Sonifying Abstract Syntax Trees for Accessibility: Supporting Neurodiverse and Blind and Low-Vision Users in an Educational IDE ACM Student Research Competition Jacob Bell Grinnell College, Anna Deschamps Grinnell College, Eva Kapoor Grinnell College, Salyan Karki Grinnell College, Julian Kim Grinnell College, Nicole Moreno Gonzalez Grinnell College, William Pitchford Grinnell College, Elene Sturua Grinnell College, Charles Wade Grinnell College, Samuel A. Rebelsky Grinnell College
15:00 2h Talk		Investigating the Efficacy of Mastery-Based Tests in Fostering Effective Self-Regulated Learning Behaviors in CS1 Courses ACM Student Research Competition Joyce Gill Grinnell College, Michael Asher Carnegie Mellon University, Paulo Carvalho Carnegie Mellon University