Static code-analysis metrics have long been used to assess and guide successful software projects. Traditionally, these metrics have measured software’s commercial or professional suitability. This work explores six code metrics designed to provide educational insight, specifically comparing pre- and post-LLM student work. With these metrics we measure over a thousand CS1 and CS2 final-projects, completed from 2018 to 2024 inclusive. We first examine how student work has changed with the curriculum’s embrace of LLMs in 2023. The results show a clear LLM-correlated impact on students’ early computing work, both positive and negative. Our CS1 offers five different project themes, and we add perspective by comparing how the metrics vary across these themes. The results underscore the enduring importance of curriculum, pedagogy, and scaffolding on student work. We conclude with our program’s ongoing adaptations to this mix of signals, increasing student agency and prioritizing student demonstrations and discussions of their chosen project work.

Thu 19 Feb

Displayed time zone: Central Time (US & Canada) change

15:00 - 17:00
ACM Student Research Competition PostersACM Student Research Competition at Hall 1 - Posters
15:00
2h
Talk
Undergraduate Students' Struggles in Computer Science
ACM Student Research Competition
Sai Nakirikanti Georgia Institute of Technology, Idel Martinez-Ramos Georgia Institute of Technology, Betsy Disalvo Georgia Institute of Technology
15:00
2h
Talk
Improving Privilege Levels and Memory Protection for Teaching in Embedded Xinu
ACM Student Research Competition
Spencer Christensen Marquette University, Spencer O'Brien Marquette University
15:00
2h
Talk
Why Do Some US States Offer More Computer Science Courses Than Others? A Mixed-Methods Analysis of Access Gaps
ACM Student Research Competition
Pranavi Kamana University of Maryland, Nooshya Roshanian University of Maryland, Mahi Thakkar University of Maryland
15:00
2h
Talk
Emerging AI and the Need for a Novel Evaluation Framework in Undergraduate Computer Science Education
ACM Student Research Competition
Rudraksh Chaudhry University of Massachusetts, Amherst, Emily Nutwell University of Massachusetts, Amherst
15:00
2h
Talk
Ungraded Assignments in Introductory Computing: A Report
ACM Student Research Competition
Yehya Sleiman Tellawi University of Illinois - Urbana Champaign, Abhishek Umrawal University of Illinois Urbana-Champaign
15:00
2h
Talk
Reading Proficiency and Performance in Introductory CS: A Lexile Level Based Analysis of Cognitive Load and Assessment Outcome
ACM Student Research Competition
Elizabeth Thomas-Cappello University of Albany, SUNY
15:00
2h
Talk
Characterizing the Relationship Between Generative AI, Student Behavior, and Learning Outcomes in Upper-Level CS Education: A Case Study in an Undergraduate Machine Learning Course
ACM Student Research Competition
Anha Khan Princeton University, Romina Mahinpei Princeton University, Maryam Hedayati Princeton University, Victoria Dean Princeton University, Ruth Fong Princeton University
15:00
2h
Talk
Personalized Coding Problem Generation Using Open-source Small Language Models
ACM Student Research Competition
15:00
2h
Talk
“Born Accessible” Visualizers for Scheme Program State
ACM Student Research Competition
Jacob Bell Grinnell College, Anna Deschamps Grinnell College, Eva Kapoor Grinnell College, Salyan Karki Grinnell College, Julian Kim Grinnell College, Nicole Moreno Gonzalez Grinnell College, William Pitchford Grinnell College, Elene Sturua Grinnell College, Charles Wade Grinnell College
15:00
2h
Talk
Adaptive Uncertainty-Aware Fusion for Robust Multimodal Learning
ACM Student Research Competition
Cy Xie De Anza college
15:00
2h
Talk
Debugging Boredom: The Quest for Joy in Computer Science Education
ACM Student Research Competition
Jessica Yauney Stanford University
15:00
2h
Talk
Teaching Middle School Learners AI Hallucinations Through Chatbot Design
ACM Student Research Competition
Deniz Ozturk North Carolina State University
15:00
2h
Talk
Too Late to Succeed? Demographic Trends and Academic Performance in Introductory Computing
ACM Student Research Competition
Victoria Phelps UC Berkeley, Sahana Bharadwaj University of California, Berkeley, Zihao Huang UC Berkeley, Aananya Lakhani UC Berkeley, Oindree Chatterjee University of California, Berkeley, Heidy Hernandez UC Berkeley, Jordan Schwartz UC Berkeley, Anneliese Galler UC Berkeley, Stacey Yoo UC Berkeley
15:00
2h
Talk
Automated Assessment Tools: Feedback to and from StudentsGlobal
ACM Student Research Competition
15:00
2h
Talk
Impact of Computing Education by School Type and County on K-12 Students’ AI Literacy
ACM Student Research Competition
Ally Fu University of Maryland College Park
15:00
2h
Talk
Teacher Capacity as a Catalyst: Examining a Research-Practice Partnership’s Impact
ACM Student Research Competition
Karanjot Kaur The University of Texas at Austin
15:00
2h
Talk
Label-Free Evaluation of Retrieval-Augmented Generation in a University Policy Chatbot
ACM Student Research Competition
Lusine Hayrapetyan California State University, San Bernardino
15:00
2h
Talk
Adaptable Metrics to Assess and Improve Introductory CS
ACM Student Research Competition
Yuan Garcia Harvey Mudd College, Florence Rui Lin Harvey Mudd College, Jenny Ngo Harvey Mudd College, Edward Donson Harvey Mudd College
15:00
2h
Talk
Pedagogical Process Models of Undergraduate Computing Tutors
ACM Student Research Competition
Esse Ciego University of Florida, Skyler Steiert University of Florida, Amanpreet Kapoor University of Florida, USA
15:00
2h
Talk
Applying Universal Design for Learning to Undergraduate Computer Science Education
ACM Student Research Competition
Hia Ghosh University of Massachusetts, Amherst
15:00
2h
Talk
MerryQuery in the Loop: How Students Use and Perceive a GenAI-Powered Assistant in an Introductory Programming Course
ACM Student Research Competition
Benyamin Tabarsi North Carolina State University
15:00
2h
Talk
Visualizing and Sonifying Abstract Syntax Trees for Accessibility: Supporting Neurodiverse and Blind and Low-Vision Users in an Educational IDE
ACM Student Research Competition
Jacob Bell Grinnell College, Anna Deschamps Grinnell College, Eva Kapoor Grinnell College, Salyan Karki Grinnell College, Julian Kim Grinnell College, Nicole Moreno Gonzalez Grinnell College, William Pitchford Grinnell College, Elene Sturua Grinnell College, Charles Wade Grinnell College, Samuel A. Rebelsky Grinnell College
15:00
2h
Talk
Investigating the Efficacy of Mastery-Based Tests in Fostering Effective Self-Regulated Learning Behaviors in CS1 Courses
ACM Student Research Competition
Joyce Gill Grinnell College, Michael Asher Carnegie Mellon University, Paulo Carvalho Carnegie Mellon University