Teamwork assessment methods, such as peer evaluations, often fail to accurately capture the collaboration processes in team projects. While log data from digital collaboration tools (e.g., GitHub, Google Docs, Slack) provides objective evidence of contributions, effectively leveraging these data remains challenging. We conducted interviews (10 instructors, 16 students) and surveyed 51 students to identify their valued teamwork behaviors to guide log data usage, and investigate the perceived benefits and concerns. Students prioritized work-related behaviors such as equitable contribution and timeliness, whereas instructors additionally valued interaction behaviors like mutual support. Both groups highlighted significant limitations in existing log data, including omission of offline contributions, insufficient representation of work quality, mis-attributing contributions to “scribe” only, and risks of “gaming the data”. Many students reviewed logs on their own to monitor project progress and workload equity, but lacked structured guidance to meaningfully interpret the insights. Our findings underscore the need for student-centered teamwork assessment approaches that enable students to not only annotate and contextualize their own data, but also improve their teamwork by reflecting on a rubric of valued teamwork behaviors.

Thu 19 Feb

Displayed time zone: Central Time (US & Canada) change

10:40 - 12:00
Assessing Collaboration: Tools, Practices, and Student DynamicsPapers at Meeting Room 103-104
Chair(s): David Smith Virginia Tech
10:40
20m
Talk
A Pedagogy for Assessing Individual Contributions to Team-Based Software Projects
Papers
Yolanda Reimer University of Montana, Chris Hundhausen Oregon State University, USA, Ananth Jillepalli Washington State University, Olusola Adesope Washington State University
11:00
20m
Talk
Competing or Collaborating? The Role of Hackathon Formats in Shaping Team Dynamics and Project Choices
Papers
Sadia Nasrin Tisha pc, Md Nazmus Sakib University of Maryland, Baltimore County, Sanorita Dey University of Maryland, Baltimore County
11:20
20m
Talk
From Data to Action: Empowering Students to Assess and Improve Teamwork with Cross-Tool Log Data
Papers
Yifan Song University of Illinois Urbana-Champaign, Ritika Vithani University of Illinois Urbana-Champaign, Wenxuan Wendy Shi University of Illinois Urbana-Champaign, Brian Bailey University of Illinois Urbana-Champaign
11:40
20m
Talk
Improving Professional Dispositions in Computing Curriculum Using Sequential Peer AssessmentGlobal
Papers
Dhaval K Patel Ahmedabad University, Ayush N. Patel Northeastern University, USA, Raj N. Dave Northwestern University