From Data to Action: Empowering Students to Assess and Improve Teamwork with Cross-Tool Log Data
Teamwork assessment methods, such as peer evaluations, often fail to accurately capture the collaboration processes in team projects. While log data from digital collaboration tools (e.g., GitHub, Google Docs, Slack) provides objective evidence of contributions, effectively leveraging these data remains challenging. We conducted interviews (10 instructors, 16 students) and surveyed 51 students to identify their valued teamwork behaviors to guide log data usage, and investigate the perceived benefits and concerns. Students prioritized work-related behaviors such as equitable contribution and timeliness, whereas instructors additionally valued interaction behaviors like mutual support. Both groups highlighted significant limitations in existing log data, including omission of offline contributions, insufficient representation of work quality, mis-attributing contributions to “scribe” only, and risks of “gaming the data”. Many students reviewed logs on their own to monitor project progress and workload equity, but lacked structured guidance to meaningfully interpret the insights. Our findings underscore the need for student-centered teamwork assessment approaches that enable students to not only annotate and contextualize their own data, but also improve their teamwork by reflecting on a rubric of valued teamwork behaviors.
Thu 19 FebDisplayed time zone: Central Time (US & Canada) change
10:40 - 12:00 | Assessing Collaboration: Tools, Practices, and Student DynamicsPapers at Meeting Room 103-104 Chair(s): David Smith Virginia Tech | ||
10:40 20mTalk | A Pedagogy for Assessing Individual Contributions to Team-Based Software Projects Papers Yolanda Reimer University of Montana, Chris Hundhausen Oregon State University, USA, Ananth Jillepalli Washington State University, Olusola Adesope Washington State University | ||
11:00 20mTalk | Competing or Collaborating? The Role of Hackathon Formats in Shaping Team Dynamics and Project Choices Papers Sadia Nasrin Tisha pc, Md Nazmus Sakib University of Maryland, Baltimore County, Sanorita Dey University of Maryland, Baltimore County | ||
11:20 20mTalk | From Data to Action: Empowering Students to Assess and Improve Teamwork with Cross-Tool Log Data Papers Yifan Song University of Illinois Urbana-Champaign, Ritika Vithani University of Illinois Urbana-Champaign, Wenxuan Wendy Shi University of Illinois Urbana-Champaign, Brian Bailey University of Illinois Urbana-Champaign | ||
11:40 20mTalk | Improving Professional Dispositions in Computing Curriculum Using Sequential Peer AssessmentGlobal Papers Dhaval K Patel Ahmedabad University, Ayush N. Patel Northeastern University, USA, Raj N. Dave Northwestern University | ||