During the COVID-19 pandemic, many courses were forced to move to online teaching and assessments. This paper compares student performance in four offerings of a CS0 course, two of which were fully online (including un-proctored online assessments), and two of which were offered in a hybrid manner, with proctored in-person assessments. Comparing students’ performance on identical exam questions across the four course offerings revealed that students generally scored far better on the un-proctored online assessments than the proctored in-person assessments. The largest differences were generally observed for questions that only required students to recall statements that were included on the provided lecture slides, or were written on the slides by the course instructor as the material was taught.