Developing an in-house Augmented Reality Optical-see-through Head-Mounted Display for Computing Education
Teaching dynamic computing concepts, such as the quick-sort’s partitioning step and linked-list pointer updates, can be challenging for students to visualize and interact with in real time. Augmented reality (AR) can make these processes tangible by overlaying immediate feedback on the physical objects, but commercial optical see-through head-mounted displays (OST-HMDs) remain costly and closed-source, limiting the adoption in typical classrooms.
To address this, we adapted a low-cost OST-HMD open-source project (Project Northstar) for computing education. This in-house OST-HMD uses 3D-printed parts and commodity components, dual micro-displays, and tracking sensors. We documented our experience and provided a practical and repeatable workflow for mechanical assembly and optical calibration, including a troubleshooting guide for commonly faced problems such as how to calibrate the optics for a stable virtual–real alignment.
The current prototype operates as a secondary display driven by a host laptop, and software for interactive activities is in active development. Following software completion, we will pilot AR activities that walk students through quick-sort partitioning and step-by-step linked-list pointer updates. We will evaluate learning and usability using pre- and post-quizzes, task-completion times, and a post-task usability survey.
This poster contributes (1) a reproducible bill of materials with transparent parts costs, (2) 3D-printable models and wiring diagrams, and (3) a calibration workflow with representative results. We aim to provide an open-source replicable OST-HMD build to lower financial and technical barriers for AR adoption in computer science (CS) courses.