Teaching and Assessing at Scale: The Use of Objective Rubrics and Structured Feedback Teaching and Assessing at Scale: The Use of Objective Rubrics and Structured Feedback

Grey, Simon; Gordon, Neil

Abstract

It is widely recognised that feedback is an important part of learning: effective feedback should result in a meaningful change in student behaviour (Morris et al., 2021). However, individual feedback takes time to produce, and for large cohorts-typified by the North of 300 challenge in computing (CPHC, 2019), it can be difficult to do so in a timely manner. On occasion it seems that many academics lose sight of the purpose of feedback, and instead view it to justify a mark, rather than an opportunity to provide meaningful tuition. One strategy to provide feedback at scale is to share the workload across multiple staff, but this introduces an additional problem in ensuring that the feedback and marking are equitable and consistent. In this paper we present a case study from teaching programming that attempts to address two distinct, but related issues. The first issue is to make feedback more meaningful. We attempt to achieve this by providing detailed feedback on a draft submission of programming coursework allowing students time to make changes to their work prior to the final submission date. We present an analysis of the data generated from this approach, and its potential impact on student behaviour. The second issue is that of scalability. This feedforward approach creates a significant pressure on marking and on the necessity to provide feedback on a draft submission to large numbers of students in good time so that students can act upon it. To achieve this, we consider an approach based on creating an objective, reusable marking rubric so that the work can be reasonably spread across multiple members of staff. We present an analysis of the data generated from this approach to determine whether we consider the rubric to be objective enough to remove individual interpretations and biases, and where discrepancies exist attempt to determine where those discrepancies arise. This work was carried out through an analysis of impact on student assessment, as well as from the academic staff involved in using the rubrics. Preliminary results from this work show that the more objective rubric used by several did enable a scalable solution for rapid feedback on submissions, and this did indicate some improvement in student outcomes. However, the work also illustrated the problems of subjective interpretations and some variation in outcomes by marker.

Citation

Grey, S., & Gordon, N. (2024). Teaching and Assessing at Scale: The Use of Objective Rubrics and Structured Feedback Teaching and Assessing at Scale: The Use of Objective Rubrics and Structured Feedback. New Directions in the Teaching of Physical Sciences, 19(1), 1-9. https://doi.org/10.29311/ndtns.vi19.4103

• Journal Article Type: Article
• Acceptance Date: Oct 14, 2024
• Online Publication Date: Dec 18, 2024
• Publication Date: Dec 18, 2024
• Deposit Date: Dec 19, 2024
• Publicly Available Date: Dec 20, 2024
• Journal: New Directions in the Teaching of Natural Sciences
• Print ISSN: 1740-9888
• Electronic ISSN: 2051-3615
• Publisher: Higher Education Academy
• Peer Reviewed: Peer Reviewed
• Volume: 19
• Issue: 1
• Pages: 1-9
• DOI: https://doi.org/10.29311/ndtns.vi19.4103
• Keywords: Computing Education; Feedback; Teaching Programming
• Public URL: https://hull-repository.worktribe.com/output/4965892
• Publisher URL: https://journals.le.ac.uk/index.php/new-directions/article/view/4103