Student-weighted Multiple Choice Tests

Date
2015-05-12
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
Large-enrolment courses routinely administer multiple choice tests. Well-thought-out multiple choice tests are excellent assessment instruments, but their format allows for guessing. Furthermore, the opportunity for students to highlight their levels of mastery of material is not necessarily present. Frary (1989) reviews multiple choice methods that attempt to capture student knowledge in each question. In this workshop, we will discuss one such format of multiple choice testing known as Confidence Weighting (Echternacht, 1972). In this model, students are given a certain freedom to assign relative weights to individual questions representing their belief in the correctness of their response. The purpose of this is to allow students to demonstrate their level of confidence on their true knowledge of the material. Thus, students with identical responses to the questions may receive different overall scores depending on their indicated degree of confidence for each question. We experimented using this method in two first-year calculus courses during three semesters in 2014. During this workshop, we describe our experience along with issues encountered while using this model. The session will be interactive allowing for participants to share ideas and their personal experiences with various multiple-choice models. The model described here has not been widely used and we hope to explore questions and possible issues that may arise with the workshop participants. The outcome will be ideas for improvements to the Confidence Weighting method that can be applied in future courses. Variations on this method will also be explored and discussed (Lang, 2014).
Description
Keywords
Citation