The effectiveness of examiner training in a simulation-based assessment of cardiac physical examination competence

Date
2013-01-25
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
Background: Examiner training is considered the most effective method to minimize psychometric errors in measurement for performance-based assessments. Purpose: To assess the effect of frame-of-reference training on the perceptions and scoring of examiners rating videotaped OSCE performances. Methods: Post-graduate medical trainees participated in a simulation-based OSCE designed to evaluate cardiac physical examination competence. Scores of these performances by a cohort of examiners trained in the frame-of-reference technique were compared to an untrained group. Examiner perceptions of the training and scoring process were assessed. Results: No significant differences were found in the mean scores and the internal consistency of the scoring tool between examiner cohorts. Examiners felt that training was potentially useful, although refinement of the frame-of-reference technique may have been required. Conclusion: Additional studies are needed to determine if examiner training is effective and to identify how this might be most effectively delivered.
Description
Keywords
Health Sciences, Medicine and Surgery, Psychometrics
Citation
Haw For Chin, O. R. (2013). The effectiveness of examiner training in a simulation-based assessment of cardiac physical examination competence (Master's thesis, University of Calgary, Calgary, Canada). Retrieved from https://prism.ucalgary.ca. doi:10.11575/PRISM/28072