Milestones: a Rapid Assessment Method for the Clinical Competency Committee

Authors

Christopher Nabors, New York Medical CollegeFollow
Leanne Forman, New York Medical CollegeFollow
S Peterson
Melissa Gennarelli, New York Medical CollegeFollow
Wilbert Aronow, New York Medical CollegeFollow
Lawrence DeLorenzo, New York Medical CollegeFollow
Dipak Chandy, New York Medical CollegeFollow
C Ahn
Sachin Sule, New York Medical CollegeFollow
Gary Stallings, New York Medical CollegeFollow
Sahil Khera, New York Medical CollegeFollow
C Palaniswamy
William Frishman, New York Medical CollegeFollow

Journal Title

Archives of Medical Science : AMS

First Page

201

Last Page

209

Document Type

Article

Publication Date

2-1-2017

Department

Medicine

Abstract

INTRODUCTION: Educational milestones are now used to assess the developmental progress of all U.S. graduate medical residents during training. Twice annually, each program's Clinical Competency Committee (CCC) makes these determinations and reports its findings to the Accreditation Council for Graduate Medical Education (ACGME). The ideal way to conduct the CCC is not known. After finding that deliberations reliant upon the new milestones were time intensive, our internal medicine residency program tested an approach designed to produce rapid but accurate assessments. MATERIAL AND METHODS: For this study, we modified our usual CCC process to include pre-meeting faculty ratings of resident milestones progress with in-meeting reconciliation of their ratings. Data were considered largely via standard report and presented in a pre-arranged pattern. Participants were surveyed regarding their perceptions of data management strategies and use of milestones. Reliability of competence assessments was estimated by comparing pre-/post-intervention class rank lists produced by individual committee members with a master class rank list produced by the collective CCC after full deliberation. RESULTS: Use of the study CCC approach reduced committee deliberation time from 25 min to 9 min per resident (p < 0.001). Committee members believed milestones improved their ability to identify and assess expected elements of competency development (p = 0.026). Individual committee member assessments of trainee progress agreed well with collective CCC assessments. CONCLUSIONS: Modification of the clinical competency process to include pre-meeting competence ratings with in-meeting reconciliation of these ratings led to shorter deliberation times, improved evaluator satisfaction and resulted in reliable milestone assessments.

Recommended Citation

Nabors, C., Forman, L., Peterson, S., Gennarelli, M., Aronow, W., DeLorenzo, L., Chandy, D., Ahn, C., Sule, S., Stallings, G., Khera, S., Palaniswamy, C., & Frishman, W. (2017). Milestones: a Rapid Assessment Method for the Clinical Competency Committee. Archives of Medical Science : AMS, 13 (1), 201-209. https://doi.org/10.5114/aoms.2016.64045

Publisher's Statement

Originally published in Archives of Medical Science 2017; 13, 1: 201–209. The original material can be found here.