Portal de Periódicos da CAPES

Quantitative Validation of a General Competency Composite Assessment Evaluation

2004; Wiley; Volume: 11; Issue: 8 Linguagem: Inglês

10.1111/j.1553-2712.2004.tb00773.x

1553-2712

Earl J. Reisdorff, Dale J. Carlson, M. E. Reeves, Gregory K. Walker, Oliver W. Hayes, Brian Reynolds,

Clinical Reasoning and Diagnostic Skills

Academic Emergency MedicineVolume 11, Issue 8 p. 881-884 Free Access Quantitative Validation of a General Competency Composite Assessment Evaluation Earl J. Reisdorff MD, Corresponding Author Earl J. Reisdorff MD Michigan State University Emergency Medicine Residency Lansing, Lansing, MI Ingham Regional Medical Center, 401 West Greenlawn, Lansing, MI 48910. Fax: 517-372-6757; e-mail: reisdoe@irmcmail.irmc.orgSearch for more papers by this authorDale J. Carlson MM, Dale J. Carlson MM Department of Medical Education, Ingham Regional Medical Center, Lansing, MISearch for more papers by this authorMat Reeves PhD, Mat Reeves PhD Department of Epidemiology, Michigan State University, East Lansing, MI USASearch for more papers by this authorGregory Walker MD, Gregory Walker MD Michigan State University Emergency Medicine Residency Lansing, Lansing, MISearch for more papers by this authorOliver W. Hayes DO, Oliver W. Hayes DO Michigan State University Emergency Medicine Residency Lansing, Lansing, MISearch for more papers by this authorBrian Reynolds MD, Brian Reynolds MD Michigan State University Emergency Medicine Residency Lansing, Lansing, MISearch for more papers by this author Earl J. Reisdorff MD, Corresponding Author Earl J. Reisdorff MD Michigan State University Emergency Medicine Residency Lansing, Lansing, MI Ingham Regional Medical Center, 401 West Greenlawn, Lansing, MI 48910. Fax: 517-372-6757; e-mail: reisdoe@irmcmail.irmc.orgSearch for more papers by this authorDale J. Carlson MM, Dale J. Carlson MM Department of Medical Education, Ingham Regional Medical Center, Lansing, MISearch for more papers by this authorMat Reeves PhD, Mat Reeves PhD Department of Epidemiology, Michigan State University, East Lansing, MI USASearch for more papers by this authorGregory Walker MD, Gregory Walker MD Michigan State University Emergency Medicine Residency Lansing, Lansing, MISearch for more papers by this authorOliver W. Hayes DO, Oliver W. Hayes DO Michigan State University Emergency Medicine Residency Lansing, Lansing, MISearch for more papers by this authorBrian Reynolds MD, Brian Reynolds MD Michigan State University Emergency Medicine Residency Lansing, Lansing, MISearch for more papers by this author First published: 28 June 2008 https://doi.org/10.1197/j.aem.2004.01.009Citations: 16AboutPDF ToolsRequest permissionExport citationAdd to favoritesTrack citation ShareShare Give accessShare full text accessShare full-text accessPlease review our Terms and Conditions of Use and check box below to share full-text version of article.I have read and accept the Wiley Online Library Terms and Conditions of UseShareable LinkUse the link below to share a full-text version of this article with your friends and colleagues. Learn more.Copy URL Share a linkShare onFacebookTwitterLinkedInRedditWechat Abstract Objectives: The authors sought to modify and validate a composite assessment evaluation process that assesses resident acquisition of the Accreditation Council for Graduate Medical Education (ACGME) general competencies (GCs). Methods:This study critically analyzed the evaluation process used in a multicenter study (150 emergency medicine resident evaluations) to determine whether the procedure was psychometrically valid. For each GC, principal component analysis (PCA) was used to determine whether certain evaluation items could be eliminated, as well as to determine the magnitude of variability explained by up to three linear combinations or "principal components." The factor proportions (factor loadings) of various eigenvectors were measured to determine the degree of variability (determined by the square of the factor proportion) within a data or item set. The factor proportions essentially measure the length of the eigenvector as determined from a correlation matrix. Results: The first three principal components are reported as factor proportion sum (% of total variability) as follows: patient care 0.91 (83%), medical knowledge 0.87 (76%), practice-based learning and improvement 0.90 (81%), interpersonal and communication skills 0.84 (71%), professionalism 0.74 (55%), and systems-based practice 0.80 (64%). PCA showed that evaluating certain traditional categories such as medical knowledge seemed to capture a single element, whereas professionalism appeared to measure a more complex, multidimensional phenomenon. Conclusions: By using a structured development process, the authors were able to create valid evaluation items for determining resident acquisition of the ACGME GCs. References Leach DC. The ACGME competencies: substance or form?. J Am Coll Surg. 2001; 192: 396– 8. Reisdorff, EJ, Hayes, OW, Carlson, DJ, Walker, GL. Assessing the new general competencies for resident education: a model from an emergency medicine program. Acad Med. 2001; 76: 753– 7. Reisdorff EJ, Hayes OW, Reynolds B et al. General competencies are intrinsic to emergency medicine training. A multi-center study. Acad Emerg Med. 2003; 10: 1– 5. Swing SR. Assessing the ACGME general competencies: general considerations and assessment methods. Acad Emerg Med. 2002; 9: 1278– 88. Hockberger RS, Binder LS, Graber MA et al. The model of the clinical practice of emergency medicine. Ann Emerg Med. 2001; 37: 745– 70. Citing Literature Volume11, Issue8August 2004Pages 881-884 ReferencesRelatedInformation