Reliability and construct validity of a Structured Technical Skills Assessment Form

Christopher P. Winckel, Richard K. Reznick*, Robert Cohen, Bryce Taylor

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

223 Scopus citations

Abstract

Current methods of evaluating technical competence of surgical residents are subjective and potentially unreliable. This study assesses the reliability and construct validity of a new format for the assessment of technical ability, the two part Structured Technical Skills Assessment Form (STSAF). Part I, which is completed while an operation is proceeding consists of approximately 120 essential components of the procedure. Part II, completed at the end of the operation, is a 10-point global rating form. Forty-one operations were evaluated using the STSAF, with multiple observers present at 26. Inter-rater reliability of both Parts I and II were high (.78 and .73, respectively). Statistically significant differences were noted between senior-resident and junior-resident performances, suggesting construct validity. The incorporation of structured guidelines to the assessment of technical skill leads to high inter-rater reliability and construct validity, which ultimately may result in improved and reproducible evaluations of surgical trainees.

Original languageEnglish
Pages (from-to)423-427
Number of pages5
JournalAmerican Journal of Surgery
Volume167
Issue number4
DOIs
StatePublished - Apr 1994

Fingerprint

Dive into the research topics of 'Reliability and construct validity of a Structured Technical Skills Assessment Form'. Together they form a unique fingerprint.

Cite this