Solid validity evidence for two tools assessing competences in musculoskeletal ultrasound: a validity study
Authors' conclusion
MSUS operator competences can be assessed reliably and valid using either the OSAUS or the EULAR assessment tool, thereby allowing a uniform competency-based MSUS education in the future. Although both tools demonstrated high inter-rater reliability, the EULAR tool was superior to OSAUS.
Study context
- Population
- Physicians with different levels of musculoskeletal ultrasound (MSUS) experience (novices, intermediates, experienced) examining the same RA patient
- Participants
- 30 physicians120 recorded examinations
- Comparison
- EULAR vs Objective Structured Assessment of Ultrasound Skills (OSAUS) assessment tools for MSUS competences
- Outcome
- Validity evidence for MSUS competence assessment tools
Methodological detailsblinded raters, video-recorded examinations assessed in random order
- Blinded raters
- Video-recorded examinations assessed in random order
Main finding
As reported in the abstract
| Group | Inter-rater reliability (Pearson correlation coefficient (PCC)) | Inter-case reliability (Cronbach's alpha) | Correlation of score with experience level (R2) |
|---|---|---|---|
| OSAUS | 0.807 | 0.970 | 0.897 |
| EULAR | 0.848 | 0.964 | 0.868 |
Inter-rater reliability (Pearson correlation coefficient (PCC))
OSAUS0.807
EULAR0.848
Inter-case reliability (Cronbach's alpha)
OSAUS0.970
EULAR0.964
Correlation of score with experience level (R2)
OSAUS0.897
EULAR0.868
- Significant discrimination between MSUS experience levels (both tools)
- P < 0.001
Original publication
Solid validity evidence for two tools assessing competences in musculoskeletal ultrasound: a validity study. Rheumatology (Oxford). Published 12 June 2023. doi:10. 1093/ rheumatology/ kead286
Composed by AI from the published abstract and checked against it. How Briefs are made →