Who is Being Assessed or Evaluated?:
Observer-based (e.g., rubric, rating tool, 360 degree feedback)
Notes for Type:
The simulation involved an inpatient visit with a person who had suffered a stroke. In the validation study, the standardized patient encounters were viewed from different rooms via remote cameras. The authors suggest that this tool can also be used as an onsite (in situ) observational tool.
Source of Data:
Health care providers, staff
Notes for Data Sources:
16 volunteer faculty members representing dentistry, medicine, occupational therapy, pharmacy, and physician assistant professions with experience teaching and assessing students, and no prior experience with IPE assessment.
Notes for Content:
6 dimensions are rated:
1. Communication (with other team members/ team with patient)
3. Roles and responsibilities
4. Collaborative patient-family-centered approach
5. Conflict management/resolution
6. Team functioning
An overall global rating of the individual’s performance/team’s performance.
7 ratings (6 dimensions and global rating) for each of the 4 team members plus the team as a whole resulting in 35 ratings; each rater had to observe a 35 minute teamwork encounter scenario, although time may vary with scenario.
Ratings were made on a 3 point scale (i.e., below expected, at expected, and above expected). Descriptive behavioral anchors developed by the authors are provided.
Raters received 60 min of training immediately prior to TOSCE administration. Training included viewing video demonstrations representing three different levels of performance. Training was deemed to be completed when all 16 raters agreed on the performance level of students and teams shown in the videos. During the actual study, raters watched a team encounter of 4 students (trained actors who performed at varying levels of teamwork competencies) and made individual and team ratings.
Scoring procedures were not described. The research study was designed to evaluate the accuracy with which raters used the TOSCE. Students portrayed a target performance level. Researchers assessed the accuracy of faculty judgments by comparing TOSCE ratings to the target performance level.
Open access (available on this website)
Notes on Access:
Contact the author to confirm permission to use.