Resource Center

Collections Outcomes-based Evaluation Tools

This collection explores the nature and purpose of evaluation methods commonly utilized in the IPE literature with a focus on intervention outcomes. The evaluation may involve assessment of participants, but more commonly involves learner satisfaction and attitudinal change. Of the 90 studies included, most evaluated soon after the educational intervention, only five specifically referred to an evaluation framework, and the most frequently used tool was the RIPLS.  The studies collected here show a noteworthy reliance on students’ self-rated perceptions of their attitudes towards collaborative practice collected through surveys, focus groups and interviews.

Observational teamwork assessment for surgery: Content validation and tool refinement

Observational teamwork assessment for surgery: Content validation and tool refinement

National Center for Interprofessional Practice and Education's picture
Submitted by National Center... on Dec 9, 2014 - 10:41am CST

BACKGROUND: Effective teamwork is crucial for safe surgery. Failures in nontechnical and teamwork skills are frequently implicated in adverse events. The Observational Teamwork Assessment for Surgery (OTAS) tool assesses teamwork of the entire team in the operating room. Empirical testing of OTAS has yet to explore the content validity of the tool.

Start the Conversation

Every registered user can comment on website content.

Please login or register to comment

Assessment of stress and teamwork in the operating room: An exploratory study

Assessment of stress and teamwork in the operating room: An exploratory study

National Center for Interprofessional Practice and Education's picture
Submitted by National Center... on Dec 8, 2014 - 10:12am CST

BACKGROUND: Although effective teamwork is fundamental to patient safety in the operating room (OR), acute stress increasingly is recognized as detrimental for teamwork. This study concurrently assessed teamwork and stress levels experienced by OR team members.

METHODS: Data were collected in real time in 20 elective surgical cases. The validated Observational Teamwork Assessment for Surgery was used to assess teamwork, whereas stress was assessed using the validated State-Trait Anxiety Inventory.

Start the Conversation

Every registered user can comment on website content.

Please login or register to comment

Observational teamwork assessment for surgery: Construct validation with expert versus novice raters

Observational teamwork assessment for surgery: Construct validation with expert versus novice raters

National Center for Interprofessional Practice and Education's picture
Submitted by National Center... on Dec 8, 2014 - 9:38am CST

OBJECTIVE: To test the construct validity of the Observational Teamwork Assessment for Surgery (OTAS) tool.

SUMMARY BACKGROUND DATA: Poor teamwork in surgical teams has been implicated in adverse events to patients. The OTAS is a tool that assesses teamwork in real time for the entire surgical team. Existing empirical research on OTAS has yet to explore how expert versus novice tool users use the tool to assess teamwork in the operating room.

Start the Conversation

Every registered user can comment on website content.

Please login or register to comment

Observational Skill-based Clinical Assessment tool for Resuscitation (OSCAR): Development and validation

Observational Skill-based Clinical Assessment tool for Resuscitation (OSCAR): Development and validation

National Center for Interprofessional Practice and Education's picture
Submitted by National Center... on Dec 8, 2014 - 9:28am CST

AIM: The aim of the study reported here was to address the need to assess and train teamwork and non-technical skills in the context of Resuscitation. Specifically, we sought to develop a tool that is feasible to use and psychometrically sound to assess team behaviours during cardiac arrest resuscitation attempts.

Start the Conversation

Every registered user can comment on website content.

Please login or register to comment

A multicenter trial of aviation-style training for surgical teams

A multicenter trial of aviation-style training for surgical teams

National Center for Interprofessional Practice and Education's picture
Submitted by National Center... on Dec 4, 2014 - 4:16pm CST

AIMS: This study measured the effect of aviation-style team training on 3 surgical teams from different specialties. It focused on team working and communication, particularly briefing, time-out, and debriefing, and sought to understand how improvements in team skills could be implemented in a broad range of naturalistic surgical environments to improve safety, quality, and efficiency.

Start the Conversation

Every registered user can comment on website content.

Please login or register to comment

The Oxford NOTECHS System: reliability and validity of a tool for measuring teamwork behaviour in the operating theatre

The Oxford NOTECHS System: reliability and validity of a tool for measuring teamwork behaviour in the operating theatre

National Center for Interprofessional Practice and Education's picture
Submitted by National Center... on Dec 2, 2014 - 1:58pm CST

INTRODUCTION: The frequency of adverse events in the operating theatre has been linked to the quality of teamwork and communication. Developing suitable measures of teamwork may play a role in reducing errors in surgery. This study reports on the development and evaluation of a method for measuring operating-theatre teamwork quality.

Start the Conversation

Every registered user can comment on website content.

Please login or register to comment

Evaluation of multidisciplinary simulation training on clinical performance and team behavior during tracheal intubation procedures in a pediatric intensive care unit

Evaluation of multidisciplinary simulation training on clinical performance and team behavior during tracheal intubation procedures in a pediatric intensive care unit

National Center for Interprofessional Practice and Education's picture
Submitted by National Center... on Dec 2, 2014 - 11:43am CST

OBJECTIVE: Tracheal intubation in the pediatric intensive care unit is often performed in emergency situations with high risks. Simulation has been recognized as an effective methodology to train both technical and teamwork skills. Our objectives were to develop a feasible tool to evaluate team performance during tracheal intubation in the pediatric intensive care unit and to apply the tool in the clinical setting to determine whether multidisciplinary teams with a higher number of simulation-trained providers exhibit more proficient performance.

Start the Conversation

Every registered user can comment on website content.

Please login or register to comment

Assessing teamwork: A reliable five-question survey

Assessing teamwork: A reliable five-question survey

National Center for Interprofessional Practice and Education's picture
Submitted by National Center... on Dec 2, 2014 - 10:58am CST

BACKGROUND AND OBJECTIVES: Currently available tools to measure teamwork, an essential component of primary care, are generally very resource intensive and thus cannot be administered frequently. To explore the possibility of developing a brief teamwork-assessment instrument, we first administered 29 questions about teamwork from the Practice Environment Checklist (PEC) to all members of six clinical teams in a residency outpatient practice (n=56). We found that the scale assessed a single dimension of teamwork and that a five item survey has acceptable reliability (Cronbach alpha=0.89).

Start the Conversation

Every registered user can comment on website content.

Please login or register to comment

Working together - primary care doctors' and nurses' attitudes to collaboration

Working together - primary care doctors' and nurses' attitudes to collaboration

National Center for Interprofessional Practice and Education's picture
Submitted by National Center... on Dec 2, 2014 - 10:32am CST

BACKGROUND: Multidisciplinary teamwork is recommended for various disorders and it has been suggested that it is a way to meet the new challenges and demands facing general practitioners (GPs) in modern society. Attempts to introduce the method in primary care have failed partly due to GPs' unwillingness to participate. The aim of this study was to measure attitudes towards collaboration among GPs and district nurses (DN) and to investigate whether there is a correlation between a positive attitude toward collaboration and high self-esteem in the professional role.

Start the Conversation

Every registered user can comment on website content.

Please login or register to comment

Psychometric properties of an attitude scale measuring physician-nurse collaboration

Psychometric properties of an attitude scale measuring physician-nurse collaboration

National Center for Interprofessional Practice and Education's picture
Submitted by National Center... on Dec 2, 2014 - 10:15am CST

This study examined the psychometric properties of an assessment tool for measuring attitudes toward physician-nurse collaboration. A survey addressing areas of responsibility, expectations, shared learning, decision making, authority, and autonomy was administered to first-year medical and nursing students. Factor analysis of the survey indicated that the survey measured four underlying constructs of shared education and collaborative relationships, caring as opposed to curing, nurse's autonomy, and physician's authority.

Start the Conversation

Every registered user can comment on website content.

Please login or register to comment