Resource Center

Collections Outcomes-based Evaluation Tools

This collection explores the nature and purpose of evaluation methods commonly utilized in the IPE literature with a focus on intervention outcomes. The evaluation may involve assessment of participants, but more commonly involves learner satisfaction and attitudinal change. Of the 90 studies included, most evaluated soon after the educational intervention, only five specifically referred to an evaluation framework, and the most frequently used tool was the RIPLS.  The studies collected here show a noteworthy reliance on students’ self-rated perceptions of their attitudes towards collaborative practice collected through surveys, focus groups and interviews.

Evaluating Interprofessional Education and Collaborative Practice: What Should I Consider When Selecting a Measurement Tool?

Evaluating Interprofessional Education and Collaborative Practice: What Should I Consider When Selecting a Measurement Tool?

National Center for Interprofessional Practice and Education's picture
Submitted by National Center... on Mar 20, 2015 - 8:15am CDT

This National Center-commissioned monograph provides basic information about good practices and processes in measurement instrument selection, development and use.
 

Viewed as a “primer” on interprofessional education and collaborative practice (IPECP) evaluation and assessment, it does not make recommendations on specific tools or tell individuals what to measure. Instead the primer guides readers on what to look for when selecting a tool, the importance of defining purpose and how to assess a tool’s evidence of validity.
 

Start the Conversation

Every registered user can comment on website content.

Please login or register to comment

An exploratory review of pre-qualification interprofessional education evaluations

An exploratory review of pre-qualification interprofessional education evaluations

Jill Thistlethwaite's picture
Submitted by Jill Thistlethwaite on Feb 11, 2015 - 3:32pm CST

There are diverse perceptions about the primary purpose of evaluation. In interprofessional education (IPE), there has been a perceived focus on evaluating against the outcome of improved collaborative practice and quality of care. This paper presents an exploration of the nature and purpose of evaluation methods commonly utilized in the IPE literature with its focus on outcomes-based evaluation and particularly the Kirkpatrick framework. It categorises recent evaluations of pre-qualification (pre-certification) IPE interventions.

Start the Conversation

Every registered user can comment on website content.

Please login or register to comment

An evaluation of interdisciplinary team training in hospice care

An evaluation of interdisciplinary team training in hospice care

National Center for Interprofessional Practice and Education's picture
Submitted by National Center... on Dec 22, 2014 - 3:15pm CST

Medicare requires all hospice agencies to conduct regular interdisciplinary team meetings to facilitate collaboration within the team and to coordinate holistic plans of patient care. This study takes a preliminary look at hospice agencies' preparation of interdisciplinary team members for collaboration within team meetings and aims to explain hospices' strategies for training and assessing the collaborative strength of interdisciplinary team meetings.

Start the Conversation

Every registered user can comment on website content.

Please login or register to comment

Start the Conversation

Every registered user can comment on website content.

Please login or register to comment

Assessing teamwork in the trauma bay: Introduction of a modified "NOTECHS" scale for trauma

Assessing teamwork in the trauma bay: Introduction of a modified "NOTECHS" scale for trauma

National Center for Interprofessional Practice and Education's picture
Submitted by National Center... on Dec 19, 2014 - 3:59pm CST

BACKGROUND: A modified nontechnical skills (NOTECHS) scale for trauma (T-NOTECHS) was developed to teach and assess teamwork skills of multidisciplinary trauma resuscitation teams. In this study, T-NOTECHS was evaluated for reliability and correlation with clinical performance.
METHODS: Interrater reliability (intraclass correlation coefficient) and correlation with the speed and completeness of resuscitation tasks were assessed during simulation-based teamwork training and during actual trauma resuscitations.

Start the Conversation

Every registered user can comment on website content.

Please login or register to comment

Methods for evaluating practice change toward a patient-centered medical home

Methods for evaluating practice change toward a patient-centered medical home

National Center for Interprofessional Practice and Education's picture
Submitted by National Center... on Dec 19, 2014 - 3:42pm CST

PURPOSE: Understanding the transformation of primary care practices to patient-centered medical homes (PCMHs) requires making sense of the change process, multilevel outcomes, and context. We describe the methods used to evaluate the country's first national demonstration project of the PCMH concept, with an emphasis on the quantitative measures and lessons for multimethod evaluation approaches.

Start the Conversation

Every registered user can comment on website content.

Please login or register to comment

The Knowledge, Skill, and Ability Requirements for Teamwork: Revisiting the Teamwork-KSA Test's validity

The Knowledge, Skill, and Ability Requirements for Teamwork: Revisiting the Teamwork-KSA Test's validity

National Center for Interprofessional Practice and Education's picture
Submitted by National Center... on Dec 19, 2014 - 3:33pm CST

The Teamwork – Knowledge, Skills, and Ability (KSA) Test was developed by Stevens and Campion to operationalize their comprehensive taxonomy of teamwork competencies. The test is generally considered ‘valid’ and has been used frequently in organizations. Our review of the literature found an average criterion validity of.20 for the Teamwork-KSA Test, although there was considerable variability across studies. We could find no research on the item properties, factor structure, or subscale reliabilities, and no extensive investigations of the nomological net of this test.

Start the Conversation

Every registered user can comment on website content.

Please login or register to comment

The knowledge, skill, and ability requirements for teamwork: Implications for human resource management

The knowledge, skill, and ability requirements for teamwork: Implications for human resource management

National Center for Interprofessional Practice and Education's picture
Submitted by National Center... on Dec 19, 2014 - 11:36am CST

This study reviews the literature on groups to determine the knowledge, skill, and ability (KSA) requirements for teamwork. The focus is on: (1) KSAs rather than personality traits; (2) team rather than technical KSAs; and (3) the individual rather than team level of analysis. Fourteen specific KSAs are derived. Then, the implications of these teamwork KSAs for the modification or development of human resource (HR) management systems are determined, and research issues are discussed.

Start the Conversation

Every registered user can comment on website content.

Please login or register to comment

Team training can improve operating room performance

Team training can improve operating room performance

National Center for Interprofessional Practice and Education's picture
Submitted by National Center... on Dec 19, 2014 - 11:29am CST

BACKGROUND: This study was conducted to determine if team training using a federally sponsored team training program improves operating room (OR) performance and culture.
METHODS: The TeamSTEPPS program, a team training program designed and tested for health care applications, was provided to the OR staff. The training occurred over 2 months to all members of the OR team, including scrub technicians, nurses, certified registered nurse anesthetists, anesthesiologists, surgeons, and all anesthesiology and surgical resident staff.

Start the Conversation

Every registered user can comment on website content.

Please login or register to comment

Applying a Multidisciplinary Approach Using the TeamSTEPPS Communication and Teamwork Methodology While Debriefing a Critical Event Simulation

Applying a Multidisciplinary Approach Using the TeamSTEPPS Communication and Teamwork Methodology While Debriefing a Critical Event Simulation

National Center for Interprofessional Practice and Education's picture
Submitted by National Center... on Dec 19, 2014 - 10:39am CST

This poster presentation details an innovative safety program which incorporates a multidisciplinary approach to team debriefing and high-fidelity simulation-based training during a simulated critical event (shoulder dystocia). This simulation program includes all providers (physicians, midwives, nurses, and residents) associated with our obstetric unit and reinforces the concept of patient safety through practiced communication and teamwork.

Start the Conversation

Every registered user can comment on website content.

Please login or register to comment