W(e) Learn Interprofessional Program Assessment Scale

Submitted by National Center... on Oct 14, 2016 - 1:21pm CDT

Instrument

Authors:

MacDonald, C.J.

Archibald, D.

Trumpower, D.L.

Casimiro, L.

Cragg, B.

Jelley, W.

Overview:

This tool was designed as part of a national evaluation of 20 interprofessional education projects funded by a $20 million grant from "Health Canada." A team of investigators based at the University of Ottawa was contracted to design, develop, and refine a set of quantitative and qualitative tools for program evaluation purposes. The W(e) Learn instrument is the first instrument in the package. The second tool, the Interprofessional Communication and Collaboration Scale (ICCAS), is described elsewhere on our website. W(e) Learn is a one-page, 30-item self-report questionnaire completed at the end of instruction by learners in a variety of education settings. Based in a theoretical model of learning, it was designed to provide learner feedback to faculty and program administrators regarding the structure, content, service, and outcomes of the program. Reliability statistics for the four item categories (scales) were uniformly high.

Link to Resources

Resource links:

MacDonald, C.J., Archibald, D., Trumpower, D.L., Casimiro, L., Cragg, B., & Jelley, W. (2010). Designing and operationalizing a toolkit of bilgual interprofessional education assessment instruments. J Res Interprof Educ, 13: 304-316.

Attachment:

WeLearnAssessment.Final_.pdf

Descriptive Elements

Who is Being Assessed or Evaluated?:

Organizations

Instrument Type:

Self-report (e.g., survey, questionnaire, self-rating)

Notes for Type:

The object of evaluation is not "organization" so much as "program," the scope of which varied by project.

Source of Data:

Health care trainees

Instrument Content:

Satisfaction with IP training

Notes for Content:

Questionnaire covers 4 aspects of learning program quality:

Structure (facilitation/teaching quality, pedagogy, interactivity, and community),
Content (inclusivity, authenticity, and responsiveness to stakeholder’s needs)
Service (provided by the facilitator, the learner’s organization, and other resources)
Outcomes (learner satisfaction, gains in knowledge and skill, and attitude change)

Instrument Length:

30 items, no information on time to complete.

Item Format:

7-points scales (1 = "strongly disagree," 7 = "strongly agree); all items positively worded.

Administration:

Post class.

Scoring:

None described.

Language:

English and French

Norms:

None described.

Access:

Open access (available on this website)

Psychometric Elements: Evidence of Validity

Content:

Items were developed by the core team of investigators, shared with a small group of outsider educators, and then a broader group of subject matter experts representing IPE and IPC in different specialties (medicine, speech, nursing, physioltherapy, occupational therapy, pastoral care).

Response Process:

Items were reviewed by English and by French speakers as well as a bilingual speaker; a consensus group process confirmed equivalence in meaning between the two versions.

Internal Structure:

Cronbach's alpha estimates of internal consistency for the four scales were as follows:Outcomes r= 0.90; Content r = 0.09; Service r = 0.88; Structure r = 0.94. Results of the factor analysis were inconclusive.

Relation to Other Variables:

None described.

Consequential:

None described.

Assessment & Evaluation

W(e) Learn Interprofessional Program Assessment Scale

Related Resources

User Collections

Start the Conversation