the presentation - Canadian Knowledge Transfer and

advertisement
Program Training and Consultation Centre
Communities of Practice in Tobacco Control
Cynthia Neilson, MA, BPHE
Health Promotion Specialist, Knowledge Transfer
Irene Lambraki, PhD
Senior Research Associate
The Program Training and Consultation
Centre is a resource centre funded by
Public Health Ontario.
www.ptcc-cfc.on.ca
Program Training and Consultation Centre
Objectives
Provide participants with an understanding of:
• what CoPs are and why we use this model
• how CoPs at PTCC function and have evolved
• how we support CoPs
• how we engage researchers
• how we evaluate the CoPs and what we learned
2
Program Training and Consultation Centre
Program Training and Consultation Centre
• Resource Centre of the Smoke-Free Ontario Strategy since
1993
• Funded by Public Health Ontario
• Strategic Priorities include:
• Building capacity of 36 public health departments and organizations
working in tobacco control in Ontario
• Support moving evidence into action
• Strengthen program development and applied research efforts
• Build system capacity to support the Smoke Free Ontario Strategy
renewal
3
Program Training and Consultation Centre
Propel Centre for Population Health Impact
• Propel is a collaborative enterprise with a mandate to
conduct solution-oriented research and knowledge
exchange to accelerate improvements in the health of
populations.
• Propel carries out the applied research of PTCC. Current
initiatives involve conducting:
– evidence-based reviews, evaluating interviews developed with the
field, documenting practices from the field; and conducting a
developmental evaluation to support the PTCC program
• The Propel Centre for Population Health Impact at UW
has been a PTCC partner since 2009.
4
Program Training and Consultation Centre
What are Communities of Practice?
• A group of people who:
•
•
•
•
share a concern,
a set of problems
passion about a topic
deepen their knowledge & expertise by interacting on an ongoing
basis.
Mechanism for learning, sharing and co-creating
knowledge through fostering interdisciplinary and
intersectoral relationships.
(Wenger, McDermott & Snyder, 2002)
5
Program Training and Consultation Centre
Why we implemented CoPs?
• Smoke Free Ontario Strategy (SFO) - initiative of the
Ministry of Health and Long-Term Care
• To progress SFO, need invention and innovation – this
is primarily generated from the field
• PTCC instituted CoPs to support invention and
innovation via provincial-level relationship building and
knowledge exchange as a way to progress the SFO
6
Program Training and Consultation Centre
Type of CoPs
• PTCC hosts formally instituted CoPs that are
externally funded and hosted by PTCC
• Membership is voluntary
• Priorities and activities are generated from
membership
7
Program Training and Consultation Centre
Purpose and Audience of CoPs
• Purpose- to facilitate evidence-informed practice, knowledge exchange
and cross-province communication among practitioners engaged in the
Smoke-Free Ontario Strategy.
Public Health
NGOs
CoP
Members
Government
8
Researchers
Program Training and Consultation Centre
CoPs at a Glance
9
Community of Practice
Launch Date
Status
Tobacco Reduction for
Young Adults
Sept 2008
CoP meets regularly via
webinar and in-person
Organizational Learning
through Tobacco
Control
Sept 2008
CoP closed Apr 2009
Tobacco-Free Sports &
Recreation & SF
Outdoor Spaces
May 2009
CoP meets regularly via
webinar and in-person
Media Advocacy for
Healthy Public Policy
Nov 2010
CoP closed June 2012
Smoking Cessation
Workplace Learning
Collaborative
Sept 2012
LC meets regularly via
webinar and in-person
Program Training and Consultation Centre
How did PTCC decide on a CoP topic area?
Domain
• Originally consultations with public health practitioners
(through Tobacco Control Area Network meetings - TCANs)
• Consulted literature on other models (Garcia & Dorohovich,
Wenger, etc.)
Objectives of the Consultation:
• To discuss the value of province-wide CoPs
• To identify key content areas for province-wide CoPs
• To determine the structure of CoPs and the products they
desired to stimulate and support learning
10
Program Training and Consultation Centre
Evolution of Topic Selection
11
Then
Now
How we collect
information
External
Consultations with
TCAN
Internal mechanisms at
PTCC for collecting
information
Who is involved
TCAN/ PHU staff
Knowledge broker, PTCC
staff, current CoP
members
How we examine
potential topics
Developed a matrix Hot topics are identified
• Weighted score and discussed at PTCC
using information from
the field
How a topic is
selected
Weighted score
Relevance and capacity
Program Training and Consultation Centre
Roles in a CoP
• Members – individuals who provide meaningful
contributions to the community
• Subject Matter Experts –experienced members
who can judge what is important, ground-breaking and
useful to the group
• Facilitator – foster and facilitate member interaction
• Community Leader –guide the community’s
purpose, intent, energizes the process
(Garcia & Dorohovich, 2007)
12
Program Training and Consultation Centre
Welcoming Members and CoP Growth
• Initially, we invited 2 PH practitioners from each TCAN,
as well as a handful of NGOs and researchers to form
our CoP- this became the core membership
• Our thoughts around membership have evolved
• Field Support Staff at PTCC identify new members
Public Health
Units
13
Field Support
Staff
Community of
Practice
Program Training and Consultation Centre
HOW- Practice
• Host (bi-)monthly/monthly interactive webinars
• 2 in-person meetings per year
• Host an online community
Members learn about and share:
• Research and evaluation projects
• Policy development opportunities
• Social marketing/social media campaigns (prevention,
protection, cessation)
• Opportunities for collaboration
• Lessons learned from practice
• Helpful resources
14
Program Training and Consultation Centre
Typical Monthly Webinar Agenda
15
Program Training and Consultation Centre
Online Space
16
Program Training and Consultation Centre
Community Charter and Learning Agenda
17
Program Training and Consultation Centre
Evidence Summaries/Literature Reviews
• Documents to help support/guide practitioners in
making evidence informed decisions.
Selected Topics:
• Social marketing to influence young adults’ tobacco behaviour
• Workplace tobacco cessation initiatives for young adults
• Smoke-free beaches in Ontario: Progress and implications for
practice
• Compliance & enforcement of smoke-free outdoor spaces bylaws
18
Program Training and Consultation Centre
Research Projects
• No Butts About It- Propel & PTCC
– Evidence-based workplace health promotion project to help
workplaces in the retail sector offer a SF environment and offer
employees support (esp.YAs)
• TFSR Hockey Evaluation Study- OTRU & PTCC
– Assess the impact of TFSR policies at the individual and community
levels within ON hockey organizations and teams
• Environmental Scan- YMCA & YWCA’s- Propel & PTCC
– Understand the extent YMCA and YWCA locations in Ontario are
enacting comprehensive tobacco-free policies that go beyond
provincial laws or municipal by-laws
19
Program Training and Consultation Centre
Documentations of Practice
YA CoP
• Choose To Be…Smoke-free: Peterborough County-City
Health Unit’s Woman-Centred Program
TFSR & SF Outdoor Spaces CoP
• The Development and Promotion of Guelph Soccer’s
tobacco-Free Policy: Success Factors & Lessons
• Partnerships Developed between Ontario’s Local Public
Health Agencies & Ontario Hockey League Teams
• Creating Smoke-Free Places: The Development of SmokeFree outdoor Space By-Laws in Ontario
DoP Full Reports: http://www.ptcc-cfc.on.ca/learn/DoPs/
20
Program Training and Consultation Centre
Evaluation of the Communities of Practice
•
•
•
•
•
•
•
21
Background
Conceptual Framework Guiding the Study
Purpose
Methods
Selected Results
Summary
Applying the Evaluation Findings
Program Training and Consultation Centre
Background
PTCC’s Communities of Practice (CoPs) are an important
mechanism for provincial-level networking, knowledge exchange
and innovation for the SFO
A developmental and utilization-focused evaluation undertaken to
understand how PTCC’s CoPs were developing and how they could
be improved
(Patton, 1994)
Key stakeholders engaged: PTCC and Community of Practice (CoP)
members
22
Program Training and Consultation Centre
Our Thinking…
Complex problems require complex solutions that get used
(Best et al., 2009)
Knowledge exchange, learning and integrating diverse
perspectives are critical to generating these solutions
Hard to do - requires different organizations and sectors with
different values, ways of thinking and doing to work well together
(Fiol et al., 2009, LeBaron, 2003)
23
Program Training and Consultation Centre
Conceptual Framework
( Adapted f rom Manske, 2 0 0 1 )
External Co ntext
Community of Practice
Knowledge Domain
Shared Identity
Psychological Safety
( Organizational Chara cteristics)
Information/Kno wle dge
Social Capital
( Interactive Process es)
Member Identification
( Individual Characteristics)
24
Knowledge Use
Program Training and Consultation Centre
Purpose
To examine:
• How PTCC’s CoPs were using knowledge gained from the CoP
• How PTCC’s CoPs were developing with respect to shared identity,
member identification, social capital and psychological safety
• The importance of above concepts in CoP context and why
• The mechanisms or factors that CoP offers help to strength cohesion and
knowledge use
• Member satisfaction with the CoP and areas of improvement
• The value add members gained by participating in the CoP
25
Program Training and Consultation Centre
Methods
Embedded case study design using mixed-methods (i.e.,
quantitative and qualitative methods)
(Yin, 2009; Creswell et al., 2011)
Phase I Quantitative Study (Online Survey)
Assessed: member satisfaction, how CoPs were developing re: study,
differences between the CoPs, relationships between concepts
Phase II Qualitative Study (interviews, CoP documents)
Phase I findings informed focus of Phase II and sample
Data coded and analysed for common themes using NVivo 9
(Strauss & Corbin, 1990; Glaser & Strauss, 1967)
9
26
Program Training and Consultation Centre
Characteristics of CoPs Examined
27
Characteristics
(at time of Phase I study)
Young Adult Tobacco
Reduction (YA CoP)
Tobacco Free Sports and
Recreation (TFSR CoP)
Funding
Provincial government
Provincial government
Secretariat Support
CoP Leadership Roles
LEARN Team
Co-Chairs
LEARN Team
Co-Chairs
Duration of Existence
At least 1 year
At least 1 year
Frequency and Mode of
Interaction
Monthly teleconference
Two face-to-face
Monthly teleconference
Two face-to-face
Membership Type
Membership Cap
Voluntary
50 members
Voluntary
50 members
Membership Size
40
30
Membership Composition
Local public health, TCAN,
Research, government, NGO,
private business
Local public health, TCAN,
Research, government,
community organizations
Program Training and Consultation Centre
Phase I Study Sample
70 members across CoPs
35 of 56 eligible members completed survey
(63% response rate)
Eligibility criterion: Attended >1 meeting
YA CoP
23 of 34 members
68% response rate
28
TFSR CoP
12 of 22 members
55% response rate
Program Training and Consultation Centre
Phase II Study Sample
14 members (subset of Phase I study)
7 YA CoP
7 TFSR CoP
Sampled Diverse Perspectives:
Varying levels of knowledge use (rarely, sometimes, often)
Sectors Represented
Roles Assumed in CoP
Gender and Education
29
Program Training and Consultation Centre
PHASE I: SELECTED RESULTS
30
Program Training and Consultation Centre
Member Satisfaction
CoP Components
Satisfied
Content addressed in CoP
(e.g., agenda topics, knowledge products, etc)
Areas for Improvement
√
Knowledge Exchange Opportunities
(e.g., guest speakers, networking, practice sharing)
√
Greater access to
researchers
Online Space
(knowledge repository, asynchronous communication
features like discussion posts, access to members)
√
Link pictures to comembers’ contact
information and bio
Meeting management
(e.g., frequency, duration, facilitation, organization,
teleconference/webinars, in-person meetings)
(knowledge
repository)
√
General Trend √
Level of Support from Member Organization
Teleconferences/Webinars:
easy to be distracted, limits
quality of knowledge
exchange
Participation ‘on top’ of
work priorities
TFSR CoP more satisfied than YA CoP for all of above aspects
31
Program Training and Consultation Centre
Differences between CoPs
TFSR CoP had consistently higher average ratings across all concepts
assessed than YA CoP (i.e., they used CoP knowledge more, had stronger
shared sense of identity, etc)
• However only significant difference between TFSR CoP and YA CoP
was based on shared identity and psychological safety
32
Program Training and Consultation Centre
Relationships between Concepts and Knowledge Use
Shared identity, member identification, social capital and
psychological safety positively and significantly
E.g., the more strongly shared the CoP identity the greater the social
capital (or vice-versa)
Shared identity, member identification, social capital and
psychological safety each significantly related to knowledge use
E.g., the more strongly shared the CoP identity, the more often knowledge
gained from CoP would be used
33
Program Training and Consultation Centre
PHASE II: SELECTED RESULTS
34
Program Training and Consultation Centre
Knowledge Use Per CoP
Both CoPs used knowledge in conceptual and instrumental ways
Conceptual
(sharing, increased awareness, learning with no immediate behaviour change)
“most of my knowledge that I’ve learned about this area has come from this
community of practice. So anything about how to start …policy…all the how-to’s,
what campaigns seem to work…all that…”
Instrumental
(planning to use knowledge, making decisions, implementing changes)
“(name of intervention), it had been evaluated and (when I took it) forward to
management, I got an immediate ‘Yeah sure. Look into this and see if we can
partner with them’”
TFSR CoP more instances of instrumental knowledge use than YA CoP
35
Program Training and Consultation Centre
Knowledge use: Areas for improvement
YA CoP
Greater access to researchers as area is under-researched and underfunded
Move beyond discussing CoP knowledge to actual implementation:
“there’s a show and tell kind of feel to teleconferences and not
enough ‘let’s problem solve here. Let’s look at general strategies.
What should be happening. Who could orchestrate that?’”
36
Program Training and Consultation Centre
Shared Identity
Shared understandings of what is ‘core’ and ‘distinctive’ about our CoP
(Corley & Gioia, 2004)
A Common Purpose
Presence/Lack
We’re inclusive
We’re very local public health focused
We’re about knowledge
sharing and learning
What we’re about aligns with my work
We’re aligned with a broader movement
Information/Knowledge
We’re a Community of Practice
37
We’re evidence-based
We’re about the (CoP topic area)
Program Training and Consultation Centre
Importance of Shared identity
Facilitates Coherence:
“Contributes to a more collaborative process” by “putting us all on the same page…
so we all know what our purpose is of being here,” creating one shared voice…
a synergy… so you’re really working towards something together”
Facilitates Sense of Belonging and Member Participation
Forms anchor point for member identification“…helps with building a sense of
belonging to the group as well as a reason to attend meetings (because) if you
catch people with what they’re…passionate about, they’ll likely be much more involved”
Knowledge Use:
“…if you’re in it for the same reasons, then I think you’re more committed
and you’re going to share more and listen more attentively and so on…”
38
Program Training and Consultation Centre
Shared Identity: Area(s) for Improvement
YA CoP:
“I feel somewhat disjointed in understanding exactly what we’re trying to accomplish.”
Reason? Lack of Common Purpose
“Well the TFSR CoP … there is a shared understanding (there) because those
working actively in that CoP are all working with similar goals. They have the
Public Health Standards, TSAG Report from the province telling (them they) must be
working on this…They also have that provincial campaign to be working on…so
they’re more action-based where ours has been more idea-based. So I think there
has been more interest from this CoP to do the same because that’s what’s keeping
them together and that’s what’s really working.”
39
Program Training and Consultation Centre
Shared Identity: Area(s) for Improvement
YA CoP lacked clarity about ‘who we are’ as a CoP because no clear
government directives to guide them:
“…I think the disconnect here is…how are we working in the context of what
the Ministry of Health and Long-Term Care is doing…do we (as a CoP) espouse their
philosophy?... We need to understand their perspective, direction…goals for young
adult tobacco reduction if we’re to have any coordination…and it’s just sort of the
elephant in the room. Nobody’s talking about it”
TAKE AWAY:
Need to create “alignment” between ‘who we are’ as CoP and mandates /
priorities of key entities in broader system even when such mandates
don’t exist
40
Program Training and Consultation Centre
Member Identification and Importance
“Who I am” is defined in part by “who we are” as a group, creating a sense
of belonging
(Ashforth & Mael, 1989)
Contributes to development and strengthening of social capital:
Enhances active participation and accountability to members: it makes
you “feel motivated,” “more engaged,” and “some sense of obligation to
work with people in the group,” and “you get better reception when you
approach people to work with them on something”
Knowledge Use:
“When you feel that sense of belonging…you’re going to be more
motivated to work. You’re going to feel like you’re a part of the CoP,
and then you’re going to facilitate these initiatives out in your local
community…and then the public will see the benefits as well”
41
Program Training and Consultation Centre
Member Identification: Area(s) for Improvement
Non-local public health sector tended to have weaker sense of belonging to CoP
• this detracted from their motivation to network, actively participate or use CoP
knowledge because CoP knowledge wasn’t relevant to their sector’s needs
Why? Non-local public health sectors commonly defined CoPs as “very local
public health focused,” which shaped focus of information that circulated in
CoP
TAKE AWAY:
To encourage member identification and in turn motivation, create a shared
identity that encompasses values and needs of their organizations/sectors
42
Program Training and Consultation Centre
Social Capital
The features of social organization, such as networks, trust and norms of
reciprocity
(Putnam, 1993)
Some Key Findings:
Members from both YA CoP and TFSR CoP made new connections with
“members…across the province,” “in different health units,” and “beyond
public health”
Members also felt:
• “comfortable” to contact other members,
• co-members were trustworthy (i.e., benevolent- and competence-based
trust), and
• co-members were “…very receptive when you approach them for things”
43
Program Training and Consultation Centre
Importance of Social Capital
Empowerment:
Networking and learning what others are doing and see
“that the work that we are doing here (in our health unit) is very
similar to work that’s been done around the province (increases) the
comfort factor that yes, we’re on the right track…Let’s keep going
down this road”
Knowledge Use:
“when you trust your coworkers and their opinions…you’re going
to go to them for more information” and more likely of “giving their
ideas a shot”
44
Program Training and Consultation Centre
Social Capital: Area(s) for Improvement
Getting active participation from peripheral members or “lurkers”
was like “pulling teeth”
Why?
• Technology: “with teleconference meetings, everyone is
unseen….You’re vulnerable, you don’t know who is listening”
• Level of Experience or % time spent at work on CoP topic area
Is it really so bad? ‘lurkers’ liked the flexibility the CoP offered
Take Home
Structure CoP so it allows multiple levels of participation to keep members
connected and coming back
45
Program Training and Consultation Centre
Key Mechanisms that Facilitate Cohesion and Knowledge Use
1.
Knowledge
•
2.
Procedures
•
•
•
3.
Access to relevant knowledge
In-person meetings
Regular Meetings
Community Charter and Learning Agendas
Structures
•
•
•
•
•
Structured Time for Practice Sharing
Working Groups
Member Roles
Online Space
CoP Itself
4. People
•
•
46
PTCC
Members
Program Training and Consultation Centre
Value Add for Members
• “Awareness of what’s going on around the province”
• ability to access evidence and resources via online space and members
• “Networking” and “provincial-level relationships I didn’t have before”
• “Creating linkages and having a greater impact by working together,”
• “…Not reinventing the wheel”
• CoP is a space that validates for members that they are on the right track
with their initiatives
• “Developed a level of expertise in content area that would not have had
otherwise”
47
Program Training and Consultation Centre
Summary
Shared identity, member identification, social capital important
to diverse members cohering in ways that enhance knowledge use
Members from both CoPs satisfied with CoP, but TFSR CoP moreso
TFSR CoP developing ‘better’ than YA CoP due to clear common
purpose that aligned with priorities of government
Several mechanisms contributed to development or strengthening of
shared identity, sense of belonging, social capital and knowledge use
48
Program Training and Consultation Centre
Applying the Evaluation Findings
• Confirmed that many of the activities or decisions we’ve made
are working and should continue (e.g. in-person meetings, coleader role, learning agenda, practice sharing, etc.)
• Created an online practice sharing
• Provide additional support for working groups
• Selected a new online platform
• Recruited additional researchers and created co-leader roles for
them
49
Program Training and Consultation Centre
References & Resources Related to CoPs
Garcia, J., & Dorohovich, M. (2007). The truth about building and maintaining successful communities of practice. Defense
Acquisition Journal Review, 12(1), 19-33.
McDonald, P. & Viehbeck, S. (2007). From evidence-based practice making to practice-based evidence making:
Creating communities of (research) and practice. Health Promotion Practice, 8(2), 140-144.
Lambraki, I.A. (2012). Identity, Psychological Safety and Social Capital: A mixed methods examination of their influence on
knowledge use in the context of LEARN Communities of Practice. Dissertation, University of Waterloo.
http://hdl.handle.net/10012/7284
Nowaczek, A., Lambraki, I., Manske, S. (2010). Knowledge use among PTCC’s LEARN communities of practice: Tobacco use reduction for
young adults and tobacco-free sport and recreation. Developmental evaluation of LEARN communities of practice. http://www.ptcccfc.on.ca/cms/one.aspx?pageId=100781
Wenger, E., McDermott, R. & Snyder, W. (2002). A guide to managing knowledge: Cultivating communities of practice. Boston,
Massachusetts: Harvard Business School Press.
CP Squared - “The Community of Practice on Communities of Practice” http://cpsquare.org/
Program Training and Consultation Centre, LEARN Project. CoP reading and resource list. http://www.ptcccfc.on.ca/common/pages/UserFile.aspx?fileId=103912
50
Program Training and Consultation Centre
Thank you!
Cynthia Neilson
Cynthia.neilson@cancercare.on.ca
416-971-9800 x 2822
Irene Lambraki
ilambrak@uwaterloo.ca
(519) 888-4567 ext 33354
51
Download