The PCORI Pilot Projects Learning Network – Leading innovation in networked learning and
collaboration
Alison Rein MS, Emily Moore, Lauren Edmundson, Raj Sabharwal MPH, Laura Esmail PhD, Amanda Brodt MPP - AcademyHealth, Washington, DC
The Opportunity
As interest and uptake in patient-centered outcomes research (PCOR)
increases, the rapid synthesis and dissemination of lessons learned
from the field is needed. In February 2013, PCORI and
AcademyHealth launched the PCORI Pilot Projects Learning Network
(PPPLN) which connects the first cohort of researchers funded by
PCORI and is committed to optimizing their learnings to rapidly
advance PCOR. As a connector and network extender,
AcademyHealth applies its our knowledge about forming communities
and fostering collaboration to this effort.
Achieving the Aims of the PPPLN
Research
Prioritization
Methods
PPPLN Groups
Medication
adherence
AIM 1: ACTIVELY SCAN FOR, HARVEST AND
SYNTHESIZE INFORMATION
Research
Prioritization
& Analytic
Methods
Health Care
Decision
Supports
Prior to launching the PPPLN, we needed to better understand
the pilot projects both individually and as a group. To do this, we
conducted qualitative analyses of research plan focus areas and
methods. This analysis has supported many activities and serves
as the backbone of the PPPLN; it helped us to divide the PPPLN
into four groups, which created smaller communities within the
greater network to facilitate cross-project learning and
identification of common themes.
Technology
and
Infrastructure
PROs
Figure 1. How qualitative analyses informed
creation of the four smaller communities
based on research focus.
1. Actively scan for, harvest, and synthesize information from pilot
projects;
2. Capture key themes with potential to inform PCOR;
AIM 2: CAPTURE KEY THEMES WITH
POTENTIAL TO INFORM PCOR
0
An important function of the PPPLN is to capture
information from pilot projects that may be useful to future
researchers. In 2013, we surveyed pilot projects about
their patient and other stakeholder engagement via a webenabled tool. Full results will be disseminated via a
forthcoming peer-reviewed manuscript.
4. Support dissemination.
• Data collection and analysis
• Data collection on stakeholder engagement practices;
• Share and Tell Webinars, allowing researchers to present their
progress and discuss common challenges;
• Communication through Basecamp, an online platform enabling
resource sharing and collaborative discussion;
• Fostering collaboration
• Collaborative projects based on common interests and experiences;
• An in-person meeting in Washington, DC for cross-project
networking, reflective and forward looking discussions on Years 1& 2,
and working sessions for the collaborative projects; and
• Technical assistance (TA) and dissemination support
• Support and TA for pilot projects during the dissemination process.
• Generating opportunities for projects to share insights and lessons
learned;
• Creating a “safe” space to discuss challenges and seek peer advice
• Engaging multiple members of the research team, not just the principal
investigators;
• Using an multiple modes of communication; and,
• Creating opportunities for networking whenever possible.
Collaborative Projects’ Co-Chairs in the PPPLN
Language of Engagement
Stakeholder Engagement Challenges and Facilitators
The Power of Qualitative Methods
IRB Issues Unique to PCOR
Using PROMIS Measures in PCOR
Figure 3. The locations of co-chairs of the collaborative
projects
AIM 4: SUPPORT DISSEMINATION
The PPPLN provides support throughout
the dissemination process to help pilot
projects “tell the stories behind their
research” and why it matters. The PPPLN
has also provided technical assistance
related to dissemination on questions such
as, how to bring clinical tools to market, how
to translate research into policy, and how to
disseminate research findings to varied
audiences.
The Dissemination
Process
Planning
Share and Tell Webinars
offer researchers an
audience for their
preliminary results.
Product
development
The PPPLN identifies
potential dissemination
opportunities of interest to the
researchers.
Measuring Success in Year One
While the PPPLN is ongoing, preliminary indicators related to
participation suggest that it has been a successful means for achieving
its aims.
To promote enhanced discussion and products that will contribute to the
field of PCOR, the PPPLN has fostered the development of several
cross-project collaborations. These groups are using their pilot project
experiences to document lessons learned, and produce guidance
documents, presentations and other products that inform PCOR. These
groups meet by phone on a regular basis and also met in person at the
PPPLN Meeting in Washington, DC in March 2014; many have products
forthcoming later this year.
• Qualitative analysis of pilot project research plans to better
understand their aims and needs;
• Facilitation of information sharing and cross-project learning
Patients/consumers
Patient(s)/Consumer(s) (unaffiliated
individuals)
Caregivers/family
members
Caregiver(s)/Family
Member(s)/ of
Patient…
Patient/consumer
advocacy organizations
Patient/Consumer/Caregiver
Advocacy…
Clinicians
Clinician(s)
Clinic/Hospital/Health
System
Representatives
Clinic/Hospital/Health
System
Representative(s)
Purchasers
Purchaser(s)
Payers
Payer(s)
Industry
Representatives
Industry
Representative(s)
Policy
Makers
Policy
Maker(s)
Other
Other
AIM 3: FACILITATE CROSS-PROJECT
LEARNING AND COLLABORATION
To achieve these aims, we engaged in a number of activities, including:
• Review of interim reports and summary of shared challenges,
experiences and areas for improvement;
Percent Reporting Engagement
10 20 30 40 50 60 70 80 90 100
Figure 2 Select findings from the PPPLN survey on engagement.
3. Facilitate cross-project learning and collaboration; and,
• Progress monitoring
Over the past year and a half, we have noted several important factors
that contribute to the success of a learning network. These include:
Stakeholder Groups Engaged in the Pilot Projects (n=39)
Creating a Learning Network
All members of the pilot project research teams, including their
stakeholder partners, were invited to participate in the PPPLN. The
PPPLN was designed to :
Lessons Learned
The PPPLN tracks and
promotes published work
among its members.
External vetting
Release
The PPPLN helps
researchers identify
their target journals.
Figure 4. A chronological look at how the PPPLN supports the pilot projects through the dissemination process.
The success of the PPPLN is reflected in members’ participation, which
was voluntary and not financially supported. The majority of projects
have been engaged in the learning network through at least one activity.
In particular, participation in the collaborative projects suggests that
researchers appreciate how the PPPLN can contribute to the future of
PCOR. At this point, more than 50 percent of projects are involved in a
collaborative project.
Implications for Future Efforts
Practical and empirical evidence is needed to support the growth and
evolution of PCOR. The PPPLN illustrates the value and potential
benefits of active portfolio management in building the evidence base
for PCOR, identifying practice and research gaps, and accelerating the
dissemination and uptake of findings to advance the field. Future
research funders and coordinators should consider the important role
that a learning network can play in in accelerating knowledge
generation and sharing across awardees.
References & Acknowledgements
This work was supported through a Patient-Centered Outcomes
Research Institute (PCORI) Contract Award (2000-20-10-10 CMO-001).
All statements in this report, including its findings and conclusions, are
solely those of the authors and do not necessarily represent the views
of PCORI, its Board of Governors or Methodology Committee. In
addition, we would like to thank our PCORI colleagues, Laura Forsythe,
Lori Frank, Jason Gerson and Natalie Wegener, for their contributions
and support. For more information visit http://www.pcori.org/fundingopportunities/pfa-awards/pilot-projects/ and follow us @PCORI.