Virtual Patients as CPD for early diagnosis of cancer: A

advertisement
Virtual Patients as CPD for early
diagnosis of cancer: A case study
Dr Alison J. Wint, Dr Sarah J. Street, Simon Messer
Abstract
The UK has poorer cancer survival outcomes than comparable European countries. Education of GPs
to improve referral is part of the government’s strategy to rectify this. This project evaluates the use of
Virtual Patients (VPs) for GP CPD in raising awareness of early signs of cancer and supporting
referral decision making. Six VP cases were created to simulate a GP surgery, 4 of which were cases
with early signs of cancer. They were authored by GPs as part of a collaborative project between
Avon Somerset and Wiltshire Cancer services and the University of the West of England. Participants
for the project (n=72) were recruited from GP practices. Evaluation was by a self administered equestionnaire that captured both quantitative and qualitative data. The data were evaluated using
statistical and thematic analysis. The results showed that the VPs served to highlight the importance
of early diagnosis of cancer and to increase awareness of cancer assessment tools and knowledge of
available support. The study also showed that participants found the VPs very engaging; the benefits
include being online, quick and fun to do. There was significant agreement that VPs provide an
authentic e-learning solution and that further cases would be beneficial.
Keywords; Computer simulation; General Practice; cancer; consultation and referral;
education
How this fits in: This fits with the aims of the National Awareness and Early Diagnosis
Initiativeworking to promote awareness and earlier diagnosis of cancer.
1.0 Introduction
It has been recognised since the publication of the cancer Reform strategy in 2007 1 and the Improving
Outcome Strategy of 20112, that the national outcomes for Cancer, although improving have not yet
equalled those of countries with comparable health care systems.
Prof Sir Mike Richards the cancer Tsar in 2009 proposed that 5,000 lives could be saved if Britain’s
cancer outcomes matched the average in Europe and 10,000 lives would be saved if the UK could
achieve standard of the best in Europe3. A variety of factors have been found to influence outcomes
and in response to address these factors, the National Awareness and Earlier Diagnosis Initiative
(NAEDI) was launched in 20084. It included several strands of work, one of which reviewed systems,
process, access and clinical practice in Primary Care. Several primary care Tools to aid decision
making, management and referral from Primary Care of patients suspected of having a cancer
diagnosis have been developed5.
In 2011 the Department of Health invited bids from Cancer Networks for the funding of initiatives
which would support GPs in making a cancer diagnosis and increase the reach and impact of the
NEADI agenda. The Avon Somerset & Wilshire Cancer Network was successful in securing funds to
partner with the University of The West of England for the development of an innovative educational
tool which would achieve this.
GPSim is a simulation focussed on providing Continuing Professional Development (CPD) for GPs
around early signs of cancer. The innovation comes from using a set of virtual patients that provide an
engaging online, multimedia and interactive experience. Commissioned by the Avon Somerset &
Wiltshire Cancer services (ASWCs) network and authored by GPs, each case simulates a
consultation with focus on increasing awareness of early signs for cancer as well as the support
available to GPs from the network. The cases are deployed in UChoose, a VP player and authoring
tool developed by UWE to the international Medbiquitous standard for virtual patients6. The cases are
presented as branching narrative systems that offer the learner various pathways and outcomes
depending upon the decisions that they make. The learner is able to engage in a conversation with
each patient, represented as an avatar, as well as access pertinent data such as medical records to
inform their decisions. The patient set consists of mix of cases, some with early signs of cancer and
some without, so that the consultation is not a foregone outcome.
2.0 Literature Review
Virtual patient systems were first seen in the early 1970s 7 and since then have evolved greatly,
helped both by the advancements in multimedia technology and the opportunities provided by the
expanding World Wide Web.
The benefits of using virtual patients in teaching, learning and assessment has been clearly
demonstrated8 as well as its application in offering a wide range of learning design 9. Ellaway notes
the strength of virtual patients is to promote and/or assess clinical reasoning particularly in complex
and emergent settings. Such virtual patient systems have also been shown to enable to learner to
acquire clinical problem-solving skills more efficiently10.
Although the idea of virtual patient education is not new, it is still regarded as an educational
innovation and widespread regular use of this method of learning is yet to come into everyday
practice11.
St Georges Medical School, London is one of the few UK medical schools that contradict this
statement. They have been using web-based branched narrative virtual patients to replace traditional
linear paper based problem based learning (PBL) cases since 2005 and educators there have
observed evidence of “deep learning” and “critical thinking” related to the key decision points in the
virtual patient cases.
A major step in the field of virtual patient instruction was the inclusion of virtual patients in the United
States Medical Licensing Exam (USMLE) in 2007.
The educational strength of virtual patient education if felt to be most notable in promoting clinical
reasoning, an important aspect of clinical learning11.
Simulations have the ability to engage the learner in repetitive and deliberate practice in a safe and
reproducible environment with personalised expert feedback 12. Patient simulations also allow
curriculum administrators to fill in gaps in clinical exposure and introduce learners to unusual and rare
conditions13.
Virtual patients offer some practical and educational advantages when compared to other popular
simulation technologies like mannequin-based physical simulators and human actors. When
delivered over the internet, virtual patients are relatively inexpensive to distribute and update
compared with their physical counterparts, (McGee, University of Pittsburg School of Medicine).
A recent systematic literature review on the value of virtual patients in medical education listed the
following advantages: efficiency, standardisation, easy accessibility, interactivity, decreased instructor
workload, exposure to rare but critical cases (eg a ruptured aortic aneurysm), personalised learning,
immediate and personalised instruction and feedback, efficiency, improvement of clinical skills in a
non threatening experimental environment, student autonomy and links to the medical literature14.
Other advantages discussed in the literature on virtual patients are that they enable the teaching of
practical decision making, offer the rehearsal of common clinical scenarios, allow the time and place
of learning to be convenient to the learner and are also fun to take partake in.
The disadvantages of virtual patients discussed in the review are as follows: potentially expensive
and resource intensive, difficult to integrate into medical curricula, difficult to edit and author, limited
by technology, limited by lack of diversity (race, culture and discipline) and poor at evaluating complex
cognitive skills such as empathy, negotiation and breaking bad news 14. Other disadvantages
discussed are inflexibility of cases, difficulty achieving realism as requires realistic choices which in
turn become exponential and therefore difficult to develop.
In spite of promising research results in recent years and some attempts to integrate virtual patients in
different medical curricula, the effective use requires evidence to guide design and integration.
3.0 Methodology
3.1 Case design
A team of six GPs were recruited and funded for the equivalent of six sessions by ASWCs to author
the content for the cases.ASWCS provided the project management and administrative support and
were responsible for introducing the authors to NAEDI and the Primary Care tools to aid earlier
diagnosis of cancer, and defining the clinical learning objectives 5. A series of workshops jointly run
with UWE provided training in use of the software, guidance on how to author a case, preliminary
planning of the case narratives and the opportunity for peer review. Additional one-to-one authoring
support was provided by UWE as required. Authors also created supporting materials including
patient records and links to assessment tools and web-based information.
The digital media assets, including the audio of patients’ speech and the avatars used to represent
the patients were created by the team at UWE.
Six cases were written which were released in two groups of three with each group consisting of one
placebo non-cancer case and two patients with early signs of a more common, non-gender specific
cancer.
The cases are available here:http://uchoose.uwe.ac.uk/uchoosehub and can be accessed by
entering the code ‘GPsim1’ once registered on the site.
3.2 The pilot
A self-administered questionnaire was developed as a web form using Survey Monkey. The
instrument produced quantitative data from Likert rated statements as well as qualitative data from
free text responses. The survey was divided into three sections consisting of items that:



provided demographic data,
answered questions relating to learning outcomes about earlier referral for cancer and tools
and resources that support Primary Care
answered questions about e-learning and the use of virtual patients
72 GPs from across the network region .were recruited by ASWCS for the pilot.
4.0 Results
There were 72 participants. Gender and age are presented in Figure 1.
[Figure1: Demographic Data]
4.1 Opinions of the Usefulness of the tool
This part of the survey was intended to gauge opinion about the usefulness of the simulation tool to
increase awareness of early signs of cancer. The results are presented in Table 1.
[Table 1: Opinions on the usefulness of the tool]
4.2Opinions on e-learning and the use of Virtual Patients
This part of the survey gauged opinion about e-learning and the use of Virtual Patient cases for online
simulation.
4.2.1 I feel that I benefit from being able to learn online
The quantitative data for participants’ attitude to this statement are presented in Figure 2. 94.4%of
respondents either strongly agreed or agreed that they benefited from online learning.
[Figure 2: “I feel that I benefit from being able to learn online”]
4.2.2 Case based learning using virtual patients is a good way of engaging with online
learning
The quantitative data for participants’ attitude to this statement are presented in Figure 3.
91.7% respondents either strongly agreed or agreed that Virtual Patients were a good way of
engaging with online learning
[Figure 3: “Case based learning using virtual patients is a good way of engaging with online learning”]
A number of themes are evident including those of interactivity, and ease of access as well as the
cases requiring some improvements, specifically with respect to the lack of options relating to what
can be said to the patient at any one time. This is discussed further in section 6.0 below.
4.2.3 I would like to see more of these cases being developed for GP CPD
The quantitative data for participants’ attitude to this statement are presented in Figure 4. 88.9%
respondents either strongly agreed or agreed that this simulation was useful for their CPD.
[Figure 4: “I would like to see more of these cases being developed for GP CPD”]
4.3 Additional Open comments
This part of the survey was designed to allow participants the opportunity to comment on the
positive aspects of the simulation as well as identify any issues and make suggestions for
improvement. The resulting qualitative data was subjected to thematic analysis and the major
themes are presented in Figure 5.
[Figure 5: Qualitative comments about the positive and weak aspects of the learning resource.]
5.0 Statistics
Quantitative data were analyzed using the SPSS 17.0 programme. Due to the ordinal nature of the
quantitative data, the descriptive statistics involve univariate analysis and include the median and
frequency distribution. Data is presented in tables with a corresponding bar chart.
Qualitative data were subjected to thematic analysisusing a grounded theory approach. ComputerAssisted Qualitative Data Analysis (CAQDAS) was conducted using XSight™ by QSR International.
5.0 Discussion
5.1 Summary
Evidence from this pilot shows that learners benefited from interacting with the virtual patient cases
which have served to:





Highlight the importance of early diagnosis of cancer
Increase awareness of Primary Care cancer assessment tools
Increase confidence in 2WW referral
Increase knowledge of available support to GPs
Increase awareness of the late effects of cancer
5.2 Strengths and limitations
The study has shown that participants feel they benefit from online working and that the virtual
patient cases have provided a useful addition to CPD activity. Of particular value was the
supplementary information and resources that were attached to each case, e.g. links to external web
resources, NICE guidance and cancer assessment tools.
Participants found the interactive nature of the VPs engaging, and highlighted the benefits of them
being online, quick and fun to do.
Four comments were received regarding technical issues including poor audio quality and the
simulation being slow to load. A helpline was established in order to deal with such issues during the
pilot and the problems were identified as relating to the users accessing the cases via NHS
computers with very old versions of Internet Explorer.
The main limitation of the tool identified related to the lack of options available as one progresses
through a case, with learners expressing frustration at not being able to ask questions previously
available to them. This is not thought to be a fault of the tool itself nor the concept of virtual
patients, but relates to a lack of experience in case authoring. This was the first time this particular
approach of using virtual patients was used and all the authors were new to this. The experience
gained from this pilot, will address this issue by enabling the personal development through
experience of the case authors and the technical team..
5.3 Comparison with existing literature
The findings of this study are in concord with the literature. Respondents were able to practice their
clinical decision making in a risk free simulation and found the Virtual Patient cases to be interactive,
fun and easily accessible (11). The disadvantages, in terms of difficulty in authoring realistic choices
have also been highlighted (14).
5.4 Implications for research and/or practice
Overall, this pilot study has shown that the use of virtual patient cases for CPD around the early signs
of cancer was very favourably received by participants. There was significant agreement that case
based learning using virtual patients provides an authentic online learning solution and that further
cases would be beneficial. As a result of this positive response, ASWCS commissioned a further set of
eight cases, again themed around 10 minute consultations and early signs of cancer, but also
included cases of rarer cancers.
6.0 Additonal Information
Funding: this project was funded by Avon Somerset & Wiltshire Cancer services.
Ethical approval: University of the West of England
Competing interests: None
Acknowledgements: Case authors: Dr Barbara Barton, Dr Sanjeev Popli, Dr Amelia Randle Dr Knut
Schroeder, Dr Kate Staveley, Dr Sarah Street.
REFERENCES:
(1) Department of Health.Improving outcomes: a strategy for cancer. London:
Department of Health 2011.
(2) Thomson CS, Forman D. Cancer survival in England and the influence of early diagnosis:
what can we learn from recent EUROCARE results? Br J Cancer 2009; 101 Suppl 2. S102 S109.
(3) Richards MA. The size of the prize for earlier
diagnosis of cancer in England. Br J Cancer
2009; 101(Suppl 2): S125–S129.
(4) Richards M.A. et al. Cancer survival in Australia, Canada, Denmark, Norway, Sweden,
and the UK, 1995-2007 (the international cancer benchmarking partnership): An analysis of
population-based cancer registry data (2011) The Lancet, 377 (9760) , pp. 127-138.
(5) Signs for Survival: www.aswcs.co.uk
(6) Medbiquitous (2010) ANSI/MEDBIQ VP.10.1-2010 Medbiquitous Virtual Patient
Specifications and Description Document. [online] Available from:
http://www.medbiq.org/working_groups/virtual_patient/VirtualPatientDataSpecification.pdf
[Accessed: 21st January 2012]
(7) Harless, W. G.; Drennon, G. G; Marxer, J. J.; Root, J. A. & Miller, G. E. (1971).
CASE: a Computer-Aided Simulation of the Clinical Encounter. J Med Educ, 46, 5,
pp. 443- 448
(8) Issenberg SB, McGaghie WC, Hart IR, Mayer JW, Felner JM, Petrusa ER, Waugh RA,
Brown DD, Safford RR, Gessner IH, et al. 1999. Simulation technology for health care
professional skills training and assessment. JAMA 282(9):861–866.
(9) Ellaway, R.; Candler, C.; Greene, P. & Smothers, V. (2006). An Architectural Model for
MedBiquitous Virtual Patients.Technical report, MedBiquitous, Baltimore.
(10) Lyon, HC.; Healy, JC.; Bell, JR.; O'Donnell, JF.; Shultz, EK.; Moore-West, M.; Wigton,
RS.;Hirai, F. & Beck, JR. (1992). PlanAlyzer, an interactive computer-assisted program to
teach clinical problem solving in diagnosing anaemia and coronary artery disease.
Acad Med 67(12), pp. 821-828.
(11) Cook DA, Triola MM. Virtual Patients: A critical literature review and proposed next steps.
Med Educ 2009; 43: 303-311
(12) Issenberg SB, Mcgaghie WC, Petrusa ER, GordonDL, Scalese RJ. Features and uses of
high fidelity medical simulations that lead to effective learning. A BEME systematic review.
Med Teach. 2005; 27: 10-28.
(13)Tworek J, Coderre S, Wright B, McLaughlin K. Virtual patients: ED-2 band-aid or valuable
asset in the learning portfolio? Acad Med. 2010; 85: 155-158.
(14)Saleh, Naveed MD, Texas A&M University: “Annals of Behavioural Science and Medical
Education 2010, Vol 16, No 2, 29-31.
Download