Introduction Review the Pros and Cons of Varying Report

advertisement
Key Considerations for Report
Generation & Customization
Richard Wzorek
Director, Production IT
Confidential © Almac Group 2012
Agenda
Introduction
Review the Pros and Cons of Varying Report Types
The Effects of Downstream Workflows on Reporting Standards
Levels of Reports Customization
Unique Trial Designs That Require Heavily Customized or Ad-hoc Reporting
Q&A
Introduction
Q: Why is report customization an important topic?
– A: 85-90% of a sponsor user’s time within an IVR/IWR
system is spent in reports
Q: Who can be impacted by reports customizations
and the information they produce?
– A: Clinical team, operations, data management,
informatics, logistics, etc.
Introduction
Q: What impact does reports user roles play in
implementing customizations?
– A: Reports have some of the highest potential for multipatient unblinding when the wrong user role is assigned
Q: How is the information in the report used?
– A: This is crucial to flesh out during requirements to
ensure usability
Introduction
Review the Pros and Cons of Varying Report Types
The Effects of Downstream Workflows on Reporting Standards
Levels of Reports Customization
Unique trial designs that require heavily customized or ad-hoc reporting
Q&A
Categories of Reports
Static flat reports
– A report that outputs fixed results and offers little
to no dynamic adjustments (i.e., PDF files, Excel
spreadsheets, HTML)
Dynamic flat reports
– A report that outputs fixed results and offers dynamic filtering and
sorting (i.e., web reports that require input form the user before they
rerun)
Fully interactive reports
– A report that supports filtering, sorting, grouping, drill down, and drill
through (i.e., a web based dashboard)
Static Flat Reports
PROS
Easy requirements
acquisition process and
training
CONS
Lack of flexibility
Reports will generate the
same output (format &
content)
Often require post live
amendments
Good for situations where
the data will be imported
into a downstream
system or process
A sponsor will often
require a large number
of these type of reports
to address their needs
Dynamic Flat Reports
PROS
The ability to dynamically
filter reduces the number
of report needed
CONS
More involved
requirements acquisition
process
Data can be exported as
static and some of the
after export effort is
reduced
Increased need for user
training
Output format stays
consistent
Data must be modeled
correctly to ensure high
performance
Fully Interactive Reports
PROS
The user can identify and
focus on outliers quickly
CONS
Requirements
acquisition requires
more engagement
Ability to “drill” into
details in real time
Requires more training
and burn in time
Filtering and sorting are
context sensitive
Requires data to be
modeled and preaggregated to deliver high
performing reports
Introduction
Review the Pros and Cons of Varying Report Types
The Effects of Downstream Workflows on Reporting Standards
Levels of Reports Customization
Unique Trial Designs That Require Heavily Customized or Ad-hoc Reporting
Q&A
Effects of Workflow
How is the information in the report used?
Results viewed on the screen drive real-time actions in the IVR/IWR
system
Printed and brought into meetings
Saved to PDF and emailed to a distribution list
Exported to excel and additional information and formatting is
added
Exported to excel and the results are added into another
spreadsheet or system
Effects of Workflow
Results viewed on the screen drive real-time actions in the
IVR/IWR system
Printed and brought into meetings
A report is the correct tool
Saved to PDF and emailed to a distribution list
Should this be an automated process?
Exported to excel and additional information and formatting is added
What are the chances of manual errors?
Exported to excel and the results are imported into another system
Should this be a data transfer or integration?
Effects of Workflow
Understanding how the reports and the information
they provide are used will pave the way to achieving
effective standardized reporting.
Reduced study level
customizations
Easier
requirements
acquisition
process
Reduced need
for re-training
on every study
Effective
Standardized
Reporting
Introduction
Review the Pros and Cons of Varying Report Types
The Effects of Downstream Workflows on Reporting Standards
Levels of Reports Customization
Unique Trial Designs That Require Heavily Customized or Ad-hoc Reporting
Q&A
Types of Customizations
Simple Customizations
Using the standard or core reports offered with the
small changes necessary to make them work with the
specific protocol. These types of changes do not
typically necessitate changes in reports standards.
Examples:
• Addition and removal of data points
• Changes to static sorting
• Changing labeling of data points, etc.
Types of Customizations
Moderate Customizations
Using a standard or core report with more than 30% of
the functions within the report changed. These types of
changes may necessitate changes in reports standards
to help contain costs.
Examples:
• Changes to the way the data is grouped
• Adding custom calculations
• Using custom sort lists, etc.
Types of Customizations
Custom Reports
This entails starting from scratch or customizing more than
50% of the functions within the report. These types of
changes should drive standards discussions. This is the most
important area to understand the differences between needs
and wants.
Examples:
• Custom dashboards
• Repurposing part of a report
• Predictive analytics
Introduction
Review the Pros and Cons of Varying Report Types
The Effects of Downstream Workflows on Reporting Standards
Levels of Reports Customization
Unique Trial Designs That Require Heavily Customized or Ad-hoc Reporting
Q&A
Ad-hoc Reporting
Q: Do I need Ad-hoc reporting capabilities?
– A: With a well defined and built suite of interactive reports
this will most often not be necessary.
Q: How do I know when this
functionality will be needed?
– A: In data collected from over 500 trials, the biggest users
of Ad-hoc functionality are from global logistics when they
are working across a large program of studies.
Unique Trial Designs
& Reporting
• Multiple treatment arms with each arm having a
different visit schedule
• Adaptive trials that add or drop treatment arms
• Unique cohort management methods
• Complex site and IP hierarchy
– Sites: Region, Cluster, Country, Site
– IP: Lot, box, kit, vial
Key Takeaways
Understand the workflows the data within the
reports will be used to support
Ask yourself who needs to be involved in reporting
requirements acquisition
Balance cost savings and value when
determining the correct solution
Thank You!
Download