here - Information Services and Technology

advertisement
Information Technology – Roll Out of OracleBI Discoverer to
the Worldwide User Community
Final Status Report of 11/25/2012
Scott Mc Coy
MS-PTC 610-851
November 25, 2012
Academic Research
Additional Progress in Completing the Usability Study
Results of the Interview
Twenty-two users (key users) within certain worldwide (North America, South America, Europe and Africa)
operation areas (Booking, Documentation, and Equipment) were identified to be data collectors and were given
the interview template. These twenty-two users canvassed their geographical areas to determine what existing
reports were needed for daily operations.
Two hundred twenty reports (220), normally executed from Star-Net or through vendor systems were converted
to Oracle(BI) Discoverer Plus and can be run through either Oracle(BI) Discoverer Plus or Oracle(BI)
Discoverer Viewer. The selection was based on resource requirements needed to run the reports (execution
statistics), the reports that were created in the vendor system, and as of a result of the interview questions
created by the Usability Department (AKA training department). The latter reports were identified by these key
users as crucial to a department’s operations, but were also cross referenced as ones that caused the most calls to
the support group. More specifically, Star-Net reports, along with the vendor reports number approximately
800, of which 220 were converted. Vendor system reports number 45, so interviewing uncovered 175 Star-Net
reports that needed to be converted. A representative list of converted reports is shown in the below screen
print:
Results of the Task based Focus Groups
The objectives of this activity:

To discover what the structure of an XXX department is, to efficiently implement Oracle(BI)
Discoverer
The Usability and ADP Group discovered that most departments canvassed, consisted of
managers and subordinates. In the larger agents, there is one manager and several supervisors. In
the smaller agents, there is one manager and subordinates.

To discover what users use Star-Net (the existing system)
Lists of users were accumulated in order to set them up in the Oracle(BI) Discoverer System.
Larger agents, those judged by container handling volume or those representing multiple
shipping companies, tended to have a segregated staff for each shipping company. Smaller
agents tended to inter-mingle staff to handle multiple shipping companies.

To discover how users adapt to new a new technology
For all agents, the learning of a new system is an issue, due to perceived learning curves and
limited time to switch interfaces while performing functions.

To discover changes that need to be made to this new technology to increase adaptability
Issues with adaptability centered on the following concerns:
a. Performance for some workbooks was extremely slow.
b. Necessary Items (fields or columns) are not available in Oracle(BI) Discoverer
that are available in Star-Net.
c. Functionality available to the ADP Staff for the creation of workbooks was not
available to the Discoverer Plus user (the participants in the task-based focus
group).
d. Reports failed to produce data even though data was contained in the system.
e. Missing data which could not be explained by differences between the production
system (updated continuously) and the test system (frozen on 26-OCT-2012).
f. Functionality (emailing, scheduling) in Star-Net that is not in Oracle(BI)
Discoverer.
g. A physical limit (10 Megabytes) on the size of an exported file which may
necessitate breaking up of data based on smaller date ranges. These multiple
workbooks will need to be recombined necessitating more time for job
completion.

To discover the aptitude of different users groups in understanding this new technology
Individuals within the task-based focus group were the more knowledgeable users of the
previous system. A broader base of users exists. These users will be encountered in January
when the Group Task Analysis is conducted in Chicago, IL.

To discover the user’s current aptitude in Structured Query Language (SQL)
It is not expected that SQL knowledgeable users will be trying to alter the tool generated code.
A finding of this task-based focus group was that the functionality to view the automated
generated code does not allow modification of the code.
The following data will be collected:

Notes on the interactions, concerns and frustration of the task-based focus groups in conceptually and
physically evaluating a new reporting and analysis tool
To summarize, there are concerns by agents
a. On using a new tool due to time available to perform functions.
b. On the current product as implemented because of perceived performance and data
retrieval issues.
c. On users mentioning that Discoverer Plus as a replacement for Star-Net will lead to more
work to remove unnecessary data from the raw data produced.
d. On the lack of columns available.
e. On the loss of functionality compared to the existing system used.

Observations by the Application Development Pool (Developers, Support, and Trainers) on how the
task-based group evaluates a new reporting and analysis tool
a. ADP is investigating enhancements to accommodate the users concerns
b. Support has voiced concern that additional calls may be received, not only about the current
performance issues, but now about utilizing the new tool, if ADP and training cannot
accommodate all the users concerns.
c. Training is further adjusting material based on a more thorough understanding of what the users
wish to accomplish.
Tasks Accomplished
1. Results of Interview questions will be analyzed and are reported (This status)
2. Surveys will be sent out the week of November 18, 2012 and expected back by November 23, 2012 (In
progress)
3. Task-based focus group statistics are being analyzed and are reported (This status)
Tasks to be Accomplished
1. Group Task Analysis Proposal will be completed by December 2, 2012
Tasks Dispensed With
1. Group Task Analysis for Additional “Discoverer Plus” users has been pushed to January 2013 so it will be
dropped
2. Group Task Analysis for all Discoverer Viewer users has been pushed to February 2013 so it will be
dropped.
Proposed Schedules – Completion Status Noted
Proposed Schedule – Interview Proposal
Work Package
Meet with UI Team to finalize
proposal
Book Conference Room
User access list and automated
script
Conduct Sessions - North America
Users (Remote) Multiple meetings
Conduct Sessions - South America
Users (Remote) Multiple meetings
Conduct Sessions - Europe Users
(Remote) Multiple meetings
Analyze Data and produce findings
of workbook changes
Create Draft Report
Review and comment on report
Publish final Report
Owner
Scott (UI Team), Linda (Support),
Marsha (ADP Manager)
Linda (Support)
Lydia (ADP Team Lead)
Scott(UI Team), Linda (Training),
Marsha, Rajan (ADP Managers)
Scott(UI Team), Linda (Training)
Scott(UI Team), Linda (Training)
Scott(UI Team), Linda (Training),
Marsha, Rajan (ADP Managers)
Scott (UI Team)
(ADP & Support)
Scott (UI Team)
Estimated Time-to-Complete
2 hours (Completed)
1 hour (Completed)
10 hours compile, 5 hours write
script (Completed)
3 hours on November 5 – 9
(Completed)
3 hours on November 5 – 9
(Completed)
3 hours on November 12 – 16
(Completed)
1 week (Completed)
1 week
1 week
1 week
Proposed Schedule – Task-Group Proposal
Work Package
Meet with UI Team to finalize
proposal
Book Conference Rooms – Send
meeting notices.
Create User Tasks
Participants
Scott (UI Team), Linda (Support),
Marsha (ADP Manager)
Linda (Support)
Conduct Task-based Group Focus
meetings
Scott(UI Team), ADP & Support
(Moderators) Business Process
Group and Users (NA, SAM, EU),
ADP),
Analyze Data and produce findings
of the survey
Create Draft Report
Review and comment on report
Publish final Report
Scott(UI Team), Linda (Training),
Marsha, Rajan (ADP Managers)
Scott (UI Team)
(ADP & Support)
Scott (UI Team)
Scott (UI Team), with review by
Linda (Training), Marsha, Rajan
(ADP Managers)
Estimated Time-to-Complete
2 hours (Completed)
1 hour (.25 hour for 4 sessions)
(Completed)
1 hour November 5 , 2012 and
November 12, 2012 (Creation)
(Completed)
2.5 hours on November 7, 2012 at
0700 hours, 1100 hours and 1400
hours (NA, SAM)
2.5 hours on November 14, 2012 at
0800 hours (EU) (Completed)
1 week (Completed)
1 week
1 week
1 week
Proposed Schedule – Survey Proposal
Work Package
Meet with UI Team to finalize
proposal
Book Conference Room
Create Survey
Owner
Scott (UI Team), Linda (Support),
Marsha (ADP Manager)
Linda (Support)
Scott (UI Team), with review by
Linda (Training), Marsha, Rajan
(ADP Managers)
Distribute Survey
Fill out Survey (individual users)
Scott(UI Team), Business Process
Group (NA, SAM, EU)
Users (NA, SAM America, EU)
Analyze Data and produce findings
of the survey
Create Draft Report
Review and comment on report
Publish final Report
Scott(UI Team), Linda (Training),
Marsha, Rajan (ADP Managers)
Scott (UI Team)
(ADP & Support)
Scott (UI Team)
Estimated Time-to-Complete
2 hours (Completed)
.25 hour (Completed)
4 hours November 18, 2012
(Creation) (Completed)
4 hours on November 19, 2012
(Review)
3 hours on November 19, 2012
(Completed)
.25 hours from November 19 – 23
(Completed)
1 week
1 week
1 week
1 week
Appendix A – Heuristic Analysis of Oracle(BI) Discoverer
Visibility of system status
Purpose Statement: The system should always keep users informed about what is going on, through
appropriate feedback within reasonable time.
Oracle(BI) Discover messages are received by the user concerning execution of queries such as
estimated time to completion or null data results. Invalid logic messages, in the creation of conditions,
calculations, use of parameters, etc. are received while workbooks are being created.
Match between system and the real world
Purpose Statement: The system should speak the users' language, with words, phrases and concepts
familiar to the user, rather than system-oriented terms. Follow real-world conventions, making
information appear in a natural and logical order.
This is a function of the Oracle(BI) Discoverer Administrator (ODA). Users have voice concerns about
this because there was no standard followed in naming Business Areas, Folders and Items. Some ODAs
did consider the users in the naming convention, but others did not. Some Business Areas, Folders and
Item names contain acronyms and initialisms of the data they represent.
User control and freedom
Purpose Statement: Users often choose system functions by mistake and will need a clearly marked
"emergency exit" to leave the unwanted state without having to go through an extended dialogue.
Support undo and redo.
There are exits and cancel options available to the user to terminate erroneous actions.
Consistency and standards
Purpose Statement: Users should not have to wonder whether different words, situations, or actions
mean the same thing. Follow platform conventions.
Across Business Areas, Oracle(BI) Discoverer offers the same interface for creating and running
workbooks. Different Applications Areas have chosen to implement different Oracle(BI) Discoverer
products initially, so for a period of time (estimated to be several months), users will need to log into
different front ends (login screens) to access workbooks. After all applications are combined, this
should not be an issue.
Error prevention
Purpose Statement: Even better than good error messages is a careful design which prevents a
problem from occurring in the first place. Either eliminate error-prone conditions or check for them
and present users with a confirmation option before they commit to the action.
Invalid logic messages, in the creation of conditions, calculations, use of parameters, etc. are received
while workbooks are being created.
Recognition rather than recall
Purpose Statement: Minimize the user's memory load by making objects, actions, and options visible.
The user should not have to remember information from one part of the dialogue to another.
Instructions for use of the system should be visible or easily retrievable whenever appropriate.
Oracle(BI) Discoverer offers a workspace that is visually pleasing and all inclusive. Oracle(BI) Discoverer
offers the user a wizard that walks the user though the mechanics of creating a workbook.
Flexibility and efficiency of use
Purpose Statement: Accelerators -- unseen by the novice user -- may often speed up the interaction for
the expert user such that the system can cater to both inexperienced and experienced users. Allow
users to tailor frequent actions.
Oracle(BI) Discoverer offers the user a wizard that walks the user though the mechanics of creating a
workbook. Cross enabled functionality, such as tabbed dialogue boxes that allow the choosing of
alternate functions regardless of the original functionality chosen, exists.
Aesthetic and minimalist design
Purpose Statement: Dialogues should not contain information which is irrelevant or rarely needed.
Every extra unit of information in a dialogue competes with the relevant units of information and
diminishes their relative visibility.
Dialogue boxes filter out information that does not meet use criteria. For example, in the calculation
dialogue box, alphanumeric items are not presented to the user, whereas numeric items are presented
for use.
Help users recognize, diagnose, and recover from errors
Purpose Statement: Error messages should be expressed in plain language (no codes), precisely
indicate the problem, and constructively suggest a solution.
Oracle(BI) Discoverer error messages are expressed in plain language, although codes are sometimes
included. In essence, among users, system mechanic knowledge varies. Therefore the error messages
contain information for all users, and this information can assist a novice user in addressing the issue
with an appropriate expert user.
Help and documentation
Purpose Statement: Even though it is better if the system can be used without documentation, it may
be necessary to provide help and documentation. Any such information should be easy to search,
focused on the user's task, list concrete steps to be carried out, and not be too large.
Oracle(BI) Discoverer help is online, searchable, cross-hyperlinked within topic and segregated by
product (Oracle(BI) Discoverer Administrator, Oracle(BI) Discoverer Plus, Oracle(BI) Discoverer Viewer,
etc.). The index is not so good, which hampers the use of a printed document, but Chapter 23, entitled
Dialog Reference is very searchable based on Keywords as is the entire help document.
Appendix B – Sample Findings of the Task-based Focus Group
Note: Unedited from original
Tracking #
Issue
BR8000002806
Create the same report from Current system and Discoverer
to confirm if information available in both databases.
BR8000002806
Create the same report from Current system and Discoverer
to confirm if information available in both databases.
BR8000002807
Create the same report from Current system and Discoverer
to confirm if information available in both databases.
US8000002840 After expanding the list of worksheets under the IMDL INTERMODAL DISPATCH REPORT workbook and clicking on
the separate worksheets to execute them, an error message is
received (See attached screen print) This has occurred
somewhat sporadically for different worksheets for multiple
users. To attachments
US8000002841 Get the attached error when trying to pull up the Outgate
TPO CTI Report. I entered "Outgate TPO CTI Report", "Outgate
TPO CTI", "Outgate TPO" and "Outgate" and received the
below for all.
TH8000002846 Create a workbook named 'Export Turnaround by Vessel' to
extract ECS data from ECODW. The needed columns are, for
example, Prv Atloc Code, Prv Xns Code, Prv Xns Dttm, Curr
Eqp No, Curr Eqp Chkd, Curr Eqp Typ, Prv Vsl Code, Prv Voy
Code, etc. Note that these column only available in the folder
'Illogical xns lcn check N'.
US8000002966 Testing the reports in Discoverer Viewer. Users ran into many
performance issues, including errors, log report times, no data
found, missing data, and time outs. The attached document
describes the issues found from each tester.
TH8000003001 Submit the report 'EQP-ECS Monthly IMP-EXP Rp - History'
with the parameters:
EQP XNS Date From 01-Aug-2012
EQP XNS Date To 15-Aug-2012
EQP XNS Code 'IRO'
Result or Comments of the User or
Usability Team
Error retrieved when tried to
generate report via Discoverer
Viewer. Report was duly generated
via Current system IMDRR27,
comparison was not possible since we
were not able to retrieve information
from Discoverer.
Error retrieved when tried to
generate report via Discoverer
Viewer. Report was duly generated
via Current system ¿ IMDRR27,
comparison was not possible since we
were not able to retrieve information
from Discoverer.
Data was retrieved from Current
system, however, nothing was
retrieved from Discoverer. (as per
attached ref file)
Intermittent error received when user
attempts to execute a workbook.
Error message received for several
workbooks
Inability to find or utilize the correct
items to create a workbook
See Attached Document
The report could be exported
successfully, but BL Shipper Name is
blank while checking in ECS
transaction, there exists 'Customer'
information.
Disposition Code 'EXP'
At Location Starts with 'THLCH%'
And export to CSV file
TH8000003004 Run report 'IMDL - CFS Cargo Report' with parameters
Vessel 'MAV2'
Voyage '0119S'
Line 'CBW'
Discharge Port 'THLCHPT'
Then export to CSV file
Example: TGHU1095707
Customer : NATIONAL STARCH AND
CHEMICAL (THAIL
The report could be run successfully.
The report can be export to CSV and
saved with no problem.
However, when export CSV and
clicked at open, no result is shown
(the screen is blank for a long time
despite the file size is only 31k.)
Download