ISDS Survey Results 2010
Integrated System
Deployment & Support
2010
User Survey Results
Page 1 of 41
ISDS Survey Results 2010
Introduction
This report is designed to summarize end-user satisfaction with the Integrated System based on the data
collected from the prior three annual user surveys. Invitations to participate in the user survey are extended
annually to approximately 3000 active Integrated System users at the University of Virginia who hold one or
more module responsibilities. Data is acquired from users that self-select to complete the survey. The number
of survey responses that were collected per year is 1,026 in 2008, 759 in 2009, and 869 in 2010.
The raw data was cleared of duplicates prior to analysis. Duplicates were eliminated based on the presence of
data from repeated logons and from data with identical timestamp information. Responses were also
eliminated from the “ease of use” and “helps me do my job more effectively” module analysis if the respondent
did not indicate that they had the associated module responsibility.
For purposes of comparison with prior years, where responses are broken out by responsibility the PO
Shopper Only respondents were merged with the Finance responses and those respondents who indicated
they had both HR & PO Shopper responsibilities were merged with the Finance / HR responses.
The Tukey analysis of variance method was used to compare survey responses between years. Statistically
significant differences found between years are denoted by colored braces connecting the results as follows:
Red brackets denote statistically significant differences between two consecutive years.
Blue brackets denote statistically significant differences between non-consecutive years.
In responses where statistical differences were found between years, notable events during the time periods
reported are listed merely as observational background information and are not meant to infer that a correlation
definitely exists between the notable events listed and the actual survey responses.
Page 2 of 41
ISDS Survey Results 2010
Results
Demographics
1. Where do you work?
85
68
82
176
129
155
643
479
533
122
82
99
2. How often do you use the Integrated System?
518 378
463
334 245
322
111 96
63
63
3. In which applications do you have responsibilities? (Check all that apply.)
Page 3 of 41
39
21
ISDS Survey Results 2010
521
505
650
376
528
498
395
363
423
447
471
287
459
411
389
369
453
417
Page 4 of 41
ISDS Survey Results 2010
4. Do you ONLY use the Integrated System to approve transactions and/or run reports?
783
218
576
156
638
206
If yes, which do you do?
94
37
85
75
24
51
81
44
75
s
Page 5 of 41
ISDS Survey Results 2010
5. How long have you worked at the University of Virginia?
182
844
153
605
137
732
6. How frequently do you use other desktop tools such as Excel, Access, or PC reporting tools
(e.g., PC SAS, Brio Query, Crystal Reports)?
613 463 535
463
202 132 161
41
47
Page 6 of 41
45
89
78
80
61
37
41
ISDS Survey Results 2010
7. Please tell us the order in which you would seek Integrated System help.
Notable events* during the time periods reported:
 In-house Help Desk outsourced after 2009 survey
 Discoverer Plus, web version, implemented prior to 2010 survey
*Notable events are listed merely as observational background information and not meant to
infer that a correlation definitely exists with the actual survey responses.
Page 7 of 41
ISDS Survey Results 2010
7. Where do you seek help – broken down by user type.
Notable events* during the time periods reported:
 In-house Help Desk outsourced after 2009 survey
*Notable events are listed merely as observational background information and not meant to
infer that a correlation definitely exists with the actual survey responses.
Page 8 of 41
ISDS Survey Results 2010
7. Where do you seek help – broken down by user type.
Page 9 of 41
ISDS Survey Results 2010
7. Where do you seek help – broken down by user type.
Notable events* during the time periods reported:
 Discoverer Plus (web version) implemented prior to 2010 survey
Notable events* during the time periods reported:
 Discoverer Plus (web version) implemented prior to 2010 survey
*Notable events are listed merely as observational background information and not meant to
infer that a correlation definitely exists with the actual survey responses.
Page 10 of 41
ISDS Survey Results 2010
8a. Discoverer reports provide me the information I need to complete my tasks.
8b. Discoverer reports run quickly enough
Page 11 of 41
ISDS Survey Results 2010
8a. Discoverer reports provide me the information I need – breakdown by user type.
8b. Discoverer reports run quickly enough – breakdown by user type.
Page 12 of 41
ISDS Survey Results 2010
9a. IS reports provide me the information I need to complete my tasks
9b. IS reports run quickly enough
Page 13 of 41
ISDS Survey Results 2010
9a. IS reports provide me the information I need – breakdown by user type.
IS reports run quickly enough – breakdown by user type
Page 14 of 41
ISDS Survey Results 2010
8. & 9. Summary
5.00
4.50
4.13
4.08
4.07
4.00
3.94
3.81
3.85
3.85
3.86
3.75
3.65
3.82
3.70
2008
3.50
2009
3.00
2.50
2010
560N=5 466
466
42
531
Discoverer Reports
provide me with the
information I need to
complete my task
469
378
424
IS Reports provide me
with the information I
need to complete my
task
547
458
518
Discoverer Reports run
Quick Enough
461
380
412
IS Reports run Quick
Enough
8. & 9. Summary response for all years
5.00
4.50
4.09
4.00
3.86
3.82
3.72
3.50
3.00
2.50
2008-2009-2010
2.00
1.50
1.00
1557
1271
1523
Discoverer Reports IS Reports provide me Discoverer Reports
provide me with the with the information I run Quick Enough
information I need to need to complete my
complete my task
task
Page 15 of 41
1253
IS Reports run Quick
Enough
ISDS Survey Results 2010
Human Resources
Notable events* during the time periods reported:
 Self-Serve Time and Leave implemented after 2009 survey taken.
*Notable events are listed merely as observational background information and not meant to
infer that a correlation definitely exists with the actual survey responses.
Page 16 of 41
ISDS Survey Results 2010
10-11. Timekeeper.
5.00
4.50
4.00
3.88
4.02
3.79
3.70
3.92
3.79
2008
3.50
2009
2010
3.00
2.50
The following Integrated System module is
easy to use: Timekeeper
The Integrated System helps me do my job
effectively in: Timekeeper
Page 17 of 41
ISDS Survey Results 2010
10-11. Labor Distribution
5.00
4.50
4.00
3.50
3.44
3.40
3.57
3.46
3.57
3.56
2008
2009
2010
3.00
2.50
The following Integrated System module is
easy to use: Labor Distribution
The Integrated System helps me do my job
effectively in: Labor Distribution
Page 18 of 41
ISDS Survey Results 2010
Accounts Payable.
Page 19 of 41
ISDS Survey Results 2010
10-11. Employee Self Service (Training Registration)
Page 20 of 41
ISDS Survey Results 2010
10-11. General Ledger
Page 21 of 41
ISDS Survey Results 2010
10-11. Accounts Receivable.
Page 22 of 41
ISDS Survey Results 2010
Possible impact: Student Information System interfaces
Grants Management
Page 23 of 41
ISDS Survey Results 2010
10-11. Employee Self Service (Fixed Assets).
Page 24 of 41
ISDS Survey Results 2010
10-11. Purchasing
Notable events* during the time periods reported:
 Marketplace implemented in 2007
*Notable events are listed merely as observational background information and not meant to
infer that a correlation definitely exists with the actual survey responses.
Page 25 of 41
ISDS Survey Results 2010
10.11. Employee Self Service (HR).
Page 26 of 41
ISDS Survey Results 2010
10. Ease of Use – Summary by module and year – Percent
5.00
4.50
2008
4.29 4.29 4.29
4.16
2009
4.00
3.83
3.89
3.93 3.91
3.89
3.88
3.79
3.79
3.77
3.81 3.83
2010
3.70
3.44
3.50
3.40
3.52
3.46
3.63
3.58
3.57 3.58 3.55
3.56
3.52
3.52
3.51
3.45
3.69
3.51
3.30 3.28
3.00
2.50
HR/Payroll
Timekeeper
SSTL
LD
Training
registration
Pay slip
A/P
GL
AR
GM
Fixed Assets
Purchasing
Ease of use – number of responsibility holders who responded.
900
848
800
771
771
725
2008
719
700
673
667
2009
629
600
2010
532
500
500
400
368
328
309
300
264
228
310
286
255
253
239
226
252
230
200
223
205 200
198
171
176
183
146
163
151
113
100
0
HR/Payroll
Timekeeper
SSTL
LD
Training
registration
Pay slip
Page 27 of 41
A/P
GL
AR
GM
Fixed Assets
Purchasing
ISDS Survey Results 2010
11. Helps me do my job effectively – summary by module and year - Percent.
5.00
4.50
2008
4.03
4.15
4.09
4.02
3.93
4.00
3.92
3.91
2009
4.01
3.97 3.96
3.92
3.89
3.79
3.85 3.89
3.79
3.68 3.69
3.66
3.73
3.69
3.76
3.74
3.71
2010
3.59
3.57 3.57 3.56
3.45
3.50
3.49 3.51
3.00
2.50
HR/Payroll
Timekeeper
SSTL
LD
Training
registration
A/P
GL
AR
GM
Fixed Assets
Purchasing
Notable events* during the time periods reported:
 Marketplace implemented in 2007
 Discoverer Plus, web version, implemented prior to 2010 survey
 Self-Serve Time and Leave implemented after 2009 survey taken
Helps me do my job effectively - number of responsibility holders who responded.
900
800
2008
707
681
700
600
669
2009
644
2010
552
487
500
505
400
325
300
252
222
292
289
284
251
241
227
214
186
200
234
233
203
203
159
177 172
129
148
168
137
125
94
100
0
HR/Payroll
Timekeeper
SSTL
LD
Training
registration
A/P
GL
AR
GM
Fixed Assets
*Notable events are listed merely as observational background information and not meant to
infer that a correlation definitely exists
with
Page
28 the
of 41actual survey responses.
Purchasing
ISDS Survey Results 2010
Summary Ease of Use – Average All Modules – All Years
5.00
4.50
4.00
3.50
3.00
2.50
2008-2009-2010
2.00
1.50
1.00
Human
Resources/Payroll
Timekeeper
Labor Distribution
Training
registration
SSTL
Pay slip
Accounts Payable General Ledger
Accounts
Receivable
Grants
Management
Fixed Assets
Purchasing
11. Summary: Helps me do my job effectively – All Modules – All Years
5.00
4.50
4.00
3.50
3.00
2.50
2008-2009-2010
2.00
1.50
1.00
Human
Resources/Payroll
Timekeeper
Labor Distribution Training registration
SSTL
Accounts Payable
.
Page 29 of 41
General Ledger Accounts ReceivableGrants Management
Fixed Assets
Purchasing
ISDS Survey Results 2010
12. The requirements and steps to gain access to IS are clear?
12. Summary by year
Page 30 of 41
ISDS Survey Results 2010
13. The time it takes to do a transaction in the Integrated System, e.g. run a query, save, or navigate
between forms, is fast enough for me to complete my tasks efficiently.
The time it takes to do a transaction in the Integrated System - breakdown by User Type
Notable events* during the time periods reported:
 Marketplace implemented in 2007
 Discoverer Plus, web version, implemented prior to 2010 survey
 Self-Serve Time and Leave implemented after 2009 survey taken
*Notable events are listed merely as observational background information and not meant to
infer that a correlation definitely exists with the actual survey responses.
Page 31 of 41
ISDS Survey Results 2010
14. ODS/Discoverer is normally available for me when I need to run reports.
1
0
2
5
3
5
35
21
32
297 238
274
95
75
66
ODS/Discoverer is normally available to me – Breakdown by user type
The ODS availability was extended from 6 pm to 10 pm after the 2009 survey; therefore there is no notable
event that would correspond with this downward trend. Possibilities to explore: are users working longer
hours, or possibly working from home during non-peak hours?
Page 32 of 41
ISDS Survey Results 2010
15. The Integrated System is available for me to complete my tasks when I need to do them.
The Integrated System is normally available to me –breakdown by user type.
Page 33 of 41
ISDS Survey Results 2010
13-15. Availability and Response Time - Yearly Averages
5.00
4.50
4.11
4.14
4.05
3.53
3.50
3.41
4.00
3.96
4.00
4.00
3.53
2008
2009
3.00
2010
849
662
747
433
337
379
877
678
784
2.50
The time it takes to do a transaction in the ODS/Discoverer is normally available for
Integrated System, e.g., run a query, save,
me when I need to run reports
or navigate between forms, is fast enough
for me to complete my tasks efficiently
The Integrated System is available for me
to complete my tasks when I need to do
them
Notable events* during the time periods reported:
 Marketplace implemented in 2007
 Self Serve time and leave implemented after 2009 survey
Q13 – Q15 Summary – Availability and Response Time - Overall Average – All Years
5.00
4.50
4.10
4.00
3.50
3.99
3.49
3.00
2.50
2.00
2008-2009-2010
1.50
1.00
The time it takes to do a transaction in
the Integrated System, e.g., run a
query, save, or navigate between
forms, is fast enough for me to
complete my tasks efficiently
ODS/Discoverer is normally available
for me when I need to run reports
The Integrated System is available for
me to complete my tasks when I need
to do them
*Notable events are listed merely as observational background information and not meant to
infer that a correlation definitely exists with the actual survey responses.
Page 34 of 41
ISDS Survey Results 2010
The following communication tools are useful:
16. Communication Tools breakdown by User Type.
34
32
25
78
75
102
433
322
317
213
171
233
Notable events* during the time periods reported:
 More and more users are creating a shortcut to the Logon Page, thus bypassing current news
 Users may unintentionally have pop-ups blocked
*Notable events are listed merely as observational background information and not meant to
infer that a correlation definitely exists with the actual survey responses.
Page 35 of 41
ISDS Survey Results 2010
34
32
29
75
72
99
420
306
309
215
173
223
32
31
26
71
72
101
423
304
303
208
166
221
21
21
20
58
63
74
273
203
199
162 126
Page 36 of 41
170
ISDS Survey Results 2010
22
24
19
68
68
79
262
199
203
189
157 196
Communication Tools: Average All Years
5.00
4.50
4.00
3.50
3.00
2.50
2.00
1.50
1.00
3.86
3.46
3.51
3.27
3.62
2008-2009-2010
Current News
Web site (popup window
when log on)
Targeted I.S.
User Notices
(email)
On-line
Frequently
Asked Questions
Page 37 of 41
IS Exchange
User Group
Announcements
ISDS Survey Results 2010
17. I see improvements in IS usability over the past year
I see improvements in IS usability over the past year – break down by User Type
Notable events* during the time periods reported:
 Marketplace implemented in 2007
 Student Information System interfaces began after 2009 survey
*Notable events are listed merely as observational background information and not meant to
infer that a correlation definitely exists with the actual survey responses.
Page 38 of 41
ISDS Survey Results 2010
18. Overall, I am satisfied with the Integrated System.
Overall I am satisfied with the Integrated System - break down by User Type
Overall I am satisfied with the Integrated System - break down by User Frequency
Notable events* during the time periods reported:
 Marketplace implemented in 2007
 Student Information System interfaces began after 2009 survey
*Notable events are listed merely as observational background information and not meant to
infer that a correlation definitely exists with the actual survey responses.
Page 39 of 41
ISDS Survey Results 2010
18. Summary – Overall I’m Satisfied - All Responses by Year
Summary – Overall I’m Satisfied – All Responses – All Years
Notable events* during the time periods reported:
 Marketplace implemented in 2007
 Self Serve time and leave implemented after 2009 survey
 Student Information System interfaces began after 2009 survey
*Notable events are listed merely as observational background information and not meant to
infer that a correlation definitely exists with the actual survey responses.
Page 40 of 41
ISDS Survey Results 2010
5.00
4.50
4.00
3.68
3.50
3.00
2008-2009-2010
2.50
2.00
1.50
1.00
Overall, I am satisfied with the Integrated System.
Overall I'm Satisfied with the Integrated System
5.00
4.50
4.00
3.66
3.50
3.76
3.54
3.48
3.63
3.71
3.72
2009
2010
3.00
2.50
2.00
1.50
1.00
2004
2005
2006
Page 41 of 41
2007
2008