vi
TABLE OF CONTENTS
CHAPTER
1
2
TITLE
PAGE
DECLARATION
ii
DEDICATION
iii
ACKNOWLEDGMENT
iv
ABSTRACT
v
ABSTRAK
vi
TABLE OF CONTENTS
vii
LIST OF TABLES
xii
LIST OF FIGURES
xvi
RESEARCH OVERVIEW
1.1
Introduction
1
1.2
Problem Background
2
1.3
Problem Statement
4
1.4
Research Objectives
4
1.5
Research Scope
5
1.6
Research Significance
5
1.7
Chapter Summary
6
LITERATURE REVIEW
2.1
Introduction
7
2.2
Mobile Handsets and Applications Technologies
8
2.2.1
Feature Phones Vs. Smartphones
8
2.2.2
Mobile Applications (Mobile Apps)
8
2.2.3
Mobile Apps Categories/Genres
9
2.2.4
Mobile Operating Systems
10
2.2.5
Mobile OS and Apps Statistics
11
2.2.6
Mobile App Development Challenges
17
vii
2.3
User Experience (UX)
19
2.3.1
What is User Experience (UX) ?
19
2.3.2
User Experience (UX) vs. Usability Evaluation
23
2.3.3
Evaluation vs. Design Methods
24
2.3.4
User Experience Challenges
24
2.3.5
UX Time spans
25
2.3.6
Anticipated UX
28
2.3.7
UX Evaluation Methods
29
2.3.7.1
2.3.7.2
2.4
2.5
3
Technology Acceptance Model: Background and
Evolution
Chapter Summary
37
42
44
48
RESEARCH METHODOLOGY
3.1
Introduction
49
3.2
Research Design
49
3.2.1
Initiation Phase
51
3.2.2
Planning Phase
51
3.2.2.1 Mobile Application for the Study
51
3.2.2.2 Requirements Collection
52
3.2.2.3 e-learning@UTM System Analysis
53
3.2.2.4 Prototype Development
54
3.2.2.5 Research Model and Hypothesis
Development
3.2.2. Questionnaire Development
57
61
Implementation and Testing Phase
63
3.2.3.1
Data Collection
64
3.2.3.2
Data Analysis and Interpretation
65
3.2.3.3
Research Model: Reliability & Validity
Assessment
Hypotheses Testing
66
67
3.2.3
3.2.3.4
3.2.4
3.3
4
UX Evaluation Methods (During Early
Prototypes)
Questionnaire as UX Evaluation Method
Report Writing
Chapter Summary
67
69
E-LEARNING@UTM ANALYSIS AND MOBILE APP
PROTOTYPE DESIGN
4.1
Introduction
69
4.2
70
e-learning@UTM Sitemap
viii
5
4.3
e-learning@UTM Modules Classification
70
4.4
Core Modules Description
73
4.5
e-learning@UTM Usage & Modules Mapping
76
4.6
e-learning@UTM Use Case Diagram
77
4.7
Use Cases Description
78
4.8
First e-learning@UTM Mobile Application Prototype
84
4.9
Second e-learning@UTM Mobile Application Prototype
87
4.10
Chapter Summary
90
DATA ANALYSIS AND INTERPRETATION
5.1
Introduction
91
5.2
Demographic Data
92
5.2.1
Total Respondents
92
5.2.2
Gender
93
5.2.3
Age
95
5.2.4
Faculty
96
5.2.5
Education Level
98
5.3
5.4
5.5
Descriptive Results
100
5.3.1
Usefulness
100
5.3.2
Ease of Use
106
5.3.3
Enjoyment
111
5.3.4
Context
116
5.3.5
Intention to Use
121
User Experience Evaluation Model Testing
126
5.4.1
Measurement Model
127
2.4.1.1
Reliability Assessment
128
2.4.1.2
Validity Assessment
132
5.4.2
5.4.2 Structural Model
135
5.4.3
5.4.3 Hypotheses Testing
135
2.4.3.1
Hypothesis 1
135
2.4.3.2
Hypothesis 2
136
2.4.3.3
Hypothesis 3
136
2.4.3.4
Hypothesis 4
136
2.4.3.5
Hypothesis 5
138
2.4.3.6
Hypothesis 6
138
2.4.3.7
Hypothesis 7
138
2.4.3.8
Hypothesis 8
138
Chapter Summary
140
ix
6
DISCUSSION AND CONCLUSION
6.1
Introduction
141
6.2
Achievement of Research Objectives
141
6.2.1
First Objective
142
6.2.1
Second Objective
142
6.2.2
Third Objective
143
6.3
Limitations
145
6.4
Recommendations and Future Work
145
6.5
Practical Implications
146
6.6
Chapter Summary
105
REFERENCES
148
APPENDIX
153
x
LIST OF TABLES
TABLE NO.
TITLE
PAGE
2.1
Mobile OS History (Source Wikipedia)
10
2.2
Mobile Application Development Challenges
17
2.3
UX Evaluation Methods: Studied Period of Experience
30
2.4
UX Evaluation Methods: Study Type
30
2.5
UX Evaluation Methods: Development Phase
32
2.6
UX Evaluation Methods: Evaluator (Info Provider)
33
2.7
UX Evaluation Methods: Type of Data
34
2.8
UX Evaluation Methods: Applications
35
2.9
UX Evaluation Methods: Requirements
36
2.10
UX Evaluation Methods: During Early Prototypes
37
2.11
UX Evaluation Methods: Filtered
37
3.1
Research Methodology: Phases and Activities
50
3.2
Comparison between mobile application prototyping
methods
56
3.3
Research Model Constructs
57
3.4
Questionnaire Items
62
4.1
Modules Classification
72
4.2
Modules Description
73
4.3
e-learning@UTM Usage & Modules Mapping
77
4.4
“Login” Use Case Description
78
4.5
“Edit Profile” Use Case Description
78
4.6
“View All Courses” Use Case Description
78
4.7
“View Registered Courses” Use Case Description
79
4.8
“Select Course” Use Case Description
79
xi
4.9
“View Course Participants” Use Case Description
79
4.10
“View Notice” Use Case Description
80
4.11
“View Marks & Grades” Use Case Description
80
4.12
“View Forum” Use Case Description
80
4.13
“Participate in Forum” Use Case Description
81
4.14
“View Assignments” Use Case Description
81
4.15
“Upload Assignments” Use Case Description
81
4.16
“View Topics Outline” Use Case Description
82
4.17
“Select Topic” Use Case Description
82
4.18
“View Resources” Use Case Description
82
4.19
“Download Course Materials” Use Case Description
83
5.1
Number and Percentage of Respondents Per Prototype
92
5.2
Gender: Number and Percentage Per Prototype
93
5.3
Number and Percentage of Respondents’ Age Per
Prototype
95
5.4
Number and Percentage of Respondents Per Faculty
96
5.5
Number and Percentage of Education Level
99
5.6
Number of Respondents Per Prototype
100
5.7
Usefulness Measurement Items: Mean and Standard
Deviation
101
5.8
Usefulness Measurement Items: USFL1 Responses
102
5.9
Usefulness Measurement Items: USFL2 Responses
103
5.10
Usefulness Measurement Items: USFL3 Responses
104
5.11
Usefulness Measurement Items: USFL4 Responses
105
5.12
Ease of Use Measurement Items: Mean and Standard
Deviation
106
5.13
Ease of Use Measurement Items: EZUSE1 Responses
107
5.14
Ease of Use Measurement Items: EZUSE2 Responses
108
5.15
Ease of Use Measurement Items: EZUSE3 Responses
109
5.16
Ease of Use Measurement Items: EZUSE4 Responses
110
5.17
Enjoyment Measurement Items: Mean and Standard
5.18
Deviation
112
Ease of Use Measurement Items: ENJMNT1 Responses
112
xii
5.19
Enjoyment Measurement Items: ENJMNT2 Responses
113
5.2
Enjoyment Measurement Items: ENJMNT3 Responses
114
5.21
Enjoyment Measurement Items: ENJMNT4 Responses
115
5.22
Context Measurement Items: Mean and Standard
Deviation
117
5.23
Context Measurement Items: CNXT1 Responses
118
5.24
Context Measurement Items: CNXT2 Responses
119
5.25
Context Measurement Items: CNXT3 Responses
120
5.26
Intention to Use Measurement Items: Mean and Standard
Deviation
5.27
Intention to Use Measurement Items: INTUSE1
Responses
5.28
136
Coefficient of Determination: Second e-learning@UTM
Mobile Application Prototype Model
5.38
134
Coefficient of Determination: First e-learning@UTM
Mobile Application Prototype Model
5.37
134
AVE and AVE Square Root: Second e-learning@UTM
Mobile Application Prototype Model
5.36
132
AVE and AVE Square Root: First e-learning@UTM
Mobile Application Prototype Model
5.35
131
Cronbach’s Alpha & Composite Reliability: Second elearning@UTM Mobile Application Prototype Model
5.34
129
Cronbach’s Alpha & Composite Reliability: First elearning@UTM Mobile Application Prototype Model
5.33
128
Items Loading: Second e-learning@UTM Mobile
Application Prototype Model
5.32
124
Items Loading: First e-learning@UTM Mobile
Application Prototype Model
5.31
123
Intention to Use Measurement Items: INTUSE3
Responses
5.3
122
Intention to Use Measurement Items: INTUSE2
Responses
5.29
122
Hypotheses Results: First e-learning@UTM Mobile
136
xiii
Application
5.39
141
Hypotheses Results: Second e-learning@UTM Mobile
Application
142
xiv
LIST OF FIGURES
FIGURE NO.
TITLE
PAGE
2.1
App Download Per Month
12
2.2
Available Apps – App Store Vs. Android Market
12
2.3
iOS & Android App User Retention
13
2.4
Global Apps Download
13
2.5
Average Daily Downloads Per Month
14
2.6
Smartphone OS Global Sales (Gartner Q4-2011)
14
2.7
Worldwide Sessions Per Category
15
2.8
Smartphone Penetration in U.S
15
2.9
Top Smartphone Apps
16
2.10
Time spans of user experience (Adapted form Roto et al.,
2011)
2.11
26
UX over time with periods of use and non-use (Adapted
from Roto et al., 2011)
27
2.12
AttrakDiff Online Survey
43
2.13
EmoCards
43
2.14
TAM Model, Davis et al. (1989) – (1)
45
2.15
TAM Model, Davis et al. (1989) – (2)
45
2.16
TAM2: Extension of The Technology Acceptance Model,
(Venkatesh and Davis, 2000)
2.17
Unified Theory of Acceptance and Use of Technology
(UTAUT), (Viswanath et al., 2003)
3.1
3.2
45
46
Proposed Model for Evaluating Anticipated User
Experience (AUX) for Mobile Application Users
59
Study participation request distributed for students
65
xv
4.1
e-learning@UTM Sitemap (Student Perspective)
71
4.2
e-learning@UTM Student Use Case Diagram
79
4.3
First prototype: Login Screen
84
4.4
First prototype: Main Screen
84
4.5
First prototype: “My Courses” Screen
85
5.6
85
4.7
First prototype: “Selected Course” Screen
First prototype: “Topic Outline” Screen
4.8
First prototype: “Selected Topic” Screen
86
4.9
Second prototype: Splash Screen
87
4.10
Second prototype: Login Screen
87
4.11
Second prototype: “My Courses” Screen
88
4.12
Second prototype: “Selected Course” Screen
88
4.13
Second prototype: “Topic Outline” Screen
89
4.14
Second prototype: “Selected Topic” Screen
89
5.1
Number of Respondents/Prototype
93
5.2
Number of Respondents/Gender
94
5.3
Number of Respondents/Age
96
5.4
Number of Respondents/Faculty
98
5.5
Number of Respondents/Faculty
99
5.6
Number of Respondents for Item USFL1
102
5.7
Number of Respondents for Item USFL2
103
5.8
Number of Respondents for Item USFL3
104
5.9
Number of Respondents for Item USFL4
105
5.10
Number of Respondents for Item EZUSE1
107
5.11
Number of Respondents for Item EZUSE2
108
5.12
Number of Respondents for Item EZUSE3
109
5.13
Number of Respondents for Item EZUSE4
110
5.14
Number of Respondents for Item ENJMNT1
113
5.15
Number of Respondents for Item ENJMNT2
114
5.16
Number of Respondents for Item ENJMNT3
115
5.17
Number of Respondents for Item ENJMNT4
116
5.18
Number of Respondents for Item CNXT1
119
5.19
Number of Respondents for Item CNXT2
120
86
xvi
5.20
Number of Respondents for Item CNXT3
121
5.21
Number of Respondents for Item INTUSE1
123
5.22
Number of Respondents for Item INTUSE2
124
5.23
Number of Respondents for Item INTUSE3
125
5.24
UX Evaluation Model: First e-learning@UTM Mobile
Application Prototype
5.25
6.1
126
UX Evaluation Model: Second e-learning@UTM Mobile
Application Prototype
127
Proposed Mobile Application Development Guidelines
145