e-ERC e-Learning System
The 4th International Scientific Conference
“e-Learning and Software for Education” (eLSE)
BUCHAREST (April 17-18, 2008)
Mani Pelmo
Sherubtse College
BHUTAN
Acknowledgements
Advanced Distributed Learning
Department
SSEB (Strengthening Support to
Education in Bhutan) CIDA project
RUB (Royal University of Bhutan)
2
Outline
Introduction
Usability Testing
Performance Testing
Summary
Recommendation for future work
3
Bhutan
4
Introduction
e-ERC (Education Resource Center)
– Open source based learning management
system
Evaluate usability
Evaluate performance under the
networking environments outside college
campus
5
Usability Testing
Methodology
– Questionnaire technique used:
constructed and designed based on the literature
review
– 4 measurement constructs used:
Correctness
Ease of use/user friendly
Ease of learning
Satisfaction and Acceptance
6
Methodology
Number of items within the four categories of measurement
7
Participants and Procedures
Total participants
– 77 students (Computer Science Department)
Procedures
– Instructions to participants:
Brochures
Presentation
– Answers were given using the 5-point Likert
scale
8
Data Analysis
Statistical measures:
– Mean
– Standard deviation
Software used:
– MINITAB
9
Questionnaire Results (1)
Mean and standard deviation for individual
question
10
Questionnaire Results (2)
Mean and standard deviation for each
measurement constructs
11
Performance Testing
simulation was accomplished using network
simulator, NS2
Simulation procedures
– dial-up connection from a outside campus (n0 and n1): 56Kbps as a
bandwidth and 10ms as delay
– Internet (n1 and n2): 2Mbps as a bandwidth and 100ms as propagation
delay
– Server (n2 and n3): 500Kbps as a bandwidth and 10ms as a
propagation delay
12
Simulation Procedures
1, 5, 10, 15 and 20 simultaneous users
13
Simulation Results (1)
Total time to transfer a file (in sec.)
14
Simulation Results (2)
Mean and standard deviation for
transferring 100KB file
15
Summary
Usability Testing
– prepared questionnaires, presentations, and
instructions for conducting questionnaires
– conducted pilot study with small group of participants
Performance Testing
– Conducted NS2 simulation of the operations of the eERC System with 1 - 20 simultaneous user
Good performance is expected for downloading
a file size of 100KB or less
16
Recommendation for future work
Test with a large number of participants
should be carried out
Moodle should be explored
Usability study on Moodle should be
carried out as well
Comparative study between e-ERC and
Moodle should be examined
17
THANK YOU!
18