Instructor Course Evaluation (ICE)
Instructors’ Manual
OIRA / IT
November 2014
The Blue Experience
• Assesses the students’ evaluations of the instructor, the course, and learning
outcomes.
• OIRA in collaboration with IT implemented a new ICE application (Blue
Evaluations) , acquired from
• “eXplorance is a leading provider of Learning Experience Management (LEM)
solutions for higher education, corporate training and organization
management”
• “eXplorance develops enterprise-Course web-based software that helps
educational institutions achieve a competitive advantage through effective
collection mechanisms of critical organizational information, flexible
departmental processes, as well as enhanced enterprise communication” – source:
eXplorance
• All AUB requirements, and in particular the Confidentiality, were respected
Blue Highlights (source: eXplorance)
• Blue is: A web based information gathering, sharing and analysis
software, and reporting tool for:
 Blue/ Course Evaluations
 Blue/360 Performance Appraisal
 Blue/Surveys
 Blue/Tests
• Blue is 100% Web-based, allowing:
 Security. Ensure privacy and confidentiality of all data
 Ease of access for every authorized user
(any browser, any input device)
 Integration with existing data sources and IT infrastructure
 Synchronization with authentication infrastructure (i.e. Login access via
your existing employee/ student portal)
 Branding needs (example: Logos, customized reports headers)

3
Blue Highlights
• Blue enables instructors to add a pool of
optional questions (restricting to a maximum of 3, now)
• Supports team taught courses, cross listed
courses, etc.
• Can be leveraged to power mid-term reviews, i.e.
provide formative evaluation
• Provides live access to response rate information
• Text Analytics option for open-ended
comments (to be implemented at a later stage)
4
Overview of Definitions
- (source: eXplorance)
5
Question Personalize (QPs)
• Instructor(s) are given the option of adding
personalized evaluation questions (up to 3 for the time
being)
• The personalized questions will be added by Instructors
at the end of the standard ICE
• The evaluation scales will follow the ICE scales.
• For the time being no additional open ended (no
comments) questions will be added by Instructors
https://oirablue.aub.edu.lb/Blue/sqvg-eng.aspx?lang=eng&pid=e820314b-44dc-44fa-bac3-3fc898c42767&tid=f07cbedb70a246d9f3f91795fd0650bb&uid=2cf216dda0201b2a8d5091d42ac8e74f&regl=en-us
6
Reports & Analysis
• Provides permanent report repository
• Report Types
 Individual instructor report
 Aggregate reports based on existing instructor demographics
 Comparative reports at individual or aggregate levels
• Report Blocks
 Analysis block on response
 Frequency, Score, Aggregate frequency
 Graphics, tables, statistics
 Norms, averages
 Summary, gap analysis, response rates.
 Analysis block on demographics
 Cross tabulation
 Response to Demographic
7
Text Analytics
• Text Analytics report blocks are designed to produce a
clear and concise visualization of freeform open ended
feedback
 Uses powerful algorithms that examine the content of
freeform comments provided by raters and based upon the
assigned dictionary it attempts to place the comments into
predefined themes established in the dictionary
 The themes with the highest number of comments are added
to the report
 Can be reported as frequencies, charts, clouds, and trends.
8
9
10
11
Timeline
o
o
o
o
o
o
o
o
Faculty Presentation November 5.
Faculty add items (max of 5), November 5-14.
Student Presentation, November 11.
Go Live Date – Fall 2014-15 (November 17)
User Manuals and Guidelines are available
Access is through AUB NetDB, and fully secured
System closed Midnight of December 9-10.
Grade Hold for students who have not completed their
evaluations.
o Reports will be released early January, 2015.
12
Project Timeline
13
Initiating email instructing Faculty Members to add
additional questions
From: Blue Srvc <blue-srvc@aub.edu.lb>
Date: October 31, 2014 at 22:18:47 GMT+2
To: Karma El-Hassan <kelhasan@aub.edu.lb>
Subject: Fall 2014-15 On-Line Instructor Course Evaluation (ICE) - Personalized
Additional Questions
Reply-To: Oira Oira <oira@aub.edu.lb>
Dear Faculty member,
OIRA is in the process of launching the Fall 2014-15 on-line ICE evaluations, kindly review
the ICE questionnaire and feel free to add up to three additional questions if you feel the
need to do so.
To add the additional questions you can go to the following link. and then follow the
instructions.
Kind regards,
Dr. Karma El Hassan, Director
Office of Institutional Research
& Assessment (OIRA)
14
Form reviewing the Personalized Questions update
15
Click ‘Preview’ to view ICE Items and ‘Edit’ to add, edit, or review the
personalized questions
16
Once Entered the Additional Items, Update
17
QP Deadline Expiry
18
Responses (and Reports)
• To access the Response Rates and Reports
• Access the Blue Application using AUB
username and password
http://oirablue.aub.edu.lb/blue
• Select Dash Board
19
User Sign-On
(http://oirablue.aub.edu.lb/blue)
20
21
Select the required CRN (if multi courses for the term)
22
Response Rate Summary
23
Thank you
For Queries Contact
Email: OIRA@aub.edu.lb
Phone: Ext 3131/3130
24