Smart Sparrow - Institute for Teaching and Learning

advertisement

Smart Sparrow:

Using learning analytics to measure student engagement in case based learning

Presented by

Dr Vanessa Hughes

Sydney Nursing School

The University of Sydney Page 1

Smart Sparrow Case Based Studies

Cohort: First Year Bachelor of

Nursing Advanced Studies

Students

Nursing focus: Clinical notes, family/social history and diagnosis is provided

Content: Focuses on connecting the signs/symptoms observed with the underlying pathophysiology

The University of Sydney Page 2

The Evolution of Online Case Based Learning in NURS1005

2012 2013 2014 2015

Passive PDF Online module + videos +

PDF worksheet

Smart Sparrow

Adaptive Learning

Smart Sparrow technology has made it possible to:

• embed videos into the lesson

• create lessons that adapt to the students responses

• create an active learning environment

• test student knowledge and understanding

The University of Sydney Page 3

Purpose of the Online Case Study Lesson

– Replaces 1 hour of face to face teaching

– Covers important content in greater detail

– Connects bioscience theory with clinical practice

– Students receive formative feedback that enables them to: a.

Check their answers b.

Understand the level of detail and knowledge expected c.

Practice answering similar types of questions to the ones included in their Pathophysiology Workbook Assessment

The University of Sydney Page 4

1. Trigger Video

2. Clinical Notes

3. MCQ or

Short Answer Question

Incorrect Answer Correct Answer

The University of Sydney

Guidance Model Answer

Page 5

The University of Sydney Page 6

The University of Sydney Page 7

Using Learning Analytics to Improve Learning and Teaching

– How long did students spend watching each video? Did they watch all of it?

– Were the questions too hard/easy? What needs to be clarified?

– What are the concepts that all students struggle with? What can I do to facilitate their understanding of the content?

– How long did each exercise take? Are they disengaging at some point?

– I would never have been able to easily answer any of these questions without Smart Sparrow Analytics.

The University of Sydney Page 8

Lesson Completion Semester 2

Week 1 Week 2

96% of students attempted the lesson 85% of students attempted the lesson

The University of Sydney Page 9

Simple overview of how students engaged with the activity

The University of Sydney Page 10

Anonymous Participation Students Enrolled in Smart Sparrow

49% completed the activity

94% completed the activity

The University of Sydney Page 11

Ability to Track Learning Pathways

The University of Sydney Page 12

Short Answer Responses

The University of Sydney Page 13

Student Feedback (1= Strongly disagree, 5= Strongly Agree)

The videos in this module helped me to better understand the content.

I feel that completing this module will help me complete my pathophysiology workbook.

I feel that the feedback provided encouraged me or helped me find the answer when I made a mistake.

The model answers provided helped me understand what is expected of me and helped me understand what I needed to know about this topic.

Week 1 (n=179) Week 2 (n=154)

4.11

4.11

4.06

4.27

4.54

4.05

4.28

4.49

The University of Sydney Page 14

Using Analytics to Track Student Performance

Using the analytics students can be categorised as:

– No risk

– Low risk

– High risk

This data can be used to:

– send personalised emails to students

– identify students for follow up using the Track & Connect program

The University of Sydney Page 15

Using analytics to provide personalised student feedback

Students are sent a personalised email (weekly) (via SRES) based on their risk category.

 No risk – congratulations on completing all activities

 Low risk – encouragement to improve

 High risk – encouragement to improve, support and advice

Students at risk are emailed with their advisors details as well as the contact details for other university support services.

The email also contains links to additional resources that address common misconceptions found in the short answer responses.

This email feedback system has lead to several student problems being identified by the end of week 3.

It is hoped that this system will lead to a reduction in absent fails and enable students who are falling behind to get the help they need earlier in the semester.

The University of Sydney Page 16

Important Points

– Numbers only tell half the story: a.

Use a combination of MCQ and short answer questions.

b.

By quickly scanning short answer responses you can identify common misconceptions.

– Start small and build on the lesson.

– Keep it simple, too many trap states and pathways can lead to errors.

– Guidance to correct mistakes can be simple e.g. a recommended reading, video etc.

If you have not used SRES (Student Relationship and Engagement System), you will need to contact Adam Bridgeman ( adam.bridgeman@sydney.edu.au

) to be registered as a user.

The University of Sydney Page 17

Download