Exam Absence Survey: Preliminary Analysis & Findings Presented at the Extended Management Committee 2 February 2010 Professor George Subotzky Executive Director: Information & Strategic Analysis Acknowledgements The following staff members of DISA were involved in design, administration & analysis of this survey: – Hanlie Liebenberg: design – Yuraisha Chetty: design & oversight – Lerato Tladi: design, implementation, data analysis & preparation of presentation – George Subotzky: design, interpretation & presentation – Pam Pistorius: admin support Introduction & Background • Efforts to improve Unisa’s course success rates are thwarted not only by failure, but also attrition prior to writing • Analyses have shown that up to 10% of students are admitted to exams, but for a variety of reasons do not write • At the final signoff meeting for the exam results of the 2009 Oct/Nov sitting, it was decided to investigate the reasons for this • Accordingly, DISA was requested to design and conduct a survey to do this and to report by the end of January Conceptual Framework & Method • At the heart of the Success & Retention model lies the assumption that non-academic factors impact as much, if not more than academic ones one student success • Accordingly, the survey was designed to investigate all probable reasons for exam absence – both academic & non-academic • 13 questions & 158 items • Relevant students were identified – Problem of not being able to distinguish absentees from results outstanding, practical & PG students) • Survey notification sent by e-mail & SMS with link to access electronic survey Focus • Preliminary analysis – focusing on main findings • Subsequent analysis – focusing on relationship between variables and background demographics Response Rate • Survey population (13 Jan): 27 299 • Response rate (25 Jan): 2 359 (8,7%) (full) • Response rate (2 Feb): – Total responses: 5 105 (19,0%) – Full responses: 3 747 (13,7%) • This represents a remarkably high response rate • Frantic responses from many students – part of the findings Mode of Study 100% 94.3% 80% 60% 40% 20% 5.7% 0% Full-Time (Study only) Part-Time (Work and Study) Reasons for Exam Absence 56.9% 60% 50% 40% 30% 20% 10% 11.2% 16.0% 15.9% 0% Academic Factors Non-academic Factors within Factors factors your control beyond your control Exam Preparedness 40% 30% 37.4% 25.3% 20% 17.7% 19.7% 10% 0% Very well prepared Somewhat prepared A little prepared Not at all prepared Reasons for Exam Unpreparedness Insufficient study time 38.5% Lacked confidence to write 24.9% Wasn't motivated to write 11.3% Did not know what to expect in the examination 10.4% Did not understand the study material 9.8% Inadequate feedback on assignments 5.0% 0% 10% 20% 30% 40% 50% Exam Study Methods Read the study material 23.2% Used the prescribed textbook (where applicable) 22.3% Summarized the study material 16.3% Worked through previous examination papers 10.9% Drew up a study timetable 9.3% Memorized the study material 8.1% Used additional material/sources beyond the prescribed study material 7.5% Participated in face-to-face study/discussion groups 1.2% Participated in on-line study/discussion groups 1.2% 0% 5% 10% 15% 20% 25% Needed More Academic Support 58.7% 60% 40% 41.3% 20% 0% Yes No Tried to Contact Lecturer 80% 70.8% 60% 40% 29.2% 20% 0% Yes No Why Lecturer was not Contacted Did not have the time to contact the lecturer 35.8% Did not think that it would be useful 30.7% Lecturer previously unavailable 17.6% Did not know the lecturer 9.1% Lecturer previously uninterested or unwilling to help 6.8% 0% 10% 20% 30% 40% Experience with Contacting Lecturer The lecturer was not available 25.3% Contacted the lecturer by telephone 18.2% Contacted the lecturer via e-mail 17.7% Received unsatisfactory support 10.2% Contacted the lecturer during the morning 9.1% Contacted the lecturer during the afternoon 6.2% Contacted the lecturer via myUnisa 5.4% Received satisfactory support 4.9% Contacted the lecturer by letter 1.1% Contacted the lecturer in person (face-to-face) 1.0% Contacted the lecturer after hours 1.0% 0% 5% 10% 15% 20% 25% 30% Tutorial Classes Offered 50% 40% 40.4% 38.2% 30% 21.4% 20% 10% 0% Yes No Don't know Attended Tutorial Classes 100% 83.0% 80% 60% 40% 20% 17.0% 0% Yes No Tutorial Class Ratings 80% 70% 60% 40% 30% 20% 0% Helpful Not Helpful Reasons for not Attending Tutorials No time to attend tutorial classes 38.9% Tutorial class times were not convenient 25.7% Far or inaccessible location of the venue 23.0% No transport money 7.8% Did not think that attending classes would be helpful 2.7% No information about the times/venues 1.8% 0% 5% 10% 15% 20% 25% 30% 35% 40% 45% Needed Counselling Support 80% 73.2% 60% 40% 26.8% 20% 0% Yes No Contacted Unisa's Counselling Services 100% 80.6% 80% 60% 40% 20% 19.4% 0% Yes No Why Counselling Services not Contacted 80% 60% 54.1% 45.9% 40% 20% 0% Didn't have the time Didn't think it would be useful Experience with Counselling Services Tried to contact but didn't succeed 27.4% Received unsatisfactory report 19.0% Contacted Unisa via e-mail 16.0% Contacted Unisa after hours 13.5% Contacted Unisa during the morning 9.3% Contacted Unisa during the afternoon 8.9% Contacted Unisa by telephone 4.2% Received satisfactory support 1.7% 0% 5% 10% 15% 20% 25% 30% Consulted Anyone Regarding Exam Decision 80% 71.8% 60% 40% 28.2% 20% 0% Yes No Received Advice Influenced Exam Decision 80% 60.5% 60% 40% 39.5% 20% 0% Yes No Person Consulted for Exam Advice Family 31.6% Friends 15.0% Medical doctor 13.3% Employer 10.9% Colleagues at work 9.6% Other students 7.3% Unisa Lecturer 4.9% Private psychologist/psychiatrist 2.8% Unisa Counsellor 2.1% Unisa tutor 1.5% Religious leader 1.1% 0% 5% 10% 15% 20% 25% 30% 35% Had Enough Study Time 60% 49.8% 50.2% Yes No 40% 20% 0% Spent Sufficient Time Studying 70% 64.7% 60% 50% 40% 35.3% 30% 20% 10% 0% Yes No Reasons for Insufficient Study Time Work responsibilities interfered with my studies 45.5% Domestic responsibilities interfered with my studies 24.1% Did not have enough study leave 17.5% Did not receive the study materials in time 8.1% Social life interfered with my studies 3.9% Did not receive the study materials at all .8% 0% 10% 20% 30% 40% 50% Reasons for not Studying Enough Did not feel motivated to study 51.5% Social life distracted me 24.8% Not interested in the study material 11.0% Course was not relevant to my future work/career 8.0% Course did not cover the topics I thought it would cover 4.6% 0% 20% 40% 60% Other Factors: Exam Absence Work responsibilities 44.1% Domestic responsibilities 21.2% Illness 18.6% My social life 4.3% Was late(other reasons) 2.5% Was late (unreliable transport) 2.4% Wrong exam date 2.0% Wrong exam time 1.6% Was late (my own fault) 1.4% No transport money 1.1% Wrong info about venue .8% 0% 10% 20% 30% 40% 50% Strong Consequences for Exam Absence 100% 80% 82.4% 60% 40% 17.6% 20% 0% Yes No Perceived Consequences of Exam Absence The completion of my studies would be postponed 33.4% I would be disappointed in myself 28.3% Family would be disappointed 11.7% Employer would be disappointed 7.4% Other financial support would be lost 5.7% Employer would withdraw financial and other support 5.3% Employer would not provide another opportunity to write 3.0% Lecturer would be disappointed 2.9% Family would withdraw financial and other support 2.3% 0% 5% 10% 15% 20% 25% 30% 35% 40% Why There Would Be No Strong Consequences Was not concerned as I could simply write again at the next Unisa examination 46.6% Family would understand 24.2% Employer would understand 10.3% Family would continue to support me financially and otherwise 7.6% Employer would provide another oportunity for me to write 6.1% Employer would continue to support me financially and otherwise 5.2% 0% 10% 20% 30% 40% 50% Unisa Exam Support Clearer information on exam times and venues 3.4% Clearer information on exam requirements 15.5% Better study material 9.3% Earlier distribution of study material 14.5% More general encouragement and support 9.9% Better access to tutorial support 8.8% Better tutorial support 10.5% Better access to lecturer support 8.7% Better lecturer support 8.0% Better access to counselling support 6.7% Better counselling support 4.8% 0% 5% 10% 15% 20%