School of Humanities First Year Assessment Report

advertisement

B

ACHELOR OF

A

RTS

(H

UMANITIES

)

F

IRST

Y

EAR

A

SSESSMENT

R

EPORT

Prepared by

Margaret Macleod

Project Officer

Commissioned by Professor Keithia Wilson as part of an Australian Learning and Teaching (ALTC)

National Fellowship

Funded and sponsored by the School of Humanities

Draft Report – not for distribution 

November 2010

TABLE OF CONTENTS

1.OVERALL SUMMARY …………………………………………………………...1

2. SUMMARY OF KEY PRINCIPLES FOR FIRST YEAR ASSESSMENT …...2

3. ASSESMENT RE VIEW…………………………………………… ...………….

4

APPENDIX1……………………………………………………………………..…

.8

APPENDIX 2……………………………………………………………………….

10

APPENDIX 3 …………………………………………………………………...…11

0

Overall Summary of Evaluation of Humanities Assessment Items

Semester One

1007HUM Social Sciences in Australia (N)

1009HUM Intro to Screen Analysis (N, GC)

1021HUM Cultural perspectives 1 (GC)

1105HUM Youth and S ociety (GC, L)

1405HUM Creative Practices (GC)

1603HUM Islam in the Modern World (N)

1702HUM Styles and genres of journalism (N)

1703HUM Effective Writing (N,GC,L )

1705HUM Foundations of Western Culture (N, GC)

1802HUM Writing for the Web (GC)

Semester Two

1007HUM Social Sciences in Australia (GC,L)

1013HUM Great Books B (N,GC)

1015HUM Screen History and Research (N,GC)

1022HUM Cultural Perspectives 2 (GC)

1104HUM Creative Writing 1 (GC )

1105HUM Youth and Society (N)

1117HUM World History (N,GC)

1306HUM Art and Cultural Work (GC)

1501HUM New Communication Technologies (N,GC )

1502HUM Communication Performance (GC)

1503HUM News and Politics (N,GC)

1510HUM Intro to Public relations (N,GC)

1603HUM Islam in the Modern World (N,GC)

1704HUM Intro to Social Enterprise (N,GC,L)

1802HUM Writing for the Web (GC)

This review of first year Humanities written assessment tasks is based largely on the writer’s experience as an Academic Skills Learning Adviser for the past 10 years. It has enabled some common patterns in both positive and problematic practices to be identified from a student perspective.

The review has focused on written tasks. It has found that the first year written tasks are relevant to the learning outcomes and overall aims of the courses. A mix of assessment tasks is provided in the courses, providing students with a variety of ways to demonstrate their learning and achievement. Most tasks are clear and unambiguous and meet the students’ level of skills development.

The review has found that there are three areas where some revision is recommended in order to enhance the first year assessment experience for

Humanities students. These are:

1. Inconsistencies in expected overall word counts (see Appendix 2).

2. Inconsistencies in the weighting of items (see Appendix 3).

Both of these inconsistencies can confuse students, and lead to disengagement.

3. Lack of specific resources to assist students with their assessment tasks.

Further development or enhancement of resources to assist with tasks, especially those involving comparative analysis tasks, reflective writing tasks, and case study tasks would significantly enrich the learning experience for these students and moderate some of the assessment pressures that contribute to poor student retention. It is also recommended that these resources be placed in the same location on the course L@G websites.

1

SUMMARY OF KEY PRINCIPLES FOR FIRST YEAR ASSESSMENT

(BASED ON STUDENT FEEDBACK)

Students value transparency in assessment tasks .

This is because initially most students do not have the confidence or skills to be able to ‘interpret’ tasks. Valued assessment includes:

Assessment tasks that are clear, straightforward and unambiguous.

Assessment information (e.g. task description and marking criteria) that is in concordance.

Marking criteria that guide students to understand what parts of the task are most important/worth the most marks. Students do not consider generic marking criteria helpful.

Assessment that clearly relates to the course and overall degree. That is, students value being able to see how a particular task is beneficial to understanding the course content, and how it is relevant (in terms of skills and content) to the degree as a whole . ‘Why am I being asked to do this?’ is unfortunately a common student question.

Students value consistency .

Lack of consistency can contribute to a sense of personal inadequacy, disempowerment and perceived inability to negotiate the complexities of university culture. To enhance consistency students find it helpful if:

All members of the teaching team in a course ensure they are giving the same messages to students about assessment tasks. A frequent complaint is that ‘the lecturer told us to do X, but our tutor told us to do

Y’.

All members of the teaching team in the same course commit to a single referencing format.

All members of the teaching team within and across courses commit to the same message about general rules (e.g. use of quotes, permitted word length, use of headings etc).

All members of the teaching team in a course taught across campuses ensure they are providing students with the same resource assistance.

Assessment tasks of a similar word length attract similar weighting in different courses.

Information about assessment appears in the same place on the L@G website. Beginning students need time to navigate the complexities of university websites.

Assessment defines what students see as important, and directs how they manage their time .

Given that many are juggling work and family commitments, this is not surprising. Therefore, assessment tasks that are disproportionately complex or demanding or focus on just one small part of the overall content will undermine students’ engagement with the content of the course as a whole.

Students value assessment tasks that sequentially build on academic skills as well as content knowledge .

2

This applies to assessment tasks within a course and assessment tasks across the courses.

In first semester, students value essay tasks that initially

Are relatively short (e.g. 750-1000 words)

Are relatively simple (e.g. summary/description and simple interpretative analysis – such as answers to how/why questions)

Include limited research requirements (e.g. simple searches of readily obtainable information)

By second semester, students feel more capable of writing essays that

Are longer (1200-2500 words)

Incorporate more complex analysis (e.g. critical analysis/evaluation tasks)

Include more rigorous research

Students prefer a mix of tasks

This can include quizzes, short answer tests, essays, exams etc. Different tasks enable students to show their understanding of content in different ways.

Students value resources that model the desired outcome

Resources can include example essays, paragraphs etc. In the first semester, an example essay structure is also considered useful. A FAQ resource is also valued (and for academics, can help reduce time spent answering questions).

Students appreciate assessment tasks that are staggered.

Beginning students can become overwhelmed if, for example, they are expected to submit three essays in the same week. Beginning students need time to acquire good university time management skills. If this is not possible, they prefer that a mix of tasks (e.g. different weighting, word length or complexity) be required within a short period.

Students prefer course readings to be intelligible .

Readings that are complex and loaded with unfamiliar and highly specialised academic terminology (i.e. those written for a learned academic audience) can challenge beginning students, especially non-traditional students, who may have poor general reading skills. This can lead to disengagement and a self perception that they are not capable of handling university study. It makes sense therefore to ensure that their initial readings are at an appropriate level and are comprehensible in order to build their reading and comprehension skills and general confidence.

3

ASSESSMENT REVIEW

1.

Clarity

– Are assignment tasks clear and unambiguous?

Most first year Humanities assessment tasks are very clear and unambiguous. This is particularly the case for tasks in 1009HUM , 1013HUM and 1015HUM (semester 1) and 1117HUM and 1510HUM (semester 2).

However, the task for 1802HUM (website with critical reflection) could be seen by students as ambiguous. The directive given is to “provide reflective critique in light of the course content. Written analytical skills, self-reflective evaluation skills and developed web aesthetic are the desired outcomes in learning of this item”. Students may need more direction than this to understand exactly what is required.

I could not find any detailed information about tasks for semester 1 courses

1021HUM and 1603HUM in either their course outlines or L@G websites. One possible reason is that tasks were provided in tutorials or lectures. If this is the case, one potential problem is that students who are unable to attend classes may be disadvantaged. Students prefer to have the full assessment task easily locatable, preferably in either the course outline and/or their L@G website.

Recommendations – It is recommended that the task for 1802HUM be reworded to clarify what is required. It is also recommended that detailed information about assessment tasks for 1021HUM and 1603HUM be located in the course outline and L@G website.

2.

Criteria

– Do the marking criteria assist in understanding the assignment task?

Students value marking criteria that relate clearly to the task and guide them in understanding exactly what is expected of them and what parts of the task are most important and/or worth the most marks. Assessment tasks in 1105HUM and 1009

HUM

(Aurora’s Tute) are particularly well supported with highly relevant marking criteria.

Most courses have marking criteria of moderate specificity, that is, the criteria relate to the task, although a breakdown of individual percentages for each criterion is not supplied. Not all academics agree that this is necessary, although students have expressed a preference for this. A breakdown of marks or some other technique that that guides students towards and highlights rewards for analysis over description, for example, can be particularly useful for students.

Students usually do not consider generic marking criteria helpful. Some courses

( 1703HUM , 1013HUM, 1015HUM, 1104HUM, 1802HUM only offer generic marking criteria.

I was not able to locate any marking criteria for tasks in 1021HUM or 1603HUM.

4

Recommendations – It is recommended that marking criteria for courses

1703HUM, 1013HUM, 1015HUM, 1104HUM, 1802HUM be updated to provide more task guidance for students. If marking criteria exist for tasks in 1021HUM and 1603HUM, these should be made easily locatable for students.

3.

Weighting - Is weighting appropriate for assignment tasks?

As Appendix 3 illustrates, there are some significant inconsistencies in the weighting of tasks. Although it is reasonable to expect weighting variations in assessment across a first year array of courses, it is important to consider the message that is being given to the student by assessment weighting. For example, assessment tasks in 1021HUM and 1306 HUM allocate only 10% weighting to tasks of 1500 word length. Similarly, a 2000 word output attracts only 20% weighting in 1021HUM and

1022HUM . This could send a message to students that these assignments are comparatively not very important, and that their time and effort is much better spent elsewhere on higher weighted tasks in other courses.

Recommendations – It is recommended that course convenors across the first year courses discuss the relative weighting of assessment tasks across the first year.

4.

Level of Difficulty

– Are assignment tasks suitable for students’ level of skill development?

General Comments

Most tasks appear suitable for students’ level of skill development. They are relatively simple tasks incorporating basic interpretative analysis and limited research requirements.

However, tasks that include more complex analysis, such as case study tasks

( 1510HUM ) , comparative analysis tasks ( 1007HUM, 1013HUM, 1015HUM,

1603HUM and 1702HUM ) and critical analysis tasks ( 1802HUM ) can challenge beginning students, especially non-traditional students, unless they are particularly well supported with specific resources that explain how to achieve the desired outcome. This is also the case for reflective journals ( 1105HUM, 1022HUM,

1501HUM and 1704HUM ) if critical analysis is required as part of the task, which it is in these tasks.

Recommendations

– It is recommended that resources be developed to assist students in achieving the desired outcomes . This issue of suitable resources to assist in scaffolding skills is discussed further in 6. Resources below.

Course Specific Comments

1105HUM : The Reading Analysis task in 1105HUM (Semesters 1 and 2) could be potentially difficult for beginning students because of the requirement that students

5

make connections between complex quotations and their reflexive journal. However, this complexity or difficulty could well be mitigated by good teaching and supportive lectures and tutorials. Nevertheless, the risk is always that teaching staff will change, and therefore this kind of support could be lost. Further, when large numbers of sessionals are teaching in a first year course, the quality of teaching can vary.

Recommendations

–To ensure the sustainability of this task, it is recommended that this task be simplified, and/or excellent resources are developed that model the kind of support required in lectures and tutorials.

This will ensure that in the future this task is manageable for students regardless of who comprises the teaching team.

1007HUM : The essay task in 1007HUM ( semester 1 and 2) includes a bank of questions . However, there is a larger bank of questions in the semester 2 course than there is in the semester 1 course. Many of these additional questions are considerably simpler, which suggests that they may be more suitable for beginning

Semester 1 students.

Recommendation – It is recommended that these easier questions be added to the Semester 1 essay task.

1021HUM and 1603HUM : As I could not find specific information about the tasks in

1021HUM and 1603HUM, I cannot comment on their difficulty. However, the brief details about the research task in the Course Outline for 1021HUM do indicate that an ethics clearance will be required. How suitable this is for beginning students is unclear.

Recommendations

– It is recommended that the issue of a task necessitating an ethics clearance be discussed.

5.

Relationship to Course Learning Outcomes: Do the assignment tasks clearly relate to/develop the learning outcomes for the course?

There are no significant disparities between Learning Outcomes and assignment tasks in any of the assessment tasks in the courses

6. Workload: Is the overall assessment workload manageable for the students?

Depending on the courses that students select, students who are just developing time management skills may find themselves overwhelmed by the need to submit several assessment tasks in the same week (see Appendix 1). Another issue is the overall disparity in course expectations of total written words (see Appendix 2). For example, in Semester 1, one course expects students to write over 4 times the amount of total words than another course does. Again, it is expected that there will be variations depending on the type of course offered, but a high total wordage can be viewed as an excessive workload. This perceived excessive workload may

6

contribute to a sense of unfairness and lead to disengagement. It may also lead to a disproportionate amount of time being spent on the one course.

Recommendation

– It is recommended that course convenors across the first year courses discuss both these issues.

7. Resources: Are there sufficient appropriate resources provided to assist students with their tasks?

Students value resources that model the desired outcome and assist with the specific task. These resources can include information on how to organise information, example essays, paragraphs etc. In the first semester, students also consider an example essay structure useful. A FAQ resource is also valued, and for academics, can help reduce time spent answering questions).

Several courses provided specific resources to assist students with their tasks which can be regarded as exemplars. For example,

 1105HUM provided resources that explained how to approach their tasks

1009HUM (

Note: ‘Aurora’s Tute’ only

) provided an example essay

 1503HUM provided a tips sheet

1015HUM (Note: Nathan campus only) provided three example essays

 1117HUM provided a guide to writing a briefing note.

Recommendation – It is important for equity reasons that course resources provided to assist students with tasks are provided to all students on all campuses.

The following courses ( 1702HUM, 1703HUM, 1705HUM , Semester 1; 1007HUM,

1013HUM, 1704 HUM Semester 2) provided generic resources, or links to generic resources, to assist students with writing in general. Although these are useful, they do not necessarily assist with specific tasks that require specific approaches or structures, and/or more complex tasks. It should be noted that the Course Outline for

1704HUM suggested that a Reflective Writing Guide was available on L@G.

However, I was unable to locate this resource .

Recommendation

– It is recommended that specific resources, such as example essays and information on how to approach and write specific tasks

(reflective essays, comparative analysis essays etc) be developed.

In several courses ( 1021HUM, 1603HUM, 1802HUM Semester1; 1104HUM,

1306HUM, 1501HUM, 1510HUM, 1603HUM, 1802HUM Semester 2) I could not locate resources to assist students with their tasks.

Recommendation – It is highly recommended that appropriate resources be developed to enable scaffolding of skills and assistance with these tasks.

7

4

5

6

7

8

9

APPENDIX 1 week

1007

1

Sem Tutorial presentation

10%

2

3

1009

Weekly Worksheets

30%

1021

10

11

12

13

Exam MC

20%

Research Essay

1500w, 40%

Narrative Report

1500w, 35%

14

15

Open Book Exam

1500w, 30%

Essay

1500w, 35%

Presentation

10%

Essay

1500w, 30%

Major Project a. Essay 2

1500w, 30% b. Research

Portfolio

1500w, 10% c. Reading Journal

2000w, 20%

Essay

1500 w

40%

1105 1405

Class exercises

30%

Digital narrative

20%

Reflective journal and reading Analysis

40%, 500+ words

Artist book

30%

Semester One

1603

Attendance

10%

Short answer test

20%

1702 1703

Oral pres

Weeks 3-12

20%

Current affairs Test

20%

Exercises weeks 3-

8

1500 w, 40%

1705

Participation

10%

Short tests

250w

5%

Short tests

250w

5%

Essay

1500w, 35%

Experimental book

30%

Quiz

10%

Short answer test

20%

Major essay

2000 w

50%

Essay

1500 w

30%

Essay

1000w

25%

Short tests

250w

5%

Short tests

250w, 5%

Exam MC

30%

Essay

1500w, 35%

Open Book Exam

1500w, 35%

1802

Sem class exercises

20%

Web page

500w, 20%

Web page

500w, 20%

Web site

1200 w

40%

8

we ek

1007

1

Sem presentat

2

10%

3

4

5

6

1013

Participati on

20%

1015

Weekly worksheets

30%

1022 1104

Participation

20%

Semester

Presentation

20%

1105 1117

Participation

20%

Online

Discussion

5%

Briefing notes

500w,10%

Semester Two

1306 1501

Work book

500w30%

Blog

20%

7

8

9

12

Exam MC

20% exam

1000w,25

%

Review

1000w, 30%

Essay

2000w,40%

10

Research

Essay

1500w, 40%

11

Assignme

30%,1000w

Reflective journal

2000w,20%

Short story folio

1500w,25%

13

14 O Book

Exam

1500w,

30%

Digital narrative

25%

Reflective journal

800w,20%

Reading analysis

500w,25%

Briefing notes

500w,10%

Online

Discussion

5%

Sound

Project

30%

Essay

1500w

10%

THome exam

25%,100

0w

Essay

1500w,40

%

Personal mapping

2000w,40%

Short story folio

2500w,35%

Essay

1500w,30%

Briefing notes

500w,10%

Team

Project

20%

Exam

2000w

40%

Exam

Practical

10%

Blog

20%

Essay

1000w

20%

Exam MC

40%

1502

Presentation

10%

Exam

MC,SA

40%

1503

Semester

Debate

20%

News story

300w

20%

News story

300w

20%

Exam MC

25%

1510

Tutorial

Participation

10%

Presentation

20%

Video Task & evaluation

30%

News story

300w,

15%

Case study

1000w,25%

Oral present

Weeks8-12

20%

Exam

25%; Presentat

1500w,20%

1603

Attendance

10%

Test

20%

Essay

2000w,50%

Exam

20%

1704

Participation

20%

1802

Semester exercises 20%

Web page

500w

20%

Presentation

30 mins

40%

Web page

500w,20%

Web site

1200 w

40%

Reflective

Journal

1250w

40%

9

Appendix 2

Total Word count/course (essays, written exams)

Semester 1 Semester 2

Words Course code

1500 1702

2000

2000+

2200

3000

1603

1105

1802

1007, 1009

4000

6500

1703, 1705

1021

Words

900

1000

1500

1250

2000

2200

2500

2800

3000

3500

4000

6000

Course code

1503

1501

1702

1704

1306, 1603

1802

1015, 1510

1105

1007,1013

1117

1104

1022

10

APPENDIX 3

Weighting/Word Length Breakdown (semesters 1 and 2)

Weighting Word Length

(Written tasks)

Course code/semester

5%

10%

15%

20%

250

500

1500

300

1705/1

1117/2

1021/1,1306/2

1503/2

300

500

800

1000

1500

2000

1503/2;

1802/1&2

1105/1&2

1501/2

1510/2

1021/1; 1022/2

25%

30%

35%

40%

500

1000

1500

500

1000

1500

1500

2500

500+

1200

1250

1500

1105/1&2

1702/1, 1703/1; 1013/2, 1510/2

1104/2

1306/2

1013/2, 1015/2; 1112/2

1009/1, 1021/1, 1105/1&2, 1500/1, 1702/1; 1007/2,1117/2

1009/1; 1705/1; 1703/1

1104/2

1105/1

1802/1&2

1704/2

1007/1&2; 1105/1,1703/1; 1015/2

50%

2000

2000

1022/2, 1117/2

1603/1&2

Word Length/Weighting Breakdown (semesters 1 and 2)

Weighting Course code/semester Word Length

(Written tasks)

250

300

500

800

1000

5%

20%

10%

20%

25%

30%

40%

20%

20%

25%

30%

1705/1

1503/2

1117/2

1802/1&2

1105/1&2

1306/2

1105/1

1105/1&2

1510/2

1702/1, 1703/1; 1013/2, 1510/2

1013/2, 1015/2; 1112/2

1200

1250

1500

2000

2500

40%

40%

10%

20%

25%

30%

35%

40%

20%

40%

50%

35%

1802/1&2

1704/2

1021/1,1306/2

1510/2

1104/2

1009/1, 1021/1, 1105/1&2, 1500/1, 1702/1; 1007/2,1117/2

1009/1; 1705/1; 1703/1

1007/1&2; 1105/1,1703/1; 1015/2

1021/1; 1022/2

1022/2,1117/2

1603/1&2

1104/2

11

Download