The Year of the Curriculum: Life Without Levels The programme consists of a Bridging Unit and five further units: (Have you done the Bridging Unit and Unit 1?) Bridging Unit What is the new Coming to terms National The Curriculum Measuring Making usewith the new new National what we value of assessment National Curriculum asking for? Curriculum in context The tools of the trade The Year of the Curriculum: Life Without Levels Unit 2 Making use of assessment But the only use would to have numbers Ofiscourse, there besome little point in to please (or displease) Ofsted? making assessment unless we were going to use them. Would there? Unit 2 Making use of assessment Welcome to Unit 2 First things first - did you do your homework for Unit 1? (Do you remember what it was?) © Curriculum Foundation So,was It didto: you look at the new requirements in terms of knowledge, Spendand skills some understanding? time looking at the section of the new national curriculum that is relevant Did you find to you anything (your year about group the or subject) and look at the requirements competencies? one by one in terms of knowledge, skills and shall We understanding. be looking at Are this you further happyinwith this the balance? Unit. Please Is thereshare anything yourinthoughts them about on the the competencies? website. © Curriculum Foundation 5 Unit 2 Making use of assessment There are three sections to this unit: Section 1: Introduction (setting the scene) Section 2: The nature of the assessment task (basically, what are we trying to do, and how do we make use of assessment?) Section 3: Assessing skills (how the new national curriculum lends itself to assessing skills) © Curriculum Foundation 6 Section 1 Introduction Here are a few of the people we are going to meet in this unit. You may recognise some of them anyway (especially if you followed the Curriculum Design programme). Do you? © Curriculum Foundation 7 . See if you can spot them as they are referenced! © Curriculum Foundation And here are some pairs of types of assessment – can you explain the differences? Formative summative Formal - informal Diagnostic evaluative Quantitative qualitative Norm referenced criterion referenced Open response multiple choice Standards based performance based Initial - ipsitive © Curriculum Foundation That seems to make sixteen different types. Did you get them all? So, what do they all mean? We shall be explaining them as we go along. You could group these into five different groups according to: • Purpose • Type of question • The learning being assessed • Referencing • Setting These groups are set out in Part 6 © Curriculum Foundation 10 Patrick Terenzini ( “Assessment with open eyes.” 1989) looked at it in a different way, and put forward a taxonomy of these types in the following model. His three dimensions are: purpose, object and level. © Curriculum Foundation 11 Section 2 The nature of the assessment task There are three key questions: • What are we doing when we assess? • How can we be sure that we are accurate in our assessments? • What different approaches are there? © Curriculum Foundation 12 In Unit 5 of the first programme, we looked at what it is that we are actually trying to do when we assess. In essence we are trying to find out what someone has learned, either as we go along (formative) or at the end (summative). And the bit of learning that we are interested in is usually to do with the aims we set in our lesson, unit or whole curriculum. Or we might be checking before we start to see whether they have already learned what we are about to teach them (initial assessment). The learning concerned is actually contained inside someone’s head. © Curriculum Foundation 13 Yes, it’s a picture of the neural networks of Any idea what this is? the brain. What about this next picture? © Curriculum Foundation 14 These are the synapses – where nerve cells interconnect. When we learn something, a new connection is made and the pathway becomes more complex. © Curriculum Foundation 15 So, if learning is about making new connections in the brain, then assessment is about finding out what new connections have been made. Perhaps the process should look like this. (That’s a brain they’re all looking at, by the way. This is a GCSE exam of the future.) © Curriculum Foundation 16 As we cannot actually get inside our pupils’ brains, we just have to do the best we can. Assessment is not an exact science. In order to find out what is going on inside someone’s brain, we have to observe their behaviour in certain controlled situations. At the simplest, we ask them some questions and see what they say. If they say “Paris” when we ask them what is the capital of France, we conclude that they know what the capital of France is. So the big issue for assessment is how valid are the conclusions we can draw from our observations. Simple pieces of knowledge are easy enough, but it starts getting more complex when we get into deeper understanding. Can we really conclude that someone understands something complex from the basis of their answers to some questions? And would everyone respond similarly to the same questions, even if they had equal understanding? © Curriculum Foundation 17 Do you remember ‘reliability’ and ‘validity’ from Unit 5 of the first Programme? Reliability in assessment means that whoever carries it out would come to the same conclusion. Validity means that we are actually assessing the thing we want to assess. Unfortunately, the two are often at the opposite ends of a line of tension. The more reliable an assessment is, the less valid it seems to be. And vice versa. We gave IQ tests as an example. They are high in reliability, but we are not sure if they are measuring intelligence or the ability to answer IQ test questions – so low in validity. Assessments made by teachers in the course if their work are often the most valid, but there is always a question of subjectivity and whether all teachers would come to the same conclusion. So they are low on reliability. Validity Reliability © Curriculum Foundation 18 We mention “know” and “understand” here – and these are some of the ‘building blocks’ of the curriculum that we looked at in Unit 1. Do you remember what they were? They are important to letting us look into the brain, and to deal with the issues of validity and reliability. © Curriculum Foundation Unit 1 looked at these ‘building blocks’ of the curriculum: Knowledge Possession of information Skills Ability to perform mental or physical operation Understanding Development of a concept: putting knowledge in a framework of meaning If you recall, each of these levels of expectation had some related verbs that made them explicit. These help us unlock what is in the brain. Knowledge State, name, label, draw, identify, describe Skills Carry out, perform, find, investigate, explore Understanding Explain, justify, analyse, give reasons for These are the verbs that also help us make the assessments. Knowledge Skills Understanding But what implications do these three forms of learning have for assessment? This is what we shall be looking at across this programme of Units. But here is a short outline to go on with. © Curriculum Foundation 22 Knowledge is on the whole the easy bit to assess because usually a simple question will be sufficient. We can be both valid and reliable in our assessment of knowledge. Not only that, we can assess whole classes at a time because we can do it through written papers. This is probably why we are so keen on doing it. Understanding is much harder to assess because this is where we really need to get inside the brain. Because we cannot actually do so, we need to look for ‘proxy measures’ such as the ability to explain or give reasons. These will give us some idea about the extent of understanding. This is best done through oral questioning of individual students in a series of different situations over time. Much more expensive – and much less popular. It also runs into issues of reliability. © Curriculum Foundation 23 So, that’s all very technical – but this Unit is supposed to be about making use of assessment! This is where we come back to those pairs of assessment words: Formative summative Diagnostic evaluative Initial - ipsitive Did you notice some definitions appearing in earlier slides? Did you spot them? In fact, these six terms are all different uses of assessment. © Curriculum Foundation 24 Here are some short definitions: • Initial is to establish a baseline or starting point • Formative is to check how learning is progressing to make adjustments to the course or to teaching as you go along • Summative is to get a final picture of learning – often for reporting or accountability reasons or to award a qualification • Diagnostic is to find out why someone is not learning as well as they should • Evaluative is to find out how well a programme or institution is doing (rather like the SATs) • Ipsative is finding out how well someone in doing in relation to their previous performance. © Curriculum Foundation 25 Of course, all of these are uses that we will wish to make of assessment at some point in a year: establishing a baseline or starting point, getting a final picture of learning, finding out why someone is not learning as well as they should, finding out how well someone in doing in relation to their previous performance. You might also want to find out how well a lesson or unit of work went or, if you are a school leader, how well a class or the whole school is doing. But most importantly as teachers, we want to check how well learning is progressing so that we can make adjustments to our teaching as we go along. This is the formative use, and there is much more to follow about this in this unit. © Curriculum Foundation 26 In Unit 1, we referred to the Note for inspectors: use of assessment information during inspections in 2014/15 This states that inspectors will: • spend more time looking at the range of pupils’ work to consider what progress they are making in different areas of the curriculum • talk to leaders about schools’ use of formative and summative assessment and how this improves teaching and raises achievement • evaluate how well pupils are doing against relevant age-related expectations as set out by the school and the national curriculum (where this applies) © Curriculum Foundation 27 So Ofsted see both formative and summative as important. But to make any use at all of assessment, we have to be clear about what sort of learning we are assessing: knowledge, understanding or skills. They each have their different methods. As we have seen, knowledge is the most straightforward. Understanding is fairly straightforward if it can be done orally – the issue is one of time. But skills, especially mental skills, are difficult. We shall look at these separately in the next section. © Curriculum Foundation 28