CBA Autumn 2014
Practical Training Session
September / October 2014
1
Overview
9.00
Registration
9.30
Welcome
CBA Autumn 2014
Preparing staff and resources
10.45
Tea/Coffee
11.00
Exploring NILA and NINA
Preparing pupils
13.00
Lunch
13.45
14.45
Outcomes and reports
Questions, evaluation & close
2
Learning Intentions
At the end of the session you will:
• understand the importance of preparing the computers before
working with NILA and NINA;
• know how to set up the assessments and to prepare pupils to sit
them;
• have had an opportunity to explore the assessments from an
administrator, teacher and pupil point of view;
• be aware of the reports and outcomes produced and how they can
be used to inform planning; and
• know what guidance and support is available from CCEA and C2k.
3
Focus on Raising Standards
“The introduction of the CBAs is
consistent with the national
strategy to improve pupil
performance within literacy
and numeracy.” p61
“…fit well with an official
assessment strategy that
focuses on assessment for
learning and a wider national
strategy to reduce inequity in
student outcomes.” p61
OECD Review of Evaluation and Assessment in
Northern Ireland Education 2013
4
Purpose of CBA
‘Its purpose is to help teachers improve outcomes for children in
literacy and numeracy – and to provide information to parents on how
they can support their children’s learning in these critical areas.’
John O’Dowd, Oral Statement (11 March)
5
Legislative Context
In an email to schools on April 10, 2014, the Assessment and
Qualifications Team (DENI) noted that:
• NILA and NINA will not be specified for mandatory use in 2014/15;
• the Department expects schools to continue to carry out diagnostic
assessment using an assessment, or assessments, of their choice;
and
• the results of this assessment should be used as the basis for
engagement with the pupil’s parent/guardian.
6
NILA and NINA
What do they have in common?
• May be completed by Year 4 to Year 7 pupils
• Web-based and pupil responses to questions are saved
automatically online
• Adaptive and not time-bound
• Longer a pupil takes to answer the longer the assessment will take
• Can be paused and re-started from that point
• Available in English & Irish
• Special Entry Points available
• Pupils should not repeat assessments
• Reports and outcomes available within 48 hours of completion
7
Developments
For Autumn 2013
SEN Entry Point
Both
HI Entry Point
NILA
Skills Focus Report
NINA
Year Group Report
NINA
Improved Parent Report
Both
SS and AROs available within 48 hours
Both
Improved IM selection
Both
Modified pupil checklist
Both
Improved assessment monitoring
NINA
8
Developments
For Autumn 2014
Software adapted to operate on the C2k transformed network
Both
Improved SEN Entry Point selection
NILA
Improved HI Entry Point selection
NILA
Skills Focus Report
NILA
Question number added to the bottom of the screen
NILA
Improved filtering of reports
NILA
Reduction in question techniques
NINA
Improved practice area
NINA
9
Roles and Responsibilities
10
Principal
Overview of school computer-based assessment
Responsible for:
• accessing the school username and password
• arranging the SIMS upload to WebXchange
• allocating the CBA administrator role
Also able to:
• view details for all staff, classes and pupils in the school
• monitor progress for all classes in the school
• view/print reports for any class or pupil in the school
11
Administrator
Manages at school level
Responsible for:
• teacher passwords
• SEN/HI Entry Points
Also able to:
• view details for all staff, classes and pupils in the school
• monitor progress for all classes in the school
• view/print reports for any class or pupil in the school
12
Teacher
Manage at classroom level
Responsible for:
• pupil usernames and passwords for class
• preparing pupils
– pupil demos
– NINA practice area and NILA practice assessment
– NINA poster
•
•
•
•
administering assessments
monitoring assessment progress
accessing outcomes
using outcomes to plan learning and teaching
13
Classroom Assistant
Continue good practice
Should:
• focus on the individual needs of the pupil; and
• take account of their usual methods of working in the classroom.
Should not:
• give them an unfair advantage over other pupils; or
• offer help which reduces the reliability or validity of the outcomes.
14
Preparing Software
15
SIMS Upload to WebXchange
Role to be assigned by Principal
• Quick to complete
• Complete well in advance of using assessments
• Need to have:
– Instructions sent to principals (approx. 26 August)
– School username and password – Principal can access this from ‘Principal
Documents with MY-SCHOOL area of C2k exchange (school username DENI
number)
• Does not affect use of practice assessment/area by pupils
• Last date to complete is 26 September 2014
If you experience any difficulty with SIMS/Webxchange or
accessing Principal Documents, please contact the C2k Service
Desk on 0870 601666.
16
Teacher Passwords
Administrator
Once SIMS upload is completed, teacher:
• usernames will be available for within 5 working days
• passwords available for NINA.
Key points
Administrator needs to:
• create teacher passwords for NILA
• note down as they cannot be printed
N.B. NILA passwords are case sensitive
17
Special Entry Points
SEN (Special Educational Needs) Entry Point:
• for pupils experiencing difficulties with literacy/numeracy
– quicker access to easier questions
– more positive and potentially shorter assessment experience
– offers same access to the full range of questions as other pupils
HI (Hearing Impaired) Entry Point:
• for pupils who are receiving support for a hearing impairment
– removes the Listening aspect of the assessment
– allows pupils to be assessed in Reading and Writing
Use of the Special Entry Points will not be obvious to pupils.
18
Qualifying for
Special Entry Points
The teacher and the Senior Management Team must:
For the SEN Entry Point
• reasonably expect that the pupil is performing two or more years
below their chronological age; and
• be in agreement that an SEN Entry Point is appropriate for the pupil.
For the HI Entry Point
• have evidence that the pupil is receiving support for a Hearing
Impairment; and
• be in agreement that an HI Entry Point is appropriate for the pupil.
Only the Administrator can set a Special Entry Point
19
Setting a Special Entry Point
for NILA
When the
pupil begins
the entry
point cannot
be changed
20
Setting a Special Entry Point
for NINA
21
Pupil Password List
Teacher
Pupil Usernames and Passwords
•
•
•
•
•
access them
check the special entry points
print them
change them if required
remember NILA passwords are case sensitive
Unlock
NILA
passwords
Special Entry Points
NILA - HI, S or S/HI
NINA - X
22
NILA: Monitoring Assessment
Progress for the School
23
Monitor Assessments
NILA EM completed
NINA completed
NILA EM started
NINA started
NILA IM completed
NINA not started
NILA IM started
NILA – to help monitor progress during an assessment the question
number is displayed at the bottom of the screen (most pupils answer 46
questions).
NINA – each strand takes approximately 20 minutes.
24
Preparing Computers
25
Computers
• Only use pupil workstations
• Teacher laptops cannot be used
• Connect to the C2k network at least 30 minutes
before CBA use
• Computers not been connected to the C2k network
recently may take longer to update
• Pupils must first log into the C2k network with their
individual C2k username and password.
• Multiple pupils logged on with the same username
and password will not be able to access NILA and
NINA.
26
Check the Sound
NINA
• Go to the practice area
• Select any practice question and
• Click the sound icon
• You should be able to hear the sound play
NILA
• Go to the practice assessment
• Click the sound icon
• You should be able to hear the sound play
27
Pre Flight Check (PFC)
Key Points
• Simple and user-friendly resource for schools
• Automatically runs when pupils click on NILA or NINA link via their
‘MY-SCHOOL’ homepage
• Completed prior to commencing assessments
• Checking correct versions of software are installed
• In case of incorrect set-up - provide guidance and advice to schools
• When successful takes you straight to the assessment homepage
NINA
http://preflightcheck.ccea.org.uk/nina.html
NILA
http://preflightcheck.ccea.org.uk/nila.aspx
28
Help Identify Issues
• Every time the PFC runs CCEA is notified.
• Gives us frequency of information but not detail.
• Completing the pop up report gives details of:
– school,
– workstation
– teachers comment.
• Help identify patterns
• Need to include both DENI number and workstation number – little
sticker on computer.
29
Moving Forward
with the CBA 2014
Admin passwords available to schools
11 August
Preparation instructions provided to schools
26 August
Manuals and posters delivered to schools
5 September
Phase 1 assessments completed
8-12 September
Phase 2 assessments completed
15-18 September
Final date for SIMS upload
26 September
Phase 3 assessments completed
29 September-12 December
Evaluations live
8 September – 12 December
30
Enjoy!
See you at 10.45.
31
Exploring NILA and NINA
32
Pupil Demos
Key points
• There are 4 demos
• 2 Practice Demos introduce the techniques needed
• 2 Real Assessment Demos prepare pupils for logging in to actual
assessments
• Available in Irish Medium
• Subtitles can be switched on
• Scripts are available from www.ccea.org.uk
33
Accessing CBA
Teacher ‘MY-SCHOOL’ homepage
• ‘View All’
• ‘Curriculum Links’
• ‘NILA’ or ‘NINA’
34
Accessing CBA
Pupil ‘MY-SCHOOL’ homepage
• ‘My Links’
• ‘NILA’ or ‘NINA’
35
36
The Literacy Assessment
•
•
•
•
•
•
Single assessment
No time limit
Most pupils complete 46 questions
Must enter an answer to move on
Average time of 40 minutes
Four difficulties of questions
– age appropriate for the pupil (=), for a younger pupil (<), an older pupil (>) or an
even older pupils (>+)
• SEN Entry Point starts with (<)
• Question number is displayed at the bottom of the screen
• 8 different answer techniques
– cloze, drag and match, drag into order, drag punctuation, drag to hot spot, pick
multiple, pick one and select word
• Practice assessment
37
Focus on Skills
Aspect of Literacy Skills Focus
Pupils’ ability to …
Listening
Information
Retrieval
Listen to and understand information
and ideas.
Reading
Sequence
Understand information and ideas
Information
Find and use information
Features of
Texts
Understand different types of texts
Opinions
Respond to different layers of
meaning
Writing
Punctuation Punctuate text
Spelling
Recognise accurate spellings
Grammar
Use grammar accurately
38
Adaptive Routing in NILA
Let’s take a few minutes to look through the CBA Objectives Report
39
Preparing Pupils
to use NILA
40
Take 15 minutes to explore the NILA Practice Assessment
41
42
The Numeracy Assessment
• 2 strands:
– Strand 1 Understanding & Using Number
– Strand 2: Shape & Space, Measures and Handling Data
•
•
•
•
•
•
•
Neither has a fixed time for completion
Each strand assessed using an adaptive approach
Can move on without submitting an answer
Pupils take an average of 20 minutes per strand
Voiceover
Only mental arithmetic questions are timed
Irish Medium version only available to IM schools or those with IM
units
• Pencil and paper should be available to pupils
• Practice area
43
Focus on Skills
Strand 1
Skills Focus
Pupils
Pupils’ability
abilityto
to…
…
Number
Facts
Counting & Understanding Number;
Facts and Mental Arithmetic
Operations
Operations with Whole Numbers,
Integers and Decimals
Fractions, Decimals, Percentages,
Ratio & Proportion
Problems – including Money,
Function Machines & Algebra
Shape and Space
Fractions
Problems
Strand 2
Shape and
Space
Measures
Handling Data
Measures
Handling Data
44
NINA Assessment Process
What is being assessed?
How difficult are the
questions?
Column
Information Provided
Skills Focus
Specific Area of the curriculum
Objective
Specific aspect of numeracy
Year
Curriculum year of the question
Band
Difficult, medium or easy
How the pupil performed? Outcome
Ticks and crosses
45
Adaptive Assessment
• Start in their target year - one year below their current school
designated year e.g. Year 3 questions for a Year 4 pupil
• SEN Entry Point is 2 years below target year
• 3 difficulties of questions
– Easy, medium and difficult
•
•
•
•
•
First question is a ‘medium’ one
First set of 6-8 questions assesses general numeracy
Move up, down or stay in the year
Move up or down can be reversed
Process repeated until assessment determines they are answering
questions appropriate to their ability
46
NINA SEN Entry Point
Pupil’s
Curriculum Year
First Non-SEN Entry
Point questions will be
from:
First SEN Entry Point
questions will be from:
Year 4
Year 3
Year 1
Year 5
Year 4
Year 2
Year 6
Year 5
Year 3
Year 7
Year 6
Year 4
47
Adaptive Assessment
Let’s take a few minutes to look through the CBA Objectives Report
48
Preparing Pupils
to use NINA
49
50
• Take 15 minutes to explore the NINA Practice Assessment
Pupils are
allowed to
use pencil
and paper
51
During an Assessment
Question not fully loaded (images/buttons are misplaced/missing)
Step 1: If this issue continues for more than 10 seconds click on ‘F5’
once.
Step 2: If the problem persists for this user, close Internet explorer (IE)
and get the pupil to log back into their assessment.
Step 3: If the problem is still not resolved, please remove this device
from the assessments and use another workstation if available.
Step 4: If the problem remains, contact the C2k Service Desk urgently
on 0870 6011666.
52
Phoning C2k
Please make a note of the following information before calling the C2k
Helpdesk:
•
•
•
•
•
•
date and time of issue
assessment being attempted (NINA or NILA)
description of issue
workstation ID
pupil ‘C2k / NINA / NILA’ account user name
if possible please take a screenshot.
53
Outcomes and reports
54
What NILA / NINA Tables and
Reports are available?
• NILA / NINA Results Tables provide schools with Age-Related
Outcome (ARO) Ranges and Standardised Scores (SS). These are
available for individual pupils, classes, year groups and at whole
school level. These build over time to show additional data as it
becomes available for new academic years.
• NILA / NINA Parent Reports contain the results table for an
individual pupil, showing only the Age-Related Outcome (ARO)
Range.
• NILA / NINA Objectives Reports provide specific information about
the questions asked and whether the pupil answered correctly or
incorrectly.
55
Results Table (School,
Year Group and Class)
56
Results Table (Individual Pupil)
57
Parent Report
58
Objectives Reports
Report
Purpose
Assessment
Question order
Shows the path through the
assessment
Both
Skills Focus
Performance in different areas of
the curriculum
Both
Year
Performance in relation to the
difficulty of the questions
NINA
59
NILA Objectives Report
What skills
have been
assessed?
What was the
difficulty of the
questions?
CY is now Age
> above what is expected in
the pupil’s curriculum year
= within what is expected in
the pupil’s curriculum year
< below what is expected in
the pupil’s curriculum year
How did the
pupil
perform?
Columns reordered so that
the Outcomes
are on the right.
60
NINA Objectives Report
Question Order
Band
Single report
which includes
both Strand 1
and Strand 2.
E – Easy
M – Medium
D - Difficult
Printable
individually or in
batches within 48
hours for current or
previous years.
61
NINA Curriculum Year Report
Year
Single report
which includes
both Strand 1
and Strand 2.
Difficulty of
Questions
answered is clear.
Clear where
pupil has
answered
multiple
questions from
an objective.
Printable
individually or in
batches within 48
hours for current or
previous years.
62
NINA Skills Focus Report
Skills
Focus
Single report
which includes
both Strand 1
and Strand 2.
Printable
individually or in
batches within 48
hours for current or
previous years.
Difficulty of
Questions
answered is clear.
Number of
Questions will be
included with the
pupil details at the
top of the page.
Teacher will know
the pupil’s target
year.
Clear where
pupil has
answered
multiple
questions from
an objective.
63
NILA Skills Focus Report
64
Using Outcomes
CBA “… are intended for diagnostic purposes and the assessment data
is primarily used for:
• Assessing pupil progress and identifying their learning needs
• Supporting self-evaluation and target-setting
• Helping teachers shape their teaching to address the learning needs
of their pupils
• Providing information for parents on their children’s strengths and
weaknesses within literacy and numeracy.”
OECD Review of Evaluation and Assessment in Education (2013)
p.54
65
CCEA Support and Resources
for Autumn 2014
• Face-to-face training (10 September - 1 October)
• Online Training Course (From 25 August)
• Preparation instructions – SIMS upload, school username/password
• NILA / NINA Guidance Documents, including guidance for pupils
with SEN
• ‘How to change an answer before you submit it in NINA’ poster
• Pupils demos and scripts
• NINA practice area
• NILA practice assessment
66
Websites and Helpdesks
Resources and Information for Schools
• Latest information about CBA and online resources for schools on
www.ccea.org.uk
Computer-Based Assessment Helpdesk
Monday – Friday (except for public holidays)
Email cba@ccea.org.uk
Hardware/ IT Difficulties or help with computers/laptops
• C2k helpdesk 0870 6011666
• C2K Exchange (desktop icon)
67
Questions, Evaluation and Close
68