STANDARD SETTING/
ORIENTATION
COMPUTER APPLICATIONS TECHNOLOGY
JANUARY 2012
Welcome and Farewell



New Colleagues
New Schools
Schools quitting the subject


CAT and IT can be offered together in Grade 10
from this year
Moves to do away with the “designated” list
CAT_Standard Setting_2012
2
Agenda

Reflection:






Results, Exam papers
Irregularities and Incidents (Marking Centre)
Curriculum Delivery
Assessment & Irregularities
Moderation
The way forward





CAPS
PoA & Curriculum Delivery – Gr 11 and 12
Assessment and Moderation
Important Dates
Planned workshops
CAT_Standard Setting_2012
3
Reflection on 2011 NSC
Examinations
CAT_Standard Setting_2012
4
National CAT Results
Provincial Results
“WC takes first place on average with two provinces
blowing on WC’s neck. In terms of pass rate, WC takes
3rd position.”
Central Results
Exam
Date
Wrote
Average
Pass rate Pass rate
30%
40%
0-29%
70-79%
80-100%
Not
Resulted
200811
1338
50.8
83
61
238
111
86
0
200911
1211
45.5
85
63
182
69
32
0
201011
1347
47.6
88
66
151
84
41
51
201111
1157
46.4
88
60
129
69
37
32
CAT_Standard Setting_2012
7
Central compared to others
Wrote
Average
Pass rate
30%
Cape Winelands
1524
52.7
93.1%
76.0%
98
99
Eden and Central Karoo
968
49.6
87.7%
65.1%
112
76
Metropole_Central
1347
46.4
88.0%
64.0%
151
41
Metropole_East
1682
49.4
90.1%
71.7%
164
58
Metropole_North
2498
50.1
91.2%
73.0%
201
97
Metropole_South
1025
47.2
91.2%
70.5%
84
14
Overberg
433
48.8
93.5%
69.3%
24
20
Westcoast
535
52.4
97.2%
80.0%
15
30
10012
49.6%
91%
71.2%
849
435
District
CAT_Standard Setting_2012
Pass rate
40%
0-29%
80-100%
8
Performance in Paper 1 (2011)
80
Paper 1 2011
70
60
50
WCED
40
MCED
30
20
10
0
Q1
Q2
Q3
Q4
Q5
Q6
CAT_Standard Setting_2012
Q7
Paper
9
Performance in Paper 2 (2011)
80
Paper 2 2011
70
60
50
WCED
40
MCED
30
20
10
0
Q1
Q2
Q3
Q4
Q5
Q6
CAT_Standard Setting_2012
Q7
Paper
10
Reflection 2010 NSC Practical Exams

Practical Examinations
 Significant Improvement in Data Management of data on CD’s –
 Fewer reports on missing data
Irregularities
Incidents
Missing data
Incorrect Date and Time stamps
0 wrote the backup paper
Pink Information sheets without bar
code stickers
Incorrect folder structures
School Name on CD’s, pink sheets
and other documents (letterheads)
Incorrect indication of files modified
on pink info sheets
CAT_Standard Setting_2012
11
Analysis of NSC Paper 1
Ave % per Question of Paper 1
100.0
90.0
80.0
Percentage (%)
70.0
60.0
50.0
40.0
30.0
20.0
10.0
0.0
Paper 1
Q1
66.4
Q2
63.5
Q3
67.5
Q4
45.0
Q5
28.4
CAT_Standard Setting_2012
Q6
32.0
Q7
23.8
Paper 1
44.9
12
Reflection: Poor Performance in questions
Question
Poor performance
Question 1
1.4 Save bmp as jpg
1.6 Counting the occurrence of ‘e’
1.7 Sorting and manipulating attributes
Question 2
2.7 Format Painter
2.9 Column Break
2.10.1 Flip Image
2.11 Custom Symbol
2.12 Outline Numbering
Question 3
3.1 Date Format
3.5 Leader Tab
3.6 Grouping of Objects
3.8 Formulas in table
3.9 Sorting in Table
CAT_Standard Setting_2012
13
Poor performing questions (Cont.)
Question
Poor performance in
Question 4
4.4 Function vs. Formula
4.6 VlookUp function
Nested-IF
Question 5
5.3 Combination of function & formula
5.4 Correcting formula
5.7 LEN function
Question 6
6.2.1 Unique field and Primary key
6.7 Text Box vs. Label Box
6.7.3 Formatting to currency
6.7.4 Grouping Function in form
Question 7
Bookmarks; Hyperlink Properties
7.2 Paste Link
7.3 [4] Bonus marks
CAT_Standard Setting_2012
14
NSC Paper 1: General remarks

Lack of proficiency






Practise, practise, practise …
Time management
Poor foundation in Grade 10
Teaching Methodology
Exam Techniques
Exam dry Runs
CAT_Standard Setting_2012
15
Analysis of NSC Paper 2
Ave % per Question for Paper 2 (Theory)
100.0
90.0
80.0
Percentage
70.0
60.0
50.0
40.0
30.0
20.0
10.0
0.0
Ave % per Question
Question 1
Question 2
Question 3
Question 4
Question 5
Question 6
Question 7
72.2
65.2
41.4
40.8
35.1
47.8
24.7
CAT_Standard Setting_2012
Paper Ave
%
42.1
16
Poorly answered questions - Paper 2
Poorly answered questions – Paper 2
NSC Paper 2: General remarks

Learners must write






Notebooks!
Correct terminology
Poor foundation in Grade 10
Teaching Methodology
Exam Techniques
Exam dry Runs
CAT_Standard Setting_2012
19
Reflection: Curriculum Delivery
CAT_Standard Setting_2012
20
What went well




PAT deadlines
Mark sheets provided when requested
No SBA assessment irregularities
CA received warm welcome at all schools
CAT_Standard Setting_2012
21
What needs improvement


Some schools never submit mark sheets
PAT irregularities




Not done under controlled conditions
Not monitored by teacher
Not checking e-mails every day
Failing to keep evidence of practical work
CAT_Standard Setting_2012
22
Notebooks




Empty notebooks – concern
Volume – must correlate with planning and measure
curriculum delivery
Learners must write
Theory vs. practical notes –


Summary of Practical content also in learner notebooks
Lack of application/exercises/questions and answers
CAT_Standard Setting_2012
23
Reflection: Assessment (SBA)

Theory Tests:
 Multiple Choice and Matching questions not in ratio with
Section B questions
 Example:


Theory Test: 10 +10 + 30 = 50 vs.
NSC Paper: 10 + 10 + 130 = 150
Theory Tests assess too little content
 Reduced Max Totals of Exams – must be communicated
and motivated to CA
Theory Exams
 Questions verbatim from NSC papers still occur …


CAT_Standard Setting_2012
24
Reflection: Internal Assessment (SBA)

Practical Tests:
 Must administer similar to NSC exam configuration
 Marking Guideline similar to NSC Prac. paper
 Time duration of tests not in ratio with max totals i.e.
70 Mark test within approx. 60 minutes
 Lack of proficiency/skill impacts on effective time
management in completing practical exams
 Loss of data a concern
 Marking be completed at least 1 week after
assessment
 Feedback
CAT_Standard Setting_2012
25
Reflection: Assessment (SBA)

Examinations





Internal Practical Examinations - NSC security configuration.
All Question papers to be moderated internally or by peer
teacher.
The use of NSC-/Common-/Provincial/past SJ papers verbatim
NOT allowed
Common Paper for Trial Exams in 2012 …
Grade 12 Papers: Cannot be less!
 Paper 1: 200 Marks
 Paper 2: 150 Marks
CAT_Standard Setting_2012
26
Best Practises

Past Exam Papers






Regular Homework on Operational Knowledge,


Monitor learners' homework
Regular informal tests


DoE Papers (Oct, Rewrite and Suppl.)
Teachers to set their own papers
Visit: Thutong Education Portal
Use past NSC papers to set informal assessment
Collated per content breakdown (Prac. & Theory)
Test basic knowledge
Avoid copies pasted in notebooks
Learners must write in order to comprehend
CAT_Standard Setting_2012
27
Assessment Irregularities (2011)-SAIC

Recorded irregularities in 2011



PAT irregularities
Consequences
Position of CA
CAT_Standard Setting_2012
28
Internal Moderation




Overall compliance,
BUT, Script moderation still paper exercise…
Please comply with the following:
 Standard and Quality Setting of FATs; Tests and
Exam Papers
 Moderation of scripts (in line with NSC marking
processes)
 Administer – using control sheets
Use Moderation control sheets:
 Formal Tests (Practical and Theory)
 Examination Papers
 Scripts
 PAT
CAT_Standard Setting_2012
29
Moderation: Method


Internal Moderation – imperative/compulsory
Moderation by:





Subject Head
Peer teachers at 1 specific school, or
Peer teachers at neighbouring schools
Support groups or mini-cluster
Set assessments/exams in small groups –


minimise workload in setting and moderation
Same pace setter
CAT_Standard Setting_2012
30
District Moderation


Face Moderation (per term) of SBA at selected schools
Desktop Moderation:






Formal Assessment and Mid-Year Exam papers
(selected schools)
Submission of electronic recording sheets - July
PATs – see timeline
Teacher File with SBA
Cluster/Peer Moderation - on-going
Final Moderation and Verification (all schools)
CAT_Standard Setting_2012
31
Evidence of Learner Performance







Available at all times – all stake-holders
At school – not at home or with learners
FATs for recording and promotion purposes.
Absent due to valid reason, provide a copy of medical
certificate or other valid reason.
No valid reason – a note (intervention) of the educator
Intervention letters be co-signed by a witness (Subject
Head, Grade Head, Peer Teacher etc.)
Archiving of Scripts …
CAT_Standard Setting_2012
32
Current Curriculum Developments: CAPS

CAPS (Curriculum and Assessment Policy
Statement)



Implementation in 2012
Orientation – 2011
Important notes on CAT CAPS:





Teaching Plan
Work Schedule and Daily Planning
Assessment (NCS vs. CAPS)
Weightings of tests and exams?
Exemplar tests and exams …
CAT_Standard Setting_2012
33
Important Events/Dates
Term
Term 1
Term 2
Term 3
Term 4
Event
Time Frame
Schools
Visitation to focus schools
On-going
Selected Schools
Moderation of June
Examination papers (Gr. 12)
7 May 2011
Selected Schools
Submission of Gr. 10 to 12
Recording Sheets
23 July 2011
All Schools
Submission of Gr. 12 PAT
Marks
17 August 2011
All Schools
Submission of Gr. 12
Recording Sheets (SBA)
October 2011
All Schools
Gr. 12 Final Moderation &
Verification
October 2011
Groups
Submission of Gr. 10 & 11
Recording Sheets
July 2011
November 2011
All Schools
CAT_Standard Setting_2012
34
Curriculum Support - 2011

Some schools


Some schools


1 visit per term
Other schools


2 visits per term
On request
Be prepared …
CAT_Standard Setting_2012
35
Programme of Assessment(PoA)

PoA – Grade 10 (CAPS)


PoA – Grade 11 – as per 2011





P1: 120 P2: 100
June exams: P1 – 180 P2 – 100
November exams: P1 – 200 P2 - 150
PoA – Grade 12 – as for 2011
Tests only - no tasks
Weighting of tests …?
CAT_Standard Setting_2012
36
Recording in 2012

Recording sheets for 2012 are being
prepared

The recording sheets for 2011 will work and can
be adapted
CAT_Standard Setting_2012
37
Planned workshops

PAT workshop


Setting quality exam/test questions


Saturday 14 April
Introduction to html (new content in 2013)


Saturday 4 February (Garlandale)
Saturday 18 August
Venues TBA
CAT_Standard Setting_2012
38
Office-Suite




MSO 2003 vs. 2010 (DBE)
MSO 2010 – Gr 10 to 12
Upgrade impacts on preparation for NSC
practical exam (Office 2003, 2007 or 2010)
Challenges –

Outdated Hardware specs
CAT_Standard Setting_2012
39
Challenges









Teacher training and development
ICT maintenance and sustainability
Data Management (Backups)
Overcrowding?
Office 2003/2007/2010
Classroom/Subject Management
Remedial work after examinations
Exam dry run
NSC Practical Exam date -17 October 2011
CAT_Standard Setting_2012
40
Communication


Check e-mails regularly.
Technical Problems – log a call (CEI)

Inform CA of Technical Problems

Communication and deadlines

WCED CAT web-site:
http://www.curriculumdev.wcape.school.za/index.php?option=co
m_content&view=article&id=321&Itemid=1
22
CAT_Standard Setting_2012
41
Suggestion Box
pdavidso@pgwc.gov.za
CAT_Standard Setting_2012
42
Many Thanks