Data validation Checklist

advertisement
Data Validation
Key Information Set
Learning Enhancement and Academic Practice
Learning Enhancement and Academic Practice
This page is intentionally left blank
X:\Quality Office\Dinh\ProcedureNotes\KIS\KISchecklist.docx
Page 2 of 32
Learning Enhancement and Academic Practice
INDEX
A. Introduction ............................................................................................................ 5
B. Checklist ................................................................................................................ 5
Questions 1-6........................................................................................................ 6
Questions 7-13...................................................................................................... 7
Questions 14-18.................................................................................................... 8
Question 19........................................................................................................... 9
C. KIS Toolkit ........................................................................................................... 10
D. KIS Timeline ........................................................................................................ 12
E. Screenshots ......................................................................................................... 13
F. Appendices .......................................................................................................... 32
X:\Quality Office\Dinh\ProcedureNotes\KIS\KISchecklist.docx
Page 3 of 32
Learning Enhancement and Academic Practice
This page is intentionally left blank
X:\Quality Office\Dinh\ProcedureNotes\KIS\KISchecklist.docx
Page 4 of 32
Learning Enhancement and Academic Practice
A.Introduction
Data in the Academic Information System (AIS) is used for a number of corporate
submissions such as the HESA return and the Key Information Set (KIS). While
it is desirable for all data quality issues to be addressed, this document details
only problems encountered while compiling KIS.
Essentially, departments must ensure that data in AIS matches information
published in module handbooks, programme handbooks or any other media. It is
imperative that data in AIS is correct at all times to prevent departments having to
do significant amount of data cleansing for each return.
B.Checklist for Academic Departments
The checklist below is by no means exhaustive, but it should help departments to
focus on particular issues and address them in good time either directly or by
liaising with the Student Administrative Services (SAS).
KIS is produced using current academic year’s data (x) for publication in the
following academic year (x+1) for the benefit of prospective students in the
academic year after that (x+2).
For example, KIS 2013-14 uses data from the academic year 2012-13 to inform
the student intake of 2014-15.
In the current academic session, check the following data items:
X:\Quality Office\Dinh\ProcedureNotes\KIS\KISchecklist.docx
Page 5 of 32
Learning Enhancement and Academic Practice
What to check?
Why is this important?
1. Is all activity recorded in
AIS?
KIS is derived from data held in AIS,
therefore a ‘nil return’ will be shown if no
scheduled activity or assessment is
recorded in the system
2. Is the programme of study
eligible for KIS?
KIS is produced for the benefit of
prospective undergraduate (including
integrated masters) students only
3. Does the module’s number
of credits in AIS match the
module handbook?
AIS\Programme and Module
KIS uses module data to build ‘typical’
Structure\Module Catalogue
student experience at each stage of study Edit \huuf100mc
4. Does the module’s learning
and teaching information in
AIS match the module
handbook?
KIS percentage ‘contact hours’ is derived
from activity scheduled in the Attendance
Elements
AIS\Programme and Module
Structure\Module/Course
Attendance
Elements\huufhu165\huufhu16
9
See Appendix 1 for
procedure notes
5. Does the module’s
assessment information in
AIS match the module
handbook?
KIS assessment categories are taken
from data recorded in AIS
AIS\Programme and Module
Structure\Maintain Module
Assessment Elements\huuf165
See Appendix 2 for
procedure notes
6. Does the length of
programme match the
programme handbook?
KIS tuition fees are calculated based on
this information
AIS\Course Data\POS\Basic
tab\’Duration’ (suf100_2)
Liaise with SAS as
appropriate
X:\Quality Office\Dinh\ProcedureNotes\KIS\KISchecklist.docx
Page 6 of 32
Where to check?
How to make changes?
AIS\Course Data\POS\KIS
tab\’Ignore this Course for KIS
Purposes’ (suf100_2)
Tick or untick the box as
appropriate
Liaise with SAS as
appropriate
Learning Enhancement and Academic Practice
What to check?
Why is this important?
Where to check?
How to make changes?
7. Does the number of credits
at POS level match the
programme handbook?
KIS programmes are expected to have
120 credits at each stage
AIS\Course Data\POS\Basic
tab\’Course Weight’ (suf100_2)
Liaise with SAS as
appropriate
Incorrect number of credits will give
incorrect number of modules contributing
to the stage
AIS\Course
Data\YOS\******Y*\Basic
tab\’Course Weight’ (suf100_e)
Liaise with SAS as
appropriate
9. Does the qualification
match the programme
handbook?
KIS qualification is displayed on Unistats
AIS\Course Data\POS\Basic
tab\’Qualification’ (suf100_2)
Liaise with SAS as
appropriate
10. Does the method of study
match the programme
handbook?
HESA uses the method of study to derive
correct statistics for KIS
AIS\Course Data\POS\Basic
tab\’Method of Study’ (suf100_2)
Liaise with SAS as
appropriate
11. Does the student status
match the programme
handbook?
This data item is used to determine
whether or not a programme is eligible for
KIS
AIS\Course Data\POS\Basic
tab\’Student Status’ (suf100_2)
Liaise with SAS as
appropriate
12. Does the Honours Indicator
match the programme
handbook?
This data item is displayed on Unistats as
part of the KIS programme title
AIS\Course Data\POS\Basic
tab\’Honours Indicator’
(suf100_2)
Liaise with SAS as
appropriate
13. If a programme of study is
accredited, is the
accreditation information
recorded?
This information is displayed on Unistats
against the programme details
AIS\Course Data\POS\Accredit
tab (hupfh111)
See Appendix 3 for
procedure notes
8. Does the number of credits
at YOS level match those
at POS level?
YOS credits = POS credits / duration
X:\Quality Office\Dinh\ProcedureNotes\KIS\KISchecklist.docx
Page 7 of 32
Learning Enhancement and Academic Practice
What to check?
Why is this important?
Where to check?
14. Does the Organisation Unit
match the programme
handbook?
If a course is new or has no students then
the KIS study information (learning &
AIS\Course
teaching and assessment) is estimated
Data\POS\Unit/Staff tab
(suf100_2)
using the average across the
Organisation Unit
How to make changes?
Liaise with SAS as
appropriate
LEAP uses this information to distribute
15. Does the Staff Name match
statistics relating to Annual Monitoring of
the programme handbook?
Programmes
AIS\Course
Data\POS\Unit/Staff tab
(suf100_2)
Liaise with SAS as
appropriate
16. Is the Ceremony Name in
AIS correct?
This is the name that goes on the degree
certificate
AIS\Course Data\POS\Names
tab (suf100_2)
Liaise with SAS as
appropriate
17. Are the Stages complete?
For KIS, the average data at each stage
within an Organisation Unit is used to
estimate for the same stage of a course
where there are no students. KIS
programming code also uses this to link
courses with foundation year to the main
course.
AIS\Course
Data\POS\Structure
tab\Stages button (huuf100a)
Liaise with SAS as
appropriate
18. If a programme of study
has a placement year in
industry or abroad, is Y3
Placement = ‘Y’?
KIS programming code uses this
information to allocate the percentage of
placement activity on the programme of
study
AIS\Course
Data\YOS\******Y3\Basic
tab\Placement (suf100_e)
Use dropdown arrow to
select ‘Y’ or liaise with
SAS
X:\Quality Office\Dinh\ProcedureNotes\KIS\KISchecklist.docx
Page 8 of 32
Learning Enhancement and Academic Practice
What to check?
Why is this important?
Where to check?
How to make changes?
19. If a programme of study
has a placement year in
industry or abroad, is Y3
Default status recorded?
KIS programming code uses this
information to inform HESA whether a
programme of study has a SANDWICH
year or YEARABROAD
AIS\Course
Data\YOS\******Y3\Basic
tab\Default status (suf100_e)
Liaise with SAS as
appropriate
X:\Quality Office\Dinh\ProcedureNotes\KIS\KISchecklist.docx
Page 9 of 32
Learning Enhancement and Academic Practice
C.KIS Toolkit in AIS
Three reports are available in the corporate information system AIS to assist
academic departments in the process of data validation, and should be used in
the following order:
X:\Quality Office\Dinh\ProcedureNotes\KIS\KISchecklist.docx
Page 10 of 32
Learning Enhancement and Academic Practice
1. Module Assessment/Delivery Summary by Session
This report displays all the modules within a selected sub-department together
with their KIS study information categories. It helpfully highlights in red
records where learning and teaching or assessment percentages don’t add up
to 100%. This is a good starting point in validating the Attendance and
Assessment Elements.
See Appendix 4 for procedure notes.
2. Primary Contributing Modules by Session
This report displays all programmes within a selected sub-department by
programme stage. It shows the most popular modules taken by students on a
particular stage, and their total number of credits adds up to the stage weight.
The report can be exported to Excel.
See Appendix 4 for procedure notes.
3. Programme of Study Summary Percentages
The final report in the series displays all the programmes within the subdepartment together with the KIS study information categories by each stage
of the programme.
This report can be exported to Excel.
See Appendix 4 for procedure notes.
X:\Quality Office\Dinh\ProcedureNotes\KIS\KISchecklist.docx
Page 11 of 32
Learning Enhancement and Academic Practice
D.KIS Timeline
Departmental
Validation
Report Compilation
(LEAP)
Departmental
Sign-off
Submission
(LEAP)
Institution Sign-off
• Continuous, August to March
• Academic departments ensure that data in AIS is consistent with
module/programme handbooks and other sources at all times
• March to May
• LEAP submits test files to HESA
• LEAP compiles reports for departments (iterative process)
• by 31 May
• Academic departments confirm quality of data
• before Clearing
• LEAP makes final submission to HESA
•before Clearing
•Vice-Chancellor signs off final submission
Departments are advised to work at your own pace over the validation
period and plan your workload around “pinch points” to avoid stress.
X:\Quality Office\Dinh\ProcedureNotes\KIS\KISchecklist.docx
Page 12 of 32
Learning Enhancement and Academic Practice
E. Screenshots
2. Is the programme of study eligible for KIS?
X:\Quality Office\Dinh\ProcedureNotes\KIS\KISchecklist.docx
Page 13 of 32
Learning Enhancement and Academic Practice
3. Does the module’s number of credits in AIS match the module handbook?
X:\Quality Office\Dinh\ProcedureNotes\KIS\KISchecklist.docx
Page 14 of 32
Learning Enhancement and Academic Practice
4. Does the module’s learning and teaching information in AIS match the module
handbook?
X:\Quality Office\Dinh\ProcedureNotes\KIS\KISchecklist.docx
Page 15 of 32
Learning Enhancement and Academic Practice
5. Does the module’s assessment information in AIS match the module
handbook?
Total = 100%
X:\Quality Office\Dinh\ProcedureNotes\KIS\KISchecklist.docx
Page 16 of 32
Learning Enhancement and Academic Practice
6. Does the length of programme match the programme handbook?
X:\Quality Office\Dinh\ProcedureNotes\KIS\KISchecklist.docx
Page 17 of 32
Learning Enhancement and Academic Practice
7. Does the number of credits at POS level match the programme handbook?
X:\Quality Office\Dinh\ProcedureNotes\KIS\KISchecklist.docx
Page 18 of 32
Learning Enhancement and Academic Practice
8. Does the number of credits at YOS level add up to the POS credits?
X:\Quality Office\Dinh\ProcedureNotes\KIS\KISchecklist.docx
Page 19 of 32
Learning Enhancement and Academic Practice
9. Does the qualification match the programme handbook?
X:\Quality Office\Dinh\ProcedureNotes\KIS\KISchecklist.docx
Page 20 of 32
Learning Enhancement and Academic Practice
10. Does the method of study match the programme handbook?
X:\Quality Office\Dinh\ProcedureNotes\KIS\KISchecklist.docx
Page 21 of 32
Learning Enhancement and Academic Practice
11. Does the student status match the programme handbook?
X:\Quality Office\Dinh\ProcedureNotes\KIS\KISchecklist.docx
Page 22 of 32
Learning Enhancement and Academic Practice
12. Does the Honours Indicator match the programme handbook?
X:\Quality Office\Dinh\ProcedureNotes\KIS\KISchecklist.docx
Page 23 of 32
Learning Enhancement and Academic Practice
13. If a programme of study is accredited, is the accrediting body recorded?
X:\Quality Office\Dinh\ProcedureNotes\KIS\KISchecklist.docx
Page 24 of 32
Learning Enhancement and Academic Practice
14. Does the Organisation Unit match the programme handbook?
X:\Quality Office\Dinh\ProcedureNotes\KIS\KISchecklist.docx
Page 25 of 32
Learning Enhancement and Academic Practice
15. Does the Staff Name match the programme handbook?
X:\Quality Office\Dinh\ProcedureNotes\KIS\KISchecklist.docx
Page 26 of 32
Learning Enhancement and Academic Practice
16. Is the Ceremony Name in AIS correct?
X:\Quality Office\Dinh\ProcedureNotes\KIS\KISchecklist.docx
Page 27 of 32
Learning Enhancement and Academic Practice
17. Are the Stages complete?
X:\Quality Office\Dinh\ProcedureNotes\KIS\KISchecklist.docx
Page 28 of 32
Learning Enhancement and Academic Practice
18. Placement year
X:\Quality Office\Dinh\ProcedureNotes\KIS\KISchecklist.docx
Page 29 of 32
Learning Enhancement and Academic Practice
19. Default status – year in industry
X:\Quality Office\Dinh\ProcedureNotes\KIS\KISchecklist.docx
Page 30 of 32
Learning Enhancement and Academic Practice
19. Default status – year abroad
X:\Quality Office\Dinh\ProcedureNotes\KIS\KISchecklist.docx
Page 31 of 32
Learning Enhancement and Academic Practice
F. Appendices
Appendix 1
AIS-AttendanceElem
entsV2.pdf
Appendix 2
Appendix 3
Appendix 4
AIS-AssessmentElem
entsV2.pdf
AIS-RecordingAccred
itingBodies.pdf
KISreportsGuide.pdf
X:\Quality Office\Dinh\ProcedureNotes\KIS\KISchecklist.docx
Page 32 of 32
Download