Review by the National Qualifications Authority of Ireland (NQAI) of

advertisement
Review by the National Qualifications Authority of Ireland (NQAI) of the
effectiveness of the quality assurance procedures of the Dublin Institute
of Technology (DIT)
Terms of Reference (20 September 2010)
1.
Background
The Dublin Institute of Technology was established as an autonomous institution
under the DIT Act in 1992. In 1998, it was granted degree awarding powers by the
Irish state, and makes major awards at Higher Certificate, Ordinary Bachelor
Degree, Honours Bachelor Degree, Masters and PhD levels (Levels 6 to 10 in the
National Framework of Qualifications), as well as a range of minor, special purpose
and supplemental awards. The Institute also has a major involvement in and
commitment to apprenticeship education and training. As a statutory awarding
body and provider of higher education and training, and in line with national and
international practice, the primary responsibility for the quality assurance of the
educational provision and awards made by DIT resides with the Institute itself.
Side by side with the internal quality assurance procedures which the Institute
operates, and again in line with national and international practice, DIT is also
subject to external quality assurance, as set out in the Qualifications (Education and
Training) Act, 1999. Section 39 (3) of the act provides that the NQAI shall
consider the findings arising out of the application of the DIT's quality assurance
procedures, as agreed with the Authority under section 39(1) of the Act, and may
make recommendations to the Institute which the Institute shall implement. Under
section 39 (4), the Institute is required to review the effectiveness of the Institute’s
quality assurance procedures ‘not more than once in every three years and not less
than once in every seven years’. Section 39 (5) also provides that the Authority
shall publish the results of the review of effectiveness.
The first review of effectiveness of the DIT's quality assurance procedures was
completed in 2006. The review was carried out by the European University
Association on behalf of the NQAI, under the EUA's Institutional Evaluation
Programme. The published outcomes of the review are available at:
http://www.nqai.ie/award_dit_rev.html. This review process is the second review
of effectiveness of the DIT's quality procedures, and is being instituted in fulfilment
of the statutory obligations of the DIT and NQAI under section 39 (4).
It is of note that plans are advancing for the amalgamation of the NQAI with the
Higher Education and Training Awards Council (HETAC), the Further Education
and Training Awards Council (FETAC) and the Irish Universities Quality Board
(IUQB). The new qualifications and quality assurance body will assume the
1
NQAI's statutory external quality assurance role in relation to the DIT. It is
possible that the new body may be established before this review process is
completed, and that the review outcomes may be considered and published by the
new body. In this connection, the NQAI will build into the review process a formal
consultation, which will involve all of the quality assurance agencies involved in
the amalgamation, namely, HETAC, FETAC and the Irish Universities Quality
Board (IUQB).
2.
Review Objectives
The objectives of the review will be to evaluate:
3.

the effectiveness of the procedures operated by DIT for the quality
assurance of its education and training programmes, and the awards
to which they lead in the National Framework of Qualifications, both
nationally and internationally

the extent to which DIT, in operating these procedures meets the
requisite standards, as set out in Part 1 of the Standards and
Guidelines for Quality Assurance in the European Higher Education
Area
Basis of Review Criteria and Procedures
To meet the review objectives, the DIT will be evaluated and assessed against
criteria and procedures that are informed by institutional review practice within the
Irish higher education system, and by the standards and guidelines for quality
assurance agreed by the Ministers of the Bologna signatory states. Specifically, the
criteria and procedures are informed by the following documents:

Higher Education and Training Awards Council (HETAC): Policy on
Institutional Review of Providers of Higher Education and Training (2007);
Supplemental Guidelines for Institutional Review (2008); Supplementary
Guidelines for the Review of Effectiveness of Quality Assurance Procedures
(2008)1

Irish Universities Quality Board (IUQB): Institutional Review of
Universities (IRIU) Handbook (2009); Good Practice in the Organisation of
PhD Programmes in Irish Higher Education (2009) 2
1
http://www.hetac.ie/publications.cfm?sID=44
2
http://www.iuqb.ie/info/iriu.aspx; http://www.iuqb.ie/info/good_practice_guides.aspx
2
4.

Irish Higher Education Quality Network: Principles of Good Practice in
Quality Assurance/Quality Improvement for Higher Education and Training
(2005); Principles for Reviewing the Effectiveness of Quality Assurance
Procedures in Irish Higher Education and Training (2007); Provision of
Education to International Students: Code of Practice and Guidelines for
Irish Higher Education Institutions (2009) 3

European Association for Quality Assurance in Higher Education (ENQA):
Standards and Guidelines for Quality Assurance in the European Higher
Education Area (3rd edn., 2009) 4

The UNESCO/OECD Guidelines for Quality Provision in Cross-border
Higher Education5
Review Criteria
The following are the criteria and procedures for the review of effectiveness of the quality
assurance procedures of the DIT. These criteria will apply, where appropriate, to the
Institute’s educational provision both in Ireland and overseas.
4.1
Follow-up to the 2006 review of effectiveness of DIT's quality assurance
procedures
The criterion is intended to assist the examination of DIT's internal quality culture.
Specifically, the review will evaluate the extent to which the DIT has implemented
the 33 strategically linked recommendations made by the EUA review team in
2006. Particular attention will be given to the five recommendations made by the
EUA team on quality assurance and enhancement, and to the quality issues which
the NQAI commented upon in its consideration of the review outcomes, namely:


the need to implement more proactively and to review the annual
programme reporting processes in order to encourage full participation by
both students and staff, and in order to ensure greater transparency in the
student feedback process
the need to accelerate the development of the emerging systems for school,
faculty and research review.
3
http://www.iheqn.ie/publications/default.asp?NCID=154
4
http://www.enqa.eu/files/ESG_3edition%20(2).pdf
5
http://www.oecd.org/dataoecd/27/51/35779480.pdf
3
4.2
Education and training programmes offered by the DIT
The criteria set out here are intended to assist in the examination of DIT's processes
for the quality assurance of the programmes of education and training, including
research programmes, which it provides. In line with practice in the Irish higher
education sector generally, and Ireland’s commitment to the Bologna Process, the
criteria used here are the standards from Part 1 of the European standards and
guidelines for internal quality assurance within higher education institutions. These
criteria should be considered in conjunction with the accompanying guidelines as
set out in Standards and Guidelines for Quality Assurance in the European Higher
Education Area (3rd edn. 2009), pp. 16-19.6 The guidelines provide additional
information about good practice and in some cases explain in more detail the
meaning and importance of the standards.
 Policy and procedures for quality assurance
Institutions should have a policy and associated procedures for the assurance of
the quality and standards of their programmes and awards. They should also
commit themselves explicitly to the development of a culture which recognises
the importance of quality, and quality assurance, in their work. To achieve this,
institutions should develop and implement a strategy for the continuous
enhancement of quality. The strategy, policy and procedures should have a
formal status and be publicly available. They should also include a role for
students and other stakeholders.
 Approval, monitoring and periodic review of programmes and awards
Institutions should have formal mechanisms for the approval, periodic review
and monitoring of their programmes and awards. In relation to this criterion, an
assessment will also be undertaken with regard to how these formal
mechanisms incorporate the implementation of the National Framework of
Qualifications and the relevant parts of the NQAI's policies and procedures on
access, transfer and progression.7 Areas to be examined here will include the
processes used by the Institute to ensure the accurate levelling of awards, the
extent and the manner in which NFQ award-types (major, minor, special
purpose and supplemental) are utilised, and the manner in which credit
arrangements and transfer and progression routes are embedded in the
programme development processes.
 Assessment of students
6
http://www.enqa.eu/files/ESG_3edition%20(2).pdf
7
http://www.nqai.ie/publication_oct2003a.html
4
Students should be assessed using published criteria, regulations and
procedures which are applied consistently.
 Quality assurance of teaching staff
Institutions should have ways of satisfying themselves that staff involved with
the teaching of students are qualified and competent to do so. They should be
available to those undertaking external reviews, and commented upon in
reports.
 Learning resources and student support
Institutions should ensure that the resources available for the support of student
learning are adequate and appropriate for each programme offered.
 Information systems
Institutions should ensure that they collect, analyse and use relevant
information for the effective management of their programmes of study and
other activities. In this connection, consideration should also be given to the
Institute's processes for monitoring and analysing grade distribution and profile
patterns across its education and training programmes.
 Public information
Institutions should regularly publish up-to-date, impartial and objective
information, both quantitative and qualitative, about the programmes and
awards they are offering including the award-type to which the programme
leads, the level at which it is included in the NFQ and the credit volume
associated with the programme. In this connection, consideration should also
be given to the information provision requirements on providers as set out in
the NQAI’s policies and procedures on access, transfer and progression.
5.
The Review Process
In line with best national and international practice, the review process will consist
of the following elements:

an institutional self-assessment report to be prepared by the DIT addressing
the agreed criteria and terms of reference

an expert review panel will be appointed comprising national and
international representation to conduct the review process

a review of the DIT self-assessment report by the expert panel and
consideration by the panel of any other information they might consider
relevant
5

visit by expert panel appointed by the NQAI

preparation of a review report by expert panel for submission to the NQAI,
which will include findings and a recommendations in relation to the
effectiveness of the DIT's quality procedures, and the extent of its
compliance to Part 1 of the European Standards and Guidelines

preparation of an institutional response, including a quality improvement
plan, by the DIT

consideration of review report and institutional response by the NQAI

publication by NQAI of the review outcomes.
It is of note, and in consideration of the impending amalgamation of the
qualifications and quality assurance agencies, that at all appropriate stages
of the effectiveness review the NQAI may consult and seek advice from an
advisory group comprising representatives of FETAC, HETAC, and the
IUQB. The executive of the NQAI will provide secretarial support to the
expert panel, including drafting of the expert panel’s report.
6. Indicative Timetable for Review
DIT commences self-evaluation report against agreed
criteria
September 2010
Appointment of expert review panel by NQAI
Autumn 2010
Preparation of site visit schedule and indicative timetable
by NQAI
Autumn 2010
Briefing for expert review panel
Spring 2011
DIT self-evaluation report completed and submitted to
NQAI for circulation to expert review panel
February 2011
Expert review panel site visit
March 2011
Expert review panel report completed
April 2011
DIT submits response to expert review panel report to
NQAI/new qualifications and quality assurance body
May 2011
NQAI/new qualifications and quality assurance body
considers and publishes review outcomes
Summer 2011
6
7
Download