Implementation of the IRRS Programme in States
with Operating Nuclear Power Plants
57th Regular Session of the IAEA GC – Senior Regulators’ Meeting
J. Lyons, Director
Division of Nuclear Installation Safety
Department of Nuclear Safety and Security
International Atomic Energy Agency
IAEA
International Atomic Energy Agency
Outline
• Facts and data – an overview
• Past and future IRRS missions
• Expert participation in IRRS missions
• Ways to improve the IRRS programme
•
•
•
•
•
Basic IRRS Training Course
Analysis of past missions to NPP countries
Effectiveness and efficiency of the IRRS process
Revising IRRS Guidelines
Self-assessment tool
• Transparency
• Prompt mission evaluation
• IRRS platform on the RegNet website
IAEA
Senior Regulators' Meeting 2013
4/8/2015
2
FACTS AND DATA – AN OVERVIEW
IAEA
Senior Regulators' Meeting 2013
Past and Future IRRS Missions
• Most nuclear power countries have
invited IRRS missions
• The IAEA Nuclear Safety Action Plan
foresees that Member States regularly
invite IRRS missions
IRRS missions
• The IRRS programme
will continue to grow
in 2014 & 2015:
initial missions
follow-up missions
14
• 14 missions in 2014
• 12 missions in 2015
IAEA
Senior Regulators' Meeting 2013
Number of missions
12
10
8
6
4
2
0
2006 2007 2008 2009 2010 2011 2012 2013 2014 2015
Year
4/8/2015
4
Expert Participation in IRRS Missions
• MS experts serve as reviewers
• IRRS expert pool (EU initiative)
• All MS are encouraged to nominate
experts to be included in the pool
• 322 experts
from 52 MS
participated
566 times in
46 missions
Numbers of experts in the EU pool
AUT
BEL
BUL
CYP
CZR
DEN
EST
FIN
FRA
GFR
GRE
ALB
HUN
ALG
IRE
ARG
LAT
AUS
LIT
BEL
LUX
BUL
NET
BRA
ROM
BKF
SLO
CAN
SLR
CHI
SPA
CUB
SWE
CZR
UK
0
5
10
15
IAEA
20
25
CPR
DEN
3
1
5
7
12
8
10
1
18
1
7
15
4
2
Participation by countries
ETH 2
MEX 2
FIN 26
MOR 2
FRA 29
NIR 1
GFR 12
NET 6
GRE 1
NOR 4
HUN 8
NZE 2
ICE 1
PAK 7
IND 1
ROK 11
IRE 6
ROM 9
ISR 1
RUS 5
ITA 1
SAF 3
JPN 11
SLO 9
JOR 1
SLR 15
LIT 1
SPA 12
Senior Regulators' Meeting 2013
SUD
SWE
SWI
SYR
TUN
TUR
UAE
UKR
UK
USA
1
17
14
1
2
1
3
6
26
36
4/8/2015
5
Financing IRRS Missions
• IRRS missions are financed
• by host MS;
• through Extra Budgetary contributions;
• through Technical Cooperation funds
• IRRS missions are supported by:
• European Commission; and
• MS providing cost free experts
This support is highly appreciated
IAEA
Senior Regulators' Meeting 2013
4/8/2015
6
WAYS TO IMPROVE THE IRRS PROGRAMME
IAEA
Senior Regulators' Meeting 2013
Basic IRRS Training Course
21-24 OCT. 2013
IAEA
• Open for 60 participants
• In the framework of the EC-IAEA
cooperation in the field of Nuclear
Safety
• Covers all aspects of the IRRS
programme
• Expected to be conducted on a
regular basis
Senior Regulators' Meeting 2013
4/8/2015
8
Analysis of Past IRRS Missions
• 15 initial and 6 follow-up missions
conducted in countries with NPPs
between 2006 and 2011 were
analysed
IAEA
Senior Regulators' Meeting 2013
4/8/2015
9
Analysis of Past IRRS Missions
• 15 initial and 6 follow-up missions
conducted in countries with NPPs
between 2006 and 2011 were
analysed. This included:
• a study of the frequency of references to
IRRS safety standards;
4.5
4
Number of references to GSR Part 1 Requirements/missions
reference/mission
3.5
3
2.5
2
1.5
1
0.5
0
24 32 2 18 25 27 29 20 31 4 10 15 26 33 22 16 23 19 7 36 1 11 5 30 8
3 35 9 21 17 34 14 28 12 13 6
Requirement number
IAEA
Senior Regulators' Meeting 2013
4/8/2015
10
Analysis of Past IRRS Missions
• 15 initial and 6 follow-up missions
conducted in countries with NPPs
between 2006 and 2011 were
analysed. This included:
Number of observations from initial missions
Recommendations
Suggestions
Good practices
140
Number of observations
120
100
80
60
40
20
0
I
II
III
IV
V
VI
VII
Module number
VIII
IX
X
Ratio of open issues in follow-up
missions
Suggestions
Recommendations
All
XI
• a study of the frequency of references to
IRRS safety standards;
• statistics of mission observations;
open issues/all issues
0.70
0.60
0.50
0.40
0.30
0.20
0.10
0.00
Minimum
Average
IAEA
Maximum
Senior Regulators' Meeting 2013
4/8/2015
11
Analysis of Past IRRS Missions
• 15 initial and 6 follow-up missions
conducted in countries with NPPs
between 2006 and 2011 were
analysed. This included :
Number of Good Practices in Modules
EU missions
non-EU missions
follow-up missions
50
45
40
number of GP's
35
30
25
20
15
10
5
0
I
II
III
IV
V
VI
VII
Module number
IAEA
VIII
IX
X
XI
• a study of the frequency of references to
IRRS safety standards;
• statistics of mission observations;
• analysis of observations based on their
contents;
Senior Regulators' Meeting 2013
4/8/2015
12
Analysis of Past IRRS Missions
• 15 initial and 6 follow-up missions
conducted in countries with NPPs
between 2006 and 2011 were
analysed. This included:
• a study of the frequency of references to
IRRS safety standards;
• statistics of mission observations;
• analysis of observations based on their
contents;
• a conclusion for further development of
the IRRS process.
IAEA
Senior Regulators' Meeting 2013
4/8/2015
13
Effectiveness and Efficiency of IRRS
• NSAP calls for establishing criteria for
efficiency of IRRS missions
• 16 Performance Indicators introduced to
characterize the E&E of a mission, such
as:
• Team size; team experience;
• Time available to prepare for the mission;
• Feedback from team members and from
hosts;
• Coverage of the Action Plan by findings;
• Balance of findings;
• Conciseness of mission report; etc.
IAEA
Senior Regulators' Meeting 2013
4/8/2015
14
Effectiveness and Efficiency of IRRS
• Ranges of Performance Indicator
values (defined based on past
experience):
Host Feedback
5
mark
4.5
4
3.5
3
Miss1
Miss2
Miss3
Miss4
Miss5
Miss6
mission
Ratio of open issues in follow-ups
Suggestions
All
Optimum
Acceptable
Needing attention
• Examples:
ratio of members with experience
Recommendations
•
•
•
0.70
0.60
0.50
0.40
0.30
0.20
0.10
0.00
Team Experience
1.00
0.90
0.80
0.70
0.60
0.50
0.40
0.30
0.20
0.10
0.00
Fu-1
Fu-1
Fu-2
Fu-3
Fu-4
IAEA
Fu-5
Fu-6
Fu-2
Fu-3
Fu-4
Ini-1
Fu-7
Ini-2
Ini-3
Ini-4
Ini-5
Ini-6
Ini-7
Ini-8
Ini-9
missions
Senior Regulators' Meeting 2013
4/8/2015
15
Effectiveness and Efficiency of IRRS
Efficiency and effectiveness of IRRS
missions
0.22
to analyse
0.2
Distance from optimum
0.18
0.16
acceptable
0.14
0.12
0.1
0.08
0.06
effective
0.04
• The effectiveness and efficiency of
recent missions have been evaluated
0.02
optimum
0
Ini-1
Fu-1
Ini-2
Fu-2
Ini-3
Fu-3
Ini-4
Ini-5
Ini-6
Ini-7
Ini-8
Indicators
Note: The
Performance
Indicator values introduced
and
presented
here
characterize the effectiveness and efficiency of the
IRRS missions and represent
no indication whatsoever on
the safety performance of
the host countries of the
missions
IAEA
Ini-1
Fu-1
Ini-2
Fu-2
Ini-3
Fu-3
Ini-4
Ini-5
Ini-6
Ini-7
Ini-8
C1 – Team Size
0.03
0
0.04
0.05
0
0.04
0.01
0
0.13
0.04
0
C2 – Report Length
0.11
0.15
0
0.13
0
0
0.24
0
0.17
0
0
C3 – ARM Review Time
0.13
0
0.16
0.13
0.18
0.3
0
0
0.3
0
0
-
-
-
-
0.08
-
0
0
0
0.2
0.11
0
C4 – Advance Comments
C5 – ARM Feedback
C6 – Team Experience
C7 – Host Feedback
C8 – Team Feedback
-
-
-
-
-
-
-
-
0
0.16
0.2
0
0.25
0.09
0.3
0.09
0.08
0.3
0.3
0.3
0
-
-
-
-
0
-
-
0.04
-
0
0.11
0
-
-
-
-
0
-
-
0
0
0
C9 – Action Plan Extent
0.3
-
0.14
-
0.3
-
0
0
0
-
0
C10 – Action Plan Coverage
0.3
-
0
-
0
-
0
0.3
0
-
0.3
C11 – Beyond AP Coverage
0.02
-
0
-
0
-
0
0
0
-
0.3
C12 – Balance of R and GP
0
-
0.15
-
0
-
0
0.16
0
0
0.04
C13 – Balance of R and S
0
-
0.2
-
0
-
0
0
0.3
0
0.1
C14 – Mission Report Contents
0
-
0.18
-
0.11
-
0.09
0.12
0.01
0.12
0.07
C15 – Report Completion Time
0
0.1
0.3
0
0.3
0
0.3
0
0.06
0.27
0
C16 – Open Issues
-
0.17
-
0
-
0
-
-
-
-
-
0.1
0.07
0.18
0.07
0.09
0.07
0.06
0.07
0.09
0.09
0.07
Average Measure of Deviation (D )
Senior Regulators' Meeting 2013
4/8/2015
16
IRRS Guidelines
• A revised version published in May 2013
as an IAEA Service Series volume
http://www-pub.iaea.org/MTCD/publications/PDF/SVS23_web.pdf
IAEA
Senior Regulators' Meeting 2013
4/8/2015
17
IRRS Guidelines
• A revised version published as a Service
Series volume in May 2013
• 9 Targeted Consultancies held on various
topics of the IRRS process
• Suggestions summarized in the
consultancy reports will be used as input
in a new edition of the Guidelines
• Recommendations by the Team Leaders’
meeting (January 2013) will also be
included
• Development to begin in January 2014
IAEA
Senior Regulators' Meeting 2013
4/8/2015
18
Self-assessment tool
• IRRS self-assessment methodology
and tool (SARIS) for regulatory
infrastructure for safety developed
• Question sets for NPP-related topics
have recently been revised
• Enhancement of SARIS resulted in a
user-friendly, easy to use tool
http://gnssn.iaea.org/CSN/SA/default.aspx
IAEA
Senior Regulators' Meeting 2013
4/8/2015
19
TRANSPARENCY
IAEA
Senior Regulators' Meeting 2013
Prompt Evaluation of IRRS Missions
• MS are interested in the effectiveness
and efficiency of the IRRS programme
• Recent IRRS missions have been
evaluated (pilot project) based on
feedback and on Performance Indicator
values
• After finalization of the method, the
reports will be made public.
IAEA
Senior Regulators' Meeting 2013
4/8/2015
21
IRRS Homepage on RegNet
http://gnssn.iaea.org/regnet/irrs/pages/default.aspx
IAEA
Senior Regulators' Meeting 2013
Working to Protect People, Society
and the Environment
IAEA
Senior Regulators' Meeting 2013
4/8/2015
23