Country presentation on Evaluation

advertisement

Country presentation on Evaluation

SAI- INDIA

Performance

Audit

Monitoring

And Evaluation

Project/ Program

Formulation

Appraisal and

Approval

Implementation

Agencies involved…

• Project formulation

– Based on policy decisions of Government

– Designed by Implementing Ministry

– May associate experts, stakeholders

• Project appraisal and approval

– Ministry of Finance and Planning Commission appraises

– Cabinet approves

• Project monitoring and evaluation

– MIS of the project for regular monitoring

– Independent consultant appointed by Ministry for evaluation

– Every 5 years for continuation in subsequent Plan or mid term

– Program Evaluation Office of Planning Commission may select some schemes for study

• Performance audit

– SAI

Performance evaluation and Performance Audit both aim to add value…

• Performance Evaluation

– Systematic investigation to help improve, help decide an action, or learn reasons for successes and failures or strengths and weaknesses in meeting objectives

– A main objective is to assess impact

• Performance Audit

– Assessment focusing on economy, efficiency, effectiveness

– Project/ program selected based on significance and risk

Both are often instrumental in re-thinking policy or program design

Steps to conducting performance audit…

Pilot study

Audit Design: Objective, Scope, questions, criteria, tools

Planning

Entry Conference with the audited entity

Document review in selected units

Gather and analyze evidence

Compare evidence against criteria

Develop Findings and Conclusions

Implementation

Incorporate entity response

Exit conference with audited entity

Report drafted and issued to entity

Responses of entity incorporated

Reviewed by HQ

Reporting

Performance Audit report laid to legislature

Published

Institutional aspects…

• PA Guidelines to ensure process discipline

– Aligned with international standard (ISSAIs)

• Institutionally ensured…

– risk assessment during strategic selection of topic

– audit design guiding the audit process

– sampling: either statistical or risk based

– association of the entity throughout the audit process

– ensuring competent, relevant and sufficient evidence

– association of external experts to complement audit team

– specific recommendations arising from conclusions

– balanced reporting

– Follow up audits

Tool kit for approach and methodology…

• Analysis of procedures

– Review of systems and their compliance

• Case studies

– A comprehensive understanding of a particular instance

• Use of existing data

– MIS of the audited entity after being sure of its integrity

• Surveys

– Particularly social sector program

• Analysis of results

– Focus on output and whether intended has been achieved

• Quantitative analysis

– IT, data analytics

Hydrocarbon Licensing (E&P) Policy – An example

• Policy changes in the last two decades:

Upto 1993: Exploration and production (E&P) entirely by

NOCs

1993-1999: Pre-New Exploration Licensing Policy (NELP):

• NOC as licensee

• JV of NOC with private entities for carrying out E&P activities over a specified period in selected blocks which were bid out

1999-to date: NELP:

• Bidding for selected blocks carried out by Ministry

• NOC may or may not bid

• Can have private consortia carrying out E&P activities as per the Production Sharing Contract signed with

Government.

Production Sharing Contracts for E&P

• Revenue shared between bidder and Government

• Competent bidder agreeing to the work program and offering the highest revenue share wins bid

• Bid decision on highest revenue share to Govt. :

– Revenue after considering cost recovery for successful efforts

– Share of Government as per agreed investment multiple

• As net revenue increases IM increases and so does the share of Government revenue

3 Performance Audits published so far…

• PA of 1996 and its outcome in policy revision

– Based on audit recommendations decided:

• Fields discovered by NOCs will not be bid out by Government

• Anomalies in treatment of NOCs and JVs regarding price, royalty, cess etc. were corrected and a level playing field created in NELP.

• PA of 2005 was a follow up audit

Recent PA report on the subject in 2011

(Report 19 of 2011-12)

• Audit indicated that PSC appears to have an incentive to keep costs high and IMs low.

• Government actively considering shifting from cost recovery to revenue share model

• Audit noticed that exploration activities were being extended irregularly, costs of which may be loaded on the project reducing Government share

• Government has revised its policy by allowing exploration at later stages but with a framework for ring fencing such new discoveries and their costs

THANK YOU

Download