Biodiversity Fund Program MERI Plan

advertisement
Biodiversity Fund Program Monitoring Evaluation, Reporting and
Improvement (MERI) Plan
1. About this document
This Biodiversity Fund Program Monitoring, Evaluation, Reporting and Improvement (MERI) Plan has been
developed as part of the Australian Government’s responsibilities set out in the Monitoring Evaluation Reporting
and Improvement Strategy – Caring for our Country and Biodiversity Fund. This plan details how the success of the
program will be determined, through a range of MERI approaches. The plan has been developed to reflect the
principles and processes established in the MERI Strategy. The purpose of this plan is to:

Establish a set of Key Performance Indicators and Key Evaluation Questions that frame how program
outputs and outcomes will be measured.

Establish a basis for the design and implementation of ‘fit-for-purpose’ monitoring and evaluation activities
to garner evidence of program progress and achievements.

Outline public reporting processes.
The plan contains the following:

A simple Program Logic, providing a succinct depiction of the program and the elements which will be
monitored.

A set of high level assumptions and a corresponding set of Key Performance Indicators which will frame
monitoring and evaluation activities;

Key Evaluation Questions, which will be answered in order to assess progress and achievements against the
Five Year Outcomes

A set of Standard Project Measures that will be reported by Funding Recipients
This Program MERI Plan is for the Biodiversity Fund only. Similar plans have also been prepared for the Sustainable
Agriculture Steam of Caring for our Country.
2. Background
The Biodiversity Fund is part of the $1.7 billion Land Sector Package established under the Australian Government’s
Clean Energy Future plan. It is designed to help land managers establish, manage and improve the condition of
native vegetation on their land as well as reduce the effects of climate change by improving landscape resilience,
increasing stores of carbon and reducing greenhouse gases. The Biodiversity Fund:

Is an ongoing program that will provide $946.2 million over its first six years to support land managers to
undertake projects that establish, restore, protect or manage biodiverse carbon stores;

Creates an unprecedented opportunity to establish and manage biodiversity throughout Australia’s unique
landscapes and in the process develop new market opportunities for ecosystem services;

Will improve the resilience of Australia’s unique species to the impacts of climate change, enhance the
environmental outcomes of carbon farming projects, and help land managers protect carbon and biodiversity
values on their land; and

Will support projects that reduce Australia’s carbon pollution and improve the resilience of our ecosystems to
the impacts of climate change.
The Government will do this by investing in activities that establish, restore and manage biodiverse carbon stores
throughout Australia.
The MERI Strategy – Caring for our Country and Biodiversity Fund reaffirms the Australian Government’s
commitment to monitoring evaluating and reporting on the progress and outcomes of its Natural Resource
Management and Biodiversity Conservation investments. Specifically it commits the Australian Government. The
schematic below depict how this Program MERI Plan aligns with Project MERI plans developed by Funding
Recipients:
Project MERI Plans
Ensures funding recipients collect and
report data about their project
Project
Data & Info
Program MERI Plans
Ensures the Australian Government collects
and report data about the program
Program
Data & Info
Publicly available data and information about individual projects and program
outcomes (including against five year outcomes
3. Program Logic
As set out in the MERI Strategy, a Program Logic is a useful way to depict the structure and logic of a project or program.
The program logic describes the overall linkages between funded activities, project outputs, medium-term project outcomes and long term program outcomes. It therefore shows the anticipated cause-and-effect relationships between program
activities and outcomes.
Based on the Program Logic, a set of high level assumptions about the project have been identified. See 4 below
SEWPaC Outcome 1
Conservation and protection of Australia’s biodiversity and ecosystems
Landsector package goal
Ensure carbon vegetation is biodiverse
Biodiversity Fund goals
Program long-term outcomes
Project long-term
outcomes
Project mediumterm outcomes
The extent of native
habitats in fragmented
landscapes is expanded
Carbon is biosequestered and stored
Invasive species are
managed in a
connected landscape
Biodiverse carbon plantings
and vegetation survive and
exist in the landscape
Activities
Existing carbon stores
in high value areas are
managed
Improved connections between
remnant vegetation in a
fragmented landscape
Stakeholder capacity
improved
Sites link up remnant vegetation
(including wetlands
Vegetation planted is still alive
Existing pressures (invasive species)
are reduced
are reduced
Vegetation planted is alive
Vegetation is planted
Invasive species are managed/removed
Site preparation
Improved availability
of seedlings, seed and
storage
Well functioning native
ecosystems established
Invasive species are reduced
Restoration activities
Existing native vegetation condition
that has high conservation value is
protected, managed and enhanced
Connections between remnant
vegetation in fragmented
landscape improved
Well functioning native
ecosystems connected
Well functioning native ecosystems
protected, managed, enhanced
New invasive species restricted
Project short-term
outcomes
Build connectivity and resilience in the landscape
Restoration and management of biodiverse carbon stores
Revegetation activities
Risk management
Invasive species
management activities
Fire management activities
Project administration
Enabling technologies and
systems established (eg
creation of reliable seed source
and seedling stock)
Support land managers to
protect carbon and
biodiversity values, and
control the spread of invasive
species through connected
landscapes
4. Assumptions
The program logic and achievement of the Land Sector Package Goal, Biodiversity Fund Goals and Landscape scale
long-term outcomes is underpinned by a number of assumptions. The table below identifies some key, high level
assumptions which will help inform monitoring and evaluation approaches.
Table 1: Program logic assumptions
#
Assumption
Confidence it is
correct
Achievement of the program goals will
result in improvement in biodiversity
Moderate
1
The program has public and political
support
Moderate
2
3
Achievement of program activities will
result in increased resilience of ecosystems
to climate change
Moderate
Evidence

Scientific research

Past programs

Past programs

Different political opinions

Conflicting land use

Scientific research

Past programs

Adaptive management

Can be difficult to detect

Measureable

Theory correct
Consequence if the
assumption is wrong
Low
Very high
Low
Achievement of program activities will
result in increased carbon stored
High
4
High
Planting vegetation contributes to selfsustaining vegetation communities
Moderate
5

Different for different
vegetation communities
and landscape conditions
We can measure program goals (extent,
condition, connectivity, carbon) enough to
tell a good story
High
6

Past studies

Appropriate program
design based on principles
There is a shared and agreed view of what
a connected landscape is
High

BF program design team
working closely with M&R
team
Moderate
7
8
Managing invasive species will directly
assist / lead to vegetation condition
improvement
High (project scale)

Past projects and programs
Low
Connectivity between habitats allows
species to have resilience to climate
change
Moderate

Moderate
Past projects and programs
Low
10
The program considers and manages risks,
including those associated with climate
change


Varies according to
species
Research
Low
9
Biodiversity Fund will lead to positive
carbon farming initiatives
Low
Low
12
Other land management does not limit the
biodiversity outcomes desired through the
fund
Never been done before
Untested, untried
Limited research
Different levels of
confidence in different
rainfall areas
Past experience
High
11
Low
Very high
L (landscape scale)





Low – Moderate
5. Monitoring
Biodiversity Fund monitoring will focus on four elements common across the Biodiversity Fund and related policies,
programs and agendas. These are: habitat extent; condition; connectivity; and, management of threats.
There are three complementary monitoring components:

Monitoring by funding recipients

Targeted on-ground scientific monitoring managed by the Department

Broad scale monitoring using remote sensing technology managed by the Department
Data collected will, where possible, be publicly available and link to other national policies, programs, agendas and
reporting.
Monitoring by funding recipients
Funding recipients are responsible for monitoring at the project level and their requirements are identified in their
contractual agreements with the Australian Government. Their monitoring will move beyond compliance to include
information about outcomes and on-ground change resulting from project activities as this becomes evident over
time. Monitoring and reporting tools, templates and guidance will be provided by the Department including the
NRM MERI framework1, Program Logic user guide2, MERI plan template3 and an Ecological Monitoring Guide4.
Table 1 outlines simple questions that recipients’ will address through their monitoring. These questions are linked
to the project-scale, long-term outcomes in the program logic and relate specifically to each of the program logic
landscape-scale, long-term outcomes and Biodiversity Fund Themes.
Funding recipients will only answer questions related to the Biodiversity Fund Themes against which they are
funded. The amount and intensity of on-ground monitoring will depend on project value. Projects are divided into
($500,000 and less) and (more than $500,000). All projects, with the exception of Biodiversity Fund Round 1
projects, with approved Funds greater than or equal to $500,000 (GST exclusive) are required to collect ecological
monitoring data and report the data collected to the department. This data can be collected using one of the
following recognised methods, the department may add additional methodologies to this list:






Habitat Hectares
BioMetric: Terrestrial Biodiversity Tool
BioCondition
TasVeg: Tasmanian Vegetation Condition Assessment Method
Bushland Condition Monitoring
Native Vegetation Condition Assessment & Monitoring for WA
If you do not intend to use one of these listed monitoring methods, you must then collect and report ecological
monitoring data to the department in accordance with the department’s Biodiversity Fund Ecological Monitoring
Guide4.
1
Commonwealth of Australia 2009. Australian Government Natural Resource Management Monitoring Evaluation Reporting and Improvement
Framework.
2
Commonwealth of Australia 2009. Developing and Using Program Logic in Natural Resource Management
3
Commonwealth of Australia MERI plan template for Caring for our Country Projects.
4
Developed by the Department using the Ecological Australia 2012. Abridged Field Guide for Assessing Vegetation Change: A Guide for Caring for our Country
Projects.
Ecological Australia 2012. Standard Field Guide for Assessing Vegetation Change: A Guide for Caring for our Country Projects.
Targeted on-ground scientific monitoring
The Department will select a sample of projects for on-ground scientific monitoring over the life of the Biodiversity
Fund.
External experts will be engaged to measure trend changes in vegetation condition and connectivity resulting from
Biodiversity Fund investments in the selected projects.
The data collected will support project monitoring data, provide credible scientific data and help the Department
monitor, evaluate and report progress and achievements against landscape-scale, long-term outcomes and relate
specifically to the Program’s long-term goals.
A comprehensive methodology, developed by the Australian Government for Measuring Change in Vegetation
Condition will guide Biodiversity Fund on-ground scientific monitoring5.
Remote sensing monitoring
The Department will organise and manage broad, landscape-scale monitoring using remote sensing technologies to
support project and on-ground scientific monitoring over the life of the Biodiversity Fund.
The Department’s Environmental Resources Information Network (ERIN) will develop and manage the remote
sensing component mainly to measure trend changes in vegetation extent and connectivity against the Program’s
long term outcomes and goals.
Data storage and management
Responsibility for data storage and management lies with the Department.
Biodiversity Fund Project Case Managers will collect and store compliance data from project financial and
performance reporting against contractual agreements with the Australian Government in the Department’s Grant
Management System (GMS).
Department work areas responsible for Biodiversity Fund monitoring and reporting will collect and store in a data
base separate from but linked to the GMS, data from:



5
project monitoring of on-ground change resulting from project activities;
targeted on-ground scientific monitoring; and
remote sensing monitoring.
Ecological Australia 2012. Measuring Change in Vegetation Condition: A Nationally Consistent Methodology for
Caring for our Country Projects
6. Evaluation
Unlike monitoring, evaluation will happen at specific times during the life of the program and the Department will
organise a mid-term evaluation and end-of-program review.
Table 1 below shows Key Performance Indicators (KPIs) and Key Evaluation Questions (KEQs) that have been
developed to guide evaluation and provide structure for the scope of enquiry through the framework. The KEQs
intend to address three broad categories.
Impact:
The evaluation of the contribution the Biodiversity Fund to its expected long term outcomes.
This includes an evaluation of unanticipated outcomes.
Appropriateness:
The evaluation of whether the activities or actions of the Biodiversity Fund were the best
activities to achieve the outcomes. This may include analysis of whether there were other
options that could have been more effective.
Efficiency:
An assessment of the value of the Biodiversity Fund in terms of cost, time and effectiveness
of processes. It may include what could be done to improve the implementation of the Fund.
Note: Effectiveness is not a separate evaluation category because no targets have been specified for the Biodiversity
fund against which to measure effectiveness.
Table 1: Key Performance Indicators and Outcome Evaluation Questions
Objective(s)
Key evaluation questions
Key performance indicators
Administration (Annual)
Administration (Annual)
Annual
To efficiently and effectively develop
and implement the Biodiversity Fund in
line with best practice government
policy and administrative processes
How are requirements of CCA Act being met in terms of LSCBB
reporting on Land Sector Package implementation?
 LSCBB Annual Report tabled annually in
Parliament.
Were the guidelines developed and implemented in
accordance with government policy and administrative
governance requirements?
 Grant guidelines approved by Minister.
 Central governmental agency consultation on
and approval of guidelines.
KPI source data
 Report to be tabled by 30
October each year.
 Biodiversity Fund program
data
 Program risks identified and being managed.
Have payments of funds been managed in accordance with
government and departmental administrative requirements?
 Program - grant management and finance
system data and project files up to date.
 Per cent of projects on track against deed.
 Payments made within 30 days of receipt of
correctly rendered invoice.
 Round successful with allocated budget fully
committed and projects funded for each of the
specified priorities
Did the promotion of the round reach the intended audiences
as defined in the program guidelines?
 Analysis of application numbers, funding
sought, regional coverage and types against
intended audiences per grant round.
 The number /per cent of recipients reporting
satisfaction with the program.
Has an ecological monitoring and analysis methodological
framework, been developed and agreed by the Department?

Agreed ecological monitoring and analysis
framework in place.
 Biodiversity Fund program
and monitoring information

Project and program data has been used to
evaluate the appropriateness, effectiveness,
efficiency, and impact of the program

To complete a program evaluation in
line with Commonwealth grant
requirements
Has an evaluation of the appropriateness, effectiveness,
efficiency, and impact of the Biodiversity Fund been
undertaken in line with Commonwealth grant guidelines and
ANAO ‘Implementing Better Practice Grants Administration’
guidelines?
Biodiversity Fund program
and monitoring
information

Data and lessons learned are publicly reported
Annual
Annual
Annual reporting

Annual project reporting
Biodiversity Fund invests in restoration,
revegetation and management of
invasive species
How many hectares of restoration, revegetation and
management of invasive species has the biodiversity fund
invested in?

Administration (Year 2 of program)
An ecological monitoring and analysis
framework is agreed by the Department
Administration (End of program)
The number of hectares of investment in
— Restoration
— Revegetation
— Management of invasive species
Program implementation objectives
(Year 1-10)

The restoration and management of
biodiverse carbon stores, and increasing
the connectivity and resilience of the
landscape through the following subobjectives
Enhancing and protecting biodiverse
carbon stores
Annual (every year the fund operates)
Annual
How many Biodiversity Fund projects are also participating in
the CFI?

Number of projects

Carbon amount of newly planted areas
How many Biodiversity Fund projects have indicated they may
participate in the CFI?
How much carbon has been newly sequestered through
Biodiversity Fund plantings?
For the land under management through Biodiversity Fund
projects what is the total carbon preserved?
 Biodiversity Fund program
and monitoring
information
 CFI information
Increasing the extent of native
vegetation
Improving connectivity between native
vegetation remnants
Enhancing and protecting the condition
of native vegetation
Managing invasive species threat to
biodiversity in a connected landscape
Baseline reporting – Year 1 of investment
Baseline reporting – Year 1 of investment
What is the baseline extent of native vegetation on
Biodiversity Fund project sites?

Medium to long-term (2-10 years)
Medium to long-term
What is the net increase in native vegetation extent
through Biodiversity Fund projects?

Number of hectares of vegetation extent
increased through Biodiversity Fund projects.

Average survivability of tube stock

Average survivability of seed stock
Number of hectares of native vegetation
Baseline reporting – Year 1 of investment
Baseline reporting – Year 1 of investment
How many projects have identified increased
connectivity as an aim of their projects?

Medium to long-term (2- 10 years)
Medium to long-term
How many projects (that identified increased
connectivity as an aim) have succeeded in
increasing connectivity between native vegetation
remnants?

Baseline reporting – Year 1 of investment

Number of projects
Number of revegetation projects conducted
on sites adjoining remnant vegetation,
particularly conservation assets such as parks,
reserves or wetlands.
Successful Applications

Audit of successful applications

Recipient reporting

Biodiversity Fund scientific
monitoring

Remote sensing

Successful Applications

Biodiversity Fund Scientific
Monitoring

Remote sensing

Recipient reporting

Spatial connectivity index (using
NVIS, National Carbon Accounting
System etc)

Biodiversity Fund Scientific
Monitoring

Recipient reporting

Application form

Biodiversity Fund Scientific
Monitoring

Recipient reporting

Successful applications

Biodiversity Fund Scientific
monitoring

Project reports
Baseline reporting – Year 1 of investment
What is the baseline condition of the project area?
[category or other classification of condition to be
determined through recipient reporting or scientific
monitoring]

Medium to long-term (2- 10 years)
Medium to long-term
How many projects have succeeded in enhancing
and protecting the condition of native vegetation?

The percentage of projects that improved
condition.

The percentage of projects that maintained
condition.

The percentage of projects that lost condition.
The number of hectares or sites within
Vegetation Assets, States, and Transitions
(VAST) condition category (or other
classification scheme).
Baseline reporting – Year 1 of investment
Baseline reporting – Year 1 of investment
How many projects are managing invasive species?

Medium to long-term (2- 10 years)
Medium to long-term

Have the projects been successful in managing
invasive species?

The number of projects that are managing
invasive species
The percentage of identified projects that
have been successful in managing invasive
species.
7. Reporting and Improvement
The data and information collected and analysed for each outcome (investment) area of the program will be reported publicly. Data and information will be made available
online, as it becomes available. This will include individual and aggregated project data, and any other data collected by SEWPaC. To determine the effectiveness, impact,
efficiency and appropriateness of the program, SEWPaC will coordinate two broad evaluations (a mid-term and end of program evaluation), which will collate and assess all
available data. As data and information on individual projects and the program as a whole becomes available, including through mid-term evaluations, the department will
consider areas where improvements to investments can be made, and modify priorities and program delivery accordingly.
The table below outlines the key reports to be delivered as part of this MERI plan.
Table 2: Program Reporting
Report type
Online Reporting
Purpose
To provide comprehensive
and searchable data and
information about individual
projects and the program as a
whole.




Results
Program highlights
Case studies
Status of monitoring and evaluation activities
Department annual
reports for the Land
Sector Carbon and
Biodiversity Board
(LSCBB) and SEWPaC
To demonstrate
accountability and report
progress, outcomes and
achievements.




Annual results in dot point format
Annual program highlights in dot point format
Case studies
Status of monitoring and evaluation activities.
Department program
updates
Brief updates in the form of
newsletters following to
improve transparency and
communication.




Information about activities funded
Program progress and achievements
Highlights and case studies
What is coming up in the program
Department MidTerm Evaluation
report
To report on progress towards
the impact, efficiency,
appropriateness and lessons
learned of the program.
To report on the impact,
efficiency, appropriateness
and lessons learned of the
program.



Findings against the Key Evaluation Questions
Recommendations
Lessons learned
Department End-ofProgram Review
report
Content
 Findings against the Key Evaluation Questions
 Recommendations
 Lessons learned
Attachment 1: Standard Project Measures related to the Biodiversity Fund Program Logic
Outcome level
Activity / outcome
Indicative measures
Scale
Data source
Biodiversity Fund
activities
Site preparation
Area of site
Project
Project recipients
Enabling technologies
and systems
Number of new technologies
and systems developed
Project
Project plan
Project
Project recipients
Project
Project recipients
Number of people engaged
Fire management
Hectares burnt
Hectares managed through
fire
Invasive species
management
Hectares targeted for
invasive weed treatment
Project Plans
Mid-Year Reports
Annual Reports
Project finalisation reports
Revegetation
Area revegetated
Project
Project recipients
Number of plants planted
Project Plans
Diversity of species planted
Mid-Year Reports
Annual Reports
Project finalisation reports
Restoration
Area restored
Project
Project recipients
Number of plants planted
Project Plans
Diversity of species planted
Mid-Year Reports
Annual Reports
Project finalisation reports
Support land managers
to protect carbon and
biodiversity values
Number of grant recipients
Number of grant recipients
that have not previously
received NRM funding
Project
Project recipients
Project Plans
Mid-Year Reports
Annual Reports
Project finalisation reports
Biodiversity Fund
project scale
short term
outcomes
Invasive species are
managed
Amount of invasive plant
material removed/destroyed
Project
Project reports
Project
Project reports
Number of pest animals
removed/destroyed
Number of invasive species
targeted
Invasive species are
reduced
Area of land effectively
managed for invasives
Number of invasive species
recruited at target area
Biodiversity Fund
project scale
medium term
outcomes
Vegetation is planted
Number of plants planted
Project
Project reports
Vegetation planted is
alive
Survival rate of plantings
Project
Project reports
Partnerships facilitated
to deliver large scale
biodiverse plantings
Number of grant recipients
Project
Vegetation planted is still
alive
Survival rate of plantings
Project
Project reports
Existing pressures
(invasive species) are
reduced
Area
Project
Project reports
New invasives are
restricted
Area
Project
Project reports
Sites link up remnant
vegetation (including
wetlands)
Area
Project
Project reports
Well-functioning native
ecosystems established
Condition indicator
Project
Project reports
Well-functioning native
ecosystems connected
Connectivity indicator
Project
Project reports
Number of grant recipients
that have not previously
received NRM funding
Number of new species
Connectivity indicator
GIS
Remote sensing
GIS
Remote sensing
Biodiversity Fund
project scale long
term outcomes
Well-functioning native
ecosystems protected,
managed enhanced
Condition indicator
Improved connections
between remnant
vegetation in a
fragmented landscape
Connectivity indicator
Improved availability of
seedlings, seeds and
storage
Number of projects with
nursery/production
component
Project
Project reports
Project
Project reports
Agreed ongoing management
GIS
Remote sensing
Project
Project reports
Seed/seedling outputs
Existing biodiverse
carbon stores in high
value areas are managed
Agreed ongoing management
Project
Project reports
Biodiverse carbon
plantings and
revegetation survive and
exist in the landscape
Survival rate of plantings
Project
Project reports
Invasive species are
managed in a connected
landscape
Area
Project
Project reports
Stakeholder capacity
improved
Number of grant recipients
Condition
Number of new species
GIS
Remote sensing
Number of grant recipients
that have not previously
received NRM funding
Download