KRONOS – Catalogue of Indicators for Monitoring and Evaluation of

advertisement
KRONOS – Catalogue of Indicators for Monitoring and Evaluation of E-Government Policies
Instruction for use
Field
Definition
ID
Name
Editorial status
Definition
Description
Instructions and explanation
Unique identification number
Name of the indicator,
representing an unambiguous
identifier thereof
Automatically assigned
Please choose a name that is as short as possible and still useful as an
unambiguous identifier of the indicator. For example, name “Democracy
index” is ambiguous due to the fact that many different indicators of
democratic development of nations are being measured. On the other
hand, “EIU Democracy index” refers to a particular indicator defined and
measured by the Economist Intelligence Unit.
Upon adding a new indicator entry, its status is set to the lowest level of
a “draft”. The complete set of possible values (or editing levels) includes:
 Draft: the entry has not been reviewed by an editor yet;
 Reviewed: an editor has reviewed the entry;
 Editorial group reviewed: an editorial group has reviewed the entry;
 Validated: the entry has been approved by the editorial board;
 Revoked: the entry has been revoked from the catalogue.
Current editing level of the
indicator entry
Detailed self-contained definition
of the indicator
Note finally that only editors are allowed change the value of this field;
guests and registered users cannot change its value.
Please provide a self-contained definition of the indicator and be sure
that you clarify at least three relevant issues:
1. WHAT is being measured or evaluated by the indicator in terms of
the observed subject (e.g., country, organization, project, or
population) and/or observed property (e.g., ratio or costs);
2. HOW the values of the indicator are being measured or evaluated
(e.g., interview, direct observation/measurement or lookup in the
project documentation); and
3. WHY the indicator is being measured or evaluated (e.g., comparison
History
Brief history of the indicator
evolution, specifying references to
relevant sources
Author and/or
Commissioner
Entity that has introduced and/or
commissioned the first known
definition of the indicator
Measurements
Values type
Type of the indicator values:
qualitative or quantitative
between countries/organizations or to be used as a component of an
aggregated indicator).
Please use one or more of the following phrases:
 “Originating from“ followed by the name of the source indicator from
which this indicator has originated;
 “Introduced in” followed by the year of introduction for those
indicators that has already been defined and/or described in publicly
available sources (reports, articles or papers – please specify the
references to these sources);
 “Not available” for those indicators that has not been defined and/or
described in publicly available sources.
Specify here an entity (person, organization, project team) that has
defined, introduced, measured, and/or evaluated the indicator or
commissioned the (first) measurement of the indicator. If the person or
organization is not known, please indicate the fact by specifying a “Not
known” value.
Please choose one of the following two alternatives:
 Qualitative: for indicators with symbolic values; please also specify
this type where a numeric scale is being used to represent qualitative
or symbolic values, e.g., 0-changes are not present, 1-minimal
changes, 2-middle changes, 3-huge changes, and 4-radical changes; or
 Quantitative: for indicators with numeric values.
Scale type
Type of the indicator measurement Please choose one of the following two alternatives:
scale: continuous or discrete
 Continuous: most quantitative indicators have continuous scale;
 Discrete: all qualitative indicators have discrete scale; quantitative
indicators with a limited number of possible values also fall in this
category.
Scale description Measurement unit and domain of Please use one of the following phrases:
the indicator
 “Limited interval [lower, upper]” specifying the lower and upper limit
of the values range; for indicators with quantitative values and
continuous measurement scale that have a limited domain (range) of
possible values;
Methodology
Data sources
Measurement
history and
frequency
Link to
measurements
 “N-point scale” specifying the number N of possible values of the
indicator with qualitative values and discrete measurement scale;
please also provide a precise definition of each of the N possible
values, e.g., 5-point scale: 0-changes are not present, 1-minimal
changes, 2-middle changes, 3-huge changes, and 4-radical changes;
 “[a; b; c]”; for indicators with quantitative values and discrete
measurement scale, e.g. [0; 0.5; 1] specifies an indicator with three
possible numeric values of 0, 0.5 and 1.
Methodology used to measure or Please specify at least one of the following (multiple choice possible):
evaluate the indicator values
 Direct measurement or observation;
 Interview and/or survey;
 Expert judgment;
 Calculation from (Aggregation of) other indicators;
 Unknown (values obtained from secondary sources);
 Other, please briefly specify.
References to the data sources that Please specify at least one of the following (multiple choice possible):
has been used for measuring/
 Public national/international databases;
evaluating values of the indicator
 Proprietary databases;
 Accounting records;
 Project documentation;
 Reports of national/international entities;
 Publications (publicly available sources);
 Not available.
Year (and month) of the first
Please use one of the following phrases:
measurement or evaluation of the  “First measured in “ + (month) year; frequency, e.g. “First measured
indicator values and the frequency
in June 2012; monthly”, “First measured in 2010; yearly” or “First
of the consecutive measurements
measured in 2003; every second year”;
or evaluations
 “Only theoretical verification”; if the indicator has only been
proposed, defined and maybe also applied in a limited context, but
has not been (systematically) measured or evaluated yet.
Hyperlink to Web sites providing
Please specify a hyperlink that provides direct access to the measured or
access to the indicator measured/ evaluated values of the indicator (and not a hyperlink to a general Web
evaluated values
site of the organizational entity providing the access). Please use one of
the following phrases:
 “Free of charge at “ + hyperlink;
 “Chargeable at” + hyperlink;
 “Not publicly available”; if measured/evaluated values are not
accessible online.
Geographical
Countries or geographical areas,
This field is specific to the nation-wide indicators and specifies the
scope
where the indicator values have
geographical area of the countries, where the indicator has been
been measured or evaluated
measured or evaluated. Example values of the attribute include: worldwide, 70 countries world-wide, 20 Asian countries, EU countries, or
Nordic countries.
Measured subject Measured subject: WHAT is being Please specify at least one of the following (multiple choice possible):
measured or evaluated by the
 Country;
indicator
 Population;
 Household;
 Organization;
 Environment;
 Service and/or product;
 ICT infrastructure.
Measured
Measured property: WHAT is being Please specify at least one of the following (multiple choice possible):
property
measured or evaluated by the
 Percentage/Share/Proportion;
indicator
 Maturity;
 Quality;
 Capacity;
 Number;
 Quantity;
 Competitiveness;
 Usage;
 Degree;
 Level;
 Extent;
 Frequency.
Classification
Evaluation level
The level/scope of the indicator
measurement or evaluation: from a
narrow scope of a specific project
to a nation-wide level
Evaluation aspect General aspect of the indicator
measurement or evaluation
The value of this field corresponds to the scope of the measurement or
evaluation. The narrowest scope corresponds to the project-level
indicators (e.g., project costs or e-service maturity), while the widest
scope corresponds to territorial-administrative units (e.g., nation-wide
budget or average maturity of e-services at municipal level).
Please specify exactly one of the following:
 Project;
 Organization;
 Program;
 Sector policy;
 Territorial-administrative unit.
The value of this filed corresponds to the measurement or evaluation
aspect of the indicator, where we cluster the indicators in four classes.
The organizational class includes indicators focusing on organizations,
e.g., administrative burdens. Infrastructural class includes indicators
measuring or evaluation organizational or nation-wide infrastructure,
e.g., normative/legal barriers or availability/spread of ICT. Politicalsociological class includes (mostly nation-wide) indexes of democratic
development, transparency or corruption. Economic-sustainability class
includes (again, mostly nation-wide) indexes related to GDP, economic
welfare or competitiveness.
Please specify exactly one of the following:
 Economic and sustainability;
 Political and sociological;
 Infrastructural;
 Organizational.
Related Indicators
Aggregated from Pointer to the IDs of the indicators
in the catalogue from which the
values of this indicator are
Please specify here a list of other indicators in the catalogue from which
the values of the current indicator are being aggregated.
aggregated
Aggregation
formula
Other fields
References
Language
Comments
Editorial notes
Implemented as a multiple-choice drop-down menu with the catalogue
indicators’ IDs and names.
Formula used to aggregate the
Specify here a formula that is used to aggregate the values of the
values of the related indicators into indicators indicated in the list above (field Aggregated from), e.g., sum,
the value of the current indicator
average, or weighted average specifying the weights assigned to
individual indicators.
Detailed description of sources
Please format the references following the general APA style
(outside this catalogue) used in the recommendations.
other entry fields
Language of the indicator entry
At present two languages are being supported:
 English; and
 Slovenian.
Publicly available comments
Comments of the editors of the entry that are considered to be of
interest for general users of the catalogue. These are visible to all the
users; only catalogue editors are allowed to edit the value of this field.
Private notes
Working editorial notes written by contributors and editors, not visible
to general users of the catalogue.
Download