KRONOS – Catalogue of Indicators for Monitoring and Evaluation of E-Government Policies Instruction for use Field Definition ID Name Editorial status Definition Description Instructions and explanation Unique identification number Name of the indicator, representing an unambiguous identifier thereof Automatically assigned Please choose a name that is as short as possible and still useful as an unambiguous identifier of the indicator. For example, name “Democracy index” is ambiguous due to the fact that many different indicators of democratic development of nations are being measured. On the other hand, “EIU Democracy index” refers to a particular indicator defined and measured by the Economist Intelligence Unit. Upon adding a new indicator entry, its status is set to the lowest level of a “draft”. The complete set of possible values (or editing levels) includes: Draft: the entry has not been reviewed by an editor yet; Reviewed: an editor has reviewed the entry; Editorial group reviewed: an editorial group has reviewed the entry; Validated: the entry has been approved by the editorial board; Revoked: the entry has been revoked from the catalogue. Current editing level of the indicator entry Detailed self-contained definition of the indicator Note finally that only editors are allowed change the value of this field; guests and registered users cannot change its value. Please provide a self-contained definition of the indicator and be sure that you clarify at least three relevant issues: 1. WHAT is being measured or evaluated by the indicator in terms of the observed subject (e.g., country, organization, project, or population) and/or observed property (e.g., ratio or costs); 2. HOW the values of the indicator are being measured or evaluated (e.g., interview, direct observation/measurement or lookup in the project documentation); and 3. WHY the indicator is being measured or evaluated (e.g., comparison History Brief history of the indicator evolution, specifying references to relevant sources Author and/or Commissioner Entity that has introduced and/or commissioned the first known definition of the indicator Measurements Values type Type of the indicator values: qualitative or quantitative between countries/organizations or to be used as a component of an aggregated indicator). Please use one or more of the following phrases: “Originating from“ followed by the name of the source indicator from which this indicator has originated; “Introduced in” followed by the year of introduction for those indicators that has already been defined and/or described in publicly available sources (reports, articles or papers – please specify the references to these sources); “Not available” for those indicators that has not been defined and/or described in publicly available sources. Specify here an entity (person, organization, project team) that has defined, introduced, measured, and/or evaluated the indicator or commissioned the (first) measurement of the indicator. If the person or organization is not known, please indicate the fact by specifying a “Not known” value. Please choose one of the following two alternatives: Qualitative: for indicators with symbolic values; please also specify this type where a numeric scale is being used to represent qualitative or symbolic values, e.g., 0-changes are not present, 1-minimal changes, 2-middle changes, 3-huge changes, and 4-radical changes; or Quantitative: for indicators with numeric values. Scale type Type of the indicator measurement Please choose one of the following two alternatives: scale: continuous or discrete Continuous: most quantitative indicators have continuous scale; Discrete: all qualitative indicators have discrete scale; quantitative indicators with a limited number of possible values also fall in this category. Scale description Measurement unit and domain of Please use one of the following phrases: the indicator “Limited interval [lower, upper]” specifying the lower and upper limit of the values range; for indicators with quantitative values and continuous measurement scale that have a limited domain (range) of possible values; Methodology Data sources Measurement history and frequency Link to measurements “N-point scale” specifying the number N of possible values of the indicator with qualitative values and discrete measurement scale; please also provide a precise definition of each of the N possible values, e.g., 5-point scale: 0-changes are not present, 1-minimal changes, 2-middle changes, 3-huge changes, and 4-radical changes; “[a; b; c]”; for indicators with quantitative values and discrete measurement scale, e.g. [0; 0.5; 1] specifies an indicator with three possible numeric values of 0, 0.5 and 1. Methodology used to measure or Please specify at least one of the following (multiple choice possible): evaluate the indicator values Direct measurement or observation; Interview and/or survey; Expert judgment; Calculation from (Aggregation of) other indicators; Unknown (values obtained from secondary sources); Other, please briefly specify. References to the data sources that Please specify at least one of the following (multiple choice possible): has been used for measuring/ Public national/international databases; evaluating values of the indicator Proprietary databases; Accounting records; Project documentation; Reports of national/international entities; Publications (publicly available sources); Not available. Year (and month) of the first Please use one of the following phrases: measurement or evaluation of the “First measured in “ + (month) year; frequency, e.g. “First measured indicator values and the frequency in June 2012; monthly”, “First measured in 2010; yearly” or “First of the consecutive measurements measured in 2003; every second year”; or evaluations “Only theoretical verification”; if the indicator has only been proposed, defined and maybe also applied in a limited context, but has not been (systematically) measured or evaluated yet. Hyperlink to Web sites providing Please specify a hyperlink that provides direct access to the measured or access to the indicator measured/ evaluated values of the indicator (and not a hyperlink to a general Web evaluated values site of the organizational entity providing the access). Please use one of the following phrases: “Free of charge at “ + hyperlink; “Chargeable at” + hyperlink; “Not publicly available”; if measured/evaluated values are not accessible online. Geographical Countries or geographical areas, This field is specific to the nation-wide indicators and specifies the scope where the indicator values have geographical area of the countries, where the indicator has been been measured or evaluated measured or evaluated. Example values of the attribute include: worldwide, 70 countries world-wide, 20 Asian countries, EU countries, or Nordic countries. Measured subject Measured subject: WHAT is being Please specify at least one of the following (multiple choice possible): measured or evaluated by the Country; indicator Population; Household; Organization; Environment; Service and/or product; ICT infrastructure. Measured Measured property: WHAT is being Please specify at least one of the following (multiple choice possible): property measured or evaluated by the Percentage/Share/Proportion; indicator Maturity; Quality; Capacity; Number; Quantity; Competitiveness; Usage; Degree; Level; Extent; Frequency. Classification Evaluation level The level/scope of the indicator measurement or evaluation: from a narrow scope of a specific project to a nation-wide level Evaluation aspect General aspect of the indicator measurement or evaluation The value of this field corresponds to the scope of the measurement or evaluation. The narrowest scope corresponds to the project-level indicators (e.g., project costs or e-service maturity), while the widest scope corresponds to territorial-administrative units (e.g., nation-wide budget or average maturity of e-services at municipal level). Please specify exactly one of the following: Project; Organization; Program; Sector policy; Territorial-administrative unit. The value of this filed corresponds to the measurement or evaluation aspect of the indicator, where we cluster the indicators in four classes. The organizational class includes indicators focusing on organizations, e.g., administrative burdens. Infrastructural class includes indicators measuring or evaluation organizational or nation-wide infrastructure, e.g., normative/legal barriers or availability/spread of ICT. Politicalsociological class includes (mostly nation-wide) indexes of democratic development, transparency or corruption. Economic-sustainability class includes (again, mostly nation-wide) indexes related to GDP, economic welfare or competitiveness. Please specify exactly one of the following: Economic and sustainability; Political and sociological; Infrastructural; Organizational. Related Indicators Aggregated from Pointer to the IDs of the indicators in the catalogue from which the values of this indicator are Please specify here a list of other indicators in the catalogue from which the values of the current indicator are being aggregated. aggregated Aggregation formula Other fields References Language Comments Editorial notes Implemented as a multiple-choice drop-down menu with the catalogue indicators’ IDs and names. Formula used to aggregate the Specify here a formula that is used to aggregate the values of the values of the related indicators into indicators indicated in the list above (field Aggregated from), e.g., sum, the value of the current indicator average, or weighted average specifying the weights assigned to individual indicators. Detailed description of sources Please format the references following the general APA style (outside this catalogue) used in the recommendations. other entry fields Language of the indicator entry At present two languages are being supported: English; and Slovenian. Publicly available comments Comments of the editors of the entry that are considered to be of interest for general users of the catalogue. These are visible to all the users; only catalogue editors are allowed to edit the value of this field. Private notes Working editorial notes written by contributors and editors, not visible to general users of the catalogue.