ITU Workshop on
“Smart Sustainable Cities in Latin America”
São Paulo, Brazil, 30 July 2013
Smart and sustainable cities:
The importance of indicators and metrics in
policymaking and policy assessment
Alexandre F. Barbosa, PhD
Manager, Regional Center for the Development of Information
Society – CETIC.br
barbosa.afb@nic.br
São Paulo, Brazil, 30 July 2013
Agenda
Part I: Challenges to policymaking
Part II: Importance of indicators and
metrics in policymaking and policy
assessment: key initiatives
Part III: Multistakeholder approach in
producing ICT4D statistics in Brazil
Part IV: Facts and figures about ICT
access by households and individuals in
Brazil
São Paulo, Brazil, 30 July 2013
2
Smart and Sustainable Cities
Implementing the SSC concept
Smart
Societies
I&KS
Public
Services
Environmental
Education
Energy
Management
SSC
ICT
Transport and
Mobility
Smart
Buildings
Waste
Management
Water
Management
Challenges for policymaking
3
Smart Sustainable Cities
Challenges to evidence-based policymaking
SSC
Impacts
Political
Agenda
ICT Policies
ICT
Policy
assessment
Framework
Indicators
and metrics
Social
Economic
Environmental
Quality and internationally
comparable data.
4
Smart Sustainable Cities
Challenges to evidence-based policymaking
How to design effective policies to address the
challenges posed by the implementation of the
concept of SSC?
Measurement matters: evidence-based !
Methodology matters !
São Paulo, Brazil, 30 July 2013
5
Importance of statistics in
policymaking and policy assessment
“Good policy requires
good statistics at different
stages of the
policymaking process.”
(Scott, 2005)
ICT-related
statistics
Survey data in
policymaking
São Paulo, Brazil, 30 July 2013
“The impact of policy can
be measured with good
statistics. If policy cannot
be measured it is not
good policy.”
(Othman, 2005)
Reliable
Policy relevant
Timely (to inform policy decisions)
Accessible to all key stakeholders
Cost-effective
Interdisciplinary enough to
address cross-cutting issues
6
ICT Survey Models
ICT core indicators
International common framework: methodology,
core indicators definition, questionnaire.
ICT Households and Individuals
ICT Enterprises
ICT E-Government
ICT in Education
ICT in Health
São Paulo, Brazil, 30 July 2013
7
Initiatives for measuring
environmental impacts
Defining concepts and indicators
e-Waste (WEEE - waste electrical and electronic
equipment)
e-Waste recycling
Green ICT
Green growth and sustainable development
São Paulo, Brazil, 30 July 2013
8
Sustainable Development Indicators
EU Sustainable Development Strategy
Themes:
Socio-economic development
The Sustainable
Development Indicators
(SDIs) are used to monitor
the EU Sustainable
Development Strategy (EU
SDS) in a report published
by Eurostat every two
years.
100 indicators.
11 indicators have been
identified as headline
indicators.
São Paulo, Brazil, 30 July 2013
Sustainable consumption and
production
Social inclusion
Demographic changes
Public health
Climate change and energy
Sustainable transport
Natural resources
Global partnership
Good governance
9
ICT4D statistics in Brazil
Multistakeholder approach
Brazilian Internet
Steering Committee
Brazilian Network
Information Center
Regional Centre of
Studies for the
Development of the
Information Society
Latin America and
Portuguese speaking
African countries
São Paulo, Brazil, 30 July 2013
10
ICT Surveys in Brazil
Monitoring Information Society’s priority areas
Annual ICT Surveys
since 2005:
National
Households
Survey
o ICT Households
o ICT Enterprises
2005
2006
…
2010
2011
2012
2013
o ICT Kids (5 – 9 years old)
o ICT Kids Online Brazil (9-16 years old)
o ICT in Education
o ICT in Health
o ICT Electronic Government
o ICT Lanhouses (Cybercafés)
o ICT Public Access Centers
o ICT in Non-Profit Organizations
o ICT Providers
Internet Sector Overview Report
o Quarterly report
São Paulo, Brazil, 30 July 2013
11
Engaging stakeholders
ICT survey process
Expert Group:
q Academic researchers
q
Government
2
1
ICT SURVEY
PLANNING
(Objectives, survey frame,
sample design, indicators,
questionnaire design)
qThird
q
sector
Research institutes
3
FIELD DATA
COLLECTION
Survey Procedures
Manual
Methodological
Report
(PAPI & CATI)
Collected data
(tables &
transcripts)
Raw data tables
4
DATA PROCESSING
(Data consolidation,
validation and coding)
Preliminary Data
Analysis Report
5
DATA ANALYSIS
AND DATA
PRESENTATION
DATA
DISSEMINATION
(ICT indicators and
historical data)
Publication (Analysis and ICT Indicators)
Book
Website CETIC.br
Data collection
instruments:
questionnaires,
interview scripts, etc.
São Paulo, Brazil, 30 July 2013
12
Engaging stakeholders
Data dissemination and use
1
2
ICT SURVEY
PLANNING
(Objectives, survey frame,
sample design, indicators,
questionnaire design)
3
FIELD DATA
COLLECTION
(PAPI & CATI)
4
DATA PROCESSING
(Data consolidation,
validation and coding)
5
DATA ANALYSIS
AND DATA
PRESENTATION
DATA
DISSEMINATION
(ICT indicators and
historical data)
Recipients
ICT Suvey
Projects
Data visualization tools
Dynamic tables
Government:
q Input for public policy
formulation and instrument
for policy evaluation
Academia:
q Academic research projects
Microdata base:
q SPSS
q Data dictionary
q Indicators construction syntax
São Paulo, Brazil, 30 July 2013
13
Pillars of CETIC’s survey process
Articulation of productive partnerships:
multistakeholder model
Government and
International
Organizations
58 organizations
“Good policy requires good
statistics at different stages of
the policymaking
process.” (Scott, 2005)
Academic
Organizations
“The impact of policy can be measured with good
statistics. If policy cannot be measured it is not good
policy.” (Othman, 2005)
185 experts
participate in the
survey process on a voluntary
basis.
São Paulo, Brazil, 30 July 2013
Non-profit
Organizations
14
Matrix of ICT survey’s stakeholders
Level of interest / insertion
São Paulo, Brazil, 30 July 2013
15
Matrix of relevance for ICT policies
Use of ICT survey data
São Paulo, Brazil, 30 July 2013
16
Policies based on ICT survey data
Relevance for ICT policies
2005







Policy design and monitoring
Tax Exemption Program for
Computers (Computer for All
Program)
Broadband National Plan
Low Cost Broadband Program (1Mbps
at USD 15)
Act 12.715/2012: Tax exemption for
telecom services in rural areas
Broadband for Rural Areas Program
(450 MHz-2014)
Smart Cities
Telecentres
São Paulo, Brazil, 30 July 2013







2013
Tax Exemption Programs
(Internet and smartphone)
Proinfo (Computer Labs in
public schools)
Broadband in Schools
Program
UCA (one laptop per child
program)
E-Gov Action Plan
ICT Skills development
programs
ICT impact assessment in
the health sector
17
Brazil
Facts and Figures
Population: 195 million
85% living in urban area
IBGE PNAD 2011
GDP/capita: USD11,640
Trading Economics / The World Bank 2011
8th largest ccTLD: 3.3 million
NIC.br Jul/2013
81 million Internet users
CGI.br, ICT Households Survey 2012
São Paulo, Brazil, 30 July 2013
5th largest territory in the world
Worldatlas.com 2013
GDP: USD 2.5 Trillion
Trading Economics / The World Bank 2011
5,565 municipalities
IBGE Census 2010
40% HH with Internet access
CGI.br, ICT Households Survey 2012
18
Brazil
ICT access by households and individuals
Computer (% Households with computer)
CGI.br ICT Households Survey 2012
100
80
60
40
20
28
8
36
39
47
51
14
15
Urbana
Rural
12
12
28.1 Million HH with computer
24.3 Million HH with Internet
80.9 Million Internet users (*)
(*) 10-year-old or older
0
2008
2009
2010
2011
2012
Internet (% Households with Internet access)
(% HH with Internet access by SES)
CGI.br ICT Households Survey 2012
100
100
80
80
58
60
40
20
91
40
20
4
27
6
6
8
10
0
2008
2009
2010
São Paulo, Brazil, 30 July 2013
2011
2012
90
64
65
97
73
97
78
A
60
44
31
90
Urbana
Rural
33
40
20
36
21
24
1
3
3
4
6
2008
2009
2010
2011
2012
16
B
C
DE
0
19
Thank you !
ICT surveys available for download at
www.cetic.br/publicacoes
São Paulo, Brazil, 30 July 2013
20