Open Data, Policy, and Promise:
The Big Picture
Joel.Gurin@gmail.com
Connecticut Data Collaborative Forum, 3/3/14
1
Different Approaches to Data
2
The GovLab’s Central Hypothesis
When governments and institutions
open themselves to diverse
participation and collaborative
problem-solving, and partner with
citizens to make decisions, they are
more effective and legitimate.
Three Paradigms Using Data in Different Ways
To achieve collaborative democracy, we must open up how
government institutions work. We study three paradigms:
1. Sharing Responsibility
2. Getting Knowledge and Expertise In
3. Getting Open Data Out
Sharing Responsibility
• Participatory Budgeting: A 1500-city movement
• Pulse Point: “Enabling Citizen Superheroes”
5
Getting Knowledge In: Wired Cities
6
Getting Knowledge In: Public Sentiment
DC’s Experiment: A City Report Card
Washington Mayor Vincent Gray
7
The Third Paradigm: Open Data
Open Data: Accessible, public data that
people, companies, and organizations
can use to launch new ventures, analyze
patterns and trends, make data-driven
decisions, and solve complex problems.
8
Defining Open Data
What Open Data Isn’t
• Big Data ≠ Open Data ≠ Open Government
• Big Data: Really, really big datasets
• Open Government: Transparency,
participation, collaboration – with or without
data
9
Defining Open Data
10
Defining Open Data
Open Data Changes the World For:
•
•
•
•
•
•
•
Entrepreneurs
Established businesses
Governments
Investors
Scientists
Journalists
Consumers
11
Liberating Government Data:
Federal, City, and State
Liberating Federal Data
Open Data Becomes a Priority
[Open Data is] going to help launch more
businesses. . . . It’s going to help more
entrepreneurs come up with products and
services that we haven’t even imagined yet.
President Barack Obama
13
Liberating Federal Data
The New Open Data Policy
•
•
•
•
•
“Presumption of openness”
Machine-readable
Reusable
Timely
Developed with consultation
14
Liberating Federal Data
They Agree On – The DATA Act
15
City Data: For Transparency and Development
•
•
•
•
Metro Chicago Data
New York: The Mayor’s Geek Squad
Code for Philly
Palo Alto’s open finances
16
City Data: Next Bus for Commuters
City Data for Government Accountability
Socrata: Moving from Cities to States
19
20
21
Governor Malloy’s Executive Order 39: The CT Open Data Portal
The Governor explained that the purpose of the order is to
display data in its rawest form, before it has been aggregated
and analyzed.
“Sharing data collected by state government will help to break
down silos within government, make data more easily
available for analysis by researchers and entrepreneurs, and in
turn help spur economic growth and creative new policy,” said
Governor Malloy. “This data belongs to the people of
Connecticut, and this initiative will help make that data more
easily and conveniently accessible to them.”
22
23
State Data for Policy: Measuring Progress and Success
24
Visualizing Data for Impact
25
Education: How Parents Search for Metrics
Bill Jackson, CEO
26
Data and Disclosure:
Consumer Choice, Consumer Protection
Disclosure as “Light-Touch” Regulation
Cass Sunstein, Harvard Law School
28
Consumer Information Shapes Markets
29
Consumer Information Shapes Markets
Dara O’Rourke, Founder/CEO
30
Consumer Protection Through Open Data
Courtney Powell and A.J. Fouty, cofounders
31
Consumer Protection Through Open Data
32
Consumer Protection Through Open Data
33
Consumer Protection Through Open Data
34
Open Data Drives Business Growth
Driving Business Growth in All Sectors
Health
Education
Financial Services
Energy Use
Transportation
36
Business Growth: Agriculture
From Weather Prediction to Green Revolution
Climate Corporation offices in San Francisco
37
Business Growth: Finance
40K Public Companies, Updated Daily
38
Business Growth: Health
Healthcare: The Next Big Frontier?
39
Business Growth: Health
40
Business Growth: Energy
Data for Energy Savings
Ogi Kavazovic, VP Marketing & Strategy
41
Business Growth: Data and Technology
42
Business: Finding the Value of Open Data
•
•
•
•
•
•
McKinsey study: $3 trillion annually worldwide
30 to 140 billion euros for Europe’s public sector data
2 to 9 billion British pounds
$30 billion for U.S. weather data
Tens of billions for U.S. GPS data
Hundreds of billions for U.S. health data
43
44
Open Data 500: The Study So Far
• Criteria:
– U.S. based
– National or regional scale (mostly federal data)
– Open Data must be key to business
•
•
•
•
More than 500 companies contacted so far
Wide range of sectors covered
Partnering with Open Data Institute to replicate in the U.K.
Interest in 15 countries at different stages of development
www.OpenData500.com
#OD500
45
46
Open Data 500: The Study So Far
Preliminary Findings: Open Data 500 Categories
First tier (each about 15 percent of working list):
• Data/Technology
• Finance & Investment
Second tier (6-10 percent each):
• Healthcare
• Business & Legal Services
• Governance
• Transportation
• Energy
47
Open Data 500: The Study So Far
Preliminary Open Data 500 Findings (Cont’d)
Third tier (1-5 percent each):
• Education
• Geospatial/mapping
• Lifestyle & Consumer
• Scientific Research
• Environment & Weather
• Housing/Real Estate
• Research & Consulting
• Insurance
• Food & Agriculture
48
Open Data 500: The Study So Far
Initial Observations and Caveats
• In categories with relatively few companies – such as
Environment, Weather, Agriculture – some companies may
still have a major impact
• Does not yet differentiate between small and large
companies (measured by number of employees)
• Does not yet differentiate by financial metrics – small
companies can have high valuation
• The Data/Technology category – one of the largest – may
change as government data becomes more usable
49
Some Open Data Connecticut Companies
51
52
53
54
55
For More Information
For More Information
The GovLab: Visit Our Wiki, Subscribe to Our Digest
57
For More Information
Learn about Open Data at OpenDataNow.com
58
For More Information
59
Open Data, Policy, and Promise:
The Big Picture
Joel.Gurin@gmail.com
Connecticut Data Collaborative Forum, 3/3/14
60