Monetize your APIs and Datasets or Make Them
Available as Open Data
Agenda
1.
Open Data
Open Data in FIWARE Lab
•
2.
CKAN
Providing Data
•



Consuming Data
•



3.
Creating a dataset
Publish the Dataset in the WStore
Increase Data Value
Search
Acquisition
APIs
Hands On
2
“A piece of data or content is open if
anyone is free to use, reuse, and
redistribute it — subject only, at most,
to the requirement to attribute and/or
share-alike.”
[http://opendefinition.org/#sthash.6ieidzit.dpuf]
Sergio García Gómez
3
• Open Data implies often hidden costs
–
–
–
–
Lack of quality
Insufficient documentation
Unstructured information
Limited amount of information
• All data cannot be open
– Conflicting interests
– Security
4
Open Data in FIWARE Lab
FIWARE
•FIWARE provides the
technology to build the
entrepreneurs and
developers ecosystem.
Lab
•FIWARE Lab offers the
environment where all the
stakeholders meet together
around innovation.
Data
•Data is the fuel that enables,
inspires and boosts
entrepreneurs, remarkably in
Smart Cities.
Sergio García Gómez
5
Data from Smart Cities in FIWARE Lab
Open APIs
Datasets
Real Time
Media
Existing Datasets
(census,
geographical,
tourism,...)
Vertical Systems
(mobility,
events...)
Video streams
(traffic,
surveillance..)
Historic Data
(from sensors,
events...)
Internet of Things
(sensors, Smart
meters...)
Audio
(microphones),
speaches...
Sergio García Gómez
6
CKAN
(Open) Data Platform
• Search & Discover Data:
–
–
–
–
Search by keywords
Browse by facets
Explore data with previews & visualization
REST/JSON APIs to access data and metadata
• Data Management for publishers
– Easy store & update of metadata
Sergio García Gómez
8
FIWARE Lab Instance
• Integrated with FIWARE Lab IdM (OAuth2)
– Users do not need to have different accounts
– Users can access the portal without log in to read open data
• Ability to create private datasets
– Accessible only by certain users
• Ability to publish datasets in the WStore
–
–
–
–
•
Manage the users that can access private datasets
Charge users for accessing your data
Ensure that users only access your data under some legal terms
…
 https://data.lab.fi-ware.org
9
FIWARE Lab Instance
Identity
Manager
Authenticate user
Publish data
WStore
CKAN
Notify acquisition
Retrieve data
Application
Mashup
Francisco de la Vega
Other
Applications
10
…
Other
Applications
CKAN/WStore/Application MashUp
PROVIDER SIDE
Publishing and Managing Data
Sergio García Gómez
12
Publishing and Managing Data
13
Publishing a Dataset in the
• WStore is the showcase of FIWARE
– Advertise your data for free
– Make your data visible to prospective users
• Manage users that can access your data
– Update the list of allowed users automatically
• Force users to accept some terms to use your data
• Charge users for accessing your data
– Single Payment
– Subscription
– Pay per use
14
Publishing a Dataset in the
Open Data can only be sold for free
15
Increasing your datasets value
• MashUp Platform widgets
16
Increase your datasets value
• Sell your datasets together with the Mashup to
visualize the data
– Add extra value
– Ease users the utilization of the information
• Enable buyers to embed the Mashup in other web
pages and increase the benefits
–
–
–
–
Online Newspapers
Government
Social Networks
…
17
Increase your datasets value
18
CKAN/WStore/Application MashUp
CLIENT SIDE
Search and discovery
Sergio García Gómez
20
Acquiring Private Datasets
21
APIs
• Full query/search through a JSON API
– Get full datasets meta-information
– Create, Update (metadata), Delete datasets and
resources
• CKAN (DataStore plugin) provides APIs for
– Inserting, updating and deleting data
– Querying data (JSON Filters, SQL, HTSQL)
• API Key
– X-Auth-Token: FIWARE Lab IdM Token (OAuth2)
– Authorization: CKAN default token
22
APIs: Package Show
GET /api/action/package_show?id=european-elections-results-spain HTTP/1.1
Host: data.lab.fi-ware.org
{
"resources": [
{
[...]
"state": "active",
"description": "...",
"format": "CSV",
[...],
"url_type": "upload",
"name": "...",
"created": "...",
"url":
"https://.../dataset/.../resource/.../dow
nload/....csv",
"webstore_url": null,
"mimetype_inner": null,
"position": 0,
"revision_id": "...",
"resource_type": null
}
],
"help": "[...]",
"success": true,
"result": {
"license_title": "...",
"maintainer": "",
"relationships_as_object": [],
"maintainer_email": "",
"revision_timestamp": "...",
"id": "...",
"metadata_created": "...",
"metadata_modified": "...",
"author": "",
"author_email": "",
"state": "active",
"version": "",
"license_id": "notspecified",
"type": "dataset",
+ tags, group, organization and much more…
23
APIs: DataStore SQL
GET /api/action/datastore_search_sql?sql=SELECT * from "3fd9115d-4ccb-4e379418-4a7fe54605b9" HTTP/1.1
Host: data.lab.fi-ware.org
{
"help": "[...]",
"success": true,
"result": {
"records": [
{
"Partido": "P.P.",
"Votos": "4074363",
"_id": 1,
"_full_text": "'p.p':1",
"Escanyos": "16"
},
{
"Partido": "PSOE",
"Votos": "3596324",
"_id": 2,
"_full_text": "'pso':1",
"Escanyos": "14"
},
[…]
]
24
"fields": [
{
"type": "int4",
"id": "_id"
},
{
"type": "tsvector",
"id": "_full_text"
},
{
"type": "text",
"id": "Partido"
},
{
"type": "numeric",
"id": "Votos"
}
],
"sql": "..."
}
}
APIs: DataStore JSON
GET /api/action/datastore_search?resource_id=3fd9115d-4ccb-4e37-94184a7fe54605b9&fields=Partido,Votos HTTP/1.1
Host: data.lab.fi-ware.org
{
{
"help": "[...]",
"success": true,
"result": {
"fields": [
{
"type": "text",
"id": "Partido"
},
{
"type": "numeric",
"id": "Votos"
}
],
"records": [
{
"Partido": "P.P.",
"Votos": "4074363"
},
"Partido": "PSOE",
"Votos": "3596324"
},
{
"Partido": "LA IZQUIERDA
PLURAL",
"Votos": "1562567"
},
{
"Partido": "PODEMOS",
"Votos": "1245948"
},
[...]
],
[...]
}
}
+ the number of results, links to the next results,…
25
Visualizing the Dataset in the MashUp
Platform
26
27
Publishing and Consuming Data
HANDS ON
Thanks!