DELIVERABLE
Project Acronym:
CITADEL
Grant Agreement number:
297188
Project Title:
Citadel-on-the-Move
D2.3.2 New Standards and Recommendations
Version: Final
Authors:
Geert Mareels (CORVE)
Julia Glidden (CORVE)
Reviewers:
Andrew Stott (Advisor)
Hugo Kerschot (IS-P)
John Keys (MDDA)
Leonidas Kallipolitis (ATC)
Evangelos Argyzoudis (INTRA)
Thimo Thoeye (GENT)
Jesse Marsh (ALFA)
Ira Giannakoudaki (DAEM)
Eric Legale (ISSY)
Project co-funded by the European Commission within the ICT Policy Support Programme
Dissemination Level
P
Public
C
Confidential, only for members of the consortium and the Commission Services
X
CITADEL – Deliverable D2.3.2
________________________________________________
Revision History
Version
Date
Author
Organisation
Description
0.1
6/1/14
Geert Mareels
CORVE
Outline
0.2
8/1/14
Julia Glidden
CORVE
Content
0.3
9/1/14
Andrew Stott
Advisor
Comments
0.4
12/1/14
Hugo Kerschot
ISP
Comments
0.5
13/1/14
Evangelos
Argyzoudis
Intra
Comments
0.6
15/01/14
Thimo Thoeye
Gent
Comments
0.7
15/01/14
Jesse Marsh
Alfa
Comments
0.8
15/01/14
Ira
Giannakoudaki
Athens
Comments
0.9
15/01/14
Eric Legale
Issy
Comments
1.0
17/01/14
Julia Glidden
CORVE
Final
Statement of originality:
This deliverable contains original unpublished work except where clearly
indicated otherwise. Acknowledgement of previously published material
and of the work of others has been made through appropriate citation,
quotation or both.
© CITADEL Consortium
2
Version Final – January 2014
CITADEL – Deliverable D2.3.2
________________________________________________
Table of Contents
Table of Contents .............................................................................................................. 2
1.
Introduction ............................................................................................................. 4
1.1
1.2
1.3
1.4
1.5
2.
Abstract..............................................................................................................................4
Purpose ..............................................................................................................................4
Audience ............................................................................................................................4
Scope ..................................................................................................................................4
Distribution ........................................................................................................................5
White Paper ............................................................................................................. 6
© CITADEL Consortium
3
Version Final – January 2014
CITADEL – Deliverable D2.3.2
________________________________________________
1. Introduction
1.1 Abstract
This White Paper is a public deliverable which aims to provide practical, hands-on guidelines
to help local administrators, particularly those in smaller cities and towns, use Citadel-onthe-Move tools and templates to begin to open up, convert and use data. The White Paper
starts by providing a brief introduction to Open Data and its potential value. It then provides
step-wise instructions on how to create innovative new mobile applications that unleash the
value of open public data using the Citadel approach. The document stresses the
importance of getting started (however small), engaging users in the creation of applications
(even just one app at a time) and operating (wherever possible) in accordance with ‘share
and share alike’ principles.
1.2 Purpose
The purpose of this White Paper is to provide a practical, hands-on introduction for local
administrators, particularly those in smaller cities and towns, to the tools and templates
that Citadel-on-the-Move has created to help unleash value from local data.
1.3 Audience
The audience for this White Paper is local administrators who are interested in using the
Citadel approach to open and use data but find it difficult to get started.
1.4 Scope
This paper is the second in a series of Citadel-on-the-Move White Papers. Collectively, the
series is intended to provide local administrators with a comprehensive overview of the
principles, policy requirements and practical considerations involved in opening, converting
and using public data.
White Paper series:
D2.3.1 – Open Data: Key Principles and Policy Areas
D2.3.2 – The Citadel Approach: How to Open, Convert and Use Data Across Borders
D2.3.3 – Lessons Learned: Key Observations and Recommendations
The White Paper series combined will provide the basis for the final project deliverable:
D2.4 Business Requirements – Provides a Roadmap to be followed for data innovation to
truly take off.
© CITADEL Consortium
4
Version Final – January 2014
CITADEL – Deliverable D2.3.2
________________________________________________
1.5 Distribution
The White Paper has so far been distributed and popularised using the following channels:
Open Data Forum
http://www.opendataforum.info/index.php/news2
EUROCITIES
The White Paper will be presented in a forthcoming web article
Euractiv
http://guests.blogactiv.eu/2014/01/27/local-governments-open-data/
Linked Organisation of Local Authorities
The white paper has been disseminated by direct mailing to the full range of LOLA countries
and network contacts
Citadel on the Move
http://www.citadelonthemove.eu/en-us/cities/publications.aspx
© CITADEL Consortium
5
Version Final – January 2014
CITADEL – Deliverable D2.3.2
________________________________________________
2. White Paper
How to Open, Convert and Use Data across Borders:
A Citadel on the Move Guideline
“Open data is data that can be freely used, reused and redistributed by anyone – subject
only, at most, to the requirement to attribute and share alike.” OpenDefinition.org
It seems that everyone these days is talking about Open Data
and its value to cities and citizens alike, particularly in relation to
the creation of innovative new mobile apps that enhance city
living and promote tourism.
Open data has the power to generate powerful economic,
environmental, and social value. As the Open Data Institute
argues, Open Data can help ‘unlock supply, generate demand,
and create and disseminate knowledge to address local and
global issues.’1 In addition to releasing social and commercial
value, as the Open Knowledge Foundation further argues, Open
Data can also help to promote transparency and trust in
government as well as increased citizen participation and
engagement.2
Despite all the buzz about Open Data these days, however, one hears very little about the
practical steps that a city administrator needs to take to open local government data and
unleash innovation. Too often Open Data advocates, for all their commitment and passion,
forget that for many cities and towns, especially smaller ones with limited resources,
opening and using data is easier said than done.3
Citadel on the Move is a project funded by the European Commission that aims to address
this challenge by providing cities and towns with simple and easy to use templates and tools
to help them open their data and create new applications that can be used and shared
across Europe and even around the world.
1
http://theodi.org/about-us
http://okfn.org/opendata/
3 The EUROCITIES Guidebook is a notable exception to this rule. The guidebook is written by and for cities, and offers
tailored information and practical guidelines for cities with limited resources and/or knowledge.
See:
http://www.eurocities.eu/eurocities/publications/EUROCITIES-open-data-guidebook-open-data-working-grouppublication-WSPO-9CTHZE
2
© CITADEL Consortium
6
Version Final – January 2014
CITADEL – Deliverable D2.3.2
________________________________________________
Citadel Approach
The following guidelines are designed to help local government actors use Citadel on the
Move tools and templates to kick start their Open Data efforts in 3 easy steps: 1) open up
data by making it available for access by third-party applications; 2) convert the data into a
format that makes easier to create applications; and 3) use the Citadel App Generator to
generate value from data by creating innovative applications that do not as yet exist.
The Citadel website provides more detailed instructions for troubleshooting issues as they
may arise.4 Getting started, however, can be as simple as:
Step 1: Open5
Citadel recommends that cities follow three key principles when embarking on their Open
Data journey:
1. Start Small: You don’t need to open all your data at once. Far better to see what
works and doesn’t work than to not start at all.
2. Accept Mistakes: No dataset is perfect. Opening up data will inevitably reveal
inaccuracies. The good news is that a) you are not liable for inaccuracies in your
data6 and b) opening data will also help to correct the mistakes.
3. Engage Citizens: Remember – your data is only valuable if it is used. Tell your
citizens that you are making data available and encourage them to use it.
4
N.B. Development of Citadel tools is an iterative process. For more detailed instructions, trouble shooting and the
most up-to-date version of instructions, see: http://www.citadelonthemove.eu/en-us/innovate/templateapps.aspx
and http://demos.citadelonthemove.eu/
5 Citadel on the Move has devised these recommendations in partnership with the Open Data Institute and the Open
Knowledge Foundation.
6
Standard Open Licences such as CC-BY and CC-0 have watertight legal protections against liability for the accuracy of
data. For more information see: https://creativecommons.org/licenses/
© CITADEL Consortium
7
Version Final – January 2014
CITADEL – Deliverable D2.3.2
________________________________________________
Citadel recommends that cities take the following steps when opening their data:
1. Select the Data Set: Remember – simple and small can be good! The key thing is
that the data is publically available and has no IPR restrictions on the way it can be
used, reused or redistributed.
2. Publish the Data Set: For ease of use with Citadel tools and templates, use CSV – a
very simple form that can be saved from Excel, Open Office and most spreadsheet
programmes.7 Try to use non-proprietary formats (such as CSV instead of XLS) and
structured formats (e.g. not scanned images, PDF etc). But most important of all, put
your data out there. If someone wants to use it they will find a way!
3. Publicise the Data Set: Data needs to be discovered and discoverable to be used.
Make sure to post your data on your website or a central catalogue, and tell both
your citizens and wider development communities that it is there8!
4. Keep your Data Up-to-Date: Expectations for current, if not real-time, data are
growing. Data does not need to be updated daily. Simply remember to publish new
files regularly as amended or updated data becomes available.
There will always be certain circumstances, of course, in which it is simply not feasible to
freely open all data. Wherever possible, though, Citadel on the Move strongly
recommends adherence to the norms of the Open Data Commons wherein the users
and providers of data agree to a minimum standard of share and share alike.9 To make
sure your data is truly open and easy for anyone to use, we suggest using either a
Universal (CC-0) or Attribution (CC-BY) license from Creative Commons10. By freely
opening and sharing data in this way, local governments can play a vital role in helping
to build strong data user communities that, in turn, create a virtuous circle of openness
in which the innovative use and reuse of data stimulates the further unleashing of more
and more free and open data. The first step is to open up that initial data set, however
small, and let your citizens know!
Step 2: Convert
NOTE – these instructions assume that a) the reader has a basic level of technical knowledge
in handling simple datasets and 2) the reader is able to access their dataset in CSV format.
Citadel-on-the-Move is not just about helping to open data, it is also about making sure
that, once open, the data is used. To support local administrators Citadel has created a new
7
NB: Citadel on the Move is not arguing that CSV is the preferred approach for all open data initiatives, not least of all
because it only works when the dataset is small, static and simply formed. In its simplicity, however, Citadel believes
that CSV is a good place way for municipalities with limited resources and expertise to get started. Cities that are
further along in their Open Data efforts should examine the Open Data recommendations of W3C http://www.w3.org/TR/gov-data/ - as well as new Linked Data initiatives e.g. LOD2 http://stack.lod2.eu/blog/.
8 Often, developers may be outside your local area but remember that the more apps are created based on your data,
the more value your city can derive.
9 http://opendatacommons.org/norms/odc-by-sa/
10 For more information on the norms of the Open Data Commons, see: https://creativecommons.org/licenses/
© CITADEL Consortium
8
Version Final – January 2014
CITADEL – Deliverable D2.3.2
________________________________________________
tool to ‘convert’ data released as a CSV file into a format (JSON11) that is compatible with
Citadel’s App Generator – which has been specifically designed to make it easy for just
about anyone with basic computer skills, even a nine year old, to create a mobile app that
works not only in their own city but also across borders.12
To use the Citadel Converter, follow these basic steps:
1. Make sure your dataset is as clean and well-structured as possible and saved as a
CSV file13
Access the Citadel Converter: http://www.rbox.tv/citadel/converter/php/
2. Upload the CSV file
3. Review the preview that pops up (the first 5 rows of datasets) to check that
everything appears correctly
4. If required, refine the following CSV presets and repeat the preview until the dataset
displays correctly:
a. Delimiter
b. Enclosure
c. Escape Character
5. Follow the on-screen instructions to manually map the headings of your dataset to
the values of the Citadel Dataset Template
11
Currently Citadel templates use JSON files. As a result, the starting version of the Citadel Converter converts CSV
datasets to JSON files. JSON files are perfect for releasing data because they make it easy for mobile applications to
use the data. They have the added benefit of containing labeling and licensing information that cannot be removed.
For more technically advanced users, Citadel has also created a downloadable JAVA version of the convertor:
http://rbox.tv/citadel/converter/java/converter-1.1.jar. Citadel envisions the future development of additional
Converters for other formats, as well as new templates that work with additional files.
12 Different cities often publish the same type of data in different ways. These differences create a large
interoperability challenge because for a mobile app to work across city the datasets must be compatible. To
overcome this challenge, conversion to a common format that is compatible with the Citadel mobile app templates is
required.
13 At minimum it is necessary for your CSV file to have a) a simple table with clear rows and columns b) a row at the
top with labels for the columns and c) consistent data in all fields of a column (no gaps or missing entries). Ideally,
your CSV fill will contain the following columns: title, category, description, address, postal code, city, latitude,
longitude. Step-by-step instructions can be found on the Convertor site to walk you through the conversion process:
http://www.rbox.tv/citadel/converter/php/#.
Alternatively, for a video walkthrough visit: http://www.youtube.com/watch?v=g1FbT9zdxlk
© CITADEL Consortium
9
Version Final – January 2014
CITADEL – Deliverable D2.3.2
________________________________________________
6. Select the Latitude and Longitude fields that enable data to be referenced on a
map14
7. Complete the necessary metadata fields when prompted
8. Click convert and wait for the JSON file to be produced
9. Download JSON file to your computer
Given its capacity to fuel innovation and enhance overall quality of life, Citadel on the Move
believes that it is important to think of data as a shared public good. For this reason, we
recommend uploading JSON to your own publicly accessible servers and, ideally, create a
reference to this location in the Open Data Catalogue on the Citadel Hub:
http://www.citadelonthemove.eu/en-us/thehub/opendata.aspx Referencing your data in
the Citadel Hub will help in the creation of a common public space in which everyone is free
to access data and applications on behalf of the public good.
Step 3: Use
To use your data in Citadel template applications15, follow these simple steps:
1. Access the Citadel App Generator:
http://demos.citadelonthemove.eu/app-generator/appForm.php
2. Select the Cities you want the app to work in
3. Select the relevant Dataset(s) by either of the following:
a. Uploading the JSON files directly from your computer
b. Copying the dataset URL into the box provided
4. Select the colour theme and name of the application
5. Access your application hosted on the Citadel Hub and freely share it via its URL
14
If your dataset does not contain the Latitude and Longitude values, these can be simply obtained from the following
URL http://www.mapcoordinates.net/en
15 The Citadel App Generator is intended to make it quick and easy for anyone with basic computer skills to turn data
into a new mobile app. Existing Citadel templates represent a starting set which can be extended in the future.
© CITADEL Consortium
10
Version Final – January 2014
CITADEL – Deliverable D2.3.2
________________________________________________
There are a wide variety of potential technical procedures and norms that local
governments can follow as they start to open their data. Citadel on the Move believes,
however, that regardless of the tools and templates used, the key to success lies in getting
started – one data set at a time, and getting users engaged – one application at a time. Data
is only as valuable as its use. The more people who use data the more value is created, and
the greater the incentive to open data becomes.
Citadel partners are already using Citadel templates and the App Generator to create new
apps of their own! Thanks to Citadel, tourists to Gent can easily find the city’s wide array of
art galleries.
Conclusion
The Citadel approach is quite different to the standard way of publishing Open Data - which
normally consists of publishing somewhat complex datasets as web services and then
releasing them through an API. Our goal here is to simplify this process by helping to quickly
get online the bulk of public data that is currently sitting as Excel files. In so doing, we aim
to significantly de-professionalise the Open Data process in order to extend it to broader
communities of users beginning with the public sector.
This White Paper has explained HOW local administrators can publish data more easily and
help make sure that it is used. We hope we have demonstrated just how simple the process
can be. The reason WHY is just as simple: Opening data in a reusable format gives citizens
and local enterprises the raw material they need to build new applications that take
advantage of all the possibilities that modern technologies now offer to improve public
services and ultimately make our cities and towns better places to work and live.
www.citadelonthemove.eu
Citadel on the Move
@Citadel_eu
Citadel on the Move is a 3 year project part funded by the European Commission’s ICT Policy
Support Programme (ICT PSP) under the Competiveness and Innovation Programme (CIP)
© CITADEL Consortium
11
Version Final – January 2014
CITADEL – Deliverable D2.3.2
________________________________________________
Citadel on the Move is led by the Flemish eGovernment Authority (CORVE) supported by:
© CITADEL Consortium
12
Version Final – January 2014