VERTI © 2013 Tieto Corporation Tieto’s statistical data distribution tool Pavel Bublavy Tieto pavel.bublavy@tieto.com Verti team 2 Markku Koskela Arto Hahto UI Helsinki DB layer Helsinki Pavel Bublavý Jan Czopik UI Ostrava UI Ostrava © 2013 Tieto Corporation VERTI - Tieto’s statistical data distribution tool 2014-10-02 Overall solution for distribution of statistical data Text base Presentation tool Reporting Diagrams and tables can be used as elements in building sophisticated reporting applications Helsinki Region Trends Findikaattori of Statistics Finland and Prime Minister’s Office of Finland Diagram base Statistical base Data refining tool Combining Calculation Graphics Population forecasting model for communes (City of Lahti) Statistical data distribution tool Displays data as tables and diagrams Data distribution Huge statistical cubes, complicated data structures Education resources optimation model Kohti (for Ministry of Employment and Economy of Finland) The number of cells in the cube is 2.333665125407577e+37 3 © 2013 Tieto Corporation VERTI - Tieto’s statistical data distribution tool 2014-10-02 Verti main features Scalability Tailored views for authenticated users ability to handle very big data tables Authentication Big statistical tables • Interface to customer single signon service Verti’s own logging service • Views to the database and picture base can be tailored according to the • The biggest cube at present in production has 30 dimensions user • Size of the cube is several GB • Number of non-zero cells in the cube is > 100 billion • The number expressing the count of cells contains about 30 digits Long classifications • CN commodity classification has over 20.000 rows Big databases • Size of the database of Finnish Employment Service Statistics is about 60 GB. • Statistics Finland’s Verti database contains > 7 000 cubes (px files) Two methods to delimit the view (methods can be used in parallel) • By database sector (subject area) – the user sees only parts of the database • By classification – the user sees only parts of cubes Platform for report applications • Verti has tools to build report pages • It’s possible to combine graphics with texts, both are updated peridically • Example, Helsinki Economic Trends http://www.helsinkitrends.fi • Finnish Foreign Trade Statistics in http://uljas.tulli.fi • CN statistics contain > 20 billion numbers Verti picture base • Built by Verti’s graphical tool • Graphics is created dynamically based on actual data 4 © 2013 Tieto Corporation VERTI - Tieto’s statistical data distribution tool 2014-10-02 References Finnish State Treasury (Valtiokonttori) Finland More than 20 public sector customers Main producers of Finnish Official Statistics use Verti • Administrator of public sector debt, pensions and occupational insurances • Extranet statistical and picture base on pensions, occupational accidents and insurances • Used by HR personnel in public sector organizations all over the country Statistics Finland (Statistical Office of Finland) • Verti is used as platform for special applications (www.findikaattori.fi) • Under Construction: Report pages for Finnish and foreign investors on amount, structure, rent, etc. of Finlands public debt, based on Verti database and graphics • Verti Graphics is used within selected PX-Web databases Finnish Board of Education Finnish Customs • Finnish Foreign Trade Statistics (uljas.tulli.fi) • Under construction: National database on education need forecasts by area, branch and degree of education Finnish Ministry for Employment and the Economy (TEM) City of Helsinki • Finnish Labor statistics (only internal database) • Helsinki Metropolitan area statistical database (www.aluesarjat.fi) • Four other sites, including ToimialaOnline (www2.toimialaonline.fi) • Environment statistics (www.helsinginymparistotilasto.fi) Finnish Game and Fisheries Research Institute • Helsinki Metropolitan area economic indicators (www.helsinkitrends.fi) • Finnish fisheries and hunting statistics City of Lahti The Finnish Centre for Pensions (ETK) • Common statistical database for all departments of the city organization • Central organization of private sector employment pension companies of Finland • Intranet, internet (www4.lahti.fi/verkkotilastointi) • The database contains detailed statistics on pensions • Internal PX-Web databases • Intranet database City of Lahti, City of Lohja, City of Kokkola • Extranet database (with authentication/authorization) for pension companies City of Joensuu • Public internet database will be opened later City of Espoo, City of Oulu • Venni (population growth and housing construction forecasting model for municipalities) Finnish Forest Research Institute (Metla) • Has just bought Verti license Etc. • Database for Finnish Forest Statistics will be built 5 © 2013 Tieto Corporation VERTI - Tieto’s statistical data distribution tool 2014-10-02 Verti structure server client UI framework Web browser IIS, ASP.NET, C# Javascript, HTML, CSS Graphics engine Runtime base APL Database engine APL 6 © 2013 Tieto Corporation VERTI - Tieto’s statistical data distribution tool Development base CSV, PX WEB PAX 2014-10-02 VERTI Map Graphics © 2013 Tieto Corporation Map visualization of statistics data From Px-iMap2 to PX-Map3 Map component Px-iMap2 originally developed by Statistics Norway but discontinued Agreement with Statistics Norway • Statistics Norway will get right use use basic version and distribute basic version to the statistical institutions which are members of PC-Axis Reference Group • Tieto will get right to use Px-iMap2 in Verti Map Graphics Development finished and Map Graphics integrated into Verti application by Tieto • Verti standalone >> PX-Map3 • Basic and Advanced version Distribution of PX-Map3 installation package for PC-Axis Reference Group will be handled by Statistics Finland 8 © 2013 Tieto Corporation VERTI - Tieto’s statistical data distribution tool 2014-10-02 Installation Download will be available from Statistic Finland website • http://stat.fi/tup/pcaxis/lataus_tyokalut_en.html Installation packages will be provided for • 64bit • 32bit Verti Installer Manual installation Support • Jan.Czopik@tieto.com – installation issues • Pavel.Bublavy@tieto.com – runtime issues • Petri.Friberg@tieto.com – sales 9 © 2013 Tieto Corporation VERTI - Tieto’s statistical data distribution tool 2014-10-02 Data communication between PX-Web and Verti PX-Web application PX-Web plugin created by Statistics Sweeden allowing data exchange between PX-Web and Verti Data exchange via PX file Verti plugin PX file temp Verti application 10 © 2013 Tieto Corporation VERTI - Tieto’s statistical data distribution tool 2014-10-02 PX-Map3 in Verti structure Verti Verti standalone Graph Map Graphics Basic 11 © 2013 Tieto Corporation Advanced VERTI - Tieto’s statistical data distribution tool 2014-10-02 Basic Advanced Basic version implements features which were originally intended for Px-iMap2 Advanced versiosn provides additional set of advanced features • • • • • • Area level selection • Multimap layers • Zooming- detail selection Plugin for PX-Web Free of charge Choropleth map Circle map Pie symbol • Map data reselection • Bar symbol map • Svg, vml and png graphics supported • Export of graphics to png, svg and html 12 © 2013 Tieto Corporation • Saved queries • Tools for adminstrators for building graphics into web pages and creating reports VERTI - Tieto’s statistical data distribution tool 2014-10-02 Roadmap Latest PX-Web integration support Visual appearance improvement Performance 13 © 2013 Tieto Corporation • Facelift • Mobile version • Ajax Graphics enhancements • More graph types • Animated graphs Open data • Imports & Exports Verti cloud • Turnkey solution • Scalable solution VERTI - Tieto’s statistical data distribution tool 2014-10-02 © 2013 Tieto Corporation Pavel Bublavy Tieto pavel.bublavy@tieto.com