Regional Development Forum for Europe (RDF-EUR)
Broadband for Sustainable Development
20-22 April 2015, Bucharest
Eng. Luca Rea
Project leader for the Italian
Resolution n.244/08/CSP deployment
•
• Technical aspects:
• End point location (Internet eXchange Point )
•
Protocol type
• QoS parameters and file size
•
Next QoS measurement metrics
•
•
•
Ne.Me.Sys results
• Ne.Me.Sys speed test
Regional Development Forum for Europe (RDF-EUR)
Bucharest, 20-22 April 2015
User Protection - Main aspects -
• ISP measurements: Number of measures to help consumers in understanding more on broadband service they are going to buy.
Broadband results obtained by
“ISP measurements” will be used by each
Provider instead of
“up to x Mbit/s” (advertised values)
• End users measurements: By means of the software Ne.Me.Sys
(Network Measurement System) every end user can evaluate its own fixed line Quality of Service. Results could be compared with ISP’s promised ones
•
Measurement models
• Services supplied by operators
• QoS control and consumers’ rights
•
Supervision by an independent body (Fondazione Ugo Bordoni)
• Sanctions
Regional Development Forum for Europe (RDF-EUR)
Bucharest, 20-22 April 2015
QoS fixed-line broadband connection - Operators duties -
• Operators must publish the named “Carta dei servizi”: document containing the main principles that offered services must comply with.
Minimum requirements in terms of Quality of Service are established according to ETSI ES 202 765 – 4
• Operators must transmit relevant data to AGCOM (Italian NRA), publish on their websites conditions of their services a nd advertise correct data as far as data transmission speed is concerned
• Provide predefined contents for fixed-line contracts:
communication indicating where information on aims and results concerning QoS can be found; communication concerning the technical aspects of the QoS provided, which must be available to the customer before signing the contract; technology used for the access (e.g., Dial-up POTS, Dial-up ISDN,
ADSL, ADSL2, ADSL2+, fiber optic) and the minimum characteristics that customer’s CPE must have in order to guarantee the full and correct performance of Internet access contract;
Regional Development Forum for Europe (RDF-EUR)
Bucharest, 20-22 April 2015
QoS fixed-line broadband connection – Consumer rights -
• Operators bind themselves to observe values indicated within the contracts, so if values measured are worse with respect to published ones, he can file a detailed complaint to the undertaking involved:
• He can claim QoS level restored
• If proper levels of QoS are not restored within 30 days from the complaint, the customer has the right to recede without penalties from the contract .
• Each customer can formally certify the quality of his own fixed-line broadband access by means of the free software Ne.Me.Sys
www.misurainternet.it
Regional Development Forum for Europe (RDF-EUR)
Bucharest, 20-22 April 2015
Measurement
Server
Operator’s
IP Network
Operator’s
IP Network
Twisted pair
IXP
Central System
FUB Management
Consolle
Operator’s
IP Network
Acquisition System
Measures processing
Data Repository
Both ISP Measurements and End-user measurements employ the same Network Measurements System, based on a PC software agent Twisted pair
Twisted pair
Client’s Location
IXP architecture
One or more network switch, connecting the participating
ISPs to each other.
• It is a physical infrastructure through which ISPs exchange
Internet traffic between their networks (autonomous systems).
Providers
1 2
…..
FUB n
LAN Peering
Server FTP 1
(ISP Measurements)
1 Gbit/s
Router
Up to 100 Mbit/s toward FTP1
Up to 900 Mbit/s toward FTP2
Server FTP 2
(End users )
LAN
• The primary purpose of an IXP is to allow networks to interconnect directly, via the exchange, rather than through one or more 3rd party networks
IXP
Switch
Through a measurement server located in IXP, it is guaranteed that each client measures only performances related to its own ISP
Network. This approach has been chosen since it allows for
Regional Development Forum for Europe (RDF-EUR) comparable and reproducible results
Bucharest, 20-22 April 2015
ETSI ES 202 765-4
List of QoS parameters defined by ETSI Standard ES 202 765-4
•
Data transmission rate achieved in a fixed time period (10 seconds) separately for downloading and uploading specified test files between a remote server and a user's computer
•
half the time in milliseconds, needed for an ICMP Echo Request/Reply
Packet (Ping Command) to a valid IP address
•
the ratio between the number of not replied Ping commands to the total number of sent Ping commands
•
the ratio of unsuccessful data transmissions to the total number of data transmission attempts in a specified time period
Regional Development Forum for Europe (RDF-EUR)
Bucharest, 20-22 April 2015
ETSI ES 202 765-4
Regarding data transmission speed, the following four values relevant to data transmission speed are computed for both upload and download direction:
• 95th quantile in kbps
• maximum bit rate during the analysis period of 10 seconds
• average bit rate during the analysis period of 10 seconds
The following two values are computed relative to delay:
• The mean value in milliseconds
• The standard deviation
EG 202 057-4 ES 202 765-4
Data speed rate protocol used
Throughput
Delay
(up to 2014)
FTP
20 times FTP (GET/PUT) FTP File size is equal to 10 time the headline speed under test. The results of each test is
File length divided time to download
10 pings with a 10s distance from each other (ICMP packet length is 32 byte)
HTTP
(starting at 2015)
We take into account number of
Byte downloaded with a time slot of 10 seconds
10 pings with a 10s distance from each other (ICMP packet length is 32 byte)
Regional Development Forum for Europe (RDF-EUR)
Bucharest, 20-22 April 2015
Network deployed on the whole Italian Country
Bolzano
TN
BL
PN UD Trieste
VR
NO
Milano
MN
PR
Torino
Genova
Bologna
LU
Firenze
PI
SI
GR
PD
FO
AR
Venezia
PG
TR
RI
Avezzano
PE
Sulmona
VT
Ancona
LT
CB
Roma
FR
CE BN
AV
SA
Napoli
PZ
TA
Cagliari
CS
CZ
Palermo
R.Calabria
TP
CT
MS
Bari
Measurement Server:
Neutral Acess Point (NAP)
Measurement Client:
Ministry peripheral premises
Main peripheral site (Ispettorato)
Secondary peripheral site ( Dipendenza )
FUB central site: central system
Regional Development Forum for Europe (RDF-EUR)
Bucharest, 20-22 April 2015
www.misurainternet.it/stats.php
Upload line attenuation is considered because it is less affected by frequency depending.
The Italian average distance between customers and exchange is about 1,2 km and the corresponding average upload
Line Attenuation is 11 db
11 db in upload line attenuation &
1,2 km between users and Central
Office (Exchange) regards 50% of xDSL consumers in Italy
To have a comparison between ISP performances also Line Attenuation must be the same
Regional Development Forum for Europe (RDF-EUR)
Bucharest, 20-22 April 2015
www.misurainternet.it/stats.php
modem
Loop
Cabinet
Attenuation equal to 11 dB in Upload
”probe room”
Line termination
Twisted copper pair cable 0,6 mm
(22 AVG) or 0,4 mm (26 AVG)
Access Network
OLO room
Regional Development Forum for Europe (RDF-EUR)
Example of Probe Room
Regional Development Forum for Europe (RDF-EUR)
Bucharest, 20-22 April 2015
www.misurainternet.it
5 th percentile, computed on the whole national samples, represents the value that each ISPs can advertise. In a short time the minimum will be 95 th quantile . All other values are available by local analysis at www.misurainternet.it
Regional Development Forum for Europe (RDF-EUR)
Bucharest, 20-22 April 2015
Ne.Me.Sys (Network Measurement System)
It is an open source software that allows to any consumer to certify himself his own fixed-line QoS
•
Registration is needed
•
It runs under all major OSes : Windows, Mac OSX, and Linux
•
Before of a single test user’s LAN is analyzed to assure that nobody share bandwidth it is going to measure. RAM occupation and CPU busy are also controlled.
•
To obtain a significant number of samples that allow to well characterize the fixed line under test, Ne.Me.Sys executes at least 50 tests per hour. 50 tests (20 download, 20 upload and 10 ping) constitute a measure.
Regional Development Forum for Europe (RDF-EUR)
Bucharest, 20-22 April 2015
Up to now, more than 31000 users has completed fixed-line characterization
Certified distribution
The average Actual Speed is ever half with respect to headline one. In many cases, it is due to the distance between user’s location and the central office
Statistics
Registered users
203.938
User with at least one measure
58.581
Emitted certificates In advance certificates
39.757
21.733
Emitted certificates
Regional Development Forum for Europe (RDF-EUR)
Bucharest, 20-22 April 2015
Statistics
Registered users
Regional Development Forum for Europe (RDF-EUR)
Bucharest, 20-22 April 2015
QoS fixed-line broadband connection – MisuraInternet Speed Test-
• To give to users an easier instrument to estimate QoS, a short version of Ne.Me.Sys has been realized. Such a version is named MisuraInternet Speed Test, and it allows users to have an immediately result.
• Obviously results do not have an official value from “receding contract” point of view, anyway crowdsourcing approach allows an ex ante information to evaluate the single ISP performance according to coverage
• Sample collected are one the pillar of national statistic with the aim of monitoring the growth and evolution of broadband
Regional Development Forum for Europe (RDF-EUR)
Bucharest, 20-22 April 2015
Up to now, more than 399160 users has used MisuraInternet Speed Test
Regional Development Forum for Europe (RDF-EUR)
Bucharest, 20-22 April 2015
The Italian Experience
Next Challenges:
Extend the monitoring/evaluating system to mobile connections
Create a detailed National’ Actual Speed Map to give right information to users
Exactly identify coverage areas and suggest solution for broadband connectivity according to
2020 European Digital Agenda Target
(i.e. LTE, LSA Carrier Grade, FTTx)
Stimulate competition between ISPs
This map is obtained by Telecom Italian Wholesale portal. It is an approximations because of each local municipality perimeter has been colored according to the ISP presence and technology
Regional Development Forum for Europe (RDF-EUR)
Bucharest, 20-22 April 2015
The head office of Guglielmo Marconi Foundation is in Villa Griffone, the place where the Bolognese inventor began to develop the system of wireless telegraphy which then spread throughout the world.
Villa Griffone is located in Pontecchio Marconi, about 15 km from Bologna, Italy. The garden and the rooms of the villa are home to the Marconi Museum which is dedicated to the origins and development of radio communications.
Villa Griffone is a National Monument
lrea@fub.it
Regional Development Forum for Europe (RDF-EUR)
Bucharest, 20-22 April 2015