Internet topology discovery

advertisement
Router-level
Internet Topology Mapping
By Talha OZ
Outline

Introduction

Internet Topology Collection
•
•
•

Basic Techniques
Some Measurement Projects & Platforms
Issues in Topology Collection
Issues in Topology Construction
•
•
•

My stress on this presentation
Will be explained in detail
in the next presentation
Resolving Anonymous Routers
Resolving Alias IP Addresses
Resolving Genuine Subnets
Summary
Internet Topology Discovery
2
Outline

Introduction
•
•

Internet Topology Collection
•
•
•

Basic Techniques
Some Measurement projects & platforms
Issues in Topology Collection
Issues in Topology Construction
•
•
•

Internet as a Complex Network
Motivations on Internet Topology Measurement
Resolving Anonymous Routers
Resolving Alias IP Addresses
Resolving Genuine Subnets
Summary
Internet Topology Discovery
3
Internet

Web of interconnected networks
•
•
•
•
Grows with no central authority
Autonomous Systems optimize local communication efficiency
The building blocks are engineered and studied in depth
Global entity has not been characterized

Most real world complex-networks
have non-trivial properties.

Global properties can not be inferred from local ones
•
•
Engineered with large technical diversity
Range from local campuses to transcontinental backbone
providers
Internet Topology Discovery
4
Motivation on
Internet Topology Measurement

Once the graph is built, one can study its characteristics
•
Essential to design, implement, protect, and operate underlying network
technologies, protocols, services, and applications

Capture graph’s theoretic resilience to failure or say something about its
efficiency for routing

Realistic simulation environment for developed products

Comprehend spreading of worms/viruses (Burch and Cheswick’s proposal)

Improve QoS for the multimedia content

•
Where to store the data in replicated servers distributed across the internet
ISPs are not willing to share their topology information
Lumenta Jan 06
Internet Topology Discovery
5
Internet Topology Measurement



Types of Internet topology maps
•
•
•
•
Autonomous System (AS) level maps
Point of presence (PoP) level
Router level maps
IP interface level
A router level Internet map consists of
•
•
Nodes: End-hosts and routers
Links: Point-to-point or multi-access links
Router level Internet topology discovery
•
A process of identifying nodes and links among them
Lumenta
CAIDAJan
Jan06
08
00
Internet Topology Discovery
6
Outline

Introduction

Internet Topology Collection
•
•
•

Some Measurement projects & platforms
Issues in Topology Collection
Issues in Topology Construction
•
•
•

Basic Techniques
Resolving Anonymous Routers
Resolving Alias IP Addresses
Resolving Genuine Subnets
Summary
Internet Topology Discovery
7
Internet Topology Measurement
Topology Collection

Internet topology measurement studies


Involves topology collection / construction / analysis
How to collect ?




Work on IP layer, leverage header information
IETF’s RFCs determine the behavior of the nodes
Send ICMP, UDP, TCP packets and wait ...
Ideal case and issues ...
Internet Topology Discovery
8
Internet Topology Measurement
Topology Collection – Who sets the rules ?

IETF
The Internet Engineering Task Force (IETF)
develops and promotes Internet standards

RFC
An Internet Standard is a special Request for
Comments (RFC) or set of RFCs.

http://tools.ietf.org/html/rfc792
Internet Topology Discovery
9
Internet Topology Measurement
How to collect
Internet Topology Discovery
10
Internet Topology Measurements
Probing

Direct probing
IPB
IPD
Vantage Point
IPBD TTL=64
A

B
C
D
Indirect probing
IPB
IPC
Vantage Point
IPD TTL=1
TTL=2
A
B
C
Internet Topology Discovery
D
11
Internet Topology Measurement
Topology Collection (traceroute)

Probe packets are carefully constructed to elicit intended
response from a probe destination
IPB
IPA
IPC
IPD
Vantage Point
Destination
TTL=1
TTL=2
TTL=3
TTL=4
S


A
B
C
D
traceroute probes all nodes on a path towards a given destination
•
•
TTL-scoped probes obtain ICMP error messages from routers on the path
ICMP messages includes the IP address of intermediate routers as its source
Merging end-to-end path traces yields the network map
Internet Topology Discovery
12
Internet Topology Measurement:
Background
Internet2 backbone
S s.3
s.2
n.1
c.2
u.1
U
c.1
u.2
k.1
u.3
l.1
K
k.2
C
w.1
c.3
k.3
L
a.1
l.3
Trace to Seattle
W
w.2
w.3
c.4
l.2
n.3
N
A
a.2
Trace to NY
a.3
h.2
h.1
H
h.3
h.4
d
Internet Topology Mapping
13
Internet Topology Measurement:
Background
s.1
e
f
S s.3
n.2
s.2
n.1
c.1
u.1
U
u.2
k.1
u.3
l.1
c.2
K
k.2
C
w.1
c.3
n.3
N
W
w.2
w.3
c.4
k.3
L
a.1
l.2
l.3
A
a.2
a.3
h.2
h.1
H
h.3
h.4
d
Internet Topology Mapping
14
Internet Topology Measurement
Topology Collection
e
f
Internet2 backbone
S
N
C
U
W
K
L
A
H
d
Internet Topology Discovery
Traces
•d-H-L-S-e
•d-H-A-W-N-f
•e-S-L-H-d
•e-S-U-K-C-N-f
• f - N - C - K- H - d
•f-N-C-K-U-S-e
15
Outline

Introduction

Internet Topology Collection
•
•
•

Some measurement projects & platforms
Issues in Topology Collection
Issues in Topology Construction
•
•
•

Basic Techniques
Resolving Anonymous Routers
Resolving Alias IP Addresses
Resolving Genuine Subnets
Summary
Internet Topology Discovery
16
Topology Data Collecting Platforms - I

PlanetLab
•
•
Currently consists of 1020 nodes at 483 sites
Since the beginning of 2003, 1000+ researchers develop new
technologies for
•
•
•
•
•

distributed storage
network mapping
peer-to-peer systems
distributed hash tables
query processing
CAIDA (Cooperative Association for Internet Data Analysis)
•
•
Provides tools and analyses promoting the engineering and
maintenance of a robust, scalable global Internet infrastructure.
San Diego Supercomputer Center @ UCSD
Internet Topology Discovery
17
Topology Data Collecting Platforms - II

Macroscopic Topology Measurements (Skitter project)
by CAIDA
•
•
•

characterize macroscopic connectivity and performance of the
Internet
allow various topological and geographical representations at
multiple levels of aggregation granularity
provide a valuable input for empirically-based modeling of the
Internet behavior and properties
Skitter, developed by CAIDA
•
•
skitter measurement tool reads a file of destinations and writes
a file of traceroute paths
...
Internet Topology Discovery
18
Topology Data Collecting Platforms - III
•
•
•
•
•
•

...
ICMP traceroutes are used
RTTs are also stored
24 monitors around the world
970K common destination, IPv4 addresses
Scamper does the similar thing for IPv6
Archipelago (Ark) is the evolution of the
skitter infrastructure, by CAIDA
•
•
•
•
skitter monitors
skitter measurement tool
an internal web server for distributing destination lists
a file storage server for collecting traces from monitors
Internet Topology Discovery
19
Topology Collecting Platforms - IV

The Distributed Internet Measurements and Simulations
(DIMES)
•
•
•

Model of SETI@home
Counts more than 20,343 agents scattered over five continents
“What we ask is not so much your CPU or bandwidth (which we
hardly consume), but rather, your location.”
iPlane
•
•
•
•
•
Measuring the Internet: performs traceroutes from various VPs
-- PlanetLab nodes and traceroute servers -- to construct a
router interface-level atlas of the Internet.
Clustering interfaces into PoPs
Measuring link attributes
Opportunistic measurements
Route prediction
Internet Topology Discovery
20
Topology Collecting Platforms - V

Rocketfuel tries to get the picture of the ISPs
•
•
•
•
Number of required probes is decreased
•
•
directed probing
path reduction (ingress & egress)
Alias resolution
Router identification and annotation (DNS and ISP naming)
Report on properties of maps from ten diverse ISPs :
•
•
•
Size of POPs
Distribution of router outdegree
Inter-domain peering structure
Internet Topology Discovery
21
Topology Collecting Platforms - VI



Scriptroute allows everyone to measure from several VPs
•
•
Proposes remote measurement execution on PlanetLab nodes
RPT tool avoids retracing paths
TTM, developed by RIPE NCC
•
•
Full mesh between roughly a hundred monitors
One-way delay, packet loss, and bandwidth are also stored
Atlas is based on “source-routed IPv6 traceroute”
•
probe engine, topology constructor, topology verifier, interactive
visualization program
Internet Topology Discovery
22
Topology Collecting Platforms - VII

TCP Sidecar
•
•
•

a technique and associated API for embedding measurement
probes into non-measurement TCP streams
avoids abuse reports and allows measurements to tunnel through
NATs and behind firewalls
Augment traceroute (TR) probes with IP Record Route option (RR)
DipZoom (Deep Internet Performance Zoom)
•
•
•
Focused, on-demand Internet measurements
Offers a matchmaking service which uses P2P concepts to bring
together experimenters in need of measurements with external
measurement providers.
DipZoom participants offer measurements for the benefit of being
able to access measurements offered by other participants
Internet Topology Discovery
23
Outline

Introduction

Internet Topology Collection
•
•
•

Some measurement projects & platforms
Issues in Topology Collection
Issues in Topology Construction
•
•
•

Basic Techniques
Resolving Anonymous Routers
Resolving Alias IP Addresses
Resolving Genuine Subnets
Summary
Internet Topology Discovery
24
Issues in Topology Collection
Issues I

Forward & primary paths
•
•
Asymmetric routing
miss out on backup paths

Unbiased Sampling

Traceroute & load balancer (Paris traceroute)

MPLS (TTL reduction)

Misconfigurated network elements
Internet Topology Discovery
25
Issues in Topology Collection
Issues II

Third-party address (multi homing)

Redundancy

•
•
•
intra-monitor redundancy
inter-monitor redundancy
DDoS
Responsiveness
•
•
•
ICMP echo request
TCP syn
UDP port unreachable
Internet Topology Discovery
26
Outline

Introduction

Internet Topology Collection
•
•
•

Some measurement projects & platforms
Issues in Topology Collection
Issues in Topology Construction
•
•
•

Basic Techniques
Resolving Alias IP Addresses
Resolving Anonymous Routers
Resolving Genuine Subnets
Summary
Internet Topology Discovery
27
Issues in Topology Construction - I
at Router Level

Alias Resolution
•
•
•
•
•
•
Iffinder
Ally
DNS based method
Graph based method
Analytical IP Alias Resolution (APAR)
Record route option
Internet Topology Discovery
28
Alias Resolution




Each interface of a router
has an IP address.
A router may respond with
different IP addresses to
different queries.
.33
.5
.18
Denver
.7
.13
Alias Resolution is the process of grouping the interface
IP addresses of each router into a single node.
Inaccuracies in alias resolution may result in a network
map that
•
•
includes artificial links/nodes
misses existing links
Internet Topology Discovery
29
Issues in Topology Construction - II
at Router Level

Anonymous Router Resolution
•
•
•
•
Basic heuristics [Bilir 05] & [Xin 06]
Graph minimization approach [Yao 03]
ISOMAP based dimensionality reduction approach [Xin 06]
Graph based induction
Internet Topology Discovery
30
Anonymous Router Resolution
Problem

Anonymous routers do not respond to traceroute
probes and appear as a  in path traces
• Same router may appear as a  in multiple traces.
• Anonymous nodes belonging to the same router should be resolved.
U
S
y

H
L
x
Anonymity Types
1.
2.
3.
4.
5.
K
Ignore all ICMP packets
ICMP rate-limiting
Ignore ICMP when congested
Filter ICMP at border
Private IP address
S
y
z
W
A
Sampled network
C
U
z
W
L
Internet Topology Discovery
N
C
x
A
Resulting network
31
Issues in Topology Construction - III
at Router Level

Genuine Subnet Resolution
•
Inferring Subnets in Router-level Topology Collection Studies
[Gunes 07]
Internet Topology Discovery
32
Genuine Subnet Resolution
Problem

Subnet resolution
•
Identify IP addresses that are connected over the same medium
IP1
IP1
IP2
IP3
IP2

IP3
Improve the quality of resulting topology map
A
C
B
D
(underlying topology)
A
B
A
C
D
CC
(observed topology)
Internet Topology Discovery
B B
A
D
D
(inferred topology)
33
Summary

Introduction
•
•

Internet Topology Collection
•
•
•

Internet as a Complex Network
Motivations on Internet Topology Measurement
Basic Techniques
Some Measurement Projects & Platforms
Issues in Topology Collection
Issues in Topology Construction
•
•
•
Resolving Anonymous Routers
Resolving Alias IP Addresses
Resolving Genuine Subnets
Internet Topology Discovery
34
Questions ?
Internet Topology Discovery
35
Download