CANARIE's User Controlled LightPath (UCLP)

advertisement
19th APAN meetings in Bangkok, TH
Exploring eScience Session 3: Facility Instruments
World’s First Demonstration of Multistream HDTV switching using User
Controlled LightPaths (UCLP)
Hervé Guy
[email protected]
Thursday 2005.1.27 11:00-12:30
Place: Room B, i.e. Watergate Ballroom,6th Floor Section B
Table of Contents
> UCLP v1.0
–
–
–
–
History, Deployments on UCLP lab. and CA*net 4, Definitions
University of Waterloo’s UCLP v1.4.
University of Ottawa/CRC’s UCLP v1.2 & 1.3+.
Université du Québec à Montréal or UQAM’s UCLP v 1.3.
> UCLP Demonstrations
– Purpose: UCLP will connect 4 HDTV streams to Bangkok sequentially.
– Participants: NCHC (TW); KISTI (KR); CRC (CA) and i2CAT (ES)
– Let UCLP plays
> UCLP v2.0
– Roadmap
History - UCLP v1.0
CANARIE's Directed Research Program
> Co-funded by Cisco Canada and CANARIE
(http://www.canarie.ca/funding/research/projects.html)
> Held in 2003.
> 10 proposals submitted
> 3 selected
• University of Waterloo (http://bbcr.uwaterloo.ca/~canarie/index.htm)
• University of Ottawa - Communications Research Centre (CRC)
(http://phi.badlab.crc.ca/uclp/)
• Carleton University (http://lightpath.physics.carleton.ca/)
> + 1 bonus
• Université du Québec à Montréal (UQAM)
(http://www.teleinfo.uqam.ca/opticnet/)
UCLP deployment on CA*net 4
(http://www.canarie.ca/canet4/uclp/uclponc4.html)
> For ease of management of lightpath on CA*net 4, a user must
comply with CANARIE's Lightpath Allocation Policy and must
fill out CANARIE's Lightpath Request Form.
> Only registered source IP addresses will be permitted to
connect to the lab. Requests are to be sent to [email protected]
> UCLP deployed:
– University of Waterloo v1.4: https://uclp01.canet4.net/web-uclp/.
– University of Ottawa - Communications Research Centre (CRC) v1.2
• Federation c4west:
• Federation c4 central:
• Federation c4east:
http://uclp02.canet4.net:4445/demo.jnlp;
http://uclp02.canet4.net:5550/demo.jnlp;
http://uclp02.canet4.net:7777/demo.jnlp.
– University of Ottawa - Communications Research Centre (CRC) v1.3+
• Federation 3rdw
http://205.189.33.55:8080/uclpclient.jnlp;
– Université du Québec à Montréal (UQAM) v1.2.
> Log in as a normal user. C4NOC are administrative users.
UCLP deployment on CA*net 4
How to access it?
UCLP deployment on CA*net 4
LightPath allocations
UCLP Documentations
> http://www.canarie.ca/canet4/;
> uclp/...
University of Waterloo’s UCLP v1.4
Documentations
> University of Waterloo; School of Computer Science;
> Project leader: Raouf Boutaba, Ph.D.
– [email protected]
> University of Waterloo’s URL
– http://www.canarie.ca/canet4/uclp/waterloo/uclpwaterloo.html
> CANARIE’s URL
– http://www.canarie.ca/canet4/uclp/waterloo/uclpwaterloo.html
University of Ottawa/CRC’s UCLP v1.2 & 1.3+
Documentations
> University of Ottawa
– School of Information Technology and Engineering (SITE)
(http://www.site.uottawa.ca/)
– Co-project leader: Gregor v. Bochmann ([email protected])
> Communications Research Centre
– Broadband Applications and Demonstration Laboratory (BADLAB)
(http://www.crc.ca/en/html/crc/home/research/network/system_apps/badla
b/badlab)
– Co-project leader: Michel Savoie ([email protected])
> Project URL: http://phi.badlab.crc.ca/uclp/.
> CANARIE URL:
http://www.canarie.ca/canet4/uclp/crcott/uclpcrcott.html
Université du Québec à Montréal or
UQAM’s UCLP v 1.3 Documentations
> Université du Québec à Montréal (UQAM);
– Opticnet group (which is a part of Téléinfo Lab.)
> Project leader: Omar Cherkaoui, Ph.D.
– [email protected]
> Université du Québec à Montréal’s URLs
– http://www.teleinfo.uqam.ca/english/projet_lightpath.htm
– http://www.teleinfo.uqam.ca/projet_lightpath.htm
> CANARIE’s URL
– http://www.canarie.ca/canet4/uclp/uplauqam.html
UCLP v1.0
Lightpath Definition
> According to “User controlled Lightpath Definition Document
(http://www.canarie.ca/canet4/library/c4design/user_controlled_d
efinition.ppt)”, created by Bill St. Arnaud in December 2002:
– Any uni- or bi-directional point to point connection with effective
guaranteed bandwidth
– Examples of LightPaths:
• STS channel on a SONET or SDH circuit
• Etc.
UCLP v1.0 - Lightpath Definition
Simplest Working LightPath Object
Management Domain A
LightPath
Management Domain B
UCLP v1.0 - Lightpath Definition
Concatenated LightPath Object
Management Domain B
Management Domain A
Management Domain C
UCLP Demonstrations
Overall Network Architecture
> A local end-user will create the LightPaths between each participant
to Bangkok-TH via UCLP and get the HDTV stream sequentially.
CA*net 4 OC-12
KISTI (KR)
L1/L2 + STM4
NCHC
L1/L2 +
(TW)
GigE
APAN
(TH)
LP 1 LP2 LP3
Seattle
L3
LP4
Calgary
Chicago
CRC (CA)
GigE+L1/L2
Ottawa
GigE + L2
i2CAT (ES)
UCLP Demonstrations
Detailed Network Architecture
KREONet2, KISTI, Korea
Daejeon
ONS # 2
CA*net4, CANARIE
ONS # 1
Seattle, US
STM-4
Toronto
CA*Net
4
1GigE
STS24c
HDV host @ CRC
Ottawa
STS12c circuit
SURFnet
1GigE
Real-time sender
ONS
Chicago
1GigE
1GigE
TAIWANLight
(a.ka. TANet2)
Gwangju
TWAREN
HD [email protected]
HsiuChu
Seattle, US
1GigE
VLAN633 tagging
CISCO
4506
1GigE
VoD Server,
Chunghwa Telcom
Taipei
Taipei
ONS15454
Layer2 VPN
Dedicated
channel
Juniper
GEANT
1GigE
Juniper
Hsinchu
Barcelona, ES
OPTera 5200
Router
STS-12c circuit
STM-4 circuit
1GigE circuit
GEANT
N
GIST, NetMedia LAB
L3 switch
Amsterdam
Amsterdam
TWARE
N
TWARE
STM-4
STM-4
Chicago
λ
λ
1GigE
i2CAT/UPC, Spain
HDV host
1GigE
Cisco 6513
Barcelona, ES
CESCA, Spain
Juniper
M20
Madrid, ES
RedIRI
S
1GigE
Juniper
T320
RedIRIS, Spain
UCLP Demonstrations
LightPaths & Distances
LightPath Segments
Distance (Km)
Taipei (TW) – Seattle (US)
9 746
Seoul (KR) - Seattle (US)
8 329
Bangkok (TH) - Los Angeles (US) – Calgary (CA)
15 239
Calgary (CA) – Winnipeg (CA)
1 202
Winnipeg (CA) – Toronto (CA) – Ottawa (CA)
1 867
Winnipeg (CA) – Chicago (US) – Barcelona (ES)
8 247
Total
45 341
> 1.128 time the circumference of the earth!
> Are we beating a world record here?
UCLP Demonstrations
e2e connections & Distances
LightPath Segments
Distance (Km)
Taipei (TW) - CA*net 4 - Bangkok (TH)
25 696
Seoul (KR) - CA*net 4 - Bangkok (TH)
24 279
Ottawa (CA) - CA*net 4 - Bangkok (TH)
18 308
Barcelona (ES) - CA*net 4 - Bangkok
(TH)
24 688
Total
92 971
> 2.312 time the circumference of the earth!
> Are we beating a world record here?
UCLP Demonstrations #1 (25 696 km)
NCHC (TW) to APAN (TH) LPs
> Create the LightPaths between NCHC-TW and Bangkok-TH via
University of Waterloo’s UCLP and get the HDTV stream.
CA*net 4 OC-12
KISTI (KR)
L1/L2 + STM4
NCHC
L1/L2 +
(TW)
GigE
APAN
(TH)
LP 1 LP2 LP3
Seattle
L3
LP4
Calgary
Chicago
> Let’s first present the Participant NCHC-TW;
> And see what will happen on CA*net 4 after!
CRC (CA)
GigE+L1/L2
Ottawa
GigE + L2
i2CAT (ES)
National Center for High-performance Computing
NCHC
 NCHC is Taiwan’s only National Lab dedicated to
 High-Performance Computing & applications
 Networking & its applications development
 Mission
 Provide resources and service
 Do research and development
 Offer education, training, and outreach
 Key Events
 1991: Government approved the establishment proposal
 1993: Completed HQ new building in Hsinchu Science Park
 2002: Established a branch in Tainan (in Southern Taiwan)
 2003: Transformed into an non-profit organization
19
TaiWan Advanced Research and Education Network
TWAREN
 TWAREN - Successor of TANet2
 TWAREN - Part of a comprehensive, six-year national development plan
formulated by the government to stimulate creativity and foster talents.
 TWAREN Goals
• To provide a network infrastructure for academic and research
community.
• To stimulate creativity and foster talents
 TWAREN Architecture
• TWAREN is a new hybrid network with 20G POS and DWDM
technologies at its core.
• Dual circuits form the backbone. Each of the two local carriers
provides a 10 G POS network linking the four core nodes.
• There are eleven GigaPoPs, each links to the core node at 20 Gbps
and 1 dark fiber.
• Hierarchical topology: 3 layers (core, GigaPoPs, end nodes)
• Highly scalable and flexible
• Providing multiple services
20
TWAREN Connections to North America
Vancouver
Edmonton
1GbE
Calgary
CA*Net4
Winnipeg
Halifax
Montreal
StarTap Toronto
StarLight
Abilene
Taipei
TANet2
TWAREN
 Trans-Pacific link to Seattle is at STM-16
 Link from Seattle to STARLight was
upgraded to STM-4.
 An additional 1GbE lightpath from
CANARIE serves as TaiwanLight
21
NCHC Relationship with UCLP
Lease a lightpath from CANARIE
between Seattle and Chicago.
Lightpath between
TWAREN/CA*Net4/HEAnet
 5-point videoconferencing among Taiwan (Asia),
Canada (NA) and Ireland (Europe) in March, 2004
 Distance:  18,000km
UCLP training class in Taiwan by
CANARIE engineers, joined by Korea
via videoconferencing
Collaborated with CANARIE to make
22
Demo Setup in NCHC
1GigE to CA*net4's Seattle 15454
TAIWANLight
(a.k.a TANet2)
Seattle, US
15454
STM-4
TWAREN
CHT
Taipei
15454
1 GigE
Taipei
15454
STM-4
TWAREN,Taiwan
Hsinchu
15454
HD host
@NCHC,
Hsinchu
23
UCLP Demonstrations #1 (25 696 km)
NCHC (TW) to APAN (TH) LPs
NCHC (TW) to APAN (TH) LPs via
University of Waterloo’s UCLP
> On CA*net 4 (https://uclp01.canet4.net/web-uclp).
> As normal User
– Establish the following End To End LPO:
• ons-sea01 ons-cal01
– Access the LPO via the following Source and Destination End Points:
• ons-sea01/ slot 4/ port 2
 ons-sea01 ons-cal01 
ons-cal01/ slot 14/ port 4.
– Check End To End connectivity by receiving HTDV streams from NCHC
(Taiwan) to the APAN Meeting venue at Bangkok.
– MRTG - APAN LightPaths Traffic Rates (http://ons.canet4.net/apan/).
– Remove Access the above LPO.
– Cancel or Terminate the End To End LPO.
UCLP Demonstrations #2 (24 279 km)
KISTI (KR) to APAN (TH) LPs
> Create the LightPaths between KISTI-KR and Bangkok-TH via
UQAM’s UCLP and get the HDTV stream.
CA*net 4 OC-12
KISTI (KR)
L1/L2 + STM4
NCHC
L1/L2 +
(TW)
GigE
APAN
(TH)
LP 1 LP2 LP3
Seattle
L3
LP4
Calgary
Chicago
> Let’s first present the Participant KISTI-KR;
> And see what will happen on CA*net 4 after!
CRC (CA)
GigE+L1/L2
Ottawa
GigE + L2
i2CAT (ES)
KISTI–CANARIE UCLP
Demonstrations
January 27, 2005
19th APAN meeting, Bangkok
Jong-Uk Kong
Supercomputing Center, KISTI
Supercomputing Center
27
Contents




KISTI & KREONET
KISTI-CANARIE Collaborations
Light Provisioning & UCLP for Demo
Stereo HD VoD Setup for Demo
Supercomputing Center
28
Korea Institute of Science and
Technology Information
Major Functions

Knowledge Infrastructure for Digital Research
- Advancement of Supercomputer and KREONET
- Research on the next generation technology, knowledgebased GRID, e-Science and research network

Supercomputing
Center
Knowledge Information Portal
- Information collection, management, and diffusing
system
- Digital information dissemination environment using
DOI, MDR

National Role
Value-added Information
- In-depth analysis and feasibility study
- Use of Supercomputer for BT and NT information
Science & Technology
Information Center
Knowledge Resources
Development Center
Supercomputing Center
29
KREONET I
 Korea Research Environment Open
NETwork

National high-performance science &
research network in Korea



Nation-wide optical gigabit backbone
network


About 200 members : Universities, National
Research Labs, government organizations, etc.
High-capacity access network(1Gbps~10Gbps) :
30 members
12 GigaPoPs in 11 regions (~ 10Gbps)
KREONet2

International R&E network based on KREONET

Supercomputing Center
Korea-US (StarLight and PacWave over CA*net4
Lightpath) : 1.2Gbps
30
KREONET II
Supercomputing Center
31
KISTI-CANARIE Collaborations
Trans-Pacific Connectivity : two STM-4 circuits (1.2G)
• PacWave and StarLight
• StarLight over CA*net4 lightpath, Seattle to Chicago based on UCLP
Joining Global-scale lambda Grid networking
Successful HD & UCLP Collaborative Demonstrations
• ITU Telecom Asia2004 in Busan, Korea (September 7-11, 2004)
• Collaborations with CANARIE, UPC/I2CAT
KREONet2
CA*Net4
StarLight
Seoul
Gyunggi
(Suwon, Incheon)
Chungnam
Daejeon
STM-4 * 2
STM-4 ~
Chicago
APII-testbed/KREONet2
Daejeon
Pohang
Jeonbuk
Daegu
Busan
Gwangju
Changwon
Global Lambda
Networking
Seattle
PacWave
Supercomputing Center
32
Lightpath Provisioning & UCLP for Demo
KREONet2, KISTI, Korea
Daejeon
Cisco ONS #2
CA*net4, CANARIE, Canada
Daejeon
Cisco ONS #1
Seattle, US
STM-4
Daejeon
STM-4
CA*net
4
1GigE
1GigE
Calgary, CA
ONS15454
L3 switch
Router
VLAN633
tagging
STS24c
Gwangju
ONS
1GigE circuit
Cisco
7609
UCLP
Gwangju
1GigE
Cisco
4506
STM-4 circuit
GIST, NetMedia LAB
VLAN633 tagging
1GigE
HD Receiver in Bangkok
Stereo HD VoD Server
205.189.32.252,
GIST, Gwangju
Supercomputing Center
33
Stereo HD VoD Setup for APAN UCLP Demo
GIST NML (http://hdtv.nm.gist.ac.kr) with KISTI
Supercomputing Center
34
UCLP Demonstrations #2 (24 279 km)
KISTI (KR) to APAN (TH) LPs
KISTI (KR) to APAN (TH) LPs via
UQAM’s UCLP
> On CA*net 4 (via the client UCLPGUI.EXE)
> As normal User
– Request the following LightPaths:
• ons-sea01/ slot 3/ port 1/ channel 1-12
 ons-sea01 ons-cal01 
ons-cal01/ slot 14/ port 4.
– Check End To End connectivity by receiving HTDV streams from
KISTI (KR) to the APAN Meeting venue at Bangkok.
– MRTG - APAN LightPaths Traffic Rates
(http://ons.canet4.net/apan/).
– Cancel the above LightPaths:
UCLP Demonstrations #3 (18 308 km)
CRC (CA) to APAN (TH) LPs
> Create the LightPaths between CRC-CA and Bangkok-TH via
University of Ottawa/CRC’s UCLP and get the HDTV stream.
CA*net 4 OC-12
KISTI (KR)
L1/L2 + STM4
NCHC
L1/L2 +
(TW)
GigE
APAN
(TH)
LP 1 LP2 LP3
Seattle
L3
LP4
Calgary
Chicago
> Let’s first present the Participant CRC-CA;
> And see what will happen on CA*net 4 after!
CRC (CA)
GigE+L1/L2
Ottawa
GigE + L2
i2CAT (ES)
Université d’Ottawa
University of Ottawa
CRC – CANARIE
UCLP Demo at 19th APAN
J. Michel Savoie, Research Program Manager
Broadband Applications & Optical Networks
Tel: (613)998-2489 Fax: (613)998-2753
Email: [email protected]
URL: http://www.crc.ca
January 27, 2005
Communications Research Centre Canada
Foundations for the Future
• Primary federal government
laboratory for R&D in advanced
telecommunications
• Agency of Industry Canada (IC)
• 200 research staff
Research Branches
• Terrestrial Wireless
• Satellite Communications and
Radio Propagation
• Broadcast Technology
• Broadband Network
Technologies
Shirleys Bay Campus
CRC Vision
National leadership in collaborative
research and development on innovative
communications, broadcasting and
information technologies for a strong
Canadian knowledge-based economy.
BROADBAND APPLICATIONS AND
OPTICAL NETWORKS (RBON)
R&D Activities
•
• Emerging broadband
applications, services
and technologies
•
associated with next
•
generation optical
Main
Research Themes
networks
• Broadband Applications &
Services
• Advanced Optical Networking
Technologies
• Control & Management of
Next Generation Optical
Networks
Mandate
Provide expert advice to IC, other
federal departments, agencies and
Canadian industry
Promote technology transfer to industry
Support IC and its CANARIE program
in branding Canada as a leader in optical
networks and related technologies
Key Facilities
• Broadband Applications and
Demonstration Laboratory
(BADLABTM)
• Optical Networking Laboratory
(ONL)
User-Controlled E2E Lightpath
Provisioning over CA*net 4
• Project funded under CANARIE’s Directed Research
Program on User Controlled Lightpath Provisioning
(UCLP) Software
• Lead Participant: University of Ottawa
• Participant: Communications Research Centre
• UCLP System software is being enhanced under
collaboration with the Optical Communications Group
(GCO) of the Technical University of Catalonia (UPC)
http://phi.badlab.crc.ca/uclp/
CRC Network for UCLP Demo
JVC GR-HD1
CyberCAM
IEEE-1394
205.189.32.250
VideoLAN HDV Server
Ruff Systems HDV Server
142.92.71.32
CA*net 4
GbE
H.323
Polycom
ViewStation FX
100BaseTx
LightPath Service
VLAN 633
GbE
Catalyst 6509
GbE
CRC
GigaPoP
GbE
Federal
GigaPoP
CA*net 4
Layer 3 Service
Acknowledgements and thanks to:
• CRC technical support staff and CA*net 4 NOC
operators who assisted in making this demo possible
• CANARIE for giving us the opportunity to demonstrate
our UCLP System
• NICT/TEL for allowing us to use their Ruff Systems
HDV application for streaming live High Definition TV
image and sound over IP
UCLP Demonstrations #3 (18 308 km)
CRC (CA) to APAN (TH) LPs
CRC (CA) to APAN (TH) LPs via
University of Ottawa/CRC’s UCLP
> On CA*net 4
– Federation c4central: http://uclp02.canet4.net:5550/demo.jnlp.
> As normal User
– Create the E2E Connection the following RO End Points and LPOs
• ons-ott01/ slot 3/ port2;
 ons-tor01 ons-win01  ons-reg01  ons-cal01 
ons-cal01/ slot 14/ port 4.
– Check End To End connectivity by receiving HTDV streams from
CRC (CA) to the APAN Meeting venue at Bangkok.
– MRTG - APAN LightPaths Traffic Rates
(http://ons.canet4.net/apan/).
– Delete the E2E Connection the above.
UCLP Demonstrations #4 (24 688 km)
i2CAT/UPC (ES) to APAN (TH) LPs
> Create the LightPaths between i2CAT/UPC-ES and BangkokTH via U. of Ottawa/CRC’s UCLP and get the HDTV stream.
KISTI (KR)
L1/L2 + STM4
NCHC
L1/L2 +
(TW)
GigE
APAN
(TH)
LP 1 LP2 LP3
Seattle
L3
LP4
Calgary
Chicago
CRC (CA)
GigE+L1/L2
Ottawa
GigE + L2
i2CAT (ES)
> Let’s first present the Participant i2CAT/UPC-ES;
> And see what will happen on CA*net 4 after!
i2CAT Foundation
i2CAT is a private non-profit foundation whose aim is the boost of
Research & Innovation on the second generation Internet
environment
The i2CAT project started in 1999 and finished at the end of 2003. A
private foundation was constituted on 2004 to continue this
work with more funding, administrative support and new
members.
The i2CAT key model is based on the collaboration between the
public and private sectors and the academic environment, in
the Information and Communication Technologies sector
APAN Demo
Innovation & Research Interactions
Research
Innovation
University
Administration
Private Sector
A
U
D
I
O
V
I
S
U
A
L
Technology
Transfer
Dissemination
Internet
N
E
T
W
O
R
K
T
E
C
H
N
O
L
O
G
I
E
S
B
I
O
M
E
D
I
C
A
L
Gigacat: the Gigapop
MediaCAT: video services platform
GridCAT: distributed computing
services
APAN Demo
E
D
U
C
A
T
I
O
N
i2CAT Foundation goals
i2CAT foundation is a partnership platform for research and
innovation, whose aim is:
Promoting advanced networks research and broadband
application and increasing its practice.
Creating new cooperation platforms between the private
sector and the university research community.
Pushing teamwork between world wide institutions and
societies with similar objectives into networking.
Being a meeting forum for those institutions, societies and
companies wishing to participate inside a global project for
the infrastructures development and broadband network
services.
APAN Demo
i2CAT relationship with UCLP I
CRC-UPC MOU. December 2003
The collaboration between CRC and UPC is reflected under a
Memorandum of Understanding, which establishes the terms for
collaborating on Broadband and Optical Networking Research
Projects
Joined the CRC-UofO UCLP development team.
Adapted the UCLP software to make it compliant with Nortel OPTera
Metro 5200 and Cisco Catalyst 3750
UCLP software is being implemented on the i2Cat optical experimental
network. i2CAT is currently working with CRC in the next version of
UCLP, UCLPv2
UCLP events:
CRC-UPC UCLP Demo to the EU. June 2004
Made a peering connection between CA*net 4 and i2cat
HTDV/IP demo over an optical link controlled between BCN and
Daejeon (Korea). September 2004
APAN Demo
i2CAT network
APAN Demo
i2CAT network for APAN demo
Federation 1
Castelldefels
E
Nortel OPTera
Metro 5200
Federation 2
Federation 3
CCABA
BCN
W
E
Nortel OPTera
Metro 5200
VLAN 633
W
Nortel OPTera
Metro 5200
VLAN 633
HD Host
MediaCat
APAN Demo
UCLP Demonstrations #4 (24 688 km)
i2CAT/UPC (ES) to APAN (TH) LPs
i2CAT/UPC (ES) to APAN (TH) LPs
via University of Ottawa/CRC’s UCLP
> On CA*net 4
– Federation c4east: http://uclp02.canet4.net:7777/demo.jnlp.
> As normal User
– Create the E2E Connection the following RO End Points and LPOs
• ons-chi01/ slot 2/ port 2;
 ons-win01  ons-reg01  ons-cal01 
ons-cal01/ slot 14/ port 4.
– Check End To End connectivity by receiving HTDV streams from i2CAT
(ES) to the APAN Meeting venue at Bangkok.
– MRTG - APAN LightPaths Traffic Rates (http://ons.canet4.net/apan/).
– Delete the E2E Connection the above.
UCLP Demonstrations at APAN
Period of Questions
> Thanks to Participants:
–
–
–
–
–
CANARIE (CA): Hervé Guy ([email protected])
NCHC (TW): Eugene Yeh ([email protected])
KISTI (KR): Dongkyun Kim ([email protected])
CRC (CA): Michel Savoie ([email protected])
i2CAT (ES): Sergi Figuerola ([email protected])
> Thanks to UCLP v1.0 Developers:
– University of Waterloo (CA): Raouf Boutaba ([email protected])
– University of Ottawa/CRC (CA): Michel Savoie ([email protected])
– UQAM (CA): Omar Cherkaoui ([email protected])
Download
Random flashcards
Arab people

15 Cards

Pastoralists

20 Cards

Create flashcards