Deliverable For:
New Mexico ITS On Call Project
Task 3
Communications Implementation Plan
Albuquerque Municipal Planning Area
Draft Short-Term Implementation Plan
Submitted To:
New Mexico Department of Transportation
Submitted By:
ICx Transportation Group
500 N. State College Blvd., Suite 1100
Orange, California 92868
Submittal Date:
2/25/2010
Communications Implementation Plan - Draft Short-Term Implementation Plan
Table of Contents
1.
Overview ............................................................................................................................................... 1
2.
AMPA Short Term Implementation Plan Overview .............................................................................. 1
3.
2.1
Systems Engineering Process ........................................................................................................ 1
2.2
Short Term Implementation Plan Projects ................................................................................... 2
2.3
Overview of Needs Addressed in the Short Term Implementation Plan ...................................... 2
Overview of Suggested Short-Term Communications Infrastructure Approach .................................. 3
3.1
TMC Short Term Projects .............................................................................................................. 4
3.1.1
Internet Connection Upgrade (Capacity and Reliability Improvement) ............................... 4
3.1.2
Redundant Leased Line (Physical Redundancy) .................................................................... 4
3.2
Field Fiber Short Term Projects..................................................................................................... 7
3.2.1
Reconfigure Field Fiber Connections (Redundancy and Reliability) ..................................... 7
3.3
Coors/ Paseo Del Norte Fiber Expansion (Capacity, Reliability and Physical Redundancy)........ 14
3.4
Expansion of Fiber Installation .................................................................................................... 18
3.4.1
NMDOT ITS
G2A13/G2B13 Fiber (Reliability, Redundancy and Capacity) ............................................. 18
2/25/2010
Communications Implementation Plan - Draft Short-Term Implementation Plan
List of Figures
Figure 1. Market Package ATMS01 from the AMPA Regional Architecture Document ............................... 5
Figure 2. NMDOT ITS Network ...................................................................................................................... 9
Figure 3. Reconfigured NMDOT Fiber ......................................................................................................... 12
Figure 4. Example Field Hub Fiber Connections ......................................................................................... 13
Figure 5. NMDOT and City of Albuquerque Fiber Expansion ...................................................................... 16
Figure 6. Fiber Network Redundancy ......................................................................................................... 17
Figure 7. Project G2A13/G2B13 General Project Area ............................................................................... 18
Figure 8. Proposed Fiber Cable ................................................................................................................... 20
List of Tables
Table 1. Planning-level T-1 Leased Line Cost Estimates................................................................................ 7
Table 2. Estimated Fiber Reconfiguration Costs ......................................................................................... 11
Table 3. Coors/ Paseo Del Norte Fiber Expansion ...................................................................................... 15
Table 4. Proposed Project Near G2A13/G2B13 Cost Estimate ................................................................... 21
NMDOT ITS
2/25/2010
Communications Implementation Plan - Draft Short-Term Implementation Plan
Terminology
AMPA
Albuquerque Municipal Planning Area
ATMS01
Market Package ATMS01 – Network Surveillance
NMDOT
CCTV
Closed Circuit Television
CN4013
ITS installations from Coors to Paseo Del Volcans /
West Central Interchange Improvements
CN4086
Fiber reconfiguration along I-40 and Coors
D-3
NMDOT District 3 Offices
D3017
I-25 Widening, Rio Bravo to Gibson
DoIT
New Mexico Department of Information
Technology
G2A13
I-25 Widening, Tramway to Bernalillo, Phase 1
G2B13
I-25 Widening, Tramway to Bernalillo, Phase 2
Hilltop
NMDOT Hilltop Office and Operations Facility
INX
INX Network Assessment Document
ITS
Intelligent Transportation Systems
MVDS
Microwave Vehicle Detection Systems
NMDOT
New Mexico Department Of Transportation
O&M
Operations and Maintenance
RSTP
Rapid Spanning Tree Protocol
SLA
Service Level Agreement
Telco
Telephone Provider
TMC
Transportation Management Center
TOC
Traffic Operations Center/ Traffic Management
Center
NMDOT ITS
2/25/2010
Communications Implementation Plan - Draft Short-Term Implementation Plan
1. Overview
The New Mexico Department of Transportation (NMDOT) has implemented and plans to expand
implementation of Intelligent Transportation Systems (ITS) and an associated communications
infrastructure to support improved transportation operations across the State. This technical memo is
part of Task 3 of the Communications Plan scope of services, which will develop a Communications
Implementation Plan. The implementation plan contains two main parts along with their respective
subtasks:
Part A includes the Albuquerque area and addresses the field devices and communications in and
around the Metro area. The subtasks include:





Inventory (complete)
Requirements (complete)
Gap Analysis (complete)
Alternatives Development (addressed in this memo)
Implementation Plan (addressed in this memo)
Part B includes the remaining areas Statewide outside of the Albuquerque area. The subtasks
include:





Inventory
Requirements
Technology Opportunity Assessment
Short-Term Implementation Plan
Mid- and Long-Term Plans
2. AMPA Short Term Implementation Plan Overview
The objective of this deliverable is to document the preferred implementation approach and possible
required equipment for potential short term projects in the Albuquerque Municipal Planning Area
(AMPA). In addition, this deliverable includes planning level implementation costs for each project.
2.1 Systems Engineering Process
This document complies with the Systems Engineering process outlined New Mexico Systems
Engineering User Guide. The information herein supports the preliminary steps of the Systems
Engineering process for ITS communications projects. As actual implementations are proposed for
funding, this information can be referenced to provide a portion of the complete Systems Engineering
process. To support that process, this document addresses, on a project basis the following:
2.1.1
Project Scoping
This document provides project alternatives and potential participating agencies, as required in the
Project Scoping phase of the Systems Engineering process. Participating agencies include stakeholders
and parties required to implement the project. The alternatives indicate other possible means to
NMDOT ITS
1
2/25/2010
Communications Implementation Plan - Draft Short-Term Implementation Plan
implement similar functionality. It includes the benefits as well as well as reasons why the suggested
alternative provides greater benefit.
2.1.2
Preliminary Design
The Preliminary Design phase, as outlined in the NMDOT System Engineering User Guide, requires a
System Engineering Management Plan, Concept of Operations and System Requirements. This
document provides planning level information that can be used to complete project-level Concepts of
Operations and System Requirements as projects are implemented.
2.1.3
Costs
Planning-level costs are provided to better understand the scope and scale of the potential projects.
Both implementation and estimated operations and maintenance costs are provided. Any cost
information will need to be considered as a preliminary, as the assumptions included in this document
will need to be confirmed when the project design is actually begun.
2.2 Short Term Implementation Plan Projects
Six key network areas were outlined as part of Task 3, Tech Memo 3: Short Term Alternatives. The key
areas included:






Traffic Management Center (TMC)
Hilltop
District 3 Office (D-3)
Field Fiber
Other Field Communications
Field Device Locations
The goal of the short term projects presented herein is to enhance the current NMDOT communications
network by increasing reliability, redundancy and capacity. Short term projects proposed in this
document address three of the six key network areas: the TMC, Hilltop and Field Fiber. These are the
areas where NMDOT has the most flexibility and control in the short term to improve the network.
2.3 Overview of Needs Addressed in the Short Term Implementation Plan
Three key aspects of the existing network are addressed:
1. Capacity. As field devices are added to the ITS inventory, additional capacity is needed to address
them. CCTV cameras, in particular, affect the need to add capacity. Recently, the addition of ITS
devices, including CCTV, has resulted in a need to increase the capacity to the TMC.
2. Redundancy. Network redundancy enables a network to function or recover quickly from failures.
Failures can be due to breaks from various causes (e.g. aging cable, accidental breaks by
contractors), connection or splice failures, and equipment failures. The level of appropriate physical
NMDOT ITS
2
2/25/2010
Communications Implementation Plan - Draft Short-Term Implementation Plan
redundancy of a fiber network depends upon the location of the fiber optic lines, the impact of a
loss of service due to physical breaks, and the cost to implement a redundant physical path.
In terms of location, when fiber optic cable is installed within a freeway right-of-way, the potential
for accidental breakage by contractors is minimized as access to the right-of-way itself is restricted
(as compared to fiber optic cable installed in a surface-street right-of-way). However, a risk of
breakage still exists from permitted construction and maintenance activity.
The bulk of the ITS devices in the AMPA region are located on I-25, mainly north of I-40, and on I-40
within a few miles east and west of I-25. While a break in communications that serve these devices
would not result in traumatic consequences, if cost effective means to provide physical redundancy
can be provided, it should be. A key link to address is the connection of devices to the TMC, where a
failure of the connection would result in total loss of field ITS functionality.
Two typological approaches to redundancy can be taken to fiber optic networks. One is a collapsed
ring typology. This involves installing a linear fiber-optic cable with additional fibers connected in a
redundant fashion to the communications hardware. This approach protects against failures on
individual fibers or connections. Current fiber deployment by the NMDOT in the AMPA utilizes a
collapsible dual ring topology.
The second typology is physical redundancy. This can be accomplished either by using an alternative
technology to provide a redundant path, or by creating a physical fiber optic ring, that would
operate even if there were a break or failure at some point in the ring.
Key limitations of the current infrastructure are:
 TMC network connections lack adequate capacity.
 There is no physically redundant fiber connection to the TMC from the core switches at the
Hilltop location..
 Lack of redundancy in the field fiber network.
 Lack of physical redundancy on key portions of the field fiber network that serve the majority of
field devices and provide connectivity to the TMC.
 Many field devices are not served by a fiber optic infrastructure, but are addressed via wireless
means. Wireless is not as reliable as fiber optic communications.
The goal of this short term implementation plan is to address these issues in a financially feasible
manner.
3. Overview of Suggested Short-Term Communications Infrastructure Approach
The existing ITS communications infrastructure was implemented in a step-wise fashion. Some portions
were implemented as part of road construction projects. Some were implemented as the TMC was
NMDOT ITS
3
2/25/2010
Communications Implementation Plan - Draft Short-Term Implementation Plan
relocated from District 3 to Hilltop, and from Hilltop to the current TMC location. All of these projects
were done with constrained budgets and schedules. The result is a working communications network,
but one with some potential weaknesses that should be addressed to ensure a high operational
reliability.
3.1
TMC Short Term Projects
The following describes the suggested short term projects to upgrade communications to the
Albuquerque TMC to meet requirements.
3.1.1
Internet Connection Upgrade (Capacity and Reliability Improvement)
The Internet connection at the TMC has been upgraded to a 45Mb/s, independent connection. This
connection was installed to alleviate the load on the D-3 internet connection as described in Tech Memo
1. This new connection allows traffic from deployed cellular devices to bypass the D-3 and Hilltop
locations, and be more directly connected to the end users and systems at the TMC, while reducing the
overall network utilization.
This independent connection not only reduces the load on the existing NMDOT ITS network and D-3
Internet connection, it increases the reliability. In addition, the NMDOT ITS Group now has primary
control over communications to existing field devices. The connection to the Internet is no longer
located miles away at another facility through NMDOT firewalls, nor is it shared with other NMDOT
departments as it once was. NMDOT ITS now has direct control over the usage and security restrictions
to effectively deploy devices that transfer their information to the TMC via the Internet.
3.1.2
Redundant Leased Line (Physical Redundancy)
As currently configured, all IP traffic from the various NMDOT field devices are connected to the TMC via
a series of fiber loops, all with a common termination point at Hilltop. A secondary fiber loop provides
connectivity between Hilltop and the TMC. As discussed in previous Tech Memos, this linkage is critical
to operations in the AMPA region as any failure would result in the loss of connectivity between the
TMC and a majority of the ITS field devices. To remediate this risk, a short term project is proposed to
provision a leased line (private line) from a local Telco to provide a physically redundant connection
between Hilltop and the TMC. This will ensure basic continuing connectivity to field devices in the event
of a disruption of the existing fiber connection.
A primary consideration for this connection should be the use or extension of the private network that
NMDOT has implemented between the TMC and its NMRoads service provider. Expansion of this
service to include the Hilltop location would likely be the most cost efficient as a Service Level
Agreement (SLAs) and associated equipment at the TMC have likely been (or shortly will be) installed,
simplifying implementation and long term maintenance while achieving the overarching goals of the
project.
NMDOT ITS
4
2/25/2010
Communications Implementation Plan - Draft Short-Term Implementation Plan
Systems Engineering Analysis
This project is consistent with the AMPA Regional ITS Architecture and part of Market Package ATMS01
– Network Surveillance NMDOT – District 3 TOC. Figure 1, below, provides the Market Package
illustration from the ITS Architecture document. The Figure depicts the network data flows and
relationships between the NMDOT TMC and ITS field elements. Installing a backup (redundant) leased
line would greatly enhance the dataflow reliability between the TMC and NMDOT Field Sensors, CCTV
and other NMDOT field devices.
Figure 1. Market Package ATMS01 from the AMPA Regional Architecture Document
Installing a new redundant leased line between the TMC and Hilltop will require NMDOT ITS, Telco and
possibly NMDOT IT participation.
As a part of scoping this project, alternatives must be considered to possibly defray costs or provide a
better solution than the proposed leased line. One alternative is to allow the system to operate as
currently deployed. This alternative does not meet the reliability requirements for this key connection. A
second alternative is to install a new Internet connection at the Hilltop location, rather than a dedicated,
point-to-point leased line as proposed. Hardware would need to be installed to connect both the TMC
and Hilltop securely through the Internet. This link could use the new 45Mb/s internet connection
currently deployed at the TMC, thus reducing ongoing leased line costs. While reducing monthly costs,
this alternative would require greater capital costs for equipment. In addition, this alternative increases
the complexity of the network due to the needed equipment to provide a secure connection between
sites.
NMDOT ITS
5
2/25/2010
Communications Implementation Plan - Draft Short-Term Implementation Plan
The initiating factor for implementing this project is that there is a potential for system communications
failures which would cause loss of field device connectivity to the TMC due to the fact that there is no
physical communications redundancy between the TMC and Hilltop.
The first step in developing this project would be to analyze current bandwidth needs such that the size
of the leased line can be determined. The last study completed by INX in 2007 indicated that 80Mb/s of
data was being transferred from Hilltop to the TMC. With the new 45Mb/s Internet connection at the
TMC, the overall amount of traffic on the fiber should be reduced and re-distributed. In addition to
analyzing bandwidth, actual TMC requirements during a communications disruption need to be
considered. For example, if the fiber connection to Hilltop is down, it must be determined if existing/ongoing camera feeds should be shut down to free up available bandwidth such that connectivity to field
devices (e.g. radar traffic detectors or CMS signs) can be maintained using less bandwidth, and thereby
requiring a lower cost leased line. Alternatively, the analysis should assess whether it is required to have
full TMC functionality with access to all field devices at all times. This bandwidth analysis and TMC
operations requirement assessment will provide insight into the required leased line bandwidth.
The next step would be to design the system. For a basic leased line, the Telco/Provider will install end
to end connectivity between sites. NMDOT will have the responsibility of configuring and integrating this
new connection. In developing the design, existing equipment must be able to handle a redundant
connection with Rapid Spanning Tree Protocol (RSTP) or have a similar mechanism to handle multiple
data paths without creating a data loop. It should also be noted that there must be an available network
port for the new connection at both Hilltop and the TMC.
Once the type of line and design is determined, the new leased line will need to be ordered. The
timeline will vary by location, Telco providers and potential delays while using New Mexico Department
of Information Technology (DoIT). Some providers may install the line within a few days while others
may take a month or so. When the new leased line is installed, it can then be integrated into the existing
network. Testing should follow shortly after to verify the functionality of the new line. Testing should
include temporarily disabling the main fiber line and verifying that the backup leased line is active and
passing data to the TMC. The test can conclude when the required TMC operations can be conducted
using the backup leased line.
The majority of maintenance for this installation will be performed by the Telco. There will be no new
equipment installed as part of this project since existing equipment will be used. The only change to
existing equipment will be configuration changes to manage the new data paths.
Costs will depend on what speed is required, distance, location and the type of service level. For
example, a typical T-1 to the Internet can cost approximately $500/month. Since this short term
proposed project connects two sites, the cost will most likely be higher per month. In addition to
distance, the type of Service Level Agreement (SLA) will impact the price. Unlike a DSL line for home or
small business, a private leased line such as a T-1 can include a SLA. The SLA is essentially a promise by
the Telco to meet certain up-time requirements as defined in the agreement and most often have
NMDOT ITS
6
2/25/2010
Communications Implementation Plan - Draft Short-Term Implementation Plan
financial consequences for the Telco if it does not provide adequate service. With all these factors, it is
difficult to estimate costs without contacting the Telco to obtain an estimate of costs.
Table 1 provides planning-level costs related to the leased line. Other than NMDOT staff time to order
and integrate this connection, costs for the Hilltop-TMC leased line are limited to initial setup and
ongoing monthly subscriber fees.
Description
T-1 Lease Line Setup Fee
T-1 Lease Line
Qty
Capital Costs
Unit Cost Total
1
$200
Qty
Monthly Costs
Unit Cost Total
$200
1
$200
$700
Notes
Typical Telco Setup Fee. Often
$0 this fee is waived.
$700 Approximate Monthly Costs
$700
Table 1. Planning-level T-1 Leased Line Cost Estimates
3.2 Field Fiber Short Term Projects
The following describes field fiber short term projects.
3.2.1
Reconfigure Field Fiber Connections (Redundancy and Reliability)
Reconfiguring field fiber connections would involve reconfiguration of existing fiber termination blocks
to allow a core distribution ring to be created between the Hilltop and TMC locations. As currently
configured, the NMDOT fiber network is made up of several distribution rings all terminating at Hilltop.
A failure at Hilltop would eliminate connectivity between the TMC and a large percentage of NMDOT’s
ITS field infrastructure. Reconfiguration of the fiber path between Hilltop and the TMC, as well as
spreading out the termination points of the field distribution rings, would provide redundancy. With this
reconfiguration, two separate locations could potentially access field data if one or the other was to go
offline. This project is similar to the proposed Redundant Leased Line project, with the added advantage
of increasing network redundancy without the limitations associated with the available bandwidth of
the leased line.
This proposed short term project would reroute data traffic over NMDOT-owned fiber to span both
Hilltop and the TMC, providing physical redundancy if the Hilltop location were to drop offline. Field
data would have an alternate path straight to the TMC.
Systems Engineering Analysis
This project to reconfigure fiber connections would be consistent with the AMPA Regional ITS
Architecture and is identified as part of Market Package ATMS01 – Network Surveillance NMDOT –
District 3 TOC. Reconfiguring fiber to span both the TMC and Hilltop would be enhancing the reliability
between the TMC and NMDOT Field Sensors, CCTV as well as other NMDOT field devices connected to
the Fiber Network.
NMDOT ITS
7
2/25/2010
Communications Implementation Plan - Draft Short-Term Implementation Plan
Reconfiguring the fiber between the TMC and Hilltop will require NMDOT ITS, Contractor and possibly
NMDOT IT participation.
Project alternatives must be considered to possibly defray costs or provide a better solution. The first
alternative is to allow the system to operate as currently deployed. The downside of this alternative is
the potential for the single link between the TMC and field elements to be disrupted, or for equipment
at Hilltop was to go offline. A second alternative would be to install a dedicated point-to-point leased
line from a field ring to the TMC. This would provide connectivity to the network, but ongoing point-topoint leased lines from each field ring would result in ongoing costs, which would not be required in the
reconfiguration. A third possibility is to install an Internet connection or extend the planned private
network at a field hub for connectivity to the TMC. Hardware would need to be installed to connect
both locations securely through the Internet. This would use the new 45Mb/s internet connection
currently being deployed at the TMC. This approach would reduce ongoing leased line costs while using
existing infrastructure. While reducing monthly costs, this alternative would have a higher cost than the
reconfiguration, and increase the complexity of the network.
Part of the Concept of Operations and Implementation Plan is to document project initiation,
development, and maintaining the system processes. The initiating factor that this project will mitigate
is the possibility of communication loss between the TMC and field elements if the equipment at Hilltop
fails.
Ultimately this project will add a network path from the field fiber rings to the TMC. The current fiber
implementation brings all field fiber to Hilltop then into a multilayer Cisco Catalyst 4510R switch. The
data continues from the Cisco4510R to a Cisco 2950 which passes the data to the TMC network. This is
illustrated in the NMDOT-providedFigure 2, below. The new overall design would be to install new
connections from the TMC to Field rings. In the field, this can be accomplished in many ways depending
on the distance away from the TMC, as well as the capabilities of the currently deployed equipment. The
first option is to physically splice into one of the two pairs of fibers that lead into Hilltop and reroute
them directly to the TMC. The second option uses existing and spare fiber pairs to reconfigure the fiber
to create new connections between existing field rings and the TMC. The second approach is preferred
as there will be minimal changes to existing fiber in use, and to the collapsed fiber rings currently
connected to the Hilltop location.
NMDOT ITS
8
2/25/2010
Communications Implementation Plan - Draft Short-Term Implementation Plan
Figure 2. NMDOT ITS Network
There is an issue that will arise with either of these approaches. The ITS communications network
currently uses City of Albuquerque-owned fiber, with access to a single buffer tube containing six pairs
of fiber. Terminating all the field rings directly to the TMC is impossible with the current fiber limit at the
TMC. A solution is to install environmentally hardened, Gigabit Layer 3 switches at a hub location where
fiber from the field and fiber to the TMC is readily available. Through discussions with NMDOT staff, and
based on the general location of fiber, there are two possible locations to place this equipment, either in
an existing hub or to build out a new hub. The first potential location is at 4th Street and I-40, and the
second is at the I-40/ I-25 Interchange. Both locations are indicated in Figure 3, below, with green
circles. These two locations are the points closest to the TMC where NMDOT and City of Albuquerque
fiber intersect. Field ring fibers that need to be routed to the TMC would be terminated at the selected
hub location in any Standard NMDOT cabinet capable of housing 19” rack mounted equipment. At the
new hub location, a single pair of fibers would need to be spliced to provide connectivity to the TMC.
The hardened Layer 3 switch installed at the chosen Hub location would serve as a backup to the
existing Cisco 4510 switch located at Hilltop, and would be creating a core redundant ring from which a
series of field distribution rings can be connected too. Depending on the utilization of the Cisco 4510,
adding a single hardened Layer 3 switch may not meet existing load requirements. If so, additional
switch infrastructure may be needed so that this hub location can manage the current data load. This
NMDOT ITS
9
2/25/2010
Communications Implementation Plan - Draft Short-Term Implementation Plan
new switch will then use a pair of fiber to provide connectivity from the chosen Hub location back to the
TMC.
In addition to the connection between the chosen field hub and the TMC, spare fiber between the
existing fiber field rings will need to be configured to span both the existing connection to Hilltop and to
the new field hub. Figure 4 provides example fiber connections for both possible field hub locations. The
dashed red lines show possible reconfigured connections from the field rings to the new field hub. The
figure also shows possible field-ring-to-field-ring links in orange. Adding these redundant paths will
increase the reliability of the overall network.
The connection from the new field hub should connect to the existing Layer 3 Cisco 3750 switch at the
TMC capable of handling multicast video. The Layer 3 Cisco 3750 will be acting in the same capacity as it
is used now. However, the utilization of the Cisco 3750 at the TMC should still be researched. If the
utilization is at or nearing full capacity, the unit should be upgraded, as further deployment of the field
network will increase the demand on the switch.
Besides implementing the physical infrastructure links, the network equipment must be configured to
accept this updated topology. With additional redundant links, RSTP or similar protocols must be
configured to route traffic only to the backup links if the main connection to the equipment at Hilltop
fails. The connection from the field to the hub and then to the TMC is essentially a backup and provides
more redundancy than installing a leased line from the TMC to Hilltop. However, there is no reason the
links cannot be used to augment the capacity of Hilltop.
The increased equipment and fiber network connections will ultimately belong and remain the
responsibility of NMDOT. NMDOT would remain the owner/operator of its existing equipment
infrastructure and maintain it according to existing mechanisms. The only exception would be
Albuquerque-owned fiber, which is owned and maintained by the City.
The implementation of this project will ultimately rely on the initial research and design of the fiber
splices, terminations and available runs. Fiber modification will need to maximize the use of existing
unused fiber so that substantial amounts of new fiber are not needed. The next important issue is the
location of the hub. This hub will bridge between the NMDOT and City of Albuquerque fiber cables. Use
of existing fiber hub cabinets is preferred but a new cabinet with associated infrastructure may be
required if there are no existing cabinets or room within those cabinets. Once the fiber and hub
elements are in place, a new hardened Layer 3 switch must be installed at the hub locations and
configured to integrate into the network. Next the equipment at the TMC and Hilltop must be
configured to handle the new network routes. Because this project adds redundant paths, the new
network connections between the field and TMC must be brought online one at a time and tested after
each connection is made. This is to ensure that the equipment is functioning as it should and that the
NMDOT network is still functioning and not brought down by an error in the configuration of
equipment.
This proposed short term project is ambitious in that the network will be physically modified from its
original design and intent to bring increased redundancy to the network. Fortunately, the
NMDOT ITS
10
2/25/2010
Communications Implementation Plan - Draft Short-Term Implementation Plan
implementation is largely a function of reconfiguration of existing infrastructure, excluding any needed
equipment capacity upgrades. To simplify the costing exercise and to facilitate future discussion, certain
assumptions were used so that planning-level project costs can be provided. In regards to operations
and maintenance costs, this project will add to the NMDOT’s existing infrastructure and will need to be
folded into the existing ITS device maintenance schedules. However, maintenance of the proposed
equipment is expected to be minimal due to the use of fiber and environmentally hardened equipment.
Preliminary costs are outlined in Table 2 which includes fiber terminations and network switches.
Description
Capital Costs
Qty Unit Cost Total
Fiber Terminations
12
$500
Fiber Terminations
36
$500 $18,000
Optional Costs
Qty Unit Cost Total
$6,000
New Hub Cabinet
1
Network Switches
9
Layer 3 Fiber Switch
1
$1,000
$9,000
$20,000 $20,000
$53,000
$10,000
Notes
Estimated Inter- Fiber Ring
Terminations
Estimated Hub Fiber
Terminations
Hub Cabinet, Conduit, Short
Distance of New Fiber, Power.
(Not Required if space is
$10,000 available at existing cabinets)
Field Hardened Fiber Switches
for each ring
Environmentally Hardened Level
3 Switch
$10,000
Table 2. Estimated Fiber Reconfiguration Costs
NMDOT ITS
11
2/25/2010
Communications Implementation Plan - Draft Short-Term Implementation Plan
I-25
Tramway Rd
Paseo Del Norte
NMDOT-D3
Comanche Rd
Hilltop
I-40
Paseo del Volcan
4th St
Coors Blvd
University Blvd
Pennsylvania St
Tramway Blvd
Lomas Blvd
TMC
Legend
Dr. Martin Luther King
Key Locations
Possible Hub Location
Existing Fiber to Hilltop
N
No.
DATE
1
8/14/2009
ISSUE / REVISION
Initial Draft
SUBMITTED BY:
ICx Transportation Group
500 N. State College Blvd.,
Suite 1100
Orange, California 92868
PROJECT
NMDOT ITS Program – Task 3 Communications Plan
Future Fiber
Existing Fiber from Hilltop
to TMC
New fiber path to Hub
New fiber path from
Hub to TMC
TITLE
Albuquerque ITS Fiber Network –
Proposed Fiber Paths
PAGE
SCALE
None
A4
Figure 3. Reconfigured NMDOT Fiber
NMDOT ITS
12
2/25/2010
Communications Implementation Plan - Draft Short-Term Implementation Plan
TMC IT
4th Street and I-40
I-25 and I-40
Cisco 3750E-24
TMC
Cisco 3750E-24
TMC
TMC Users
Hardened Layer-3 Switch
Cisco 3750E-24
TMC
Hardened Layer-3 Switch
Redundant
Lease Line
Cisco 3750E-24
TMC
Cisco Catalyst 4510
RuggedCom04
I-25 Lomas
RuggedCom02
I-25 Central
RuggedCom06
I-25 Gore
Reconfigured Fiber Connections From Existing Field Fiber Rings
South Ring 1
Existing Fiber Connections From Existing Field Fiber Rings
Reconfigured Fiber Connections From Existing Field Fiber Rings
Hilltop
RuggedCom39
I-25 SB @ Lomas
Hilton
I-25 Gore
Hilton to Carlisle
Hillton to Washington
Carlisle
Washington
South Ring 2
RuggedCom05
I-40 Gore
RuggedCom03
I-25 MLK
Hillton to Washington
Washington
RuggedCom34
I-25 Lead
North Ring 1
RuggedCom07
I-25 Comanche
RuggedCom08
I-25 N. Comanche
RuggedCom10
I-25 N. Montgomery
RuggedCom11
I-25 Jefferson
RuggedCom14
I-25 San Antonio
RuggedCom36
I-25 N. PdN
North Ring 2
RuggedCom12
I-25 N. Jefferson
RuggedCom13
I-25 San Mateo
RuggedCom15
I-25 N. San Antonio
RuggedCom16
I-25 Paseo del Norte
RuggedCom37
I-25 Alameda
RuggedCom38
I-25 N. Tramway
I-25 SB Alameda
I-25 SB Tramway
Coor North Ring
RuggedCom17
I-40 Rio Grande
RuggedCom19
Atrisco
RuggedCom22
SB Coors N. St. Josephs
RuggedCom24
I-40 WB Off Ramp
RuggedCom27
SB Coors S. St Josephs
RuggedCom28
NB Coors S. Sequoia
RuggedCom29
NB Coors N. Sequoia
RuggedCom30
SB Coors Redlands
Coors South Ring
RuggedCom18
N/S Coors Gore
RuggedCom20
South Gore
RuggedCom21 Coors Illif
RuggedCom23
Coors Brayton
RuggedCom25
I-40 EB Off-Ramp
RuggedCom26
NB Coors Hanover
RuggedCom32
SB Coors S. Illif
RuggedCom33
SB Coors Fortuna
New Fiber Connections Between Existing Field Fiber Rings
RuggedCom09
I-25 Montgomery IC
Future Coors Paseo Del Norte
Ring
RuggedCom
RuggedCom
RuggedCom
RuggedCom
RuggedCom
RuggedCom
Figure 4. Example Field Hub Fiber Connections
NMDOT ITS
13
2/25/2010
Communications Implementation Plan - Draft Short-Term Implementation Plan
3.3 Coors/ Paseo Del Norte Fiber Expansion (Capacity, Reliability and Physical
Redundancy)
NMDOT currently has the potential to deploy additional fiber connectivity along both Coors Blvd and
Paseo Del Norte Blvd via a partnership with the City of Albuquerque’s fiber expansion efforts. This new
fiber path is show in Figure 5. NMDOT and City of Albuquerque Fiber Expansion). This additional 10 miles
of fiber will allow NMDOT to add and integrate ITS devices onto the NMDOT ITS Fiber network. The
project area extends from the Coors/I-40 interchange north to Paseo Del Norte Blvd. The planned fiber
then travels on Paseo Del Norte Blvd to I-25.
This new fiber run will provide two major benefits to the NMDOT communications network. The first
benefit is that current devices along Coors could be directly connected to the NMDOT network. This
includes approximately seven RTMS and two cameras. These devices are currently connected through
cellular modems. Migrating them to the fiber network will increase the communications reliability,
capacity, and performance between the devices and the TMC.
The second major benefit is the ability to implement an expansion of the core redundant ring proposed
by the Reconfiguration project described above. The expanded core fiber ring provides physical
redundancy to the new fiber as well as the surrounding fiber links as shown in Figure 6. The new fiber
can be configured to span between Hilltop and the TMC using existing fibers and equipment, plus
interconnecting existing collapsed rings as shown with the orange dotted/dashed lines in Figure 6. With
this type of redundancy, switches can reroute the data around physical fiber or equipment failures along
this part of the network. In addition, the new fiber will also provide a high bandwidth network to the
northeast.
Systems Engineering Analysis
Alternatives were considered for this project. One alternative is to continue using the current cellular
communications method. Another alternative would involve investigating the use of twisted pair to
provide network connectivity to the RTMS sensors and possibly the two cameras. This type of
connectivity will be discussed later in this document and involves the deployment of Ethernet extenders
over available twisted pair. The network would be much slower but would provide redundancy and add
increased reliability and control of the network beyond what cellular can provide.
This proposed project would use newly installed City of Albuquerque fiber to the north of the Coors
interchange and to the west of Paseo Del Norte I-25 interchange. For this section, and taking into
account the fiber required for the network switches, a single 12-strand buffer tube will suffice to provide
communications for IP-based devices. When terminating, the entire buffer tube should be terminated to
the patch panel. This will allow spares to be readily available for new equipment.
The main costs of the project are the termination and possible splicing of the fiber, plus procuring and
installing the networking equipment. For cost estimating purposes, assumptions as to the number of
splices, terminations and equipment required were made, and are shown in Table 3. Because this is new
infrastructure, operations and maintenance costs be added to the NMDOT’s existing costs, and will
NMDOT ITS
14
2/25/2010
Communications Implementation Plan - Draft Short-Term Implementation Plan
need to be folded into existing ITS device maintenance schedules. Maintenance of the proposed
equipment is expected to be minimal due to the use of fiber and environmentally hardened equipment.
Planning-level costs are outlined in Table 3 which includes fiber modification and network related
infrastructure.
Description
Capital Costs
Unit Cost Total
Qty
Fiber Splicing
6
$300
Fiber Terminations
6
$500
Fiber Patch Panels
6
$300
Network Switches
6
$2,100
Notes
Splice at each cabinet approximately every two
$1,800 miles
Termination at each cabinet approximately every
$3,000 two miles
One installed at each cabinet approximately every
$1,800 two miles
One installed at each cabinet approximately every
$12,600 two miles
$19,200
Table 3. Coors/ Paseo Del Norte Fiber Expansion
NMDOT ITS
15
2/25/2010
Communications Implementation Plan - Draft Short-Term Implementation Plan
I-25
Alameda Blvd
To Bernalillo @
Dessert Mountain
Tramway Rd
Paseo Del Norte
NMDOT-D3
Comanche Rd
Hilltop
Sedillo Hill Road
Wyoming Blvd
I-40
Paseo del Volcan
4th St
Coors Blvd
University Blvd
Tramway Blvd
Lomas Blvd
TMC
Legend
Dr. Martin Luther King
Key Locations
Existing Fiber
Future Fiber
Gibson Blvd
N
Future Conduit
City Owned Fiber
Future City Owned
Fiber
Possible Fiber
Coors Blvd
I-25
No.
DATE
1
5/11/2009
ISSUE / REVISION
2
10/19/2009
Updated Fiber
3
2/24/2010
Updated Fiber
SUBMITTED BY:
Initial Draft
ICx Transportation Group
500 N. State College Blvd.,
Suite 1100
Orange, California 92868
Broadway Blvd
PROJECT
NMDOT ITS Program – Task 3 Communications Plan
TITLE
Albuquerque ITS Network
Possible Infrastructure Projects
PAGE
SCALE
None
A3
Figure 5. NMDOT and City of Albuquerque Fiber Expansion
NMDOT ITS
16
2/25/2010
Communications Implementation Plan - Draft Short-Term Implementation Plan
TMC IT
Cisco 3750E-24
TMC
Cisco 3750E-24
TMC
Redundant Loop from Coors/Paseo Del Norte
TMC Users
Cisco 3750E-24
TMC
Cisco 3750E-24
TMC
Redundant Lease Line
Hilltop
New Redundant Network Rings from Coors/Paseo Del Norte
Cisco Catalyst 4510
South Ring 1
RuggedCom04
I-25 Lomas
RuggedCom02
I-25 Central
RuggedCom06
I-25 Gore
RuggedCom39
I-25 SB @ Lomas
Hilton
I-25 Gore
Hilton to Carlisle
Hillton to Washington
Carlisle
Washington
South Ring 2
RuggedCom05
I-40 Gore
RuggedCom03
I-25 MLK
Hillton to Washington
Washington
RuggedCom34
I-25 Lead
North Ring 1
RuggedCom07
I-25 Comanche
RuggedCom08
I-25 N. Comanche
RuggedCom10
I-25 N. Montgomery
RuggedCom11
I-25 Jefferson
RuggedCom14
I-25 San Antonio
RuggedCom36
I-25 N. PdN
North Ring 2
RuggedCom09
I-25 Montgomery IC
RuggedCom12
I-25 N. Jefferson
RuggedCom13
I-25 San Mateo
RuggedCom15
I-25 N. San Antonio
RuggedCom16
I-25 Paseo del Norte
RuggedCom37
I-25 Alameda
RuggedCom38
I-25 N. Tramway
I-25 SB Alameda
I-25 SB Tramway
Coor North Ring
RuggedCom17
I-40 Rio Grande
RuggedCom19
Atrisco
RuggedCom22
SB Coors N. St. Josephs
RuggedCom24
I-40 WB Off Ramp
RuggedCom27
SB Coors S. St Josephs
RuggedCom28
NB Coors S. Sequoia
RuggedCom29
NB Coors N. Sequoia
RuggedCom30
SB Coors Redlands
Coors South Ring
RuggedCom18
N/S Coors Gore
RuggedCom20
South Gore
RuggedCom21 Coors Illif
RuggedCom23
Coors Brayton
RuggedCom25
I-40 EB Off-Ramp
RuggedCom26
NB Coors Hanover
RuggedCom32
SB Coors S. Illif
RuggedCom33
SB Coors Fortuna
Future Coors Paseo Del Norte
Ring
RuggedCom
RuggedCom
RuggedCom
RuggedCom
RuggedCom
RuggedCom
Figure 6. Fiber Network Redundancy
NMDOT ITS
17
2/25/2010
Communications Implementation Plan - Draft Short-Term Implementation Plan
3.4 Expansion of Fiber Installation
The following two projects involve implementing collapsed-ring fiber infrastructure within conduit that
is or has been installed on construction projects in the area. These paths have been planned, and this
section addresses implementation.
3.4.1
G2A13/G2B13 Fiber (Reliability, Redundancy and Capacity)
Currently NMDOT has ongoing projects along both Interstate 25 and Interstate 40. The first project is
G2A13/G2B13 which will install conduit, two CCTV and four MVDS along I-25 from Tramway to
Bernalillo. The first phase of the project will install conduit only, and the second phase will install CCTV
and MVDS devices. This short term project proposes to install and terminate fiber, and bring the two
CCTV and four MVDS devices onto the NMDOT fiber network.
Figure 7. Project G2A13/G2B13 General Project Area
This project would install, terminate and splice new fiber to connect to the existing NMDOT-owned fiber
which exists at Tramway Rd and I-25. Along with installing fiber, new network switches will need to be
installed at all CCTV and MVDS. Lastly, the devices will need to be configured to support and operate on
the new fiber network.
Two major alternatives to this project include not upgrading the area with fiber, and using some other
communications medium. The first alternative of not upgrading the area is appropriate in that
installation of fiber and associated infrastructure and equipment requires funds which the
G2A13/G2B13 projects may not have had available. The downside to this is that the devices deployed
during phase II will use cellular data modems to provide connectivity to the TMC. This results in ongoing
monthly subscriber costs for each device. The monthly cost may not come close to the capital costs of
implementing fiber; however, monthly costs associated with the service are not adding any NMDOT
NMDOT ITS
18
2/25/2010
Communications Implementation Plan - Draft Short-Term Implementation Plan
owned communication systems. The fiber system will also provide greater reliability, redundancy, and
bandwidth to existing and any possible new devices in the area.
Systems Engineering Analysis
The second alternative is to use some other communications medium. NMDOT can install a fixed
wireless solution to connect these locations. This would not be as cost efficient as installing fiber (given
that conduit already is in place). In addition, a wireless solution does not provide the same level of
redundancy as fiber. NMDOT could, alternatively, wait for cellular providers to upgrade their network to
higher bandwidth technologies that may possibly be less expensive in the future.
Part of the Concept of Operations and Implementation Plan is to document project initiation,
development, and system maintenance. The initiating factor for this project is that it will provide a high
bandwidth, reliable and redundant NMDOT-owned system to provide connectivity to current and future
field devices.
This project involves installing fiber, vaults, and network equipment infrastructure within conduit that
has been installed on previous or current construction projects. Generally, NMDOT fiber cables are 96 or
144 count bundles. If the intent is to extend the current fiber counts north, then any new fiber installed
should match its neighboring cable’s fiber count. However, to meet the required capacity of the planned
NMDOT ITS network, only 36 or 48 count fiber cables will more than suffice to provide communications
for IP-based devices. One caveat is if the intent is to share fiber with multiple jurisdictions or agencies,
greater fiber counts should be installed. When terminating at all locations, NMDOT should either
terminate the entire cable, or terminate at least 12 extra fibers (one bundle) at the patch panel. This will
allow spares to be readily available for new equipment, or future additional network rings. Plus, a
contract is already in place for fiber termination. To prepare and release additional contracts to
terminate extra fibers when needed will ultimately cost more time and money than performing
terminations when the cable is first installed.
NMDOT ITS
19
2/25/2010
Communications Implementation Plan - Draft Short-Term Implementation Plan
Figure 8. Proposed Fiber Cable
With the installation of pull boxes and conduit complete, a large portion of the costs to deploy
communications along this project have already been covered. The main costs are now installation of
the fiber, termination and possible splicing. To simplify the costing exercise and to facilitate future
discussion, assumptions were used so that an initial cut at project costs can be presented. Operations
and maintenance costs for this project will need to be folded into existing ITS device maintenance
schedules. However, maintenance of the proposed equipment is expected to be minimal due to the use
of fiber and environmentally hardened equipment.
Planning-level project costs are outlined in Table 4 which includes fiber and network related
infrastructure. Note that these costs do not include staff time, or engineering costs (if required).
NMDOT ITS
20
2/25/2010
Communications Implementation Plan - Draft Short-Term Implementation Plan
Description
Fiber Cable 24ct
Splice Vault
Fiber Splicing
Fiber Terminations
Fiber Patch Panels
Qty
Capital Costs
Unit Cost Total
35500
3
3
3
3
Cabinet
3
Network Switches
3
Notes
Installed 96 count single mode fiber per
$8.0 $284,000 linear foot. Estimated 35,500 ft
$1,000
$3,000 Approximately every 3 miles
$300
$900 Approximately every 3 miles
$500
$1,500 Approximately every 3 miles
$300
$900 Approximately every 3 miles
Approximately every 3 miles (if not yet
$2,000
$6,000 installed)
One installed at each new cabinet and one at
$2,100
$6,300 the existing cabinet.
$302,600
Table 4. Proposed Project Near G2A13/G2B13 Cost Estimate
NMDOT ITS
21
2/25/2010