Amtrak performance management report Jamie Scott

advertisement
Executive Summary
This report examines and evaluates Amtrak’s performance management and provides
recommendations for improving performance and performance management at Amtrak.
Specifically, the report analyzes Amtrak’s Northeast Corridor Infrastructure and Investment
Development business line (NECIID) and its goal of Station and Connectivity Improvement.
Amtrak has established a strong framework for strategic planning and reporting. Amtrak
is operating under a five-year strategic plan that describes the Amtrak vision and outlines goals,
key metrics, and strategies to achieve those goals. A clear logic model exists in this framework
that guides Amtrak’s investments. In addition, Amtrak regularly reports on its performance and
produces both an annual report and monthly performance reports. These two reports measure
progress toward Amtrak’s corporate goals but not toward its newer business line goals.
Despite this framework, Amtrak does not adequately measure progress toward business
line goals. Investment in the Northeast Corridor (NEC) is essential for Amtrak’s future success
and the railroad faces a formidable but achievable challenge of developing high-speed rail on the
NEC. To achieve this vision, Amtrak must do a better job reporting on infrastructure investments
and the development of partnerships to provide rail service for the 21st century.
Most important, Amtrak must integrate better planning and reporting mechanisms and
include interim targets for goals. Amtrak should appoint performance officers to measure
progress and provide analysis for leaders to adjust infrastructure investments. Amtrak has
outlined ambitious projects that it should continue. Its leaders must commit to the vision for the
NEC and be transparent about progress. Anything less will result in failure.
Jamie Scott
Performance Management consultant
McCourt School of Public Policy
Amtrak’s Current Performance Management System
Amtrak is currently operating under a five-year strategic plan for FY2011-FY2015. The
strategic plan states Amtrak’s corporate vision and identifies the corporate goals and strategies
that support the realization of that vision. The Amtrak vision states:
Amtrak is America’s first intercity travel choice for connections to
and between the nation’s key metropolitan areas, providing
customer-driven, safe, environmentally-sustainable, energyefficient and inter-modally linked service to passengers,
communities and partners. Through recognized organizational
excellence, Amtrak’s diverse and talented team will lead the
development and growth of the high-speed and intercity passenger
rail system in North America.
To achieve this vision, the corporate strategic plan defines five broad corporate goals,
which are Safety and Security, Customer Focus, Mobility and Connectivity, Environment and
Energy, and Fiscal and Organization Excellence. Each goal provides relevant metrics, including
an FY10 baseline measure (the year before the strategic plan began), the target annual change,
and an FY15 target (the end of the strategic plan period). The strategic plan further identifies
seven corporate strategies that align with Amtrak’s corporate goals. Each strategy identifies the
goal or goals that it supports.
One of these corporate strategies is the creation of six separate business lines, which will
allow Amtrak to “better respond to the wants, needs and expectations of customer segments and
improve financial performance.” Amtrak is separating its main business areas to better manage
performance in those areas. The six business lines are Northeast Corridor Infrastructure and
Investment Development (NECIID), Northeast Corridor Operations, State Supported Services,
Commuter Services, Long-Distance Services, and Corporate Asset Development. This report
focuses specifically on the performance management system for the NECIID business line and
the business line goal of Station and Connectivity Improvement.
Each of the business lines has a strategic plan with a mission statement specific to that
business line. The NECIID mission statement reads:
Amtrak’s Northeast Corridor Infrastructure and Investment
Development Business Line manages and develops Amtrak-owned
railroad infrastructure to meet the growing high-speed rail needs
of the 21st century. This includes managing station assets,
infrastructure design, maintenance and construction services, asset
capacity and utilization planning, and dispatching services in
support of all railroad operations on the Northeast Corridor.
Similar to the corporate strategic plan, the business line strategic plans identify business
line goals, which include Safety, Superior Service, Financial Performance, Station and
Connectivity Improvement, and Environmental Improvement. Each business line strategic plan
identifies metrics that map to those goals, including an FY10 baseline, expected annual change,
and an FY15 target. The business line plans also articulate five strategies to achieve the business
line goals.
The NECIID strategic plan states that the goal of Station and Connectivity Improvement
is to “make travel easier and more attractive for train passengers by improving the appearance
and operation of Amtrak-owned stations and increasing opportunities to connect with other travel
modes in key markets.” This business line goal supports Amtrak’s corporate goal of Mobility
and Connectivity. To measure the performance of this goal, the NECIID strategic plan identifies
two key metrics: change in effective speed (mph) and the number of airport connections. The
FY10 baseline measure for the change in effective speed is 0.0, the target annual change is
+0.5mph and the FY15 target is +2.5mph. The FY10 baseline for the number of airport
connections is 2 and the FY15 target is 5. There is not a target annual change for the airport
connections metric. The NECIID strategic plan further describes two strategies to support the
goal of Station and Connectivity Improvement: building new partnerships with key stakeholders
and developing business and financial plans to build high-speed rail in the NEC.
In addition to a five-year corporate vision and a more specific business line vision,
Amtrak also produces an annual corporate budget and comprehensive business plan that identify
capital and operating budget requests and business strategies for the coming fiscal year. The
business plan cautions that the NECIID business line is new and does not yet have management
and pricing strategies in place. However, the plan discusses key infrastructure investments that
will support NECIID, though it does not provide additional detail. The plan does include budget
requests and business strategies to support NEC fleet and infrastructure but does not identify the
specific NECIID business line strategies and metrics that they support.
One key target in the business plan is resolving Amtrak’s $5.8 billion State of Good
Repair (SOGR) backlog of infrastructure investment over 15 years, which will help achieve
NECIID business line goals. Amtrak’s goal is to invest $760 million annually: $380 million to
replace existing infrastructure and $380 million to develop new infrastructure. Key metrics to
measure progress toward resolving the SOGR backlog include rehabilitating 200 bridges,
overhauling Baltimore’s B&P and Union Tunnels, rehabilitating rail crossovers and junctions,
and repairing electric traction systems. For FY13, the business plan provides funding totals for
specific groups of projects for the SOGR backlog, including bridges, tunnels, communications
equipment, signaling, station improvements, and other projects. Amtrak plans to invest $627.8
million overall in infrastructure upgrades in FY13, including projects beyond the SOGR backlog.
In addition to resolving the SOGR backlog, Amtrak’s FY13 business plan highlights key
projects in the Gateway Program, a program for building new infrastructure on the NEC to
support the development of high-speed rail. The FY13 business plan outlines major
infrastructure investments in and through New York City, including new tunnels under the
Hudson River, repairs to the existing Hudson River tunnel, two new bridges at Secaucus, NJ,
additional tracks between Newark and Secaucus, and upgrades to Penn Station in New York City.
Amtrak expects that it could complete these projects in twelve years at a cost of $15 billion, but
establishes this timeline as a best-case scenario rather than a performance target.
While the business plan outlines future investment, the Amtrak Annual Report reviews
past performance. The FY12 annual report provides quantitative financial measures of specific
engineering accomplishments. Many of these projects support the NECIID business line
generally and help resolve the SOGR backlog, but Amtrak does not compare these results to
targets for measuring performance. The accomplishments include new and upgraded bridges,
tunnels, stations, and other structures ($187 million); track ($148 million); electric traction ($20
million); and communications and signaling equipment ($31 million).
The annual report also provides performance metrics for corporate goals and the
strategies to achieve each goal. Metrics for the corporate goal of Mobility and Connectivity,
which the NECIID goal of Station and Connectivity supports, include the performance measure,
unit of measurement, FY11 baseline, FY12 target, FY12 actual, variance from prior year, and
variance from target. The specific measures are intermodal ticketing partnerships, change in
effective speed, and train delays per 10,000 miles. Similar metrics do not exist for the NECIID
business line strategic goals. Below is a summary of those measures:
Performance Measure
Intermodal ticketing
partnerships
Change in effective speed
Delays per 10,000 train
miles
Unit of
Measure
FY11
baseline
FY12
target
FY12
actual
Variance
from prior
year
Variance
from
target
Count
43
47
43
0
-2
MPH
0
0.5
0.6
0.6
0.1
Minutes
347
252
327
20
-75
Although the annual report does not measure performance, the railroad does produce
monthly performance reports that provide financial performance measures and other key
performance indicators (KPIs) with comparisons to monthly and year-to-date (YTD) targets. The
only KPI included in the monthly performance report with relevance for the NECIID business
line is end-point station performance but is only a summary of all Amtrak stations, not NECspecific stations. The performance report does provide NEC-specific on-time performance
metrics in another section but only compares these metrics to the same month in the prior year
and not to a monthly or annual target. In July 2013 NEC station on-time performance was 82.7%
compared to 84.2% in July 2012. The year-to-date (YTD) on-time performance for NEC stations
was 88.2%, compared to 89% YTD in July 2012. The report also includes a summary of
engineering outputs, many of which support NECIID business line goals, but similar to the
annual report do not include comparisons to identifiable targets.
Assessing Amtrak’s Performance Management System
Amtrak has a robust planning and reporting process but fails to connect performance
measures to stated goals. The performance management system is particularly weak because the
annual and monthly reports mechanisms do not measure progress toward the business line goals
identified in the business line strategic plan.
Amtrak’s performance management system focuses primarily on financial performance
and changes in ridership. In many of its documents, particularly in the introduction letters from
Amtrak CEO Joe Boardman, the railroad highlights improving financial performance and
growing ridership. In some ways this is a necessary first step for Amtrak—the railroad has a
short history as an organization and has struggled with financial underperformance, relying
heavily on Congressional appropriations over the years. Given this history of underperformance,
Amtrak focuses on reporting positive outcomes, rather than challenges to achieve financial and
operational goals. Amtrak’s infrastructure needs are enormous and its vision for high-speed rail
is ambitious. To build support for these investments, Amtrak must convince key stakeholders
that the vision is achievable. Perception is critical to Amtrak’s success.
The five year corporate strategic plan clearly links strategies to goals, and the creation of
individual business lines allows Amtrak to better manage the performance of its various
operations. Amtrak’s annual business plan further explains some of the NECIID business line
strategies that the corporate strategic plan does not, including NEC station and route planning. In
2012, Amtrak released the Union Station Master Plan, which envisions the redevelopment of
Union Station in Washington, DC, the southern anchor of the NEC. The master plan envisions
new capacity at Union Station and new rail service along the NEC. Investing in Union Station is
a significant project for achieving the NECIID business line goal of station improvement and is a
key part of Amtrak’s NEC investment strategy. Given the complexity of that project, a master
plan separate from the business line strategic plan is appropriate.
While the structure of the NECIID business line strategic plan is strong, it lacks a robust
set of metrics, providing only two metrics for the Station and Connectivity goal and offering no
indication of other key metrics. The railroad need not provide every single metric for the
business line in the strategic plan but it could provide an appendix with an expanded list or
information about developing additional metrics. If Amtrak indeed only created two metrics for
improving station connectivity, it cannot possibly achieve that goal.
Similarly, the business line strategic plan fails to indicate actions to implement the
business line strategies or make progress toward the specific metrics. For example, the NECIID
strategic plan identifies a strategy to build new partnerships with stakeholders for long-term
business development. However, the strategy does not indicate any tactical steps to build those
partnerships or the types of partners necessary to create new airport connections, a key metric for
the business line goal of Station and Connectivity Improvement. Certainly new partnerships will
help create those connections but the strategic plan does not provide details on the nature of this
relationship. This lack of detail leaves Amtrak’s ability to create airport connections uncertain.
Achievement of business lines goals is further complicated because progress toward the
key metrics for each goal are not readily measureable. For example, the strategic plan lacks any
metrics or qualitative evidence to document ongoing progress toward the development of new
airport connections. Certainly there are interim steps to add airport connections to Northeast
Corridor rail service, but Amtrak provides no way to determine whether it can successfully
achieve the FY15 goal of five total airport connections. The lack of interim steps means it is
unclear whether NECIID’s goals are stretch goals. Since the airport connections metric does not
provide a target for annual change (the interim steps), it is impossible to know if the goal is a
stretch goal for Amtrak.
Amtrak does not appear to use regular performance data to effectively manage its
infrastructure improvements. The railroad is realistic about its infrastructure challenges on the
NEC and has set some timelines for upgrading existing infrastructure and investing in new
infrastructure. Measurement of the progress of those projects remains unclear, as do any
adjustments to investment priorities based on those data. Since Amtrak’s recent annual report
does not measure engineering accomplishments in relation to targets, it is difficult to identify
areas of underperformance and the contribution of those engineering accomplishments toward
the resolution of the deferred maintenance backlog. These reports are reporting activity (outputs)
but not performance (outcomes).
Similar reporting issues exist in Amtrak’s monthly performance reports. These reports
include a wealth of financial performance data and route performance data. Amtrak is honest
about both positive and negative results, including negative budget performance and negative
route performance. These operational performance reports are lengthy—almost 100 pages—and
include numerous detailed tables and measures of monthly performance compared to the prior
month, year-to-date, and the same time last year. The data in these monthly performance reports
more clearly indicate operational areas in which the railroad is struggling. Amtrak appears to use
these data to correct operational performance but does not compare operational performance to
the goals, strategies, and metrics from the business lines strategic plans. Similar to the corporate
annual report, the monthly performance reports provide data on engineering outputs but do not
measure performance toward engineering outcomes. Much of the financial and engineering data
allow Amtrak to demonstrate if it is performing better than last year in a given category but not
whether that performance is as good, better, or worse than expected.
Finally, Amtrak’s strategic plan and comprehensive business plan do not indicate
individuals responsible for managing performance. The strategic plan states the importance of
managers who regularly review tactical plans to execute business strategies, but does not
specifically identify performance managers. Amtrak has done a good job creating the structure
for executing corporate and business line goals but the business line plans do not indicate the
data that managers use to adjust tactics or to whom managers report.
Improving Performance Management at Amtrak
The first step toward improving performance management and performance at Amtrak is
to better integrate planning and reporting mechanisms. To accomplish this, Amtrak must further
develop its strategies for the NECIID business line. Without a clear vision to achieve business
line goals of upgrading NEC infrastructure and developing high-speed rail, Amtrak cannot
manage its performance effectively. The two main reporting tools—the annual report and the
monthly reports—do not explicitly report on progress toward the NECIID goals. While the
business lines are new, neither the annual report nor the monthly performance report indicate
whether Amtrak will report on progress toward business line goals in the future. Instead, future
annual reports should include specific sections for each business line, with aggregated data and
progress toward annual goals. Monthly performance reports for each business line may be
unnecessary, given the slow pace of infrastructure investment. However, Amtrak would benefit
from regular reports of infrastructure progress with disaggregated data on specific projects,
which could inform content for the annual report. Amtrak has created a strong performance
management foundation in its strategic plan, with a clear hierarchy of goals and strategies. The
railroad should strengthen its performance management system with integrated reporting.
An operational plan specific to the business lines would also clarify Amtrak’s annual
goals and strategies. The annual budget and business plan provide information about Amtrak’s
corporate budget and corporate strategies. A large part of this plan concerns the NEC but much
of it concerns Amtrak’s other business lines. In such a format it is easy to lose sight of the NEC
investments and to assess the annual goals for that business line. The corporate strategic plan
includes the business line strategic plans; the budget and business plan should do the same.
Amtrak should also clearly identify a chief performance officer or team of performance
officers, which it should include as part of the business line strategic plan. The recent
reorganization to create business lines means that a performance officer will likely have greater
influence on performance at the business line level with a report to a corporate performance
officer. A chief performance officer could help establish additional metrics for the business lines
and assist the reporting process to ensure reported data adequately inform the business line goals.
The performance officer for the NECIID should not be a new position, but a senior manager with
responsibility for business line operations. If a performance officer is not integrated into the
work of the business line, and serves merely to measure and report progress, he or she may not
have support from the business line Amtrak employees.
Amtrak has an adequate plan for resolving its SOGR backlog and it should continue to
upgrade current infrastructure while investing in new infrastructure. Amtrak will never develop
high-speed rail on the NEC if it waits to address its infrastructure backlog before making new
investments. Amtrak should also continue its efforts to redevelop stations along the NEC,
beginning with Washington, DC’s Union Station. Key to improving station and connectivity
improvement will be increasing capacity at core stations along the NEC. The Gateway program
in the New York area is another project Amtrak should continue to prioritize.
Unfortunately there is no quick fix for Amtrak. The maintenance backlog and necessary
investments in high-speed rail are substantial enough that a long-term commitment to investment
is essential. Commitment to the vision, honesty about challenges, transparency about progress,
and continued fiscal stability are necessary for Amtrak to successfully upgrade the NEC. As it
commits financial and engineering resources to improving the NEC, Amtrak will become a safer,
more reliable, and more attractive travel option. As ridership increases, so will revenue and
Amtrak’s ability to provide high-quality rail service. Amtrak has developed the vision for the
NEC. Now it must commit the energy and resources to ensure it is on track to realize that vision.
Download