Uploaded by Adolfo Pulido Davila

selection of key performance indicators for your.10

advertisement
Downloaded from http://journals.lww.com/nsca-scj by BhDMf5ePHKav1zEoum1tQfN4a+kJLhEZgbsIHo4XMi0hCywC
X1AWnYQp/IlQrHD3i3D0OdRyi7TvSFl4Cf3VC4/OAVpDDa8KKGKV0Ymy+78= on 02/04/2024
Selection of Key
Performance Indicators
for Your Sport and
Program: Proposing a
Complementary ProcessDriven Approach
Jo Clubb, BSc,1 Sian Victoria Allen, PhD,2 and Kate K. Yung, PT, PhD3,4,5
Global Performance Insights, United Kingdom; 2Product Innovation, Lululemon Athletica, Vancouver, Canada;
3
Medical and Performance Innovations, Kitchee Sports Club, Hong Kong SAR, China; 4Centre for Data Science,
Queensland University of Technology, Brisbane, QLD, Australia; and 5Department of Orthopaedics and Traumatology,
Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR, China
1
ABSTRACT
Key performance indicators (KPIs) are
commonplace in business and sport.
They offer an objective means to link
data and processes with performance
outcomes. Yet, their application in
sports performance, particularly team
sports, is not without issue. Here, we
review 4 key issues relating to KPI
application in team sports; lack of a
universal definition, complexity of performance, drifting from on-field performance goals with off-field targets, and
agency issues across different key
stakeholders. With these issues relating
to sports performance KPIs in mind, we
propose a complementary approach to
help practitioners focus on implementing the conditions that create performance environments and opportunities
for success in a complex sporting
Address correspondence to Jo Clubb, jo.
clubb@acu.edu.au.
environment. Ongoing process trackers
(OPTs) are quantifiable measures of the
execution of behaviors and processes
that create the environments, cultures,
and conditions for successful performance outcomes. This approach
equips sports science practitioners with
key questions they can ask themselves
and their team when starting to select
and use OPTs in their program.
INTRODUCTION
ey
performance
indicators
(KPIs) are used to evaluate the
performance of a sports team,
department, staff, and/or athletes themselves (12). They are commonplace in
business (52) and sports (30,35) on
account of the many benefits they offer.
Some examples include enabling objective evaluation of an organization, team,
or individual in meeting performance
goals (28), informing training and
K
practice decisions (25), and directly
being able to predict competition performance from KPIs (44,60).
Despite their ubiquity and copious benefits, some issues still exist with their use
in sports performance. These include
potential detrimental effects of measurement itself on athlete behaviors (24,41),
and concern with how well KPIs can
truly approximate performance in complex dynamic events such as team sports
(35). Furthermore, the increasing attention on sports performance support and
abundance of available data may induce
pressure to use KPIs to quantify the value
of performance support and try to demonstrate return on investment (12,31).
Conversely, practitioners are keen to
KEY WORDS:
sports science; sports performance; key
performance indicators; objectives and key
results; athlete monitoring
Copyright Ó National Strength and Conditioning Association
90 VOLUME 46 | NUMBER 1 | FEBRUARY 2024
Copyright © National Strength and Conditioning Association. Unauthorized reproduction of this article is prohibited.
Downloaded from http://journals.lww.com/nsca-scj by BhDMf5ePHKav1zEoum1tQfN4a+kJLhEZgbsIHo4XMi0hCywC
X1AWnYQp/IlQrHD3i3D0OdRyi7TvSFl4Cf3VC4/OAVpDDa8KKGKV0Ymy+78= on 02/04/2024
demonstrate how the data amassed and
the subsequent interventions used have a
positive impact on performance. Therefore, the purpose of this article is to discuss the issues with using KPIs in team
sports performance support. Based on
these issues, we propose a new framework, ongoing process trackers (OPTs).
This approach, which could be used in
conjunction with KPIs, is intended to
help sports performance practitioners
better select and track indicators of the
processes that ultimately underpin sports
performance.
CURRENT LANDSCAPE OF KEY
PERFORMANCE INDICATORS IN
SPORTS PERFORMANCE
Striving for peak performance is a central tenet of sporting endeavor. Thus, it
follows that sport staff will seek indicators that underpin performance on an
organizational, departmental, and individual level. Indeed, a recent organizational staff structure for team sports
proposed that performance staff,
including practitioners across sports
science, strength and conditioning,
nutrition, and psychology, and team
sport staff, made up of coaching and
scouting staff among others, each provide expertise related to specific KPIs
(11). Although the use of KPIs is relevant for team sport staff, in this article,
we focus our discussion predominantly
as it relates to performance staff.
One recent framework (12) has outlined
the following steps for performance staff
to use KPIs in a sporting setting.
Identify what it takes to succeed
Define the performance model
Determine KPIs
Assess the athlete
Plan and deploy the program of
interventions
Review
A performance model can be dissected
into the following determinants: physiologic demands, technical requirements,
tactical requirements, psychological
skills, equipment characteristics, health
aspects, and rules and regulations (12).
In
individual
time–distance-based
sports, the determinants of performance
may be more straightforward. For
instance, structural equation modeling in
swimming explained 79% of performance in young male athletes based on
biomechanical and energetic profiles (4).
Only variables that can be assessed by
performance staff were included in the
model and given the high prediction of
swim performance demonstrated, it
follows that the variables identified can
therefore be used for training control
and evaluation (4).
Such division of determinants offers performance staff an understanding of the
underpinning qualities to performance,
such as the physical capacities that can
be developed to enable the athlete to
meet, and potentially surpass, the physical demands of the sport. Associations
between jump power and heading success, and strength (predicted 1 repetition
maximum from a 3 repetition maximum
test) and tackle success in elite youth
soccer may warrant development of
such physical capacities, for example
(59). In addition, increases in reactive
strength (measured via drop jump performance) have been associated with
reductions in sprint times, whereas
increases in power (via countermovement jump performance) were associated with improvements in change of
direction abilities in elite female soccer
players (20). However, team sports performance offers greater complexity than
can often be broken down into linear
determinants of success (1). As such, simple deterministic approaches, such as
those used in individual time–distancebased sports, may be less suitable.
Therefore, the current approach to
applying KPIs in the team sport environment warrants a critical review.
ISSUES AND CHALLENGES WITH
KEY PERFORMANCE INDICATORS
In reviewing KPIs through a critical
lens, we have identified 4 areas of concern for their current application in
team sports. They are as follows.
Definition: Lack of a universal
definition
Complexity: Isolated metrics overlook the complexity of performance
Goodhart’s law: The threat of drifting
from on-field performance with offfield targets
Agency issues: Different stakeholders
often have competing interests
In this section, we will delve into each
of these issue areas in further detail.
LACK OF A UNIVERSAL
DEFINITION
Although many researchers have
aimed to formalize the definition of
KPIs for different sectors (18,36,40),
there remains a lack of universal agreement, especially in sport. Given the
widespread familiarity with the term,
it may be believed that a universal definition is unnecessary. Yet, potential
misuse of terminology is a long-time
cause for discussion in sports science
(34,54). One recent definition in sports
science is:
“a quantifiable measure used to evaluate
the success of an organization or employee
in meeting a performance objective” (12).
A performance objective is subsequently illustrated as winning a league,
tournament, or other championship,
achieving a specific time, distance, or
mass lifted in centimeter-gram-second
sports, or beating the opposition in
tactical events (12). Clearly in this
instance, clarity of the collective performance objective is required for KPIs to
be effective. Yet, this definition of KPIs
is firmly linked to a single-outcome
measure. Meanwhile, other definitions
use the properties of the measure itself,
asserting that KPIs should be a valid
measure of performance, an objective
measurement using a known scale of
measurement, and provide a valid
way of interpretation (42).
To add further confusion, similar but
different terminology, such as “performance indicators” (30) also exists. A
performance indicator is “a selection,
or combination, of action variables that
aims to define some or all aspects of a
performance” (30). In team sports, the
relationship between performance
indicators and match outcome has
been explored in Australian rules football (48), soccer (13) and rugby union
(33). In this context, performance indicators are statistical actions that can be
used to evaluate teams and individual
91
Copyright © National Strength and Conditioning Association. Unauthorized reproduction of this article is prohibited.
Strength and Conditioning Journal | www.nsca-scj.com
Key Performance Indicators
athletes, including which indicators are
likely to result in a winning outcome.
Downloaded from http://journals.lww.com/nsca-scj by BhDMf5ePHKav1zEoum1tQfN4a+kJLhEZgbsIHo4XMi0hCywC
X1AWnYQp/IlQrHD3i3D0OdRyi7TvSFl4Cf3VC4/OAVpDDa8KKGKV0Ymy+78= on 02/04/2024
It is clear from these various definitions
that a useful performance indicator
should relate to successful performance or outcome. These applications
traditionally sit within the performance analysis realm of team sports.
However, these definitions lack guidance for how such KPIs can be used
in practical terms. The focus on statistical actions during match play also
limits their use to the wider multidisciplinary performance staff. It is therefore unclear how current definitions
of KPIs relate to sports science data
collection. Such ambiguity may fuel
agency issues with how different stakeholders consider, interpret, and use
data in relation to their interpretation
of the term KPI.
ISOLATED METRICS OVERLOOK
THE COMPLEXITY OF
PERFORMANCE
As performance staff increasingly seek to
relate sports science data to performance, it seems (at least to the authors)
that KPIs may have become synonymous with broader terms such as metrics or variables, confusing the issue
further. This is perhaps because of the
abundance of metrics, thanks to the
expansion of data collection in today’s
sporting environments. Indeed, a recent
article described how the increase in data
streams within the contemporary training environment may cloud parsimonious and valid applications if not used
appropriately (31). It may also be
because of the breaking down of sports
performance into silos in traditional
fields such as physiology, biomechanics,
and performance analysis (53), in which
the term “performance indicator” may
have a specific context.
Previous literature has categorized performance indicators into match classification (e.g., score, number of shots on
targets), biomechanical (e.g., optimal
release angle for javelin throw (7)), technical (e.g., passes to oppositions (32)),
and tactical (e.g., passes and possessions
(30)). Yet, consideration is warranted as
to whether each of these categories
and individual indicators truly reflect
performance, and if so, how they combine to do so. One of the reasons why
individual indicators may not truly
reflect performance is because sports
performance, particularly in team
sports, is a complex entity (3). As such,
team performance is not only achieved
by qualities of the individual athletes
(e.g., technical skills or physical abilities), but also the emerging pattern
from the dynamic interaction between
individuals, their opponents, and environments (51). Therefore, the impact
of using isolated or specific measures
as KPIs, such as physical running output captured by in-game tracking technologies, is often limited (10,15).
Furthermore, different leagues may
require different physical or technical
KPIs to best approximate performance
(16). As well as overarching consideration for context, such as league or
position, more nuanced contextual factors are often lacking in developing
KPIs. Phatak et al. (46) recently demonstrated the need to account for
phase of play and other contextual factors such as ball possession. For example, accounting for ball possession
changes the interpretation of fouls as
a KPI in soccer (46). Caution is therefore warranted when it comes to labeling data as KPIs, particularly isolated
metrics that lack contextual narratives.
DRIFTING FROM ON-FIELD
PERFORMANCE WITH OFF-FIELD
TARGETS
Performance staff attempt to translate
their understanding of what it takes to
succeed into performance goals (12).
Drifting from these on-field performance
goals is a threat, because it may result in
time and attention being placed on areas
less meaningful to performance. This
may be driven by the different motivations of various stakeholders within team
sports, as we shall discuss in the next
section. In addition, using targets from
objective measurements may underpin
a drift from performance goals. This is
exemplified by Goodhart’s law. Named
after British economist Charles Goodhart, the common adaptation of the decree is by Marilyn Strathern:
“When a measure becomes a target, it
ceases to be a good measure.”
When outcomes are complex, as demonstrated by sport performance, a single
measure cannot represent them. This is
why there is rarely (if ever) a single KPI;
the complexity of performance warrants
multiple. Even within specific disciplines, physical development for example, a single measurement is often
underpinned by a multitude of factors.
This is illustrated by low predictive relationships between acceleration and
lower limb strength and power, for
example, indicating a complex interaction between sprint technique and leg
muscle performance (37). Therefore, if
each indicator is imperfectly correlated
with the goal of performance, concentrating on them in isolation may inadvertently create unwanted distractions
and inefficient application of resources.
This has been exemplified elsewhere in
areas such as academic publishing (21),
higher education (19), and government
spending (29) to name a few.
Although using KPIs as targets can
drive processes that have positive effects
on performance, Goodhart’s law serves
as a reminder that targets may distract
from the goal of on-field sporting performance. Given the limited time and
resources available to performance staff,
these must be spent on the most impactful contributors to performance. Lower
limb strength and power measures may
frequently be converted into targets for
athletic development, but although
meaningful, they do not solely account
for performance. Although strength and
maximal power were the best discriminators of playing level in rugby league,
they still only accounted for 12–17% of
the variation in playing level (1). Similarly, KPIs that focus on vertical force
production, such as those derived from
countermovement jump performance,
may overlook the importance of horizontal force production and therefore,
limit transference of gym-based strength
to on-field performance (47).
Beyond the issue of time efficiency,
performance staff are in danger of
“naive interventionism” if potential
92 VOLUME 46 | NUMBER 1 | FEBRUARY 2024
Copyright © National Strength and Conditioning Association. Unauthorized reproduction of this article is prohibited.
Downloaded from http://journals.lww.com/nsca-scj by BhDMf5ePHKav1zEoum1tQfN4a+kJLhEZgbsIHo4XMi0hCywC
X1AWnYQp/IlQrHD3i3D0OdRyi7TvSFl4Cf3VC4/OAVpDDa8KKGKV0Ymy+78= on 02/04/2024
harmful effects of so-called performance targets are not considered
(55). Indeed, iatrogenics (“caused by
the healer” in Greek) represents a treatment that causes more harm than good
(55). Goodhart’s law may underpin iatrogenics in sports performance that
result from turning measures into evaluations. In some cases, this may have
been witnessed through the assessment
of total distance covered as measured
by tracking technology, which has
been reported to have led to some athletes running around during breaks in
play simply to increase their distance
covered (23). Similarly, velocity based
training provides objective feedback on
bar velocity numbers during strength
work, which can improve training
intent, but with poor implementation
could encourage athletes to chase targets to the detriment of technique, and
potentially safety (23).
Another example is performance staff
may set targets to address asymmetries
assessed through strength and power
testing, such as ,10% interlimb asymmetry for return to sport from injury
(8,38). However, clinicians have also
acknowledged that the unaffected limb
is rarely normal (43) and research has
yet to demonstrate a clear influence of
asymmetry on performance (8,39). Further research is warranted to understand
whether intervention planning to target
asymmetry reduction is beneficial (43).
A final example may be setting bodyweight targets, which could lead to athletes engaging in unhealthy weight loss
behaviors. For example, 22% of youth
American football players given bodyweight targets in order to be selected
to compete were deemed to be at risk
of abnormal eating behaviors, with eating binges, excessive exercise and drastic
weight loss methods such as sauna use
reported (61). Such body-mass manipulation can lead to dehydration that may
affect performance in subsequent training activities (6), and similar thermal
weight loss techniques have been
described as “concerning” in combat
sports (5). Despite good intentions, such
emphasis on metrics has the potential to
adversely affect the quality of output and
can distract from, or even replace the
original purpose (23). Therefore, performance staff should use continuous
reflection and intention to ensure any
targets introduced serve their central
goal of enhancing sports performance.
DIFFERENT STAKEHOLDERS
OFTEN HAVE COMPETING
INTERESTS
KPIs can be different for different stakeholders. In business, organizations have
multiple stakeholders reflecting multiple
functions (52). Similarly in sport, different
stakeholders can be seen as competitors
with different motivations and means to
achieve them (22). For example, physical
preparation staff may seek to set high
training load targets to maximize performance, whereas medical staff seek to
control training load to minimize risk
of injury (22). However, agency problems and conflict may arise if performance staff select these KPIs in relative
isolation, without considering the interests of all involved stakeholders, even if
well-intentioned. For example, an injured
athlete may be concerned about their
place in the team and an upcoming contract extension, and thereby wanting to
play as soon as possible, whereas the
medical staff are predominantly concerned about the rehabilitation and subsequent re-injury risk.
Nevertheless, the team sport staff (e.g.,
coaches) would like the player to compete in an imminent important game,
because they are concerned about the
team’s winning percentage. When the
above stakeholders’ KPIs do not align,
it may lead to tension within the sports
organization. To resolve these kinds of
agency problems, performance staff
and team sport staff may adopt a shared
decision-making model when making
decisions regarding rehabilitation (62).
Expansion of this model, however, is
needed to better support them in how
to go about selecting their KPIs or
performance-focused measures.
Indeed, the rehabilitation setting may
warrant greater attention to KPIs, given
the more controlled nature of returning
an athlete from injury, and potential tension between physical performance and
medical staff during such an interdisciplinary process (22). KPIs may cover
medical (e.g., palpation pain and range
of motion), physical (e.g., high-speed
running and accelerations), and technical
aspects (e.g., passing and tackling) (56).
Time and/or clinical markers for return
to play may also be seen as a KPI (9).
Although these markers may not necessarily be named KPIs per se, they serve
similar purposes in evaluating the player’s performance and gauging their progression in RTP.
When performance is placed as the primary goal, competition between key
stakeholders
should
disappear.
Performance-focused measures determined in an interdisciplinary manner
can bring stakeholders together as teammates (22). For instance, greater preseason participation has been associated
with lower in-season injury risk (58);
therefore, the so-called training loadinjury paradox is actually in the best
interest of physical preparation and the
medical staff. Targets for injury availability may also be used, given the relationship between injuries and chance of
success demonstrated across a variety
of sports (12). It remains clear, however,
that differing responsibilities within the
performance staff, in addition to the
wider team sport staff, can threaten
agency issues when incorporating KPIs
in applied practice.
A NEW FRAMEWORK FOR
PERFORMANCE INDICATORS:
ONGOING PROCESS TRACKERS
One of the main reasons KPIs are used
so broadly is that they provide many
well-established benefits in supporting
individuals, teams, and organizations in
monitoring progress toward desired performance goals. However, given some of
the issues highlighted above, complementing KPIs with other tools may offer
a more complete approach to evaluating
performance progress over the longterm. Here, we propose a new approach
to KPIs that may offer a solution to any
unintended consequences associated
with traditional KPIs and a complementary means to help more holistically
track and support the progress of athletes or teams toward performance goals.
93
Copyright © National Strength and Conditioning Association. Unauthorized reproduction of this article is prohibited.
Strength and Conditioning Journal | www.nsca-scj.com
Key Performance Indicators
Downloaded from http://journals.lww.com/nsca-scj by BhDMf5ePHKav1zEoum1tQfN4a+kJLhEZgbsIHo4XMi0hCywC
X1AWnYQp/IlQrHD3i3D0OdRyi7TvSFl4Cf3VC4/OAVpDDa8KKGKV0Ymy+78= on 02/04/2024
Ongoing process trackers are quantifiable measures of the execution of behaviors and processes that create the
environments, cultures, and conditions
for successful performance outcomes.
Where traditional KPIs are often based
on metrics that directly serve outcome
goals, OPTs focus on measuring how
well an athlete or team are adhering to
the pathway toward achieving specific
outcomes. The rationale for the development of OPTs thus stems heavily from
literature describing the developmental
pathway to peak performance of top
athletes, and literature related to the
interplay between process and outcome
for supporting successful sporting performance. Specifically, one of the key
Table 1
Characteristics of effective OPTs
Characteristic
Long-term
Actions
Establish a bold vision, then align and
commit to the long-term goals it will
take to achieve the vision as a
multidisciplinary team
Applied examples
Team promoted to the first division after 3
years
Develop the leading physical preparation
program in the league. Evidenced by
scoring the most points in the latter
stages of games
Focused on the processes and behaviors Assemble the necessary multidisciplinary Each athlete understands and can
articulate the “why” behind their
expertise and bring all stakeholders
that constitute the pathway to
physical preparation program
together
performance success
Breakdown long-term goals into the steps Each athlete completes a designated
number of personalized physical
it will take to achieve them harnessing
preparation sessions a month
this expertise
All athletes are on time for all training
Acknowledge the complex and nonlinear Use a basket of OPTs
sessions
nature of performance
Think about the environment, conditions,
All athletes bring the right kit and
and culture you want to create to
equipment to all training sessions
facilitate long-term success and develop
OPTs to help reinforce these
Represent and engage all key
stakeholders
Medical: each athlete completes a full
Include at least one OPT per key
blood panel every 3 mo to optimize
stakeholder group
opportunity for physical adaptation
Allow key stakeholders to design their own
Psychology: each athlete completes
OPTs to best support identified longreflective practice journaling after each
term goals
physical preparation session to seek
Communicate all stakeholder OPTs for full
opportunities to accelerate learning and
transparency and alignment
development
Contextual
Consider different ways to appropriately
assess OPTs, such as observational
measures
Adapt OPTs as needed based on new
information, learnings, and context
Prevention of Goodhart’s law
Antigoal: Athletes having to get up early to
Develop “antigoals”
attend a mandatory team recovery
If KPIs are also used, review alongside OPTs
session the day after a match or
to ensure outcomes and processes are
competition, compromising their sleep
continually assessed (see below)
and ironically, their recovery and
ongoing physical development
Integration of OPTs and KPIs
Experienced athlete with perfect Olympic
Consider the learning and skill
lifting technique: focus on hitting
development phase of individual
specific testing numbers
athletes and their readiness for focusing
Lesser experienced athlete: focus on
on processes or outcomes
Olympic lifting technique development,
for example, integrating and executing
specific coaching cues or drills
Improvements to running technique, as
observed and assessed by multiple
practitioners and/or coaches
94 VOLUME 46 | NUMBER 1 | FEBRUARY 2024
Copyright © National Strength and Conditioning Association. Unauthorized reproduction of this article is prohibited.
Downloaded from http://journals.lww.com/nsca-scj by BhDMf5ePHKav1zEoum1tQfN4a+kJLhEZgbsIHo4XMi0hCywC
X1AWnYQp/IlQrHD3i3D0OdRyi7TvSFl4Cf3VC4/OAVpDDa8KKGKV0Ymy+78= on 02/04/2024
factors distinguishing “super-elite” athletes (Olympic and/or World Champions)
from
“elite”
athletes
(international representatives but nonmedalists) in a multidisciplinary developmental biography study (27) was the
joint focus of super-elites on mastery
and outcome goals, whereas elite athletes demonstrated a strong outcome
focus only. In addition, although superelite athletes reported similar training
volumes and training characteristics in
adulthood, their continued performance
improvement compared with elite athletes was attributed in significant part to
the positive psychosocial characteristics
of their training environment related to
their mastery orientation (26). Furthermore, in team sports, a perceived mastery climate created by coaches and
performance staff is a stronger predictor
of player performance than individual
psychological factors such as mental
toughness and grit (45).
Indeed, focusing on the process over
the outcome has long been a strategy
favored by top coaches to help athletes
manage the challenges and stressors
associated with performance under
pressure (14). Equally, a recent metaanalysis concluded that using process
goals had a much larger positive effect
on athlete performance (d 5 1.36)
compared with performance goals (d
5 0.44). Process goals can be effective
when set in isolation (57). That said,
other research has shown that performance is best served by focusing on
process goals for areas of learning
and development, with a switch to outcome focuses for areas of mastery (63).
Practically speaking, we suggest that
practitioners may wish to integrate
OPTs and KPIs into their measurement
practice, potentially with individualized approaches for different athletes.
Borrowing from the business world,
many top companies such as Google,
Amazon, and Uber have successfully
used a goal system called objectives
and key results (OKRs) to help set
goals and track progress toward them
(17). Where traditional KPIs are often
fixed and act to monitor the day-to-day
health of a system (e.g., 80% squad
availability), OKRs are agile and designed to also hold teams to bold and
ambitious long-term goals (e.g.,
become the top injury management
program in the league). Thus, we have
adapted several elements key to the
success of OKRs in this framework,
in the hope that this will help practitioners effectively implement OPTs
within their program. Table 1 presents
the characteristics of OPTs with corresponding actions for practitioners,
along with applied examples.
By helping to focus athletes, departments, and/or entire teams and organizations on the process over the outcome,
complementing KPIs with OPTs may
offer several potential advantages over
traditional KPIs alone. First, by their
design, they aim to reinforce behaviors
that contribute to performance success,
helping to avoid the negative consequences of Goodhart’s law—these positive behaviors function as measures and
targets that are helpful for performance
(24). Conversely, they can include “antigoals,” behaviors or approaches that
should be avoided to meet the OPTs.
This feature would ensure that performance is never inadvertently compromised to achieve targets.
Second, given the complexity of human
performance, even our best predictive
models populated by reams of data still
struggle to help us understand how the
multiple variables traditionally assigned
as KPIs combine to contribute to team
sport performance, particularly in openskill sports such as soccer, basketball,
and Australian rules football (35).
Instead, OPTs would help acknowledge
these unknowns and would be intended
to help tip an athlete’s or team’s odds in
favor of success. Third, they offer the
capacity to harness the experience, intuition, and context of practitioner and
coaching teams in defining the processes
for success in ways that traditional KPIs
Figure 1. A checklist infographic for selecting and using OPTs.
95
Copyright © National Strength and Conditioning Association. Unauthorized reproduction of this article is prohibited.
Strength and Conditioning Journal | www.nsca-scj.com
Key Performance Indicators
Downloaded from http://journals.lww.com/nsca-scj by BhDMf5ePHKav1zEoum1tQfN4a+kJLhEZgbsIHo4XMi0hCywC
X1AWnYQp/IlQrHD3i3D0OdRyi7TvSFl4Cf3VC4/OAVpDDa8KKGKV0Ymy+78= on 02/04/2024
based solely on data-driven targets often
neglect (24). Even in a data-abundant
sports performance environment, it warrants remembering that not everything
that can be measured matters, and not everything that matters can be measured (49). In
addition, OPTs may also help drive talent development in a team, program, or
organization by creating a culture that
encourages younger or less-experienced
athletes to model the positive behaviors
of more experienced athletes, and helping to incentivize the value of long-term
athlete development, and short-term
performance outcomes (2). Finally, by
encouraging athletes to focus on controllable factors, OPTs may offer the ancillary benefit of fostering athlete
autonomy and intrinsic motivation
(50), helping prevent burnout and supporting athlete well-being while facilitating long-term performance success.
goals rather than a sole focus on outcome measures. Using a basket of
OPTs allows different key stakeholders
to engage and align to support the
behaviors that can lead to long-term
goals of an organization. Practitioners
can use the OPT checklist (Figure 1) to
track and demonstrate how their program supports process-driven goals.
Conflicts of Interest and Source of Funding:
The authors report no conflicts of interest
and no source of funding.
Jo Clubb is a
sports science
consultant at her
company, Global
Performance
Insights.
4.
5.
6.
7.
8.
9.
10.
11.
Multiple strategies may support the
effective implementation of OPTs in
sports performance environments.
Given the multitude of data now collected, combined with the nonlinear
relationship to performance, using
OPTs may also help practitioners
demonstrate the buy-in and success
of a program with some distance from
on-field outcomes. Figure 1 displays a
checklist with key questions performance staff practitioners can ask themselves and their team when starting to
select and use OPTs in their program.
12.
Sian Victoria
Allen is a physiologist working in
industry R&D
at lululemon
athletic.
13.
14.
15.
16.
Kate K. Yung is
a researcher and
the Director of
Medical and
Performance
Innovations at
Kitchee S.C.
CONCLUSION
Despite widespread adoption, using
KPIs can be problematic given the
complex and nonlinear nature of team
sports performance. This concern is
compounded by the growing data
abundance and multidisciplinary practitioners within the performance staff,
which can cause a drift from on-field
performance goals and agency issues
across different stakeholders. Given
these issues, we propose a complementary framework, OPTs, that shifts
attention to the processes that underpin performance. These are quantifiable measures of the behaviors and
processes that create the environment
for success, underpinned by mastery
3.
17.
18.
19.
20.
21.
22.
REFERENCES
1.
2.
Baker DG, Newton RU. Comparison of lower body
strength, power, acceleration, speed, agility, and
sprint momentum to describe and compare playing
rank among professional rugby league players.
J Strength Cond Res 22: 153–158, 2008.
Baker J, Schorer J, Wattie N. Compromising talent:
Issues in identifying and selecting talent in sport.
Quest 70: 48–63, 2018.
23.
Balague N, Torrents C, Hristovski R, Davids K,
Araújo D. Overview of complex systems in sport.
J Syst Sci Complex 26: 4–13, 2013.
Barbosa TM, Costa M, Marinho DA, Coelho J, Moreira
M, Silva AJ. Modeling the links between young
swimmers’ performance: Energetic and biomechanic
profiles. Pediatr Exerc Sci 22: 379–391, 2010.
Barley OR, Chapman DW, Abbiss CR. Weight
loss strategies in combat sports and concerning
habits in mixed martial arts. Int J Sports Physiol
Perform 13: 933–939, 2018.
Barr SI. Effects of dehydration on exercise
performance. Can J Appl Physiol 24: 164–172,
1999.
Best RJ, Bartlett RM, Sawyer RA. Optimal javelin
release. J Appl Biomech 11: 371–394, 1995.
Bishop C, Turner A, Read P. Effects of inter-limb
asymmetries on physical and sports performance: A
systematic review. J Sports Sci 36: 1135–1144,
2018.
Brinlee AW, Dickenson SB, Hunter-Giordano A,
Snyder-Mackler L. ACL reconstruction rehabilitation:
Clinical data, biologic healing, and criterion-based
milestones to inform a return-to-sport guideline. Sports
Health 14: 770–779, 2022.
Brito Souza D, López-Del Campo R, Blanco-Pita
H, Resta R, Del Coso J. Association of match
running performance with and without ball
possession to football performance. Int J Perform
Anal Sport 20: 483–494, 2020.
Calleja-González J, Bird SP, Huyghe T, et al. The
recovery umbrella in the world of elite sport: Do not
forget the coaching and performance staff. Sports
9: 169, 2021.
Cardinale M. Key performance indicators. In:
NSCA’s Essentials of Sport Science. Champaign,
IL: Human Kinetics, Inc, 2022.
Castellano J, Casamichana D, Lago C. The use of
match statistics that discriminate between
successful and unsuccessful soccer teams. J Hum
Kinetics 31: 137–147, 2012.
Dehghansai N, Pinder RA, Baker J, Renshaw I.
Challenges and stresses experienced by athletes
and coaches leading up to the Paralympic Games.
PLoS ONE 16: e0251171, 2021.
Del Coso J, Brito de Souza D, Moreno-Perez V,
et al. Influence of players’ maximum running speed
on the team’s ranking position at the end of the
Spanish LaLiga. Int J Environ Res Public Health
17: 8815, 2020.
Dellal A, Chamari K, Wong DP, et al. Comparison
of physical and technical performance in European
soccer match-play: FA premier league and La liga.
Eur J Sport Sci 11: 51–59, 2011.
Doerr J. Measure What Matters: OKRs: The
Simple Idea That Drives 10x Growth. London,
United Kingdom: Portfolio Penguin, 2018.
Domı́nguez E, Pérez B, Rubio ÁL, Zapata MA. A
taxonomy for key performance indicators
management. Comput Stand Inter 64: 24–40, 2019.
Elton L. Goodhart’s law and performance
indicators in higher education. Eval Res Educ 18:
120–128, 2004.
Emmonds S, Nicholson G, Begg C, Jones B,
Bissas A. Importance of physical qualities for
speed and change of direction ability in elite
female soccer players. J Strength Cond Res 33:
1669–1677, 2019.
Fire M, Guestrin C. Over-optimization of academic
publishing metrics: Observing Goodhart’s law in
action. GigaScience 8: giz053, 2019.
Gabbett TJ, Whiteley R. Two training-load paradoxes:
Can we work harder and smarter, can physical
preparation and medical Be teammates? Int J Sports
Physiol Perform 12: S250–S254, 2017.
Gamble P. Prepared: Unlocking Human
Performance With Lessons From Elite Sport.
Informed in Sport Publishing, 2020. Available at:
https://www.amazon.co.uk/Prepared-UnlockingHuman-Performance-Lessons/dp/177521866X.
Accessed April 12, 2023.
96 VOLUME 46 | NUMBER 1 | FEBRUARY 2024
Copyright © National Strength and Conditioning Association. Unauthorized reproduction of this article is prohibited.
24.
Downloaded from http://journals.lww.com/nsca-scj by BhDMf5ePHKav1zEoum1tQfN4a+kJLhEZgbsIHo4XMi0hCywC
X1AWnYQp/IlQrHD3i3D0OdRyi7TvSFl4Cf3VC4/OAVpDDa8KKGKV0Ymy+78= on 02/04/2024
25.
26.
27.
28.
29.
30.
31.
32.
33.
34.
35.
36.
37.
38.
Gamble P, Chia L, Allen S. The illogic of being datadriven: Reasserting control and restoring balance in
our relationship with data and technology in football.
Sci Med Football 4: 338–341, 2020.
Groom R, Cushion C, Nelson L. The delivery of
video-based performance analysis by England
youth soccer coaches: Towards a grounded
theory. J Appl Sport Psychol 23: 16–32, 2011.
Güllich A, Hardy L, Kuncheva L, et al.
Developmental biographies of olympic super-elite
and elite athletes: A multidisciplinary pattern
recognition analysis. J Expert 2: 23–46, 2019.
Hardy L, Barlow M, Evans L, Rees T, Woodman T,
Warr C. Great British medalists: Psychosocial
biographies of super-elite and elite athletes from
Olympic sports. Prog Brain Res 232: 1–119,
2017.
Herold M, Kempe M, Bauer P, Meyer T. Attacking
key performance indicators in soccer: Current
practice and perceptions from the elite to youth
academy level. J Sports Sci Med 20: 158–169,
2021.
Hood C, Piotrowska B. Goodhart’s law and the
gaming of UK public spending numbers. Public
Perform Manag Rev 44: 250–271, 2021.
Hughes MD, Bartlett RM. The use of performance
indicators in performance analysis. J Sports Sci
20: 739–754, 2002.
James LP, Talpey SW, Young WB, Geneau MC,
Newton RU, Gastin PB. Strength classification
and diagnosis: Not all strength is created equal.
Strength Cond J 45: 333–341, 2023.
James N. Notational analysis in soccer: Past,
present and future. Int J Perform Anal Sport 6: 67–
81, 2006.
Jones NMP, Mellalieu SD, James N. Team
performance indicators as a function of winning
and losing in rugby union. Int J Perform Anal Sport
4: 61–71, 2004.
Knuttgen HG, Kraemer WJ. Terminology and
measurement in exercise performance. J Strength
Cond Res 1: 1–10, 1987.
Lames M, McGarry T. On the search for reliable
performance indicators in game sports. Int J
Perform Anal Sport 7: 62–79, 2007.
Lindberg C-F, Tan S, Yan J, Starfelt F. Key
performance indicators improve industrial
performance. Energ Proced 75: 1785–1790,
2015.
Lockie RG, Jalilvand F, Callaghan SJ, Jeffriess MD,
Murphy AJ. Interaction between leg muscle
performance and sprint acceleration kinematics.
J Hum Kinetics 49: 65–74, 2015.
Maestroni L, Read P, Bishop C, Turner A. Strength
and power training in rehabilitation: Underpinning
principles and practical strategies to return
39.
40.
41.
42.
43.
44.
45.
46.
47.
48.
49.
50.
athletes to high performance. Sports Med 50:
239–252, 2020.
Maloney SJ. The relationship between asymmetry
and athletic performance: A critical review.
J Strength Cond Res 33: 2579–2593, 2019.
Maté A, Trujillo J, Mylopoulos J.
Conceptualizing and specifying key
performance indicators in business strategy
models. In: Conceptual Modeling (Vol. 7532).
Atzeni P, Cheung D, and Ram S, eds.
Berlin, Heidelberg: Springer Berlin
Heidelberg, 2012. pp. 282–291. Available
at: http://link.springer.com/10.1007/978-3642-34002-4_22. Accessed December 20,
2022.
McGuigan M. Monitoring Training and
Performance in Athletes. Champaign, IL: Human
Kinetics, 2017.
O’Donoghue P. Research Methods for Sports
Performance Analysis. Routledge, 2009. Available
at: https://www.taylorfrancis.com/books/
9781134005369. Accessed December 20, 2022.
Paton BM, Read P, Van Dyk N, et al. London
international consensus and delphi study on
hamstring injuries part 3: Rehabilitation, running
and return to sport. Br J Sports Med 57: 278–291,
2023.
Perl J, Memmert D. A pilot study on offensive
success in soccer based on space and ball control
—key performance indicators and key to
understand game dynamics. Int J Comput Sci
Sport 16: 65–75, 2017.
Pettersen SD, Martinussen M, Handegård BH,
Rasmussen L-MP, Koposov R, Adolfsen F. Beyond
physical ability—predicting women’s football
performance from psychological factors. Front
Psychol 14: 1146372, 2023. Available at: https://
www.frontiersin.org/articles/10.3389/fpsyg.
2023.1146372/full. Accessed April 4, 2023.
Phatak AA, Mehta S, Wieland F-G, et al. Context is
key: Normalization as a novel approach to sport
specific preprocessing of KPI’s for match analysis
in soccer. Sci Rep 12: 1117, 2022.
Randell AD, Cronin JB, Keogh JW, Gill ND.
Transference of strength and power adaptation to
sports performance—horizontal and vertical force
production. Strength Cond J 32: 100–106, 2010.
Robertson S, Back N, Bartlett JD. Explaining
match outcome in elite Australian Rules football
using team performance indicators. J Sports Sci
34: 637–644, 2016.
Rosling H, Rosling O, Rönnlund AR. Factfulness:
Ten Reasons We’re Wrong about the World—and
Why Things Are Better Than You Think. London,
United Kingdom: SCEPTRE, 2018.
Ryan RM, Deci EL. Self-determination theory and
the facilitation of intrinsic motivation, social
51.
52.
53.
54.
55.
56.
57.
58.
59.
60.
61.
62.
63.
development, and well-being. Am Psychol 55: 68–
78, 2000.
Salmon PM, McLean S. Complexity in the beautiful
game: Implications for football research and
practice. Sci Med Football 4: 162–167, 2020.
Schein EH. Organizational Culture and
Leadership. 3. San Francisco, CA: Jossey-Bass,
2004.
Springham M, Walker G, Strudwick T, Turner A.
Developing strength and conditioning coaches for
professional football. Coaching Prof Football 50:
9–16, 2018.
Staunton CA, Abt G, Weaving D, Wundersitz
DWT. Misuse of the term “load” in sport and
exercise science. J Sci Med Sport 25: 439–444,
2022.
Taleb NN. Antifragile: How to Live in a World We
Don’t Understand: London, United Kingdom: Allen
Lane, 2012.
Whiteley R, van Dyk N, Wangensteen A, Hansen
C. Clinical implications from daily physiotherapy
examination of 131 acute hamstring injuries and
their association with running speed and
rehabilitation progression. Br J Sports Med 52:
303–310, 2018.
Williamson O, Swann C, Bennett KJM, et al. The
performance and psychological effects of goal
setting in sport: A systematic review and metaanalysis. Int Rev Sport Exerc Psychol 1–29: 2022.
Windt J, Gabbett TJ, Ferris D, Khan KM. Training
load–injury paradox: Is greater preseason
participation associated with lower in-season
injury risk in elite rugby league players? Br J Sports
Med 51: 645–650, 2017.
Wing CE, Turner AN, Bishop CJ. Importance of
strength and power on key performance indicators
in elite youth soccer. J Strength Cond Res 34:
2006–2014, 2020.
Yang G, Leicht AS, Lago C, Gómez M-Á. Key team
physical and technical performance indicators
indicative of team quality in the soccer Chinese
super league. Res Sports Med 26: 158–167,
2018.
Yeargin S, Torres-McGehee TM, Emerson D, Koller J,
Dickinson J. Hydration, eating attitudes and
behaviors in age and weight-restricted youth
American football players. Nutrients 13: 2565, 2021.
Yung KK, Ardern CL, Serpiello FR, Robertson S. A
framework for clinicians to improve the decisionmaking process in return to sport. Sports Med
Open 8: 52, 2022.
Zimmerman BJ, Kitsantas A. Developmental
phases in self-regulation: Shifting from process
goals to outcome goals. J Educ Psychol 89: 29–
36, 1997.
97
Copyright © National Strength and Conditioning Association. Unauthorized reproduction of this article is prohibited.
Strength and Conditioning Journal | www.nsca-scj.com
Download