Bias in Malmquist index and cost function productivity

Int. J. Production Economics 76 (2002) 177–188
Bias in Malmquist index and cost function productivity
measurement in banking
Ana Lozano-Vivasa,*, David B. Humphreyb
a
Department of Economics, University of Malaga, Plza. El Ejido, 29013 Malaga, Spain
b
Department of Finance, Florida State University, Tallahassee, FL, USA
Received 30 August 2000; accepted 26 March 2001
Abstract
This paper illustrates how many prior studies of productivity growth in the banking industry have been overstated.
This occurs with both DEA (Malmquist index) and parametric (stochastic cost frontier) productivity measurement
approaches. The problem is not due to the technique used but in how it is applied. It is easiest to see in the banking
industry due the nature of the data available. The bias is eliminated when all outputs and inputs are included in the
analysis, ensuring that the balance sheet restriction is met. Although simple in concept, this problem and its solution
have so far been neglected in the literature. r 2002 Elsevier Science B.V. All rights reserved.
Keywords: Productivity; Malmquist index; Frontier cost; Banking industry
1. Introduction
Productivity measurement has a long history,
ranging from changes in output per unit of labor
input to more complex, but more complete,
measures of total factor productivity (TFP). In
this transition, growth accounting measures of
TFP have given way to nonparametric (linear
programming) Malmquist index and parametric
(regression-based) stochastic frontier cost function
TFP estimates. However, many published studies
using the Malmquist index in the banking area
appear to have significantly overstated estimates of
productivity growth. The bias is not due to the
technique used but rather in how it is applied.
*Corresponding author. Tel.: +34-952-131256; fax: +34952-131299.
E-mail addresses: avivas@uma.es (A. Lozano-Vivas),
dhumphr@garnet.acns.fsu.edu (D.B. Humphrey).
This problem in recent productivity studies is
most easily seen in applications of the Malmquist
index to banking industry data but exists in
stochastic frontier cost function applications as
well (including our own work). Fortunately, the
bias is simple to correct and it can be measured,
reduced, or eliminated in future productivity
studies. The problem is not new but has been
consistently overlooked in published work. Our
guess is that it has persisted because no one has
shown how large it can be. While other productivity measurement difficulties remain, the one we
identify is amenable to correction.
In what follows, we explain how the bias arises
in Section 2. Its importance is illustrated by
showing that in many studies, it is the source of
the main part of measured productivity growth.
Due to the special nature of banking data and the
Malmquist index itself, it is relatively simple to
0925-5273/02/$ - see front matter r 2002 Elsevier Science B.V. All rights reserved.
PII: S 0 9 2 5 - 5 2 7 3 ( 0 1 ) 0 0 1 6 2 - 1
178
A. Lozano-Vivas, D.B. Humphrey / Int. J. Production Economics 76 (2002) 177–188
approximate the magnitude of the bias (hence our
focus on this measure). In Section 3, we show that
use of a stochastic frontier cost function to
estimate banking productivity can lead to similar
difficulties. The problem associated with both
techniques is illustrated by applying the Malmquist index and a cost function to the same set of
banking data. For completeness, although it is an
inferior measure, we also show how the growth
accounting approach to productivity measurement
is affected. Our conclusions are in Section 4 and an
appendix contains details of prior studies.
Table 1
Example of included and excluded assets and liabilities in
banking productivity studies
Factor inputs: Labor and physical capital
Assets or outputs
Liabilities or inputs
Included:
Business loans
Consumer loans
Securities
Demand deposits
Included:
Savings deposits
Time deposits
Certificates of deposits (CDs)
Excluded:
Funds sold
Vault cash
Other earning assets
Off-balance sheet
activities
Excluded:
Other liabilities for borrowed money
Short-term purchased funds
Subordinated debt
Equity
2. Bias in productivity measurement
2.1. Where the bias comes from
Single factor measures of productivity are
inferior to total factor measures because they do
not include all the inputs that affect output. In most
industries, it is easy to determine and include all the
inputs that significantly affect output as well as to
include all the outputs being produced. However, in
banking, productivity researchers use labor and
capital inputs but selectively choose only certain
inputs and outputs from balance sheet liabilities
and assets and neglect others. Whatever the choice
of banking balance sheet inputs and outputs, it is
common to measure them in terms of their (real or
nominal) value, along with the number of labor
inputs and the value of physical capital. This is
partly because banks are viewed as intermediating
stocks of the value of deposits into stocks of the
value of loans or security investments. But mostly it
is because data on the number of deposit and loan
accounts (alternative stock measures) or the number of deposit account debits and credits and the
number of new loans made (alternative flow
measures of input and output) are rarely available.
Table 1 illustrates a typical selection of asset
outputs and liability inputs included in productivity models. Excluded assets and liabilities are also
shown.1 These choices are justified by pointing to
similar selections made by previous researchers
1
Table 1, although representative, is only illustrative since
not all productivity studies have chosen to include/exclude the
same balance sheet assets and liabilities.
investigating bank cost/scale efficiencies or by
deciding to include only the ‘‘important’’ balance
sheet categories.
When studying banking cost efficiency or scale
effects, variations in loans have a much larger effect
on costs than do variations in interbank funds sold,
vault cash, or off-balance sheet activities.2 Consequently, loans are included as a banking output
while the other three asset categories are usually
excluded. However, loans, security holdings, funds
sold, and off-balance sheet activities all generate
significant revenues and therefore should be
included as a banking output in revenue or profit
analyses. Our key point is that, unlike cost or profit
analysis, there is no such ‘‘differential importance’’
of any of these liability/asset categories when it
comes to productivity measurement. Since productivity growth should reflect the change in the ratio
of outputs to inputs – and not be biased by
concurrent changes in balance sheet composition –
then all balance sheet inputs and outputs need to
be included.3 Productivity analysis differs from
banking cost, revenue, or profit analyses in that
2
Off-balance sheet (OBS) activities include standby letters of
credit, loan commitments, interest rate derivatives, and foreign
exchange contracts.
3
Including OBS activities as an output is, in our view,
inappropriate in a cost function as these activities cost almost
nothing to produce. However, OBS activities generate substantial revenues (and risk) for a bank and, as a result, should
definitely be included in a revenue or a profit function analysis.
A. Lozano-Vivas, D.B. Humphrey / Int. J. Production Economics 76 (2002) 177–188
changes in excluded balance sheet inputs or outputs
have the same effect on productivity – not a lesser
or greater effect – as those inputs and outputs
chosen to be included in the analysis.
It is well known that productivity and revenue
of a non-banking firm rises in the upswing of a
business cycle since, with excess capital capacity
and (likely) underemployed labor, output can
expand without a commensurate rise in capital
and (in this case) labor inputs. But banks are
different. There is no ‘‘excess capacity’’ among
balance sheet inputs and outputs (although there
can be for capital and labor). All liability funds
inputs find their way into assets through the
balance sheet constraint and, either directly or
indirectly, earn revenues (which is a common way
to identify outputs). In a profit maximizing bank,
funds sold should be earning the same marginal
risk-adjusted return as do loans or security
holdings but funds sold are almost always an
excluded banking output while loans are included.
Similarly, vault cash is an excluded output even
though cash holdings are an essential component
in providing payment and liquidity services
through branches and ATMs. These and other
depositor services tradeoff with interest costs that
would otherwise be needed to attract funds. In this
sense, they earn implicit revenue or a return valued
by the bank in providing a service flow to
depositors. Thus, all balance sheet assets can be
considered to be outputs since they all are
presumed to earn the same marginal risk-adjusted
return. Similarly, all liabilities are inputs since they
all are presumed to incur the same maturityadjusted interest and/or operating expense.
By excluding various liability and asset categories from the analysis, researchers largely predetermine the size and variation of their
productivity estimates over time and across sizeclasses of banks. The magnitude of this bias can be
inferred by first estimating productivity using the
set of inputs and outputs a researcher may choose
and then re-estimating using all liability and asset
categories as inputs and outputs.4
4
In the interests of tractability and parameter estimation
parsimony, only the major inputs/outputs need to be separately
specified. Those remaining can be aggregated together.
179
Take the case noted above where loans are an
included output and funds sold are an excluded
output. If loan demand expands by $500 million,
banks have a number of alternatives: they can
purchase short-term funds, they can try to attract
more deposits, or they can reduce interbank funds
sold by $500 million. The course chosen will depend
on: the interest cost of short-term purchased funds,
the interest and operating expense of increasing
deposits, and the risk-adjusted return for funds
sold. If more short-term funds are purchased (and if
these funds are an excluded input), then both loans
and measured productivity will be viewed as
expanding without a rise in inputs. If deposits are
increased, then the expansion of loans will be offset
and productivity will not change. Finally, if funds
sold are reduced and shifted into loans, loans will
again be viewed as expanding without any offsetting
rise in inputs and measured productivity will rise.
To those that loans are a more important
category of output than funds sold, we would
agree if the purpose were to measure cost efficiency
or scale economies since funds sold have a de
minimis effect on costs. To buy or sell funds all
that is needed is a small room, a few traders, some
telephones, and a direct or dial-up line to a money
market and/or other banks. However, because of
the way balance sheet inputs and outputs typically
are measured, a $500 million expansion in deposit
inputs that funds $500 million in new loans should
have the same effect on productivity as a $500
million shift in asset composition away from funds
sold to new loans. But this will not occur unless
funds sold and loans are both included in the
analysis as outputs. Similar productivity measurement problems arise when balance sheet liabilities
are excluded from the analysis.5 If researchers do
not want their productivity estimates contaminated by shifts in balance sheet composition over
time or across banks, then they need to effectively
include all liabilities and assets in their analysis.
No one would attempt to measure the productivity
5
For example, in US studies the category ‘‘other liabilities for
borrowed money’’ is often excluded as an input while deposits
are included. Changes in the excluded inputs, however, can
affect the level of loan output which, in turn, affects measured
productivity. If excluded inputs were included in the analysis,
productivity would be measured more accurately.
180
A. Lozano-Vivas, D.B. Humphrey / Int. J. Production Economics 76 (2002) 177–188
of petroleum refining operations without including
the outputs of gasoline, heating oil, motor oil,
grease, paraffin, etc., together. Otherwise, changes
in output mix due to changes in demand and prices
would yield a biased measure of productivity. Just
as in banking, petroleum refining productivity
growth is based on changes in output per unit of
labor and capital input, not in the amount of raw
petroleum input or in output mix.
2.2. Magnitude of the bias
The Malmquist index approach to productivity
measurement is, in its essentials, an overall index
measure of how the balance sheet outputs have
risen or fallen relative to the
P identifiedPfactor and
balance sheet inputs. Let
Ait and
Ljt represent the summed values of the total balance sheet
assets and total liabilities actually used in a
banking productivity study in year t: Because of
the balance sheet constraint, we know that the
ratio of all assets to all liabilities (plus the value of
equity capital) in year t; TAt =TLt ; has to be equal
to 1.00 in all years (time-series) for all banks
(cross-section). But inPall banking
productivity
P
studies we have seen,
Ait = Ljt a1:00; indicating that some assets or some liabilities (or both)
have been P
excluded
P from the analysis. Consequently, if
Ait = Ljt varies over time or across
banks (or both), this variation will make it appear
that productivity is higher or lower than what it
actually is.6 The balance sheet restriction can be
6
In many cost function applications to banking, the productivity bias described here is less obvious but exists nonetheless. It
is less obvious because cost is the dependent variable and there is
precious little information on either the level or the variation in
the various assets and liability cost shares (not balance sheet
shares). As a result, it is very difficult for researchers to determine
the size and stability of the cost shares of the excluded Ai and Lj
variables. Some cost function studies largely circumvent this
problem by defining the dependent variable, total cost, to be very
close to the sum of only the cost of the included asset and
liability categories in the model. This is not a complete solution
because total cost will include all operating expenses plus the
interest cost on all included liability categories. While interest
costs can be associated with various liability categories,
operating costs are not similarly allocated in the reported data.
As a result, if any excluded asset or liability category contributes
significantly to operating cost, then its exclusion from the model
can bias the productivity results.
P
P
met by either (a) having Ai and Lj include the
value of all assets and the value of all liabilities or
(b) so choosing Ai and Lj such that the values or
the value shares of the excluded assets and
liabilities are equal to each other and constant
over time. In practice, (a) is probably the easiest
to do. This is especially true where liability and
asset mix is significantly affected by the level of
interest rates and the stage of the business cycle so
balance sheet values and/or value shares are not
constant over time. As the business cycle varies
over time and across regions, both time-series
and cross-section productivity estimates can be
affected.
We can approximate the degree of bias by
comparing the Malmquist index measure of
productivity between (say) years 1 P
and 2 with
P the
corresponding
asset/liability
index
ð
A
=
Lj2 Þ=
i2
P
P
ð Ai1 = Lj1 Þ: This comparison across years or
between countries is shown in panel A of Table 2
for productivity studies where deposits are only
treated as an input.7 Panel B of Table 2b makes the
same comparison for studies where some deposits
are treated as an output.8 If there were no bias,
then the value in column 4 representing the ratio of
assets to liabilities used as outputs and non-factor
inputs in each study would always be equal or
close to 1.00. However, comparing the values in
columns 3 and 4 of the table, it is clear that in
almost all cases most of the Malmquist index
productivity increase or decrease can be attributed
not to productivity growth but to changes in the
asset/liability index. A first approximation to a
more accurate productivity estimate is obtained by
subtracting column 4 from 3. This result is shown
in the last column of the table. As seen, this
adjustment markedly lowers the estimate of productivity growth for banking firms, sometimes
7
While there are more Malmquist index banking productivity
studies than those shown in the tables, only those papers which
reported the data needed to compute an asset/liability index
could be included.
8
When deposits are an output, their value is added to the
value of other included asset outputs. As well, to account for
the fact that deposits supply funds to purchase assets with, this
same value of deposits is also added to the value of included
liabilities.
181
A. Lozano-Vivas, D.B. Humphrey / Int. J. Production Economics 76 (2002) 177–188
Table 2
Malmquist index banking productivity studies: A comparison of productivity and asset/liability index valuesa
Author
(1)
Time period or
Countries covered
(2)
Malmquist Index
productivity
(3)
Asset/liability
index
(4)
Column (3)(4)
1.117
1.115
0.002
(5)
(A) Funding characteristic of deposits
Devaney and Weber [4]
LMDR banks
1990–1993
Non-LMDR banks
1990–1993
1.114
1.116
0.002
Pooled sample
1989–1990
1990–1991
1.314
1.025
1.237
0.973
0.077
0.052
1990–1993
1.115
1.116
0.001
Total sample
1985–1986
1986–1987
1987–1988
1988–1989
1989–1990
1985 –1990
1.013
1.018
1.056
1.043
1.046
1.288
1.012
1.023
1.026
1.038
1.014
1.120
0.001
0.005
0.030
0.005
0.032
0.168
Berg et al. [2]
Finland–Norway
Finland–Sweden
Norway–Sweden
1.120
1.630
1.460
1.033
1.089
1.053
0.087
0.541
0.407
Wheelock and Wilson [3]
1984–1985
1988–1989
1992–1993
Savings banks
1986–1987
1987–1988
1988–1989
1989–1990
1990–1991
1991–1992
1992–1993
Mean: 86/87–92/93
Commercial banks
1986–1987
1987–1988
1988–1989
1989–1990
1990–1991
1991–1992
1992–1993
Mean: 86/87–92/93
0.986
1.018
1.001
0.913
0.987
0.992
0.073
0.031
0.009
1.047
1.061
1.005
0.971
1.043
1.050
1.006
1.026
1.042
1.006
0.995
1.006
1.015
1.017
0.987
1.010
0.005
0.055
0.010
0.035
0.028
0.033
0.019
0.016
1.071
1.092
1.056
0.993
1.008
0.951
0.981
1.021
1.002
1.019
0.999
0.996
1.049
0.999
0.973
1.006
0.069
0.073
0.057
0.003
0.041
0.048
0.008
0.015
1.032
1.152
0.986
1.052
1.193
1.390
0.020
0.041
0.404
1.188
1.125
1.636
1.050
0.812
0.628
0.138
0.313
1.008
Fukayama [5]
Devaney and Weber [6]
(B) Focused on the output characteristic of deposits
Kuussaari [1]
Grifell-Tatj!e and Lovell [7]
Gilbert and Wilson [8]
a
Regional banks
1980–1985
1980–1989
1980–1994
National banks
1980–1985
1980–1989
1980–1994
See the Appendix A for more detail on the comparisons in Panels A and B of Table 2.
182
A. Lozano-Vivas, D.B. Humphrey / Int. J. Production Economics 76 (2002) 177–188
even changing direction from positive productivity
to negative. The accuracy of this simple approximation is discussed further below. The appendix
contains more detail on the studies used in this
comparison.
3. Illustrating the bias with banking data
3.1. Degree of bias and changes in mean
productivity
We use actual (balanced panel) data on the
Spanish banking system over 1986–1991 to illustrate the importance of the productivity bias.
Three measures of productivity are computed
using (1) a symmetric Malmquist index, (2) a
stochastic frontier (composed error) cost function
and (3) a growth accounting measure.9 As we
show, all three approaches can yieldPbiasedPresults
when
the
P
P asset/liability index ð Ai2 = Lj2 Þ=
ð Ai1 = Lj1 Þa1:00:
To illustrate how the exclusion of various assets
and liabilities can affect the productivity results,
we start by defining our banking inputs and
outputs so that on average 70% of the value of
the aggregate balance sheet of Spanish banks is
covered. This would focus on loan outputs and
deposit and factor inputs. We then successively
expand the coverage of assets and liabilities
until on average 79%, 84%, 98% and finally
100% are covered (which is the no bias situation).
The input and output composition for our five
successive levels of coverage, yielding five panel
data sets, is shown in Table 3, along with the
average percent of the balance sheet value of
assets and liabilities that are covered. For each
of the five data sets, we estimate productivity
using the Malmquist index, a stochastic
frontier cost function and a growth accounting
model. To be consistent, all three methods use
the same number and specification of banking
inputs and outputs at each level of asset/liability
9
These three approaches to productivity measurement are
well known. However, they are outlined in our working paper
(available on request).
coverage.10 A corresponding asset/liability index is
also computed to gauge the degree of bias at each
coverage level. The top part of Table 3 shows the
coverage level for all methods and the non-factor
inputs/outputs for the Malmquist index approach.
The bottom part of the table shows the corresponding input price definitions for the cost
function and the cost function specifications used.
Our productivity results averaged over 1986–
1991, are shown in Fig. 1. Over the five levels of
asset/liability coverage, the growth accounting
model provides the highest estimate of Spanish
banking productivity growth. This is followed by
the stochastic frontier cost function with the
Malmquist index giving the lowest average estimate. All the three methods of estimating productivity growth generate lower estimates as the
degree of bias, indicated by the size of the asset/
liability index, falls with greater coverage of assets
and liabilities. When the asset/liability index
equals 1.00 (coverage level 5), then the potential
bias is removed and the Malmquist index suggests
that annual average productivity change was
0.8% over 6-year period. In contrast, the cost
function suggests that productivity change averaged 1.0% a year while the growth accounting
measure (which is inferior to the other two)
estimates productivity change at 0.2% a year.
Regardless of which one of the three methods is
chosen, we see that it can be seriously biased – in
this case overestimated – when some inputs and
outputs are excluded from the analysis. When 30%
of the value of banking inputs/outputs are
excluded from the analysis (coverage level 1 which
focuses only on loans and deposits), estimated
average productivity growth is 5.7% annually with
growth accounting, 5.7% with a cost function and
3.8% with the Malmquist index. When 2.0% of
the value of inputs/outputs are excluded (coverage
level 4) then the same models yield estimated
annual rates of productivity change of 0.2%,
10
For convenience and consistency with many cost function
studies, we specify deposits as an input in the cost function. Our
preferred specification [9], however, would include deposits as
an input (with an average interest rate) and as an output (to
reflect transaction and safekeeping services provided to
depositors which use the majority of capital and labor factor
inputs).
183
A. Lozano-Vivas, D.B. Humphrey / Int. J. Production Economics 76 (2002) 177–188
Table 3
Banking inputs/outputs and coverage level (Spanish banks, 1986–1991)
Coverage
level
Assets (outputs)
Liabilities (inputs)
Percent covered:
1
A1: Commercial loans
A2: Other loans+loans to other banks
L1: Demand deposits
L2: Savings+time deposits
Labor inputs
Physical capital
56
83
2
Coverage level 1+
A3: Securities
69
88
3
Coverage level 2+
A4: Other assets
Coverage level 3+
A5: Cash and reserves
Coverage level 1+
L3: Borrowed funds +deposits
from other banks
Coverage level 2+
L4: Other liabilitiesa
Coverage level 3+
L5: Equity capitalb
73
95
97
100
100
100
Assets (%)
4
5
Coverage level 4+
A6: Value of physical capital
Coverage level 4
Liabilities (%)
Input prices (P) for the cost function:
P1&2=(Interest cost of total deposits)/(L1+L2)c
P3=(Interest cost of borrowed funds+cost of deposits from other banks)/L3
P4=(Loan loss expense+other costs)/L4
PN=(Personnel expense)/(number of workers)
PK=(Materials cost+building cost+amortization)/A6
Specifications of the cost function:d
1. TC=f(A1, A2, P1&2, PN, PK)
2. TC=f(A1, A2; A3; P1&2; P3, PN, PK)
3. TC=f(A1, A2, A3, A4, P1&2, P3, P4, PN, PK)
4. TC=f(A1, A2, A3, A4, A5, P1&2, P3, P4, PN, PK)
5. TC=f(A1, A2, A3, A4, A5, A6, P1&2, P3, P4, PN, PK)
a
The value of equity capital is excluded here.
For regulatory purposes, the value of equity capital exceeds the value of physical capital.
c
Interest costs were not separately available for transaction, savings, and time deposits.
d
TC equals the sum of the separate inputs specified in each coverage level (except for capital and labor operating expenses which are
not separately allocated to the inputs used or outputs produced).
b
Fig. 1. Average productivity by level of data coverage.
184
A. Lozano-Vivas, D.B. Humphrey / Int. J. Production Economics 76 (2002) 177–188
0.4%, and 0.8%, respectively. In our example,
reducing the bias to zero results in a reduction in
estimated productivity change of 96% (growth
accounting), 118% (cost function), or 121%
(Malmquist index).11 The effects of reducing the
bias in studies of other country’s banking systems
could differ in magnitude, direction, and in terms
of which methodology is most affected.
3.2. Productivity by year and its distribution across
banks
Table 4 shows productivity for all Spanish
banks for each year.12 For simplicity, only coverage levels 1 and 4 are shown.13 There is substantial
year-to-year variation in productivity estimates
when coverage is incomplete – coverage level 1. As
well, for 1987–1988, estimated annual productivity
change ranges from 7.2% (Malmquist Index) to
9.9% (growth accounting). Since the corresponding asset/liability index for that year is 1.076, this
suggests that perhaps as much as 7.6% points of
the productivity growth for 1987–1988 is the result
of not including all assets and liabilities. As well,
since the asset/liability index is not constant, the
year-to-year bias is also not constant and ranges
from 1.026 to 1.076 (with a mean of 1.047).
The level and variation of the productivity
estimates are greatly reduced when coverage is
extended to level 4 (where only 2% of the average
value of assets and liabilities have been excluded).
Here, we show two ways in which the coverage
level can be expanded. The usual way would be to
add new variables to the model which represent
the asset/liability categories that have been excluded. This is the approach outlined in Table 3,
applied in all the figures, and shown in the middle
of Table 4 under the heading ‘‘Adding Variables to
Expand Coverage’’. As seen, the bias is very small
11
Reductions larger than 100% are possible since positive
values at coverage level 1 turn into small negative values at
coverage level 5.
12
The mean values from this exercise were used to plot
changes in average productivity as the coverage level changed in
Fig. 1.
13
Although coverage levels 4 and 5 give very similar
productivity results, coverage level 4 excludes physical capital
as an output since it is already included as a factor input.
at coverage level 4 since the corresponding asset/
liability index is very close to 1.000 – the no bias
situation of coverage level 5. The productivity
estimates for the Malmquist index, the stochastic
frontier cost function, and the growth accounting
models all show a year-to-year variation that
fluctuates between small positive and small negative values. The average result (as indicated
already in Fig. 1) is that annual productivity
growth for Spanish banks over 1986–1991 was
very small – a small decrease or a small increase.
Overall, a conclusion of little or no change in
productivity would be reasonable.
A second approach to show the effects of
expanding asset/liability coverage would be to
simply redefine the first set of new variables added
to the model shown in Table 3 (giving coverage
level 2) to include the additional variables as
coverage is expanded. This reduces the number of
new separate variables added to the model and so
minimizes the tendency of the Malmquist index to
find 100% efficiency merely by specifying additional constraints (variables). The results of this
approach are shown at the bottom of Table 4
under the heading ‘‘Aggregating to Expand Coverage’’. While the year-to-year productivity change
estimates here for coverage level 4 show some
differences from the approach discussed above, the
mean results are quite similar. At this coverage
level, where bias is almost eliminated, average
annual productivity change is 0.2% using the
Malmquist index, 0.4% for the stochastic
frontier cost function and 0.4% for the growth
accounting model. Thus, it would seem that we
obtain quite similar results using the two alternative methods for expanding asset/liability coverage.
As noted earlier in panels A and B of Table 2, a
first approximation to an unbiased value of
productivity change using the Malmquist index
was obtained by subtracting an asset/liability
index from a computed, but biased, Malmquist
index. This simple procedure is quite accurate
when compared to the more involved method of
actually including all or almost all assets and
liabilities and directly computing an unbiased
Malmquist index. Table 5 shows the result of computing a (biased) Malmquist index for different
185
A. Lozano-Vivas, D.B. Humphrey / Int. J. Production Economics 76 (2002) 177–188
Table 4
Productivity estimates by year (Spanish banks, 1986–1991)a
Year
Malmquist
index (%)
Coverage level 1
1986–1987
1987–1988
1988–1989
1989–1990
1990–1991
Mean
Cost function
(%)
Asset/liability
index
5.1
8.7
5.5
4.0
5.1
5.7
5.8
9.9
5.8
2.6
4.2
5.7
1.055
1.076
1.041
1.026
1.037
1.047
Coverage level 4: Adding variables to expand coverage
1986–1987
2.8
1.0
1987–1988
0.1
1.6
1988–1989
1.4
1.3
1989–1990
0.5
1.1
1990–1991
0.7
0.1
Mean
0.8
0.4
0.2
0.8
0.3
0.5
0.9
0.2
1.001
1.003
1.002
0.999
0.998
1.000
Coverage level 4: Aggregating to expand coverage
1986–1987
1.8
1987–1988
0.8
1988–1989
0.1
1989–1990
0.1
1990–1991
0.2
Mean
0.2
1.8
3.0
0.5
1.6
1.5
0.4
1.001
1.003
1.002
0.999
0.998
1.000
a
2.4
7.2
2.4
2.2
4.6
3.8
Growth
accounting (%)
0.7
1.3
0.1
1.0
3.0
0.4
All values have been rounded off.
Table 5
Accuracy of approximating Malmquist index productivity bias. Malmquist index productivity minus asset/liability index by coverage
level and year
Coverage level
1986–1987
1987–1988
1988–1989
1989–1990
1990–1991
Mean
Value with
no biasa
1
2
3
4
5
3.1%
2.7%
3.0%
2.9%
2.7%
0.4%
0.4%
0.5%
0.4%
0.3%
1.7%
1.1%
1.8%
1.6%
1.5%
0.4%
0.7%
0.9%
0.4%
0.8%
0.9%
0.3%
1.5%
0.9%
1.2%
1.0%
0.9%
0.9%
0.9%
0.8%
0.8%
0.8%
0.8%
0.8%
0.8%
a
Value of average Malmquist index productivity at coverage level 5 (also equals the same value at coverage level 4 in Table 4).
coverage levels and years for Spanish banks and
subtracting from it the appropriate asset/liability
index for each coverage level and year. As seen in
the table, the results of this procedure (a) yield
very similar values for different coverage levels for
the same year and for the mean across years
(indicating that the approximation method gives
consistent results across coverage levels) and (b)
the mean value of this approximation method is
very close to the value obtained when the unbiased
Malmquist index is computed by including all
assets and liabilities in the computation process
(which is the ‘‘no bias’’ situation of 0.8% annual
average productivity growth).14
14
Such a strong result is not obtained with the cost function.
This is likely due to the fact that the cost function relies on total
cost and input prices and is not dual to the Malmquist index
‘‘production function’’ specification used here.
186
A. Lozano-Vivas, D.B. Humphrey / Int. J. Production Economics 76 (2002) 177–188
Fig. 2. Malmquist index (coverage levels 1, 2 and 5).
Fig. 3. Cost function (coverage levels 1, 2 and 5).
Lastly, we show how the Malmquist index and
stochastic frontier cost function mean productivity
estimates vary across the 52 banks in the data set.
In Figs. 2 and 3, we adopt the approach of adding
variables to expand coverage. Fig. 2 shows that the
distribution of productivity change by bank from
the Malmquist index varies from around 4% per
year to a negative 8% per year even when all bias
has been removed (coverage level 5). As the
coverage level is increased from 1 to 2, finally to
level 5, the distribution essentially shifts just down
in a parallel fashion so that about half of the banks
A. Lozano-Vivas, D.B. Humphrey / Int. J. Production Economics 76 (2002) 177–188
experienced negative productivity change while
half experienced a positive productivity increase
(balancing out at 0.8 overall). Fig. 3 shows the
same information for productivity change estimates from the stochastic frontier cost function.
While this distribution is somewhat flatter than
that for the Malmquist index, the same general
parallel downward shift is evident as more and
more of the bias is removed. Although not shown
in Table 4, average overall productivity change
when all the bias is removed is 1.0% per year.
4. Conclusion
Many Malmquist index studies overstate the
level of banking industry productivity. A similar
problem can exist with a stochastic frontier cost
function or a growth accounting approach. The
bias is not due to the technique used but rather in
how it is applied. The bias is easiest to see in
banking industry studies due the nature of the data
available and used to represent balance sheet
outputs and inputs. The problem is simple to
correct and can easily be measured, reduced, or
eliminated in future analyses. The problem has
been consistently overlooked and likely has
persisted because no one has shown how large
the bias has been.
Although other productivity measurement difficulties remain, the problem we identify is eliminated when all outputs and inputs are included in
the analysis. This differs from common practice in
the banking productivity literature where only a
subset of balance sheet inputs and outputs are
included. Importantly, productivity analysis differs
from banking cost, revenue or profit analyses in
that changes in excluded balance sheet inputs or
outputs have the same effect on productivity – not
a lesser or greater effect – as those inputs and
outputs chosen to be included in the analysis.
Unlike cost or profit analysis, all liability/asset
categories affect productivity measurement equally
(if their balance sheet values are equal) and so need
to be included to obtain a more accurate estimate
of productivity.
In the text, we explain in more detail how the
bias arises in banking studies and show that the
187
majority of measured productivity in many existing studies is due to this problem. We also apply
three methods of measuring productivity (Malmquist index, stochastic frontier cost function, and
growth accounting) to a balanced panel of Spanish
banks over 1986–1991. This application illustrates
how mean productivity change estimates are
reduced as more and more of the bias is
eliminated.
Sophisticated linear programming and/or
econometric techniques can not, of course, overcome specification problems. If researchers wish to
have their productivity results taken seriously by
policy makers, it is necessary to reduce those
biases that can be reduced and note those which
remain. While the bias we identify is ‘‘obvious’’ ex
post, it clearly has not been obvious enough ex
ante in many banking productivity studies to date.
Acknowledgements
We wish to thank Jesus T. Pastor, participants
of the Workshop in Efficiency and Productivity
(Denmark, November 1999) and two anonymous
referees for helpful comments on an earlier version
of this paper. A. Lozano-Vivas is grateful for the
financial support from the CICYT, PB98-1408
(Ministerio de Educacio! n y Ciencia, Spain).
Appendix A. Outputs, inputs, and asset/liability
ratio for panels A and B of Table 2
1. [1]: Outputs are short-term loans to nonbanks, long-term loans to non-banks, checking
accounts by the public, other deposits by the
public, number of branches, and other earning
assets. Inputs are number of personnel, operating
costs, and book value of machinery and equipment.
Asset/liability ratio: Assets=short-term loans to
non-banks+long-term loans to non-banks+other
earning assets+book value of machinery and
equipment. Liabilities=checking accounts by the
public+other deposits by the public.
2. [2]: Outputs are total deposits from other than
financial institutions and total loans to other than
188
A. Lozano-Vivas, D.B. Humphrey / Int. J. Production Economics 76 (2002) 177–188
financial institutions. Inputs are man-hours per
year, book values of machinery and equipment,
and non-labor-non-capital operating expenses.
Asset/liability ratio: Assets=total loans to other
than financial institutions+book value of machinery and equipment. Liabilities=total deposits
from other than financial institutions.
3. [3]: Outputs are real estate loans, commercial
and industrial loans, consumer loans, all other
loans, and total demand deposits. Inputs are fulltime equivalent employees, book value of premises
and fixed assets, and purchased funds.
Asset/liability ratio: Assets=real estate loans
+commercial and industrial loans+consumer
loans+all other loans+book value of premises
and fixed assets. Liabilities=demand deposits
+purchased funds.
4. [4]: Outputs are securities, real estate loans,
personal loans, and commercial loans. Inputs
are number of employees, value of premises and
fixed assets (including capitalized leases), and
deposits.
Asset/liability ratio: Assets=securities+real estate loans+personal loans+commercial loans+
value of premises and fixed assets. Liabilities=deposits.
5. [5]: Outputs are revenue from loans and
revenue from business investment activities. Inputs
are number of full-time employees, the value of
premises and real estate, and liabilities including
deposits.
Asset/liability ratio: Assets=revenue from
loans+revenue from business investment activities. Liabilities=liabilities including deposits.
6. [6]: Outputs are securities, real estate loans,
personal loans, and commercial loans. Inputs are
number of employees, the value of premises and
fixed assets (including capitalized leases), and
deposits.
Asset/liability ratio: Assets=securities+real estate loans+personal loans+commercial loans+
value of premises and fixed assets (including
capitalized leases). Liabilities=deposits.
7. [7]: Outputs are loans, checking deposits, and
savings deposits. Inputs are number of employees
and operating expenses.
Asset/liability ratio: Assets=loans. Liabilities=checking deposits+savings deposits.
8. [8]: Outputs are demand deposits, loans with
domestic currency, and loans by trust account.
Inputs are number of employees, value of physical
capital, and purchased funds.
Asset/liability ratio: Assets=loans with domestic currency+loans by trust account. Liabilities=
demand deposits+purchased funds.
References
[1] H. Kuussaari, Productivity efficiency in Finnish local
banking during 1985–1990, Bank of Finland, Discussion
Papers 14/93 Research Department, 1993.
[2] S. Berg, F.R. Frsund, L. Hjalmarsson, M. Suominen,
Banking efficiency in the Nordic countries, Journal of
Banking and Finance 17 (1993) 317–388.
[3] D. Wheelock, P. Wilson, Productivity changes in US
banking: 1984–1993, Federal Reserve Bank of St. Louis,
Research and Public Information Division, Working Paper
Series 94-021 A, 1994.
[4] M. Devaney, W. Weber, Rural bank efficiency and contestable markets, USDA Grant No. 9403254, 1995.
[5] H. Fukuyama, Measuring efficiency and productivity
growth in Japanese banking: A nonparametric frontier
approach, Applied Financial Economics 5 (1995) 95–107.
[6] M. Devaney, W.L. Weber, Productivity growth, market
structure, and technological change: Evidence from rural
banking sector, Working Paper USDA, 1996.
[7] E. Grifell-Tatj!e, C.A.K. Lovell, The sources of productivity
change in Spanish banking, European Journal of Operational Research 98 (1997) 364–380.
[8] R.A. Gilbert, P.W. Wilson, Effects of deregulation on the
productivity of Korean banks, Journal of Economics and
Business 50 (2) (1998) 133–156.
[9] D.B. Humphrey, Cost and technical change: effects from
bank deregulation, Journal of Productivity Analysis 4
(1993) 5–34.