Paper-5

advertisement
The Antecedents of Internal Auditors’ Adoption of Continuous Auditing
Technology: Exploring UTAUT in an Organizational Context
ABSTRACT
The concept of Continuous auditing originated over two decades ago. Yet despite its much touted benefits
its acceptance and use in practice has been slow. To gain insight into the state of affairs, we surveyed 234
internal auditors worldwide on the status of their continuous auditing. Using the Unified Theory of
Acceptance and Use of Technology (UTAUT) we explore the antecedents of internal auditors’ intentions
to adopt continuous auditing technology. Employing the Partial Least Squares method, we find strong
support for the model with an R2 of 44.3%. Specifically, we find that internal auditors’ perceptions of
effort expectancy and social influence are significant predictors of their intentions to adopt continuous
auditing. We also find that annual sales volume of the company and voluntariness of use significantly
moderate the relationship between performance expectancy and social influence respectively.
Additionally, we present key observations regarding the internal auditors’ perceptions of the current state
of continuous auditing.
Keywords: Continuous Auditing, Continuous Assurance, Internal Auditing, UTAUT, Technology
Adoption.
1. Introduction
Continuous auditing has been touted as offering many important benefits to organizations.
Among them are the minimization of accounting errors, more timely analysis and organizational
communication, and increased audit efficiency and effectiveness. Various research studies have explained
the benefits of continuous auditing (Vasarhelyi et al., 2004; Kuhn and Sutton, 2006), discussed technical
aspects of implementing continuous auditing technology (Kuhn and Sutton, 2010), explored actual
implementations in practice (Herman et al., 2006), and examined the psychological effects of continuous
auditing on managers (Hunton et al., 2008; Hunton et al. 2010)1. Yet while the concept of continuous
auditing, first introduced by Groomer and Murthy (1989) and Vasarhelyi and Halper (1991), is about two
decades old, the actual practice of continuous auditing has remained the exception rather than the rule
(Chan and Vasarhelyi, 2011). This puzzling lag in the adoption of continuous auditing is the primary
motivation for this study.
1
For a review of the literature see Brown et al., 2007.
1
Adoption of continuous auditing technology has so far been almost exclusively limited to the
internal audit function (Chan and Vasarhelyi, 2011). Since 2005 some of the top international accounting
firms have surveyed their clients’ Chief Audit Executives (CAEs) and other top internal audit officers to
gain an understanding of their continuous auditing practices (Grant Thornton, 2011; KPMG, 2010; PwC,
2006). The results of these surveys vary in terms of how extensively continuous auditing was being
adopted in practice. For example, one survey showed that of the surveying accounting firm’s clients, 13%
had a continuous auditing system that was fully operational and 37% had a system in place but not yet
fully developed, while another firm’s survey indicated comparable figures of 7% and 13%, respectively
(see Table 1). One thing that consistently came across in these surveys, however, was the uniform
apparent optimism of the survey respondents. Regardless of the level to which continuous auditing had
been adopted, the survey respondents expected a considerably higher level of adoption in two years’ time.
Yet, taking into account the timing of these earlier surveys and this study’s results, it appears that the
implementation of continuous auditing has actually advanced very slowly. This again, raises the question
of why there seems to be a lag in the adoption of continuous auditing.
----------------------------------------- (Insert Table 1 about here) -----------------------------------Based on this study’s survey results and the results of prior surveys conducted by those firms, we
characterize the current implementation of continuous auditing as more experimentation and pilot testing
than full-blown adoption. Given the potential benefits of continuous auditing, some of which were
previously mentioned, this is puzzling. We thus set out to gain insight into this state of affairs by
conducting an online survey of industry practitioners’ internal audit practices and analyzing their
responses through the lens of the Unified Theory of Acceptance and Use of Technology (UTAUT) from
the Information Systems discipline (Venkatesh et al., 2003). UTAUT provides a theoretical framework
upon which to assess the adoption of a particular type of technology. In this study, we find that the
UTAUT model explains a substantial amount of variance in the intentions to adopt continuous auditing.
Most importantly, we find that perceptions of effort expectancy and social influence are significant
predictors of internal auditors’ intentions to adopt, while performance expectancy and facilitating
conditions are not. Annual sales volume of the company and voluntariness of use significantly moderate
the relationship between performance expectancy and social influence respectively.
Our paper is organized as follows. In the next section we briefly present an introduction to the
UTAUT framework. Subsequent sections present our research model and hypotheses, discuss our data
collection method, and outline the data analysis procedure and the results of model testing. Finally we
conclude with a discussion of our findings and the implications for practice.
2
2. Theoretical Framework
Many MIS researchers have studied acceptance of new technologies over the past two decades.
The Theory of Reasoned Action (TRA) (Fishbein et al., 1975) and the Theory of Planned Behavior (TPB)
(Ajzen, 1985; Ajzen, 1987; Ajzen, 1991) have greatly informed work in determining behavioral
intentions. TRA states that antecedents of behavioral intentions are attitudes and subjective norms. TPB
added perceived behavioral control to the two antecedents of TRA and also added a direct relationship
between perceived behavioral control and actual behavior.
Davis (1989) adapted TRA and TPB to the MIS literature to create the widely-cited Technology
Acceptance Model (TAM) (Davis, 1989), which had dramatic influence on the MIS field. As of this
writing, Google Scholar reports over 9,000 citations to that single paper. TAM, which focuses on
technology acceptance, provides usefulness and ease of use as antecedents to behavioral intentions. Other
versions of TAM made slight changes to the constructs over the years.
After over a decade of research on TAM, Davis and colleagues proposed the Unified Theory of
Acceptance and Use of Technology (UTAUT) (Venkatesh et al., 2003), which has taken the place of the
various TAM models (see Figure 1). UTAUT has been used in many contexts to predict behavioral
intentions. The basic notion is that three antecedents will predict behavioral intentions: performance
expectancy (formerly perceived usefulness), effort expectancy (formerly perceived ease-of-use), and
social influence (not in the original TAM model). A direct antecedent of actual behavior is facilitating
conditions. Finally, control variables moderate the relationships of the three antecedents of intentions:
gender, age, experience, and voluntariness of use.
----------------------------------------- (Insert Figure 1 about here) -----------------------------------One of the most interesting aspects of these models is the construct “behavioral intentions,”
which has been used as a surrogate for actual behavior in hundreds of experiments, surveys, and field
studies alike in the MIS literature. Behavioral intentions have been used as surrogates for success at many
levels of granularity and have been assessed at the individual, group, and organizational levels of analysis.
A user’s behavioral intentions (to use software or information services) can serve as an excellent
summary variable that indicates content and/or design success.
3
TAM and UTAUT have been shown to enrich our understanding of computer-related adoption
behaviors in many contexts. UTAUT is therefore adopted in this study as a way in which to understand
adoption of continuous auditing tools. If there is a shortfall in adoption of such tools, it is important to
determine to what extent the various antecedents play a role. If the problem is effort expectancy, for
instance, training programs might be useful to reduce the usability barriers. If, on the other hand, the
problem is performance expectancy, demonstrations and performance statistics could be useful.
While the TAM and UTAUT models were proposed originally at the individual level of
acceptance, it is reasonable to assume that the organizational adoption of continuous auditing
technologies depend on most of the same constructs. Executives would need to be cognizant of
performance expectancy as well as effort expectancy in deciding to adopt the technology. Facilitating
infrastructure needs to be in place as well. Further, internal auditors even have social pressures from both
within and outside of their firms. Internal pressure points would include those peers and supervisors, as
UTAUT specifies. External pressures are likely to make this variable even more important in the case of
continuous auditing; the widespread adoption of these technologies by other firms can be naturally
considered to be a benchmark that they should follow so they do not fall behind. Not adopting what others
have adopted could even create exposure for a firm, such as the failure to detect fraud as a result of not
implementing advanced technologies such as continuous auditing.
There are promising organizational level variants of the control variables as well. As firms do not
have a gender, and age was intended as a personal variable, it is important to provide a control variable
that promises to capture essential control issues. We chose to insert annual sales as one control variable
that would serve to indicate ability to acquire the technology. We also use a voluntariness construct that is
identical to the one in UTAUT, because it will account directly for situations in which the use of such
technologies is dictated by another party.
3. Research Model and Hypotheses
As UTAUT specifies, and taking into account the aforementioned slight modifications to the
control variables as well, six constructs are expected to play a significant role in internal auditors’
willingness to adopt continuous auditing technology in an organizational context: effort expectancy,
performance expectancy, facilitating conditions, social influence, voluntariness of use and annual sales of
the company. In the remainder of this section, we define each of the determinants, specify the role of key
moderators (voluntariness and annual sales), and provide the theoretical justification for the hypotheses.
Figure 2 presents the research model.
4
Effort Expectancy
Effort expectancy is defined as the degree of ease associated with the use of the system
(Venkatesh et al, 2003). With the advent of continuous auditing systems internal auditors can expect a
change in the nature of their work responsibilities from a traditionally reactive approach to a proactive
approach. Audit procedures used for transaction and compliance verification are automated in the
continuous auditing environment. The automation of transaction and compliance audit procedures shifts
the auditor's work to more complex audit objectives, such as dealing with estimate and judgment
verifications that require auditor judgment. Hence, the auditor's main role in the present continuous
auditing environment involves investigating irregularities/exceptions identified by the continuous auditing
system and dealing with audit procedures requiring judgment (Chan and Vasarhelyi, 2011). The more
seamlessly and effortlessly the auditors are able to transition into using the continuous auditing systems in
this new role, the higher will be their intentions to adopt them. Additionally, continuous auditing systems
employ (or will employ) enabling technologies including statistical methodologies such as belief
functions and neural networks, as well as technologies from computer science such as database and expert
systems, intelligent agents, and especially technologies for tagging data to facilitate transmission and
comparison, most notably XBRL and XBRLGL (Vasarhelyi et al., 2004). The internal auditors will not
only have to overcome the learning curve to become skillful at using continuous auditing systems, but
also find them easy and efficient to use. This is especially relevant since auditors will be frequently
interacting with the continuous auditing system. Given the complexities involved, the adoption of
continuous auditing systems will therefore be facilitated by the positive perceptions among internal
auditors with regard to effort expectancy. Therefore we hypothesize:
H1: Positive perceptions of effort expectancy will positively influence internal auditors’
intentions to adopt continuous auditing technology.
Performance Expectancy
Performance expectancy is defined as the degree to which an individual believes that using a
system will help achieve gains in job performance (Venkatesh et al., 2003). Continuous auditing is likely
to have many benefits such as continuous error and fraud detection, and the use of data analytics and data
modeling features (Vasarhelyi et al., 2004). Given these benefits, adoption of continuous auditing will be
facilitated by internal auditors’ perceptions of usefulness of the system in their work and the productivity
gains they can expect from it. Therefore, we argue that the extent to which internal auditors perceive
continuous auditing as being better than using its precursor, they are likely to have positive intentions to
adopt continuous auditing technology.
5
H2: Positive perceptions of performance expectancy will positively influence internal
auditors’ intentions to adopt continuous auditing technology.
Facilitating Conditions
Facilitating conditions are defined as the degree to which an individual believes that an
organizational and technical infrastructure exists to support use of the system. These conditions include
aspects of the technological and/or organizational environment that are designed to remove barriers to the
use of system (Venkatesh et al., 2003). This relates to technical, monetary and training support and the
resources available to the internal auditors in facilitating their adoption of the continuous auditing system.
As mentioned earlier, the use of continuous auditing systems is likely to involve learning of enabling
technologies and internal auditors who either possess the background knowledge or have access to the
resources required to learn will have more positive perceptions of facilitating conditions. The continuous
auditing systems also have to be compatible to systems auditors are already using. In our next hypothesis
we propose:
H3: Positive perceptions of facilitating conditions will positively influence internal auditors’
intentions to adopt continuous auditing technology.
Social Influence
Social influence is defined as the degree to which an individual perceives that important others
believe he or she should use the new system. Social influence as a direct determinant of behavioral
intention is represented as subjective norm, i.e., the explicit or implicit notion that the individual’s
behavior is influenced by the way in which they believe others will view them as a result of having used
the technology (Venkatesh et al., 2003). Internal auditors’ perception of social influence originates from
their superiors in the higher management and their peers. It is up to the internal auditors’ superiors to,
among other things, commit to the adoption of continuous auditing technology, obtain agreement from all
affected influential parties, and secure the organizational approval of funds needed to implement the
technology. We postulate in this hypothesis that:
H4: Positive perceptions of social influence will positively influence internal auditors’
intentions to adopt continuous auditing technology.
Moderating Variables
UTAUT calls for several moderators that are dependent on the particular adopter of the
technology. Because this is not personal technology, we replaced Gender and Age with Annual Sales.
6
Annual sales is likely to be a much better control variable, given that the gender and age of the potential
adopter or team should have no importance at all. Annual sales of the organization is considered to be a
more appropriate control factor. For instance, if effort expectancy (usability) or performance expectancy
(usefulness) is considered to be a potential problem, organizations with more resources would be better
able to afford training or customization to handle this problem.
The UTAUT model includes those moderators between the antecedents and behavioral intention
only for certain paths. UTAUT predicts that for performance expectancy, effort expectancy, social
influence, and facilitating conditions, gender only moderates the first three, age moderates all, and
experience moderates only the last three on behavioral intentions. Because we replaced gender, age, and
experience with annual sales, we hypothesize that annual sales will moderate all of those relationships.
H5a: Annual sales will moderate the relationship between effort expectancy and adoption.
H5b: Annual sales will moderate the relationship between performance expectancy and adoption.
H5c: Annual sales will moderate the relationship between facilitating conditions and adoption.
H5d: Annual sales will moderate the relationship between social influence and adoption.
The other moderating variable in UTAUT and our model is voluntariness of use. According to
Figure 1, voluntariness of use only moderates the relationship between social influence and behavioral
intention. We maintain that aspect of UTAUT in our research model. Therefore:
H6: Voluntariness of use will moderate the relationship between social influence and adoption.
----------------------------------------- (Insert Figure 2 about here) ------------------------------------
4. Data and Sample
We conducted an online survey by e-mailing respondents a link to our electronic survey site2. The
survey was e-mailed on our behalf for this study by the Institute of Management Accountants (IMA) to
their worldwide members whose membership profile listed one of the following responsibilities: internal
auditing, risk management, information systems or general accounting3. The survey e-mail explained the
nature of the survey and asked respondents to complete the survey provided they were knowledgeable on
2
The Qualtrics tool was used for this survey.
The IMA has substantially more members who profile themselves as “accountants” than they do “internal auditors,” “risk management,” or
“information systems.” Hence, while our survey captured practitioners in the latter three groups, we also captured practitioners in the
“accountants” group who either had direct knowledge of their company’s internal audit operations or passed on the email to someone else in
the company who did.
3
7
their company’s continuous auditing efforts and, if not, to forward the e-mail to someone within their
company’s internal audit function.
The number of surveys e-mailed was 9,013 and the number of usable responses was 234 (a
response rate of 2.60%). Of those 234 usable responses, the percentage breakdown by regional
geographic location of company operations was: North America 61%; Middle East 27%; Asia 6%;
Europe 4%; others 2%. These percentages are comparable to the IMA’s worldwide membership
breakdown of North America 72%; Middle East 16%; Asia 8%; Europe 3%; others 1%.4
The first question in the survey posed to respondents was “What is the current state of Continuous
Auditing in your company?” The four possible responses and the percentage of respondents selecting
each response were:

Fully operational in one or more of our company's systems – 19%

In place but not yet fully developed – 23%

Not implemented yet but scheduled to be implemented in future – 16%

Not implemented and no plans for future implementation – 42%
The percentages above can be compared to the three previously cited international accounting
firm surveys that were described previously and shown in Table 1. Such a comparison reveals that from
the PwC (2007) survey to the present survey in this study, the percentage of companies that have either
fully operational continuous auditing systems or systems in place but not yet fully developed (the first
two bulleted categories above) has not increased much, if at all.
After the introductory question, respondents were asked to answer a set of approximately 40
questions. The questions were of three main types: (1) company profile questions such as annual sales
and geographic location of operations, (2) questions regarding current use of and future plans for
continuous auditing, and (3) questions structured on the UTAUT technology adoption framework
described in the last section. The actual survey questions for this latter group are shown in Table 2.
Survey responses to these questions enabled us to analyze the current state of adoption of continuous
auditing technology using the UTAUT framework. We next describe the method and analysis.
----------------------------------------- (Insert Table 2 about here) ------------------------------------
4
IMA membership profile information as of April 30, 2011.
8
5. Research Method
To estimate the paths between the constructs shown in our research model (Fig. 2), and thereby
test the propositions advanced previously, we used partial least squares (PLS) which is a powerful
multivariate analysis technique. PLS is useful for analyzing structural equations with latent variables. It is
similar to LISREL, which is probably the best known of the second generation statistical techniques, in
the sense that the measurement and structural (or theoretical) models are analyzed simultaneously.
However, unlike LISREL, PLS relies on ordinary least squares estimation techniques to solve the
equations (Compeau and Higgins, 1995). PLS is most appropriate when sample sizes are small, when
assumptions of multivariate normality and interval scaled data cannot be made, and when the researcher is
primarily concerned with prediction of the dependent variable (Birkinshaw et al., 1995). The major
benefits of PLS include robustness for small to medium sample sizes and fewer constraints on the data
(e.g., normality assumptions) compared to covariance-based methods such as LISREL (Wakefield, et al.
2008). Simulation studies have also shown PLS to be robust against inadequacies such as multicollinearity, skewness and omission of regressors (Cassel et al., 1999).
In PLS all relationships are modeled simultaneously, sharply reducing concerns about
multicollinearity (Inkpen and Birkenshaw, 1994). The path coefficients obtained from a PLS analysis are
standardized regression coefficients, while the loadings of items on individual constructs are factor
loadings. Factor scores created using these loadings are equivalent to weighted composite indices. Thus,
PLS results can be easily interpreted by considering them in the context of regression and factor analysis
(Birkinshaw et al., 1995). The R2 values are used to assess the proportion of variance in the endogenous
constructs which can be accounted for by the antecedent constructs (Compeau and Higgins, 1995).
Generally, PLS results are presented in two stages. In the first stage, the researcher ensures that the
measures used as operationalizations of the underlying constructs are both reliable and valid. Once
convinced of the adequacy of the measurement model, the researcher proceeds to the second stage and
interprets the resulting model coefficients (Birkinshaw et al., 1995).
6. Data Analysis and Results
6.1 Measurement model
As evident in Table 3, all average variance extracted (AVE) values are above .50 and composite
reliability coefficients are above .70. This indicates that the measurements are reliable and the latent
constructs account for more than 50 percent variance in the items. The loadings are also in the acceptable
range and all the t-values suggest that they are significant at the .01 level.
9
----------------------------------------- (Insert Table 3 about here) ------------------------------------
Table 4 suggests that our measurement model demonstrates sufficient discriminant validity. If the
square root of the AVE is greater than all of the inter-construct correlations, it is evidence of sufficient
discriminant validity (Chin, 1998). This is the case with all the AVE values shown in Table 4.
----------------------------------------- (Insert Table 4 about here) ------------------------------------
To further assess validity of our measurements, a cross loading table (Table 5) was also
constructed as suggested by Gefen et al. (2000). If each item loading in the table is higher on its assigned
construct than on other constructs, it is evidence of adequate convergent and discriminant validity. As can
be seen in Table 5, all the diagonal elements are high and also greater than off diagonal elements
suggesting adequate convergent and discriminant validity of our measures. We noted that SI3 and SI4
seem to cross-load on facilitating conditions, and all facilitating conditions items seem to cross-load on
SI. This issue will be discussed and handled in a supplementary analysis that includes a revised set of
constructs for the UTAUT model.
----------------------------------------- (Insert Table 5 about here) ------------------------------------
6.2 Common method bias
Common method biases may occur if the predictor and the criterion variables share a common
method. In such a scenario, the common method may exert a systematic effect on the observed
correlations between measures. Thus, at least partially, common method biases may pose a rival
explanation for the observed correlations between the measures. Similarly, a common rater bias may
occur due to any artifactual covariance between predictor and the criterion variable produced by the fact
that the respondent providing the measure of these variables is the same (Podsakoff et al., 2003). In order
to rule out any rival explanations due to common method bias, we follow Liang et al. (2007) and include
in the PLS model a common factor whose indicators include all the principal constructs’ indicators and
calculate each indicators’ variances substantively explained by the principal construct and by the method.
The evidence for common method bias can be obtained by examining the statistical significance
of the factor loadings on the method factor and comparing the variances of each observed indicator
explained by its substantive construct and the method factor (Williams et al., 2003). The squared values
10
of substantive and method factor loadings are interpreted as variances explained by the substantive and
method constructs, respectively. If the method factor loadings are insignificant and substantive variances
are substantially greater than the method variances, then we may conclude that common method bias is
unlikely to be of any concern (Liang et al., 2007). As seen in Table 6, the average substantive variance is
.768 while the average method variance is .009. The ratio of substantive variance to method variance is
thus about 85:1. In addition, most method factor loadings are not significant. Therefore we argue that
common method bias is unlikely to be of concern for this study.
----------------------------------------- (Insert Table 6 about here) ------------------------------------
6.3 Hypothesis testing
Figure 3 presents the estimates obtained from the PLS analysis. Solid lines in the figure represent
significant paths while insignificant paths are represented by dashed lines. The R2 value of .443 indicates
that a significant amount of variance (44.3%) is explained by the model. The effect of effort expectancy
on adoption was significant at the .05 level (b = .152), providing support for H1. Our analysis did not find
support for H2 or H3 which represent the effects of performance expectancy and facilitating conditions
on adoption, respectively. While these latent variables are significant predictors of adoption when
UTAUT is applied in an individual context (Venkatesh et al., 2003), in our organizational model they
were not significant predictors. Social influence was found to have a significant impact on adoption
intentions of internal auditors (b = .331, p < .01) providing support for H4.
As for H5(a)–(d), Figure 3 shows that the links for H5(a), (b) and (d) are insignificant thereby
failing to confirm the moderating role of annual sales on effort expectancy, facilitating conditions and
social influence, respectively. However, the link for H5(c), performance expectancy, was significant at
the .01 level (b = -.141). Finally, the link for H6 was significant at the .01 level (b = -.253) thereby
lending support to the role of voluntariness as a moderator for the relationship between social influence
and adoption.
----------------------------------------- (Insert Figure 3 about here) ------------------------------------
11
6.4 Additional observations
In addition to the main results described in the last subsection, we noted several other key
observations from the survey responses that are worth pointing out. One concerns respondents’ perceived
benefits of continuous auditing and a second, related one is the perceived focus of the continuous auditing
system for respondents’ organizations. Overall, respondents view accuracy as the most important benefit,
followed in order of importance by timely communication, audit efficiency, timely analysis, and cost
savings. The responses to those questions differ to a small extent based on whether the program is fully or
only partially in place (Table 7).
----------------------------------------- (Insert Table 7 about here) ------------------------------------
In terms of the focus of the continuous auditing system, survey respondents overall rated the
monitoring of fraudulent activities as the most important focus of their continuous auditing system,
followed in order of importance by risk monitoring, testing of controls, detail testing of transactions, and
performance evaluation. The responses are very similar whether or not the systems are in place or are
expected in the future (Table 8). These two sets of responses imply that respondents believe that a
continuous auditing system’s ability to provide audit coverage for 100% of transactions will increase the
accuracy of accounting information while contributing to reduced risk with an emphasis on fraud risk.
----------------------------------------- (Insert Table 8 about here) ------------------------------------
Several survey questions concern the ownership and performance of the continuous auditing
function. Table 9 shows that the internal audit department has responsibility for continuous auditing in
about three-quarters of respondents’ companies; small minorities of companies assign the responsibility
to an IT group or an accounting/finance group. A comparison of companies with fully implemented
continuous auditing systems to companies in which a continuous auditing system is in place but not yet
fully implemented reveals that the IT group is primarily responsible a greater percentage of the time in the
latter (8.2% v. 13.2%). This seems to indicate that in early implementation stages IT groups are given
initial responsibility for the continuous auditing system, and once the system is fully implemented,
responsibility is transferred to internal auditing.
----------------------------------------- (Insert Table 9 about here) ------------------------------------
12
The performance of continuous auditing, however, as depicted in Table 10, does not fully mirror
responsibility or ownership. While in the majority of cases internal auditing is assigned the performance
(57.7% overall), this proportion is less than the three-quarters of internal auditing departments that are
assigned the responsibility for continuous auditing as per the preceding paragraph. In a minority but still
significant number of cases, IT management and risk management perform continuous auditing (18.9%
overall and 16.3% overall, respectively). This suggests that continuous auditing technology is sufficiently
sophisticated and complex that in some companies IT management is designated as the party to perform
continuous auditing, while in other companies continuous auditing is seen is a vital risk management tool
and
accordingly
risk
management
is
assigned
its
performance.
Additionally,
as
with
responsibility/ownership, we see a higher percentage assigned to IT in companies in which the continuous
auditing system is in place but not yet fully implemented compared to companies in which the continuing
system is fully operational (16.3% versus 25.5%).
----------------------------------------- (Insert Table 10 about here) -----------------------------------The term “continuous auditing” tends to conjure up images of perpetual, never-ending auditing,
in both concept and practice. However, this is frequently not the case. As stated in Chan and Vasarhelyi
(2011):
“Auditing continuously or in real time may seem ideal. However, the real
time audit can impact the operation of the accounting information system and may
not always be cost-effective. As a result, real time continuous auditing will tend to
occur in high risk business processes. For example, in industrial firms it may be
prudent to continuously audit the higher risk treasury disbursement process in real
time. On the other hand, it may be sufficient to audit the lower risk prepayment
expense process in periodic or frequent cycles.” (Chan and Vasarhelyi, 2011)
Our survey results bear this out: overall only 13.2% of respondents’ companies perform continuous
auditing real-time; the majority perform continuous auditing monthly or quarterly (Table 11). The
percentages of continuous auditing systems that fall into each category of time frame shown in Table 11
are quite similar to findings in PwC (2006).
----------------------------------------- (Insert Table 11 about here) ------------------------------------
13
We found that companies with fully-developed and in place (partially developed but not fully in
place) continuous auditing systems developed their technology within their own company or insourced it
in 69.8% (52.4%) of cases, outsourced the development of their technology 19.0% (27.0%) of the time,
and purchased their technology from an outside vendor about 11.2% (20.6%) of the time (Table 12).
Hence, most companies choose in-house development of their continuous auditing systems, but
significant proportions of companies outsource or purchase from an outside vendor. There does not seem
to be a “one size for all formula” for acquiring continuous auditing technology. This suggests that a
number of factors determine how a particular company approaches their acquisition of continuous
auditing technology.
----------------------------------------- (Insert Table 12 about here) ------------------------------------
Finally, our questions about future plans for continuous auditing elicited interesting responses.
Table 13 illustrates the plans of those respondents without continuous auditing to move to
implementation. The middle two time-frames given were most popular: 64% of the subjects chose the
next 12 to 24 months. The remainder was evenly split between the next 6 months and after 24 months.
Respondents also asked whether the economic climate had an effect on implementation plans. Only 9%
answered “yes” and 4% answered “somewhat.” The bulk of respondents (87% of those who have not
implemented continuous auditing) replied “not at all” (Table 14). Table 15 provides a breakdown of
reasons for failure to implement continuous auditing. By far the most popular answer was “we have not
looked into continuous auditing yet” (76%).
-------------------------------- (Insert Table 13, 14 and 15 about here) ----------------------------
7. Exploring a Revised Model
Reflecting on the strong effort expectancy and social influence paths and the two troublesome
items in the social influence construct, we revised the instruments. Even though the discriminant and
convergent validation procedures as suggested by Gefen et al. (2000) appeared successful, we recognized
some overlap between the facilitating conditions construct and items SI3 and SI4. Specifically, the two
items (“senior management has been helpful…” and “my organization has supported…”) appear to be
highly related to facilitating conditions items as shown in Table 2.
14
In addition, we explored expanding the use of the “voluntary” construct to act as a moderator for
all four main effects in the UTAUT model as well. It was not difficult to construct theoretical arguments
for each moderating effect. If a system is mandated, then all of the main effects are obviously
unimportant. Even if the firm would consider the system to be hard to use, not very useful, or not
supported, the system would still be adopted. Therefore, we see a strong argument to promoting
“voluntary” as a mediator of all of the main effects. We performed exploratory analysis of a revised
model by moving the two items to the facilitating conditions construct and making the “voluntary”
construct a moderator of all of the main effects.
As we expected, the item loadings of SI3 and SI4 were much higher as part of facilitating
conditions. Table 16 provides a revised measurement model, Table 17 a revised correlation table, and
Table 18 a revised list of item loadings. Our conclusion is that the measures appear to exhibit stronger
discriminant and convergent validity using the revised item structure.
---------------------------------- (Insert Table 16, 17 and 18 here) ---------------------------
The revised analysis resulted in a model that was much easier to explain (Figure 4). Effort
expectancy and facilitating conditions were significant determinants of adoption. At first, it seemed
surprising that performance expectancy was not a main effect. But the negatively-valenced moderator of
annual sales helped clarify what seemed anomalous. In a firm with more modest sales, performance
expectancy is quite important. However, in large firms that can afford continuous auditing, it does not
matter if the software seems less useful. Deeper pockets seem to provide a less cautious approach.
More importantly, the social influence main effect disappears. Instead, “voluntary” moderates the
relationship between social influence and adoption. If a system is mandatory, social influence does not
have a significant path, but when it is voluntary, auditors look to their colleagues for guidance.
----------------------------------------- (Insert Figure 4 about here) ------------------------------------
8. Discussion and Conclusions
In spite of the fact that the concept of continuous auditing was first introduced over two decades
ago, and that the concept has garnered a considerable amount of attention in both the academic and
professional literature, to date continuous auditing has been adopted to a limited extent, and almost
exclusively in the internal audit domain. While past surveys of CAEs and other internal audit executives
15
have indicated that plans for the implementation of continuous auditing were robust (Grant Thornton,
2011; KPMG, 2010; PwC, 2006), the results of this study’s survey indicate that progress has been made,
but there is still continued lag in the implementation of continuous auditing systems.
This study explores this lag in the adoption of continuous auditing, and seeks answers to why this
is the case. We surveyed internal auditors worldwide about the current state of adoption of continuous
auditing technology in their companies. Through application of the Unified Theory of Acceptance and
Use of Technology (UTAUT) framework, and after making some important but minor alterations to the
constructs and model, we analyzed respondents’ answers to find that the significant factors leading to
adoption of continuous auditing technology are Effort Expectancy, i.e., the ease and clarity of use, and
Facilitating Conditions, i.e., organizational support through resources, knowledge, and assistance.
In addition, the level of annual sales volume seems to moderate another important construct,
performance expectancy. Large firms tend to adopt without questioning performance expectancy but
adoption in firms with lower sales volume tend to require that the software will be useful. Another
moderator, the extent to which the system is perceived to be voluntary or mandatory, also moderates the
effect of social influence on adoption, as UTAUT predicts.
Given that respondents view accuracy as the most important benefit of continuous auditing, the
UTAUT results regarding Effort Expectancy seem quite positive. If internal auditors place top priority on
accuracy and, at the same time, believe that continuous auditing technology is uncomplicated to use, one
can logically conclude that they would be quite supportive of plans for its implementation and further use.
This bodes well for future adoption and expanded utilization of continuous auditing technology. It
therefore becomes a matter of companies’ commitment to the use of the technology: an organization that
decides to implement continuous auditing, or expand its use, will likely be able to count on little
resistance and, more likely, strong support from its internal auditors. Indeed, the result regarding Social
Influence bears this out – it almost seems as if internal auditors are ready and waiting for their company’s
top management to commit to continuous auditing.
16
References
Ajzen, I. From intentions to actions: A theory of planned behavior. In: Behavior, J. Kuhl & J. Beckman,
Eds. Action-control: From cognition to behavior. Springer, Heidelberg, Germany. 1985: 11-39.
Ajzen, I. Attitudes, traits, and actions: Dispositional prediction of behavior in personality and social
psychology. In: Berkowitz, L., Ed. Advances in experimental social psychology. Academic Press, New
York, 1987: Vol. 20, 1–63
Ajzen, I. The theory of planned behavior. Organizational Behavior and Human Decision Processes 1991:
50 (2), 179-211.
Alles, M., G. Brennan, A. Kogan, and M. A. Vasarhelyi. Continuous Monitoring of Business Process
Controls: A Pilot Implementation of a Continuous Auditing System at Siemens. International Journal of
Accounting Information Systems 2006; 7(2): 137-61.
_________, G., A. Kogan and M.A. Vasarhelyi. Putting continuous auditing theory into practice: Lessons
from two pilot implementations. Journal of Information Systems 2008; 22(2): 195-214.
Birkinshaw, J., Morrison, A. and Hulland H. Structural and Competitive Determinants of a Global
Integration Strategy. Strategic Management Journal 1995; 16 (8), 637 - 655.
Brown, C., J. Wong, A. Baldwin. A Review and Analysis of the Existing Research Streams in Continuous
Auditing. Journal of Emerging Technologies in Accounting 2007; 4: 1-28.
Cassel, C., Hackl, P., & Westlund, A. H. Robustness of partial least-squares method for estimating latent
variable quality structures. Journal of Applied Statistics 1999; 26, 435–446.
Chan, D. and M. Vasarhelyi. Innovation and practice of continuous auditing. International Journal of
Accounting Information Systems 2011; 12: 152-60.
Chin, W. W. “The Partial Least Squares Approach to Structural Equation Modeling,” in Modern Methods
for Business Research, G. A. Marcoulides (ed.), Lawrence Erlbaum Associates, Hillsdale, NJ, 1998, 295336.
Compeau, D. R., and Higgins, C. A. “Application of social cognitive theory to training for computer
skills,” Information Systems Research 1995; 6(2): 118-143.
Davis, F.D. Perceived usefulness, perceived ease of use, and user acceptance of information technology.
MIS Quarterly: Management Information Systems 1989: 13 (3), 319-339.
Debreceny, R. S., G. L. Gray, J. Jun-Jin Ng, K. Siow-Ping Lee, and W. Yau. Embedded Audit Modules in
Enterprise Resource Planning Systems: Implementation and Functionality. Journal of Information
Systems 2005; 19 (2): 7-27.
Fishbein, M. and I. Ajzen. Belief, attitude, intention, and behavior. Addison-Wesley, Reading, MA. 1975.
Flowerday, S. and R. von Solms. Continuous auditing: verifying information integrity and providing
assurances for financial reports. Computer Fraud & Security 2005; July 2005: 12-16.
17
_________, A. Blundell and R. von Solms. Continuous auditing technologies and models: A discussion.
Computers & Security 2006; 25: 325-331.
Gefen, D., Straub, D., and Boudreau, M.-C. “Structural Equation Modeling and Regression: Guidelines
for Research Practice,” Communications of the AIS 2000; (4:7).
Grant Thornton. Looking to the future: perspectives and trends from internal audit leaders. Grant
Thornton LLP 2011.
Groomer, S. and U. Murthy. Continuous auditing of database applications: an embedded audit module
approach. Journal of Information Systems 1989; 3(2): 53-69:
Hermanson, D., B. Moran, C. Rossie and D. Wolfe. Continuous Monitoring of Transactions to Reduce
Fraud, Misuse, and Errors. Journal of Forensic Accounting 2006; VII: 17-30.
Hunton, J. , A. Wright and S. Wright. Continuous Reporting and Continuous Assurance: Opportunities
for Behavioral Accounting Research. Journal of Emerging Technologies in Accounting 2004; 1: 91-102.
_________, E. Mauldin and P. Wheeler. Potential Functional and Dysfunctional Effects of Continuous
Monitoring. The Accounting Review 2008; 83(6): 1551-1569.
_________, __________ and _________. Continuous monitoring and the status quo effect. International
Journal of Accounting Information Systems 2010; 11(3): 239-252.
Inkpen, A. and Birkinshaw, J.. “International Joint Ventures and Performance: an Interorganizational
Perspective,” International Business Review, 1994; 3(3), 201-217.
Jans, M., M. Alles and M. Vasarhelyi. Process Mining of Event Logs in Auditing: Opportunities and
Challenges. 2010; Working Paper.
Kogan, A., E. F. Sudit, and M. A. Vasarhelyi. Continuous online auditing: A Program of research. Journal
of Information Systems. 1999; 13 (2): 87-103.
KPMG. Continuous auditing and monitoring: Are promised benefits now being realised? 2010; KPMG
LLP.
KPMG International (KPMG). What is Driving Continuous Auditing & Continuous Monitoring Today?
2010; KPMG International Cooperative.
Kuhn, J. and S. Sutton. Learning from WorldCom: Implications for Fraud Detection through Continuous
Assurance. Journal of Emerging Technologies in Accounting 2006; 3: 61-80.
_________ and _________. Continuous Auditing in ERP System Environments: The Current State and
Future Directions. Journal of Information Systems 2010; 24(1): 91-112.
Liang, H., Saraf, N., Hu, Q., and Xue, Y. Assimilation of Enterprise Systems: The Effect of Institutional
Pressures and the Mediating Role of Top Management. MIS Quarterly 2007; 31(1), 59-87.
Podsakoff, P., MacKenzie, S., Lee, J., and Podsakoff, N. Common Method Biases in Behavioral
Research: A Critical Review of the Literature and Recommended Remedies. Journal of Applied
Psychology 2003; 88:5: 879-903.
18
PricewaterhouseCoopers (PwC). State of the internal audit profession study: Continuous auditing gains
momentum. 2006; Available at: http://www.pwc.com/en_BE/be/systems-process-assurance/pwc-state-ofinternal-audit-2006.pdf.
_________________________ . State of the internal audit profession study: Pressures build for continual
focus
on
risk.
2007;
Available
at:
http://www.pwc.com/en_US/us/internalaudit/assets/state_internal_audit_profession_study_07.pdf.
Rezaee, Z., A. Sharbatoghlie, R. Elam and P. McMickle. Continuous Auditing: Building Automated
Auditing Capability. Auditing: A Journal of Practice & Theory 2002; 21(1): 147-163.
Searcy, D., J. Woodroof, and B. Behn. Continuous Audit: The Motivations, Benefits, Problems, and
Challenges Identified by Partners of a Big 4 Accounting Firm. 2003; 36th Annual Hawaii International
Conference on System Sciences, 7: 210
Vasarhelyi, M., M. Alles, and A. Kogan. Principles of analytic monitoring for continuous assurance.
Journal of Emerging Technologies in Accounting 2004; 1 (1): 1-2l.
_________ and F. Halper. The continuous audit of online systems. Auditing: A Journal of Practice &
Theory 1991; 10 (1): 110-128.
_________, A. Kogan and M. Alles. Would Continuous Auditing Have Prevented the Enron Mess? The
CPA Journal July 2002: 80.
Venkatesh, V., Morris, M. G., Davis, G. B. and Davis, F. D. User acceptance of information technology:
Toward a Unified View. MIS Quarterly 2003; 27 (3), 425-478.
Wakefield, R.L., D.E. Leidner, and G. Garrison, A model of conflict, leadership, and performance in
virtual teams. Information Systems Research 2008; 19:4, 434–455.
Williams, L. J., Edwards, J. R., and Vandenberg, R. J. Recent Advances in Causal Modeling Methods for
Organizational and Management Research. Journal of Management 2003; 29:6, 903-936.
19
Table 1 - Summary of Recent Surveys’ Findings of Continuous Auditing Technology Adoption
PwC 20071
13%
37%
31%
19%
100%
KPMG 2010
7%
13%
3%
77%
100%
Fully Operational in one or more of our company's systems.
In place but not yet fully developed.
Not implemented yet but scheduled to be implemented in future.
Not implemented and no plans for future implementation.
Total
1
PwC 2007 = PricewaterhouseCoopers 2007
2
GT 2011 = Grant Thornton 2011
3
published survey does not distinguish between “fully operational” and “not fully developed”.
4
published survey does not distinguish between “no plans at all” and “plans but not yet implemented”.
GT 20112
-3
33%3
-4
67%4
0%
20
Table 2 – Constructs and Corresponding Survey Questions based on UTAUT framework
Construct
Indicator
EE1
EE2
EE3
EE4
PE1
PE2
PE3
PE4
Survey Question*
Interacting with the Continuous Auditing system is generally clear and understandable
It is generally easy to become skillful at using the Continuous Auditing system
Effort
Expectancy
I (we) find the Continuous Auditing system easy to use
Learning to operate the Continuous Auditing system is easy for me (us)
A Continuous Auditing system is useful in my (our) job
A Continuous Auditing system enables me (us) to accomplish tasks more quickly
Performance
A Continuous Auditing system increases my (our) productivity
Expectancy
A Continuous Auditing system increases my (our) chances of improving my (our)
financial position
FC1
My (our) company has the resources necessary to use the Continuous Auditing system
FC2
My (our) company has the knowledge necessary to use the Continuous Auditing
system
Facilitating
Conditions
FC3
The Continuous Auditing system is compatible with other systems I (we) use
FC4
A specific person (or group) is available for assistance with the Continuous Auditing
system difficulties
SI1
People or parties who influence my (our) behavior think that I (we) should use the
Continuous Auditing system
SI2
People or parties who are important to me (us) think that I (we) should use the
Social
Continuous Auditing system
Influence
SI3
Senior management has been helpful in the use of the Continuous Auditing system
SI4
In general, my (our) organization has supported the use of the Continuous Auditing
system
DV1
I (we) intend to use the Continuous Auditing system in the foreseeable future
DV2
I predict I (we) would use the Continuous Auditing system in the coming future
Adoption
DV3
My (our) use of Continuous Auditing is very likely to occur soon
1 = less than $1 million; 2 = $1 million to $10 million; 3 = $10 million to $100
Annual Sales Sales
million; 4 = $100 million to $1 billion; 5 = more tan $1 billion
Voluntariness Voluntary 1= Voluntary; 2 = Mandated
(1 = Strongly Disagree; 5 = Strongly Agree)
* The questions shown above are the set of questions asked of survey respondents who indicated they
currently have a continuous auditing system, either fully operational or in place but not yet fully
implemented. The questions were similar but worded slightly differently for those participants who
indicated that they had a scheduled but not yet implemented continuous auditing system or did not have
any plans for a system.
21
Table 3 - Loadings of the Indicator Variables (AVE) (Composite Reliability)
Construct
Effort
Expectancy
(.694)(.900)
Performance
Expectancy
(.739)(.918)
Facilitating
Conditions
(.713)(.908)
Social Influence
(.710)(.907)
Adoption
(.846)(.942)
Annual Sales
Voluntariness
Indicator
EE1
EE2
EE3
EE4
PE1
PE2
PE3
PE4
FC1
FC2
FC3
FC4
SI1
SI2
SI3
SI4
DV1
DV2
DV3
Sales
Voluntary
Mean
3.610
3.670
3.520
3.630
3.920
3.670
3.650
3.780
3.380
3.440
3.310
3.270
3.360
3.490
3.540
3.570
3.230
3.330
3.100
3.400
1.220
SD
.738
.790
.765
.755
.835
.964
.943
.978
1.030
.977
.904
.971
.853
.826
.993
.967
1.114
1.150
1.198
1.280
.415
Loading
.837
.808
.857
.829
.824
.900
.868
.843
.867
.844
.833
.834
.828
.808
.872
.860
.925
.924
.911
1
1
t-value
24.208
19.847
29.844
20.705
25.568
51.707
31.637
30.594
36.932
29.453
31.714
28.378
26.095
18.502
47.838
34.815
56.959
64.594
49.480
n/a
n/a
22
Table 4 – Correlations among Major Constructs
Adoption
Effort Expectancy (EE)
Facilitating Conditions (FC)
Performance Expectancy (PE)
Social Influence (SI)
Annual Sales (Sales)
Voluntariness (Voluntary)
Diagonals are AVE values.
* p < .05; **p < .01 (2-tailed)
Adoption
0.846
0.416**
0.499**
0.441**
0.568**
0.085
0.311**
EE
FC
PE
0.694
0.489**
0.616**
0.501**
0.060
0.106
0.713
0.433**
0.713**
0.269**
0.345**
SI
Sales
0.739
0.571** 0.710
0.078
0.120
1.000
0.183** 0.267** 0.177*
Voluntary
1.000
Table 5 - Item Loadings and Cross Loadings
Adoption
DV1
0.925
DV2
0.924
DV3
0.911
0.379
EE1
0.328
EE2
0.347
EE3
0.325
EE4
0.458
FC1
0.384
FC2
0.409
FC3
0.430
FC4
0.350
PE1
0.400
PE2
0.353
PE3
0.406
PE4
0.425
SI1
0.390
SI2
0.540
SI3
0.531
SI4
0.085
Sales
0.311
Voluntary
EE
0.385
0.406
0.357
0.837
0.808
0.857
0.829
0.381
0.328
0.473
0.467
0.498
0.546
0.557
0.516
0.411
0.425
0.427
0.430
0.060
0.106
FC
0.459
0.440
0.478
0.457
0.337
0.456
0.369
0.867
0.844
0.833
0.834
0.356
0.390
0.350
0.387
0.544
0.468
0.645
0.706
0.269
0.345
PE
0.420
0.384
0.412
0.581
0.524
0.473
0.466
0.363
0.335
0.389
0.372
0.824
0.900
0.868
0.843
0.485
0.478
0.531
0.435
0.078
0.183
SI
0.523
0.537
0.509
0.533
0.357
0.410
0.353
0.589
0.575
0.644
0.603
0.487
0.505
0.466
0.501
0.828
0.808
0.872
0.860
0.120
0.267
Sales
0.028
0.073
0.131
0.032
0.064
0.064
0.041
0.261
0.242
0.219
0.187
0.062
0.115
0.058
0.032
0.088
0.031
0.086
0.179
1.000
0.177
voluntary
0.272
0.240
0.343
0.043
0.119
0.134
0.063
0.297
0.282
0.316
0.270
0.231
0.133
0.101
0.166
0.211
0.132
0.235
0.298
0.177
1.000
23
Table 6 - Common Method Bias Analysis
Construct
Effort Expectancy
Performance
Expectancy
Facilitating
Conditions
Social Influence
Voluntariness
Annual Sales
Adoption
Indicators
EE1
EE2
EE3
EE4
PE1
PE2
PE3
PE4
FC1
FC2
FC3
FC4
SI1
SI2
SI3
SI4
Voluntary
Sales
DV1
DV2
DV3
Average
*p < .05; **p < .01; ***p < .005
Substantive Factor
Loading (R1)
0.671***
0.840***
0.893***
0.926***
0.825***
0.912***
0.916***
0.780***
0.895***
0.966***
0.748***
0.767***
0.951***
0.995***
0.721***
0.715***
1.000***
1.000***
0.926***
0.932***
0.902***
R12
0.450
0.706
0.797
0.857
0.681
0.832
0.839
0.608
0.801
0.933
0.560
0.588
0.904
0.990
0.520
0.511
1.000
1.000
0.857
0.869
0.814
0.768
Method Factor
Loading (R2)
0.198**
-0.045
-0.037
-0.114*
0.002
-0.012
-0.052
0.066
-0.042
-0.14**
0.109*
0.078
-0.117
-0.185**
0.152*
0.143*
0.000
0.000
0.001
-0.008
0.008
0.000
R22
0.039
0.002
0.001
0.013
0.000
0.000
0.003
0.004
0.002
0.020
0.012
0.006
0.014
0.034
0.023
0.020
0.000
0.000
0.000
0.000
0.000
0.009
24
Table 7 - Survey Responses: Most important benefits of Continuous Auditing
Mean Rating*
CA fully in place
CA partially in place
Accuracy
5.90
6.08
Timely communication
5.60
5.87
Audit efficiency
5.43
5.82
Timely analysis
5.45
5.79
5.44
Cost savings
*Rating scale: (1 = Not all important; 7 = Extremely Important)
5.53
Table 8 - Survey Responses: Focus of company’s Continuous Auditing
Mean Rating*
Currently in place
To be implemented in future
Monitoring possible fraudulent activities
5.76
5.84
Risk monitoring
5.63
5.82
Testing of controls
5.64
5.74
Detail testing of transactions
5.52
5.45
4.93
Performance evaluation
*Rating scale: (1 = Not all important; 7 = Extremely Important)
4.92
Table 9 - Survey Responses: Ownership of Continuous Auditing
Internal auditing
IT group
Accounting/finance function
Others
Total
CA fully in place
78.6%
8.2%
9.2%
4.1%
100.0%
CA partially in place
73.7%
13.2%
7.9%
5.3%
100.0%
Overall
77.2%
9.6%
8.8%
4.4%
100.0%
Table 10 - Survey Responses: Responsibility for Performing Continuous Auditing
Internal auditing
IT management
CA being performed currently
60.3%
16.3%
Risk management
Other
Total
15.6%
7.8%
100.0%
CA to be performed in future Overall
50.9%
57.7%
25.5%
18.9%
18.2%
5.5%
100.0%
16.3%
7.1%
100.0%
25
Table 11 - Survey Responses: Continuous Auditing Frequency
Real time
By the minute
Hourly
Daily
Weekly
Monthly
Quarterly
Other
Total
CA fully in place
11.2%
1.0%
1.0%
13.3%
6.1%
29.6%
34.7%
3.1%
100.0%
CA partially in place
18.4%
0.0%
0.0%
7.9%
15.8%
26.3%
26.3%
5.3%
100.0%
Overall
13.2%
0.7%
0.7%
11.8%
8.8%
28.7%
32.4%
3.7%
100.0%
Table 12 - Survey Responses: Source of Development of Continuous System by Percentage
Developed within your company or insourced
Developed by an outsourcing partner
Purchased from an outside vendor
CA fully in place
69.8%
19.0%
11.2%
100%
CA partially in place
52.4%
27.0%
20.6%
100%
Table 13 - Survey Responses: Plans for Future Implementation in:
The next 6 months
The next 12 months
The next 24 months
After 24 months
Total
16%
32%
32%
21%
100%
Table 14 - Survey Responses: Have Recent Economic Events
Company’s Plans to Involve in Continuous Auditing?
Yes
Somewhat
Not at all
Total
9%
4%
87%
100%
26
Table 15 - Survey Responses: Reasons for having No
Plans for Implementation*
8%
We do not believe it would benefit us much
20%
We lack the expertise
15%
We lack the technology
17%
We do not have the necessary funds
76%
We have not looked into Continuous Auditing yet
11%
Other
* Out of 234 survey respondents, 98 indicated they had not implemented continuous auditing and had no
plans for future implementation. Those 98 respondents explained their company’s non-implementation by
selecting the answers in the table.
Table 16 - Revised Model Loadings of the Indicator Variables (AVE) (Composite
Reliability)
Construct
Effort
Expectancy
(.694)(.900)
Performance
Expectancy
(.739)(.918)
Facilitating
Conditions
(.666)(.923)
Social Influence
(.874)(.932)
Adoption
(.846)(.942)
Annual Sales
Voluntariness
Indicator
EE1
EE2
EE3
EE4
PE1
PE2
PE3
PE4
FC1
FC2
FC3
FC4
FC5
FC6
SI1
SI2
DV1
DV2
DV3
Sales
Voluntary
Mean
3.610
3.670
3.520
3.630
3.920
3.670
3.650
3.780
3.380
3.440
3.310
3.270
3.540
3.570
3.360
3.490
3.230
3.330
3.100
3.400
1.220
SD
.738
.790
.765
.755
.835
.964
.943
.978
1.030
.977
.904
.971
.993
.967
.853
.826
1.114
1.150
1.198
1.280
.415
Loading
.837
.808
.857
.829
.824
.900
.868
.843
.825
.790
.803
.798
.821
.858
.941
.929
.925
.923
.912
1
1
t-value
24.705
22.191
30.288
21.119
25.005
54.735
32.963
30.602
26.422
22.155
26.592
24.114
31.201
41.429
85.138
45.083
57.791
62.180
49.307
n/a
n/a
27
Table 17 – Revised Correlations among Major Constructs
Adoption
Effort Expectancy (EE)
Facilitating Conditions (FC)
Performance Expectancy (PE)
Social Influence (SI)
Annual Sales (Sales)
Voluntariness (Voluntary)
Diagonals are AVE values.
* p < .05; **p < .01 (2-tailed)
Adoption
0.846
0.416**
0.570**
0.441**
0.437**
0.085
0.311**
EE
0.694
0.512**
0.616**
0.447**
0.060
0.106
FC
PE
SI
0.666
0.503** 0.739
0.624** 0.515** 0.874
0.233** 0.078
0.065
0.345** 0.183** 0.185**
Sales
Voluntary
1.000
0.177*
1.000
28
Table 18 - Revised Model Item Loadings and Cross Loadings
DV1
DV2
DV3
EE1
EE2
EE3
EE4
FC1
FC2
FC3
FC4
FC5
FC6
PE1
PE2
PE3
PE4
SI1
SI2
Sales
Voluntary
Adoption
0.925
0.923
0.912
0.379
0.328
0.347
0.325
0.458
0.384
0.410
0.430
0.540
0.531
0.350
0.400
0.353
0.406
0.425
0.390
0.085
0.311
EE
0.385
0.406
0.357
0.837
0.808
0.857
0.829
0.381
0.328
0.473
0.467
0.427
0.430
0.498
0.546
0.557
0.516
0.411
0.425
0.060
0.106
FC
0.528
0.515
0.529
0.500
0.352
0.467
0.373
0.825
0.790
0.803
0.798
0.821
0.858
0.405
0.451
0.419
0.449
0.612
0.553
0.233
0.344
PE
0.420
0.384
0.412
0.581
0.524
0.473
0.466
0.363
0.335
0.389
0.372
0.531
0.435
0.824
0.900
0.868
0.843
0.485
0.478
0.078
0.183
SI
0.390
0.423
0.393
0.490
0.333
0.326
0.324
0.410
0.444
0.527
0.460
0.602
0.580
0.487
0.450
0.390
0.443
0.941
0.929
0.065
0.185
Sales
0.028
0.073
0.131
0.032
0.064
0.064
0.041
0.261
0.242
0.219
0.187
0.086
0.179
0.062
0.115
0.058
0.032
0.088
0.031
1.000
0.177
voluntary
0.272
0.240
0.343
0.043
0.119
0.134
0.063
0.297
0.282
0.316
0.270
0.235
0.298
0.231
0.133
0.101
0.166
0.211
0.132
0.177
1.000
29
Figure 1 - UTAUT Model (Venkatesh et al. 2003)
Performance
Expectancy
Effort
Expectancy
Behavioral
Intention
Use
Behavior
Social
Influence
Facilitating
Conditions
Voluntariness of use
Experience
Age
Gender
Figure 2 - Research Model
Effort
Expectancy
H1
Performance
Expectancy
H2
Adoption
H3
Facilitating
Conditions
H4
Social
Influence
H5d
H6
H5c
H5b
H5a
Sales
Voluntary
30
Figure 3 - UTAUT Findings
Effort
Expectancy
.152*
Performance
Expectancy
Adoption
R2 = .443
Facilitating
Conditions
.331**
Social
Influence
-.253**
-.141**
Sales
Voluntary
31
Figure 4 - Revised UTAUT Findings
Effort
Expectancy
.143*
Performance
Expectancy
Adoption
R2 = .443
Facilitating
Conditions
Social
Influence
.387**
-.159**
-.128**
Sales
Voluntary
32
Download