ISA Transactions xxx (xxxx) xxx Contents lists available at ScienceDirect ISA Transactions journal homepage: www.elsevier.com/locate/isatrans Research article Volterra filter modelling of non-linear system using Artificial Electric Field algorithm assisted Kalman filter and its experimental evaluation ∗ L. Janjanam a , , S.K. Saha a , R. Kar b , D. Mandal b a b Department of Electronics and Communication Engineering, NIT Raipur, Raipur, Chhattisgarh, 492010, India Department of Electronics and Communication Engineering, NIT Durgapur, Durgapur, West Bengal, 713209, India article info Article history: Received 12 February 2020 Received in revised form 29 August 2020 Accepted 24 September 2020 Available online xxxx Keywords: Non-linear system Benchmark systems Discrete-time system identification Volterra model Kalman filter AEF algorithm a b s t r a c t The main objective of this paper is to improve the identification efficiency of non-linear systems using the Kalman filter (KF), which is optimised with the Artificial Electric Field (AEF) algorithm. The conventional KF suffers from the proper tuning of its parameters, which leads to a divergence problem. This issue has been solved to a great extent by the meta-heuristic AEF algorithm assisted Kalman filter (AEF-KF). This paper proposes three steps for the identification of the systems while solving the problem as mentioned above. Firstly, it converts the identification model to a measurement problem. Next, the AEF algorithm optimises the KF parameters by considering the fitness function with the KF equations. The third step is to identify the model using conventional KF algorithm with the optimised KF parameters. To evaluate the performance of the proposed method, parameter estimation error, mean squared error (MSE), fitness (FIT) percentage, statistical information and percentage improvement are considered as the performance metrics. To validate the performance of the proposed method, five distinct non-linear models are identified with the Volterra model using KF and the AEF-KF techniques under various noisy input conditions. Besides, the practical applicability of the proposed approach is also tested on two non-linear benchmark systems using experimental data sets. The obtained simulation results confirm the efficacy and robustness of the proposed identification method in terms of the convergence speed, computational time and various performance metrics as compared to KF, Kalman smoother (KS) which is optimised using different state-of-the-art evolutionary algorithms and also other existing recently reported similar types of stochastic algorithms based approaches. © 2020 ISA. Published by Elsevier Ltd. All rights reserved. 1. Introduction System identification plays an imperative role in various fields of engineering [1]. Identification of system can proceed through linear, non-linear and combination of both. Finite impulse response (FIR) and infinite impulse response (IIR) models are frequently used for linear system identification. In [2–4], researchers have focussed on the FIR and the IIR system identification using different evolutionary algorithms like breeder genetic algorithm [2], firefly algorithm (FA) [3] and modified-interior search algorithm (M-ISA) [4]. It has been established that M-ISA algorithm results in accurate identification of IIR systems compared to the other recently introduced state-of-the-art evolutionary optimisation algorithms in terms of mean squared error (MSE), percentage improvement in MSE and computational time. However, most of the real-time systems exhibit non-linear behaviour owing to which the estimation using linear systems can often lead to spurious results [5]. If the output of the system is a differential ∗ Corresponding author. E-mail address: ljanjanam.phd2018.etc@nitrr.ac.in (L. Janjanam). or exponential or logarithmic function of input, then the system is called a non-linear system [6]. Non-linear system identification is the primary challenging task because most of the engineering fields, such as biomedical engineering, chemical industry and communication engineering, are successfully using the non-linear systems. For the identification of non-linear systems, different non-linear models such as bilinear, Volterra, and polynomial autoregressive (PAR) are employed [6–8]. The advantage of the bilinear system is that it provides a possibility for modelling time series with an occasional sharp spike. Because of this attractive feature, these systems are used in economic modelling and control problems. In [7], authors have used filtering based maximum likelihood recursive least squares (F-ML-RLS) algorithm for accurate identification of nonlinear controlled autoregressive ARMA systems and have shown that F-ML-RLS outperforms ML-RLS and recursive generalised extended least squares (RGELS) in terms of parameter estimation error. Hafezi et al. in [8], have proposed RGELS and recursive maximum likelihood (RML) algorithms for parameter identification of bilinear systems with high convergence speed, low output error, low parameter estimation error and lower computational complexity. However, these ARMA and bilinear systems https://doi.org/10.1016/j.isatra.2020.09.010 0019-0578/© 2020 ISA. Published by Elsevier Ltd. All rights reserved. Please cite this article as: L. Janjanam, S.K. Saha, R. Kar et al., Volterra filter modelling of non-linear system using Artificial Electric Field algorithm assisted Kalman filter and its experimental evaluation. ISA Transactions (2020), https://doi.org/10.1016/j.isatra.2020.09.010. L. Janjanam, S.K. Saha, R. Kar et al. ISA Transactions xxx (xxxx) xxx In addition, among all the KF parameters, the estimation of Q and R is practically challenging due to the change in the noise statistics when the filter starts working. It results in poor performance. Thus, noise statistics have significant importance on KF performance, which motivates the research of developing adaptive Kalman filter (AKF). The AKF uses adaptive filter along with the KF. The function of AKF is to tune the KF parameters depending on the estimations of the identification model. Many researchers have developed various AKFs for tuning of Q and R [23–30]. To get the best estimates of Q and R for different state estimation problems, various AKF techniques, such as maximum likelihood, Bayesian, covariance, and correlation methods, are used in [23]. However, these techniques are offline and also valid for stationary noise or noise with slowly varying statistics. In [24], the authors have proposed the multiple interacting models (IMM) algorithm to solve the problem as mentioned above. However, this IMM method is not valid for rapidly varying noise statistics. Mohamed et al. used Innovation-based adaptive estimation (IAE) and multiple model adaptive estimation (MMAE) methods to get the estimated values of Q and R [25]. However, the IAE method does not guarantee to converge to the exact values of Q and R for rapidly changing systems, and MMAE method is suitable only if the prior knowledge of system dynamics is known [26]. Karasalo et al. in [26], proposed Optimisation-based Adaptive Estimation (OAE) method to estimate the value of Q for a small window of data. Hence, the OAE method is suitable for all the rapidly changing systems in various real-time online applications. Moreover, the OAE method requires no information about system dynamics. Based on the maximum, a posterior criterion, Sage-Husa AKF (SHAKF) can recursively estimate the unknown noise statistics Q and R. However, it is not guaranteed to get the right convergence noise statistics with SHAKF [27]. Besides, in [28], Variational Bayesian (VB) based Rauch–Tung–Striebel smoother method can only estimate the values of unknown and constant noise statistics offline. Variational Bayesian-based AKF (VBAKF) method is used in the literature [29] to estimate the values of inaccurate, slowly varying noise statistic R. However, the performance of the VBAKF will degrade for an inaccurate Q ; since it assumes accurate Q. In [30], a novel AKF is designed based on variational Bayesian (VB) approach to estimate both noise statistics Q and R simultaneously for linear Gaussian state–space models, which results in a better estimation compared to other state-of-the-art AKFs. The initial error covariance matrix P0− is one of the essential tuning parameters in KF operation because it can affect the final error covariance P. However, much attention was not given earlier. Generally, a guess of P0− tends to become meagre value after some data samples. Hence, the tuning of P0− is very crucial [31– 33], especially in specific state estimation problems like target tracking and design of control systems. In [31], Xu et al. proposed an efficient AKF, which adaptively estimates P0− and R based on the expectation–maximisation approach. However, these AKF techniques [23–33] suffer from reduced convergence speed and are not guaranteed to get right estimates P0− , Q and R for various state estimation problems. In recent days, evolutionary optimisation algorithms play a significant role in solving various engineering problems due to their robustness, convergence speed and near-global optimal solution finding capability. The classical optimisation algorithms are not suitable to solve the complex real-world problems where many counteracting objective functions are to be solved simultaneously, which make the problem much involved and more complicated for the classical techniques. To optimise many objectives simultaneously, various multi-objective evolutionary algorithms (MOEAs) are developed, which result in the best performance when the problem has two or three objectives. However, are not suitable for memory-based applications. Hence, Wiener– Hammerstein systems are getting attention recently, which is a combination of linear and non-linear models [9]. Volterra is one of the most popularly used models among all the non-linear models due to its conceptual simplicity and modelling accuracy. Volterra series is a linear combination of the non-linear function of the input signal and depends linearly on the model coefficients, known as the kernel. The Volterra model suffers from the computational complexity because the number of Volterra kernels increases at an exponential rate when the number of polynomials increases. This makes the system identification using the Volterra model a very challenging task when there is a lack of knowledge about the structure of the system to be identified. So, researchers adopt the truncated Volterra series for identification [10–13]. In [11], authors have identified the higher-order Volterra kernels using real coded genetic algorithm (RCGA) with excellent precision and satisfactory computational complexity. However, RCGA suffers from low convergence speed (approximately 300 iterations) at different SNRs. In [12], authors have successfully identified the higher-order Volterra systems using genetic algorithm (GA) with random constructive heuristic (RCH), and constructive heuristic oriented by benefit (CHOB) approaches which result in high convergence speed. It is also reported that CHOB results in superior performance compared to RCH in terms of mean squared distortion and cumulative density function (CDF) with distortion at various levels of SNR, mutation rate (MR) and crossover rates (CR). Improved variable forgetting factor recursive logarithmic least mean p th (IVFF-RLLMP) algorithm accurately identifies the Volterra system under impulsive noisy environments in [13]. The KF is a famous optimal state estimator that estimates the instantaneous states of a dynamic system corrupted by noise using certain assumptions of observation noise. It was first proposed by Kalman and has been widely used in different realtime applications [14]. KF and its improved versions, such as extended Kalman filter (EKF), unscented Kalman filter (UKF), particle filter (PF) lead to a better optimal solution for the estimation problems in various applications [15–17]. When the system is highly non-linear, PF gives more accurate estimations compared to EKF and UKF [16]. In [18–20], KF algorithm has been applied to identify the Volterra model. In [19,20], Batselier et al. have identified the multiple inputs and multiple outputs (MIMO) Volterra systems using tensor network Kalman filter. However, in [19], authors have achieved two times of the convergence speed of the estimated Volterra kernel coefficients with no additional cost and also better performance is reported compared to the work in [20] due to extension of output model matrix. In [21,22], the authors have identified the Hammerstein, Hammerstein–Wiener and Hammerstein–Wiener ARMAX models by using different versions of KF. Identification of the system using KF depends on both the system dynamics (includes initial state X̂0− and state transition matrix φ ) which describe the behaviour of the system with time and the stochastic model parameters namely, initial error covariance matrix (P0− ), process noise covariance matrix (Q ), and the measurement noise covariance matrix (R) [14]. The KF results in accurate identification if these parameters are known precisely. However, in most of the practical applications, these stochastic models are unknown or partially known. The use of uncertain or biased noise statistics in KF leads to performance degradation or even divergence. The KF algorithm uses noise statistics (Q and R) to influence the Kalman gain, Ki which is applied to the error between the available process information and the most recent obtained measurement. The filter gain projects this error to the process information to get the best estimation. So, the choices of Q and R are the primary factors which determine the value of Ki , which in turn determines the operation of the KF. 2 L. Janjanam, S.K. Saha, R. Kar et al. ISA Transactions xxx (xxxx) xxx the existing MEO’s have encountered difficulties when resolving problems with spaces and high-dimensional objectives. The significant difficulties encountered by MOEAs for resolving multiobjective optimisation problems are summarised in [34]. Mnasri et al. have solved one of the complex real-world problems in [34, 35]. In [34,35], authors have solved three-dimensional indoor deployment problem while optimising a set of objectives, such as coverage, localisation, routing, energy consumption etc., using Improved Many-Objective Optimisation Algorithms and accentbased multi-objective particle swarm optimisation algorithms, respectively. Due to multiple features of evolutionary algorithms, many researchers have been motivated to incorporate the optimisation algorithms to tune the KF parameters for various applications [36– 43]. In [39], multi-objective problems are solved by using both KF and differential evolutionary algorithm (DEA). In [40], the EKF is optimised by the DEA and then used for sensorless speed control of induction motors. Ahmed et al. have introduced self tuned KF to estimate the discrete model of a synchronous DC– DC buck converter [41]. Kim et al. in [42], have used particle swarm optimisation (PSO) assisted KF in estimating the state of Lithium-Ion batteries. In [36–42], researchers tuned only three parameters of KF, namely, P0− , Q and R using different evolutionary algorithms for various state estimation problems. However, in [43], Yazid et al. have tuned all the KS parameters such as X̂0− , P0− , φ , Q and R using PSO assisted KS (PSO-KS), GA assisted KS (GA-KS), and artificial bee colony (ABC) algorithm assisted KS (ABC-KS) methods for identification of Volterra systems. The primary role of these evolutionary algorithms is to obtain the optimal set of KS parameters, and it has been established that ABC-KS results in better estimations compared to GA-KS and PSO-KS techniques. The reported values of the fitness percentage (FIT %) between the actual and the estimated coefficients is 98.64% for system input corrupted with 20 dB and 99.92% for cleaned input. From the literature [36–43], authors have motivated to incorporate the evolutionary algorithms in KF to avoid the tuning problem of KF by developing an efficient objective function. In this paper, authors have identified the second and third-order Volterra type non-linear systems using the basic KF with the optimal set of all the KF parameters (X̂0− , P0− , φ , Q and R) obtained by the AEF algorithm. The proposed AEF-KF method results in FIT values of 99.9973% and 99.9978% for 20dB additive noise input and cleaned input, respectively. To get the best estimates using KF, in this paper, a new method called AEF algorithm assisted KF (AEF-KF) is proposed to solve the non-linear system identification problem. The major contributions made in this paper are as follows: (6) The noteworthy point of this paper is that till date, only one article [43] has been reported where the Volterra type non-linear system is identified using KS, which is optimised with a meta-heuristic evolutionary algorithm. The simulation results for MSE (dB) are presented which comfortably outperform all the reported results. (7) The proposed approach has identified two industryoriented benchmark systems based on real data. The orientation of the paper is as follows: Section 2 describes the measurement model of Volterra system and analyses the problem statement. Section 3 elaborates the steps of the proposed method for the parameter estimation and also the flow chart of AEF-KF. In Section 4, discussion on simulation results for four numbers of second-order, one number of third-order Volterra modelling examples and two benchmark systems are presented. Finally, the conclusion of this paper is given in Section 5. 2. Problem statement Volterra series [11,43] is one of the most popular identification models for non-linear systems. The causal discrete-time form of qth order Volterra series is given in (1), and its matrix form is given in (2). d[n] = h0 + N −1 ∑ h1 [k1 ]u[n − k1 ] k1 =0 + N −1 N −1 ∑ ∑ h2 [k1 , k2 ]u[n − k1 ]u[n − k2 ] + · · · k1 =0 k2 =0 ··· + N −1 N −1 ∑ ∑ k1 =0 k2 =0 ··· N −1 ∑ hq [k1 , k2 , . . . , kq ]u kq =0 × [n − k1 ]u[n − k2 ], . . . , u[n − kq ] (1) where the kernels h0 , h1 [k1 ], h2 [k1 , k2 ],. . . , hq [k1 , k2 , . . . , kq ] for indexes k1 , k2 , . . . , kq ∈(0 to N-1) are constants; N represents the memory size; u[n] represents the input signal, and d[n] denotes the output of the model. d[n] = LH T (2) where L denotes the Volterra kernel vector as given in (3); H is the Volterra input vector and is given in (4). Subscript T denotes the transpose of a vector. L = [h0 , h1 [0], . . . , h1 [N − 1], h2 [0, 0], h2 [0, 1], . . . , h2 × [0, N − 1], . . . , hq [N − 1, N − 1, . . . , N − 1]] (1) In this paper, the proposed AEF-KF method is used to minimise the error between the responses of the unknown non-linear system and the Volterra system. (2) The function of the AEF algorithm is to obtain the optimised set of all the KF parameters so that the proper tuning problem of KF can be resolved. (3) The simulation is carried out by using KF and AEF-KF techniques, with various additive noise input levels. (4) The authors have also justified the results in terms of the parameter estimation, fitness percentage, coefficient convergence plots, optimum MSE values along with the corresponding convergence plots and the percentage improvement in MSE for the proposed technique with respect to the KF algorithm. (5) The proposed approach accurately identifies the second and third-order Volterra systems with high convergence speed (only very few iterations required to converge) and without any excessive computational complexity. (3) H = [1, u[n], u[n − 1], . . . , u[n − (N − 1)], u [n], u[n]u 2 × [n − 1], . . . , u[n]u[n − (N − 1)], . . . , u2 [n − 1], . . . , u2 [n − (N − 1)], . . . , uq × [n − 1], . . . , uq [n − (N − 1)]] (4) Fig. 1 shows the block diagram of the non-linear system identification using AEF-KF technique with the help of the adaptive filter. In this paper, the discrete-time unknown systems are considered, which are identified by the Volterra model with the help of the proposed AEF-KF technique. Eq. (5) shows that the output of the discrete-time unknown system is corrupted with measurement noise, v[n]. y[n] = d[n] + v[n] (5) The estimated output of the Volterra model is given in (6). ŷ[n] = L̂Ĥ T 3 (6) L. Janjanam, S.K. Saha, R. Kar et al. ISA Transactions xxx (xxxx) xxx NP number of positions are randomly initialised with the KF parameters. SA is given in (8). − SA = X̂0 (n̂ × 1) [ P0− (n̂ × n̂) φ (n̂ × n̂) Q (n̂ × n̂) R(m̂ × m̂) ] (8) The dimension of each SA is (1 × nv ar ), where nv ar is the summation of matrix sizes of all the KF parameters and is given in (9). n var = (n̂ × 1) + (n̂ × n̂) + (n̂ × n̂) + (n̂ × n̂) + (m̂ × m̂) where n̂ denotes the number of coefficients in the model and m̂ is the size of the measurement vector. Initialise algorithm-specific control parameters, such as γ0 , ε and α . Also, initialise other control parameters, namely ‘nvar’ dimensional randomly generated velocity (Vi ) and the maximum number of iterations (max _itr). Fig. 1. Block diagram of the parametric system identification using AEF-KF technique. The mean squared error (MSE) is considered as the objective function of this minimisation problem and is presented in (7). Step 2: For a finite duration, random input, evaluate the fitness value of each SA by considering the fitness function as given in (7). In this process, each SA updates the time as per (10)–(11) followed by the measurement as per (12)–(14) in the KF loop runs for 50 iterations to find out estimated output ŷ(kk). SP MSE = ⏐ 1 ∑⏐ ⏐y(kk) − ŷ(kk)⏐2 SP (9) (7) kk=1 where SP denotes the number of input sampling points. This paper employs KF and the proposed AEF-KF algorithms individually to update the parameters of the Volterra model until both the known and the unknown system responses are equal so that the error signal, e[n] is minimised and hence, MSE, given in (7), is optimised to its best possible minimum value. However, the accuracy of the results of the KF algorithm depends on the proper choices of its parameters X̂0− , P0− , φ , Q , and R. To solve this problem, many pieces of literature [36–43] have proved that if the evolutionary algorithm is used to optimise the KF parameters, then the best estimation results can be obtained. Hence, in this paper, a recently introduced AEF algorithm is used to optimise the KF parameters. The results show that AEF-KF method gives the best estimation compared to conventional KF algorithm. X̂i− +1 = φ X̂i Pi− +1 (10) = φ Pi φ + Q T (11) Ki = Pi− H T (HPi− H T + R)−1 − (12) − X̂i = X̂i + Ki (yi − H X̂i ) (13) − (14) Pi = (I − Ki H)Pi In the above equations, Ki is the Kalman gain matrix; X̂i is the estimated value of the system state Xi ; error covariance matrix Pi is defined by E [(Xi − X̂i )(Xi − X̂i )T ]; and I represents the identity matrix of size (n̂ × n̂). Here, E denotes the expected value. Step 3: Among all the fitness values, choose the best (minimum) value best(t) and the worst (maximum) value w orst(t). Step 4: Calculate the charge of the particle Ci (t) and Coulomb’s constantγ (t)using (15) and (17), respectively. 3. Parameter estimation using AEF-KF technique In this study, significant steps of the KF algorithm, such as time update and measurement update for solving the estimation problems, as described in [14], are followed. Also, a robust metaheuristic optimisation algorithm, named as AEF algorithm [44], is used in this paper to optimise the KF parameters, such as X̂0− , P0− , φ , Q , and R due to its high convergence speed, less computational complexity, less number of parameters used, highly efficient to solve single-objective non-linear problems and capable of achieving the near-global optimal solution. The fundamental theoretical concepts and steps for updating the position of each candidate solution are applied on different standard benchmark functions to establish the performance efficiency of the AEF algorithm compared to other state-of-the-art optimisation algorithms [44]. In the proposed method, initially, the AEF algorithm optimises all KF parameters. Finally, the basic KF technique identifies the Volterra kernels using the optimal set of KF parameters obtained earlier. To get the best optimal set of KF parameters using AEF algorithm, the positions of each search agent is randomly initialised with all the KF parameters, where each KF parameter is initialised with random values, and also efficient objective function is formulated. The following steps describe the procedure for parameter estimation using the AEF-KF technique, and the corresponding flowchart is shown in Fig. 2. ci (t) Ci (t) = ∑N i=1 ci (t) Step 1: Based on the number of particles (NP) in the AEF algorithm, generate ‘NP’ number of search agents (SAs), where where Ci (t) and Cj (t) are the charges of ith and jth particle, respectively; plj (t) is the position of the best fitness value obtained (15) where ci (t) = exp( fitpi (t) − w orst(t) best(t) − w orst(t) t γ (t) = γ0 ∗ exp(−α ) max _itr ) (16) (17) where γ (t) is Coulomb’s constant; α is a constant parameter; γ0 denotes initial value, and t is the current iteration. Step 5: Evaluate the total electric force acting on the ith particle, Fil (t) using (18). Fil (t) = NP ∑ rand()Fijl (t) (18) j=1,j̸ =i where rand() is a uniform random number in the interval [0,1], and Fijl (t) is the force acting on the charged particle i from j at any time t in l-dimensional search space, Fijl (t) = γ (t) 4 Ci (t) ∗ Cj (t)(plj (t) − Bli (t)) Dij (t) + ε (19) L. Janjanam, S.K. Saha, R. Kar et al. ISA Transactions xxx (xxxx) xxx Fig. 2. The flowchart of the proposed AEF-KF technique. by jth particle; ε is small positive constant, and Dij (t) is the Euclidian distance between two particles i and j and is given by (20). Dij (t) = Bi (t), Bj (t)2 examples taken from [10,11,13,43,45,46], and [12,47], respectively. Each example is verified by using the KF and the proposed AEF-KF techniques individually. In addition, using Monte Carlo simulation, each of the methods is repeated for 30 independent runs with different random population, and the averaged results are recorded for comparison purpose. The control parameters of the KF and AEF-KF techniques are summarised in Table 1. The selection of initial states of the basic KF parameters is usually adjusted manually to obtain the acceptable results [33]. Based on the literature [33,43,48,49] and dimensions of KF matrices, the authors have performed the trial and error method and have reported the best KF parameters’ initial state values in Table 1 with which a good accuracy in identification results is obtained. In the proposed AEF-KF technique, the selection of the number of particles or the number of population (NP) can influence the final solution of the evolutionary algorithm (EA). From this research, it is observed that NP should not be chosen either large or small. If the selected NP is small, then the suboptimal solution (inferior result) is obtained because the search landscape is not fully explored, and if NP is large, then computational complexity is increased. In this paper, authors have achieved the best optimal set of KF parameters by choosing the NP value of 20. The value of ‘nvar’, reported using (9), varies based on number of estimated Volterra kernels in the model (n̂) and the initial states of KF parameters (X̂0− , P0− , φ , Q and R) in AEF-KF technique are selected as random values, which are chosen between a(= −1) and b(= +1). To set the lower (a) and upper (b) bounds of KF parameters, authors have followed the same strategy as mentioned in [50]. Three different sets of a and b values (a = −10, b = 10), (a = −1, b = 1) and (a = −100, b = 100) are chosen and exhaustive experiments have been performed for Example 1. The average MSE(dB) values obtained after 30 individual runs for these three different sets of a and b values are −151.32 dB, −184.85 dB and −132.36 dB, respectively. From the MSE (dB) values, it is observed that the performance of the proposed AEFKF approach is poor for the limits (a = −10, b = 10) and (a = −100, b = 100). Therefore, authors have chosen a and b values (20) where B(t) represents the position of any charged particle at time ‘t’. Step 6: Determine the acceleration of ith particle at any time t, ali (t) using (21). ali (t) = Ci (t)Eil (t) (21) Mi (t) where Mi (t) is the unit mass of ith particle, and the electric field of the ith particle is given in (22). Eil (t) = Fil (t) (22) Ci (t) Step 7: Update the velocity and position of each particle using (23) and (24), respectively. Vi (t + 1) = rand()Vi (t) + ai (t) (23) Bli (t (24) + 1) = Bli (t) + Vil (t + 1) Step 8: Repeat Steps (2)–(7) until the termination criteria are satisfied. Step 9: Return the best position, which contains the optimised KF parameters. Step 10: Run the basic KF Eqs. (10)–(14) using the optimised KF parameters (obtained in Step 9) until max _itr is reached. Step 11: Return the updated estimated state X̂i . 4. Simulation results and discussions An extensive MATLAB simulation has been performed for identification of the Volterra type non-linear system of five different 5 L. Janjanam, S.K. Saha, R. Kar et al. ISA Transactions xxx (xxxx) xxx Table 1 Control parameters for filter design. and the corresponding outputs ŷ[n] of the identification model are given in (31)–(35), respectively. Parameters Basic -KF AEF-KF NP nv ar – – – – 1000 eye(n̂) eye(n̂) 0.0003*eye(n̂) 1 a+(b-a).*rand(n̂,1) – – – 20 31[for n̂=3] 81[for n̂=5] 115[for n̂=6] 1000 a+(b-a).*rand(n̂, n̂) a+(b-a).*rand(n̂, n̂) a+(b-a).*rand(n̂, n̂) a+(b-a).*rand(m̂, m̂) a+(b-a).*rand(n̂,1) 500 0.001 30 max _itr φ − P0 Q R X̂0− γ0 ε α y[n] = u[n] − 0.8u[n − 1] + 1.9u[n − 3] + 0.95u2 [n] + 1.1u[n]u[n − 2] − 0.63u[n − 2]u[n − 3] + v[n] (26) y[n] = −0.12 − 0.22u[n] − 0.33u[n − 1] − 0.21u [n] 2 + 0.59u[n]u[n − 1] − 0.31u2 [n − 1] + v[n] (27) y[n] = 0.8u[n − 1] − 0.5u[n − 2] + 0.7u2 [n − 1] + 0.1u2 [n − 2] − 0.4u[n − 1]u[n − 2] + v[n] (28) y[n] = 0.21u [n] − 1.62u [n − 1] + 1.41u [n − 2] 2 2 2 + 3.72u[n]u[n − 1] + 1.86u[n]u[n − 2]... + 0.76u[n − 1]u[n − 2] + v[n] (29) y[n] = u[n − 2] + 0.08u [n − 2] − 0.04u [n − 1] + v[n] 2 where ‘n̂’ is number of Volterra kernels, m̂ = 1, b = 1 and a = -1 3 (30) ŷ[n] = h1 [0]u[n] + h1 [1]u[n − 1] + h1 [3]u[n − 3] + h2 [0, 0]u2 [n] + h2 [0, 2]u[n]u[n − 2]... as -1 and +1, respectively, for all the examples. The Coulomb’s constant, γ0 and constant α are usually chosen as higher values to increase the search accuracy of the algorithm [44]. Hence, the values of γ0 and α are chosen as 500 and 30, respectively, which lead to the best results. The constant ε is chosen as a small positive value of 0.001 to avoid force defined in (19) becomes infinite. Authors have used maximum 1000 iterations to obtain the best SA (which contains an optimised set of KF parameters) due to the large dimension of search agent (SA) and examples considered in this paper are higher-order with large memory size systems. In this paper, various performance metrics are considered from [43,51–54] to show the identification efficiency of the proposed method. The percentage error between the actual and the estimated Volterra kernels, the statistical (mean and standard deviation) analysis of estimated Volterra kernels, MSE (dB), percentage improvement in MSE (dB) of AEF-KF technique with respect to KF algorithm, and fitness percentage (FIT %) between the actual and estimated outputs for Examples 1–5 under different additive noise levels are reported in Tables 2, 3, 4, 5 and 6, respectively. The minimum (δmin ) and maximum (δmax ) percentage of errors are calculated, respectively, using (25). δmin (%) = ⏐ ⏐ ⏐ ⏐ ⏐θi − θ̂i ⏐ min θi ×100 and δmax (%) = ⏐ ⏐ ⏐ ⏐ ⏐θi − θ̂i ⏐ θi max + h2 [2, 3]u[n − 2]u[n − 3] ŷ[n] = h0 + h1 [0]u[n] + h1 [1]u[n − 1] (31) + h2 [0, 0]u2 [n] + h2 [0, 1]u[n]u[n − 1] + h2 [1, 1]u2 [n − 1] ŷ[n] = h1 [1]u[n − 1] + h1 [2]u[n − 2] (32) + h2 [1, 1]u2 [n − 1] + h2 [2, 2]u2 [n − 2] + h2 [1, 2]u[n − 1]u[n − 2] (33) ŷ[n] = h2 [0, 0]u [n] + h2 [1, 1]u [n − 1] 2 2 + h2 [2, 2]u2 [n − 2] + h2 [0, 1]u[n]u[n − 1]... + h2 [0, 2]u[n]u[n − 2] + h2 [1, 2]u[n − 1]u[n − 2] ŷ[n] = h1 [2]u[n − 2] + h2 [2, 2]u [n − 2] + h3 [1, 1, 1]u3 [n − 1] (35) Figs. 3–7 show the identified outputs of non-linear system parameters under various challenging conditions using KF and AEF-KF techniques. It is observed that AEF-KF technique results in an outstanding performance compared to conventional KF algorithm. ×100 (25) 4.1. Comparison of actual and estimated outputs of the Volterra type non-linear systems where θi and θ̂i are the actual and the estimated Volterra kernels, respectively. The noisy outputs y[n] of the non-linear discretetime unknown system of each example are given in (26)–(30), The actual and the estimated outputs of Examples 1–5 using KF and AEF-KF techniques with cleaned input are shown in Table 2 Percentage error comparison between the actual and the estimated coefficients of each model. Example 1 2 3 4 5 Reference – Proposed work Yazid et al. [43] Yazid et al. [43] Yazid et al. [43] Yazid et al. [43] – Proposed work – Proposed work – Proposed work – Proposed work Reported algorithm KF AEF-KF KS PSO-KS GA-KS ABC-KS KF AEF-KF KF AEF-KF KF AEF-KF KF AEF-KF (34) 2 Minimum and maximum percentage of error SNR(10 dB) SNR(20 dB) SNR(30 dB) Without SNR 0.31%, 0.8% 0%, 0.01% 10.9%, 11.6% 3.22%, 5.15% 8.06%, 9.52% 3.22%, 5.15% 0.36%,3.48% 0%, 0% 0.3%, 6% 0%,0% 0.49%,1.4% 0%,0% 0.37%, 7% 0%, 0% 0.06%, 1.58% 0%, 0% 10%, 10% 1.93%, 2.6% 4.06%, 4.28% 1.93%, 2.5% 0.21%,3.41% 0%, 0% 0.02%, 6.7% 0%, 0% 0.81%,1.97% 0%,0% 0.25%, 13.2% 0%, 0% 0.03%, 0.74% 0%, 0% N/R N/R N/R N/R 0.31%, 1.74% 0%, 0% 0.32%, 3.7% 0%, 0% 0.49%,1.4% 0%,0% 0.32%, 4.5% 0%, 0% 0.02%, 0.6% 0%, 0% 4.76%, 9.67% 0%, 0% 3.03%, 3.33% 0%, 0% 0.23%, 1.58% 0%, 0% 0.04%,1.5% 0%, 0% 0.09%,1.11% 0%,0% 0.14%, 2.87% 0%, 0% ‘N/R’: Not Reported. 6 L. Janjanam, S.K. Saha, R. Kar et al. ISA Transactions xxx (xxxx) xxx Table 3 Statistical analysis of identified Volterra kernels with respect to true kernels of the proposed AEF-KF method. Example 1 2 3 4 5 Kernels h1 [0] h1 [1] h1 [3] h2 [0, 0] h2 [0, 2] h2 [2, 3] True values SNR(10 dB) SNR(30 dB) Without SNR STD Mean STD Mean STD Mean STD 1.9 0.95 1.1 −0.63 0.9753 −0.7756 1.8779 0.9411 1.0049 −0.6243 0.1790 0.1826 0.2008 0.1377 0.1309 0.1514 0.9826 −0.7872 1.8812 0.9441 1.0927 −0.6247 0.1654 0.1754 0.1950 0.1021 0.1117 0.1343 0.9852 −0.7912 1.8877 0.9465 1.0943 −0.6281 0.1589 0.1649 0.1902 0.1010 0.1003 0.1219 0.9990 −0.7991 1.8991 0.9494 1.0985 −0.6288 0.1453 0.1549 0.1704 0.1003 0.089 0.1115 0.0900 0.0578 0.0981 0.0845 0.0653 0.0872 −0.1167 −0.2023 −0.3256 −0.2067 0.0719 0.0545 0.0981 0.0710 0.0622 0.0642 −0.1171 −0.2187 −0.3272 −0.2081 0.0645 0.0532 0.0961 0.0667 0.0592 0.0582 −0.1198 −0.2201 −0.3295 −0.2096 0.0619 0.0492 0.0877 0.0552 0.0571 0.0557 1 −0.8 h0 h1 [0] h1 [ 1 ] h2 [0,0] h2 [0,1] h2 [1,1] −0.12 −0.22 −0.33 −0.21 −0.1151 −0.1979 −0.3245 −0.2052 0.59 −0.31 −0.3042 h1 h1 h2 h2 h2 [1] [2] [1,1] [2,2] [1,2] 0.8 −0.5 0.7 0.1 −0.4 h2 h2 h2 h2 h2 h2 [0,0] [1,1] [2,2] [0,1] [0,2] [1,2] 0.21 −1.62 1.41 3.72 1.86 0.76 h1 [2] h2 [2,2] h3 [1,1,1] SNR(20 dB) Mean 0.5851 0.7921 −0.4943 0.6947 0.0952 −0.3972 0.1971 1.3781 3.577 1.841 0.734 0.0571 0.0289 0.1024 0.0456 0.1521 0.0399 0.9952 0.0771 −0.0381 0.0986 0.0767 0.0646 −1.6115 1 0.08 −0.04 0.1287 0.1162 0.1298 0.0877 0.0988 0.5877 −0.3052 0.7943 −0.4956 0.6957 0.0967 −0.3991 0.1985 0.1156 0.1158 0.1254 0.0823 0.0942 1.3921 3.656 1.849 0.1746 0.0542 0.0271 0.1010 0.0431 0.1512 0.0378 0.9961 0.0781 −0.0389 0.0954 0.0751 0.0631 −1.6152 0.5891 −0.3086 0.7962 −0.4977 0.6961 0.0977 −0.3995 0.2077 0.1127 0.1142 0.1237 0.0723 0.0877 1.405 3.699 1.855 0.755 0.0532 0.0256 0.0098 0.0423 0.1501 0.0367 0.9977 0.0789 −0.0395 0.0939 0.0739 0.0625 −1.6171 0.5998 −0.3097 0.7988 −0.4995 0.6969 0.0993 −0.400 0.2101 0.1111 0.1117 0.1208 0.0712 0.0851 1.410 3.701 1.859 0.759 0.0512 0.0251 0.0091 0.0411 0.1499 0.0359 0.9998 0.0797 −0.04 0.0913 0.0711 0.0592 −1.1998 Table 4 Best output MSE (dB) of each model under different noise levels. Example Reference Reported algorithm 1 – Proposed work – Proposed work Mete et al. [10] Mete et al. [10] – Proposed work – Proposed work – Proposed work KF AEF-KF KF AEF-KF RLS DEA KF AEF-KF KF AEF-KF KF AEF-KF 2 3 4 5 MSE(dB) NS (dB) SNR(10 dB) SNR(20 dB) SNR(30 dB) Without SNR −84.4604 −179.4580 −96.6173 −201.4300 −84.6375 −182.0210 −97.2126 −201.5319 −91.5637 −184.0366 −99.8635 −201.7510 N/R N/R −89.4935 −239.9222 −75.9704 −168.1067 −100.6199 −546.4338 N/R N/R −96.1199 −243.1164 −76.6275 −168.6380 −101.3307 −546.6815 N/R N/R −98.5144 −243.6188 −77.4938 −169.8627 −102.9220 −546.6851 −98.4951 −184.8525 −106.3970 −202.9010 −9.6878 −9.6878 −112.5335 −243.7809 −78.8396 −171.8830 −114.6574 −546.6930 14.03 5.4 9.78 1.47 N/A N/A 23.04 3.86 2.86 3.78 14.04 0.011 ‘N/R’: Not Reported, ‘N/A’: Not Applicable, NS: Noise sensitivity. respectively. Even though the KF and AEF-KF techniques run for 1000 iterations for each example, however, it can be observed from Fig. 3 that the estimated outputs using KF and AEF-KF techniques very closely merge with the actual output within 100 iterations. From Fig. 4, it is evident that the estimated outputs slightly shift away from the actual outputs achieved using KF algorithm. However, for AEF-KF technique, the deviation between the actual and the estimated outputs for both noisy and noise-free inputs are almost negligible as compared to the previous case. From Table 2, it is observed that the minimum and maximum percentage error between the actual and the estimated coefficients using AEF-KF technique is zero for both the cases for all the examples under consideration except for the Example-1 under 10dB SNR case. It means that the SNR effect is almost eliminated by using the proposed method. On the other hand, using KF algorithm, percentage errors lie in the range of 0.02%–2.87%, 0.3%–7%, Table 5 Percentage improvement in output MSE (dB) of AEF-KF with respect to KF. Example MSE percentage improvement of AEF-KF with respect to KF 1 2 3 4 5 SNR(10 dB) SNR(20 dB) SNR(30 dB) Without SNR 112.47% 108.48% 168.08% 121.27% 443.06% 115.05% 107.31% 152.93% 120.07% 439.50% 100.99% 102.02% 147.29% 119.19% 431.16% 87.67% 90.70% 116.62% 118.01% 376.80% Fig. 3(a)-(e), respectively. An arbitrarily chosen zoomed portion (X-axis scale: 67.6545–67.655) of the actual and the estimated outputs for the cleaned input and different additive noise input levels (10 dB, 20 dB, and 30 dB) are shown in Fig. 4(a)-(e), 7 L. Janjanam, S.K. Saha, R. Kar et al. ISA Transactions xxx (xxxx) xxx Fig. 3. Actual and estimated outputs using KF and AEF-KF techniques: (a) Example 1, (b) Example 2, (c) Example 3,(d) Example 4, (e) Example 5. 0.02%–13.2%, and 0.03%–4.5% for the cleaned input, 10dB, 20dB and 30dB, respectively. From Table 3, it is observed that the mean values of estimated parameters for Examples 1–5 are very close to the actual values and the STD values are nearly zero as achieved by using the proposed AEF-KF technique. 510, 600, and 570 iterations are required, respectively, to meet the optimum values. Fig. 6(a)-(e) depict the variation of one arbitrarily chosen Volterra kernel with respect to the other Volterra kernel using KF and AEF-KF techniques under cleaned input for Examples 1–5, respectively. It is further re-established from a different perspective that AEF-KF technique converges faster than the KF technique as presented in Fig. 6. 4.2. Comparison of convergence profiles of Volterra kernels 4.3. Analysis of MSE (dB) convergence plot under noisy conditions To show how closely the estimated Volterra kernels match with the actual Volterra kernels, the convergence profiles of the estimated Volterra kernels of Examples 1–5 using KF and AEFKF techniques for noise-free input are shown in Fig. 5(a)-(e), respectively. It is observed from Fig. 5 that the estimated Volterra kernels of all the examples converge to their optimum values almost within 25 iterations using AEF-KF technique. On the other hand, using KF algorithm for Examples 1–5 approximately 600, 300, Fig. 7(a)-(e) show the variation of the output MSE (dB) values with iteration for Examples 1–5, respectively, using the KF and the AEF-KF techniques for different levels of additive input noise. From Fig. 7, it can be inferred that the MSE (dB) plot for each example marginally varies using KF algorithm under different levels of additive noise and noise-free inputs and converges slowly to the optimum MSE value. However, using the AEF-KF technique, 8 L. Janjanam, S.K. Saha, R. Kar et al. ISA Transactions xxx (xxxx) xxx Fig. 4. Zoomed in plots of the actual and the estimated outputs under different levels of noise using KF and AEF-KF techniques: (a) Example 1, (b) Example 2, (c) Example 3, (d) Example 4, (e) Example 5. these variations are too small, and MSE (dB) values rapidly converge to much lower optimum value compared to KF algorithm. From Table 4, it is observed that the output MSE (dB) values for AEF-KF technique with SNRs are much lesser susceptible to the deterioration (−0.26 dB to −5 dB) than the KF algorithm-based approach under similar conditions (−3dB to −23 dB). In addition, from Table 4, it is also observed that the proposed AEF method is much more insensitive to the additive noise compared to KF, which has been quantified in terms of noise sensitivity (NS). The noise sensitivity is defined as the maximum difference between the best and worst MSE (dB) values obtained under different noisy conditions. The proposed approach makes a minimal range (0.01 dB to 5.4 dB) of noise sensitivity compared to the KF approach (2.86 dB to 23.04 dB). 9 L. Janjanam, S.K. Saha, R. Kar et al. ISA Transactions xxx (xxxx) xxx Fig. 5. The convergence of Volterra Kernels using KF and AEF-KF techniques. (a) Example 1, (b) Example 2, (c) Example 3, (d) Example 4, (e) Example 5. output (ŷ) merges with the actual output (y) and is calculated for Examples 1–5 under various noise levels using the proposed AEFKF method. Based on the reported results in Table 6, the fitness percentages of Examples 1–4 lie between 99.9821% and 99.9998% and 100% is achieved for Example 5. From Table 6, it is also observed that for Example-2, Yazid et al. [43] have reported a FIT of 98.64% and 99.92% for additive noise 20 dB and cleaned input cases, respectively. However, From Table 5, it is evident that with respect to KF algorithm, AEF-KF technique results in MSE(dB) improvement of 87% to 121%, 116% to 168%, and 376% to 443% for the unknown systems which are modelled by using second-order with six kernels (Examples-1, 2, and 4), with five kernels (Example-3), and third-order with three kernels (Example-5), respectively. ( ) Fitness percentage, FIT (%) = 1− ∥y−ŷ∥ ∥y−mean(ŷ)∥ × 100 per- formance metric is used to show how closely the estimated 10 L. Janjanam, S.K. Saha, R. Kar et al. ISA Transactions xxx (xxxx) xxx Fig. 6. Variation of two Volterra kernels using KF and AEF-KF techniques: (a) Example 1, (b) Example 2, (c) Example 3, (d) Example 4, (e) Example 5. Table 6 Comparison of fitness percentages of each model under different noise levels for proposed AEF-KF method with the other reported approaches. Example Reference Reported algorithm FIT (%) SNR(10 dB) SNR(20 dB) SNR(30 dB) Without SNR 1 2 Proposed work Yazid et al. [43] Yazid et al. [43] Yazid et al. [43] Yazid et al. [43] Proposed work Proposed work Proposed work Proposed work AEF-KF KS PSO-KS GA-KS ABC-KS AEF-KF AEF-KF AEF-KF AEF-KF 99.9961% N/R N/R N/R N/R 99.9972% 99.9996% 99.9821% 100% 99.9963% 90.96% 98.12% 96.14% 98.64% 99.9973% 99.9997% 99.9826% 100% 99.9967% N/R N/R N/R N/R 99.9975% 99.9997% 99.9831% 100% 99.9969% 91.32% 99.87% 97.21% 99.92% 99.9978% 99.9998% 99.9834% 100% 3 4 5 ‘N/R’: Not Reported. with the proposed method, the authors have achieved 99.9972%, 99.9973%, 99.9975%, and 99.9978% for additive noise levels of 10 dB, 20 dB, 30 dB, and cleaned input, respectively. 4.4. The optimal set of KF parameters of the proposed method In the proposed technique, the dominant role of the AEF algorithm is to obtain the optimal set of KF parameters. The 11 L. Janjanam, S.K. Saha, R. Kar et al. ISA Transactions xxx (xxxx) xxx Fig. 7. Convergence profiles of output MSE(dB) values under different noise levels using KF and AEF-KF techniques: (a) Example 1, (b) Example 2, (c) Example 3, (d) Example 4, (e) Example 5. optimal solution (contains the optimal set of KF parameters) obtained after 1000 iterations using AEF algorithm for Example-5 is reported in Table 7. Authors have not reported other optimal solution sets for the rest of the examples due to its large ‘nvar’. this research work, each example is identified by two techniques, such as basic KF and the proposed AEF-KF method. The proposed AEF-KF technique identifies the model in two phases: initially, it obtains the optimal set of KF parameters using AEF algorithm. Finally, it identifies the system (model) using conventional KF with the optimal set of KF parameters obtained in phase 1. The following step by step procedure describes the computational complexity of the adopted methods. 4.5. The computational complexity of the proposed method In this paper, the procedure described in [44,55] is followed for the calculation of time complexity of the proposed method for the identification of Volterra type non-linear Examples 1–5. In Step 1: Consider the following test program [44,55] and evaluate for max_itr number of iterations. The value of max_itr is 1000 12 L. Janjanam, S.K. Saha, R. Kar et al. ISA Transactions xxx (xxxx) xxx Table 7 Optimal KF parameter matrices obtained using AEF algorithm for Example-5. X̂0− φ P0− 2 −1.82*10 −335.18 5.7 1.07*102 9.2 −34.42 14.72 −38.88 159.5 −14.61 75.18 −2.9 Q 1.04 9.2*10−2 −3.6*10−2 1.2*10−2 −2.9*10−2 −4.2*10−2 1.2 0.25 1.2*10−2 6.81 8.6 11.8 R −1.9*103 −44.3 25.20 1.4*102 −14.94 −23.47 −7.0 N/A N/A ‘N/A’: Not Applicable Table 8 Computational complexity for Examples 1-5 for using KF and proposed AEF-KF techniques. Example 1 2 3 4 5 T 1(s) MT 2(s) saturated heat exchanger (LSHE) as presented in [56]. The structure and water heating process of a heat exchanger is described both theoretically and mathematically in [56]. In LSHE, the input variable liquid flow rate is chosen as a control variable, and the rest of the input variables such as inlet liquid temperature and steam temperature are considered as disturbances (kept constant to their nominal values). The outlet liquid temperature of LSHE is considered as an output variable [56]. In this paper, Volterra series given in (1) with fixed order (q = 2) and different memory sizes (N = 5 and 8) is applied individually to identify the LSHE based on its available input and output (I/O) data set which is downloaded from the DAISY database for system identification [58] for performance comparison of Kalman filter (KF), Particle filter (PF), genetic algorithmbased KF (GA-KF), particle swarm optimisation based KF (PSOKF), Artificial bee colony optimisation algorithm based KF (ABCKF) and the proposed AEF-KF methods. Based on the knowledge shared in [43], the authors have performed rigorous experiments to select the control parameters of these techniques. The control parameters selected to obtain the best result are as follows: parameters, namely mutation rate of 0.2 and a crossover rate of 0.5 are used in GA-KF method. For PSO-KF, authors have used constriction factor, cognitive and social parameters values as 0.8, 1.5 and 1.2, respectively. For ABC-KF method, the number of food sources is set at 10. The population size for GA-KF, PSOKF and ABC-KF is set at 20. In [58], total 4000 I/O samples are measured with a sampling period of 1 s is shown in Fig. 8(a) and their normalised I/O data are shown in Fig. 8(b). In this paper, to estimate the coefficients of the model, 3000 normalised I/O data samples are utilised, and the remaining 1000 normalised I/O data are used for validation purpose [58,59]. Fig. 8(c)-(d) show the comparison of the actual and estimated output responses of six algorithms mentioned above for the validation input when N = 5 (21 kernels) and N = 8 (45 kernels), respectively. From these figures, it is noticed that the estimated outputs using these six algorithms appear to merge intimately with the actual output. However, the corresponding optimal fitness percentage (FIT % ) values reported in Table 9 clearly describe that the deviation between the outputs is more when N = 5 for all the six algorithms. It is also observed that the proposed AEF-KF results in the best fitness values (73.45% when N = 5 and 92.28% when N = 8) compared to the other five algorithms. Moreover, when N = 8, the authors have achieved better fitness values compared to N = 5 for all the employed algorithms. Hence, the general perception is that the higher the order of the Volterra series, the better is the identification task. CC KF AEF-KF KF AEF-KF KF AEF-KF 1.214 1.271 1.174 1.283 1.244 117.12 116.45 114.15 119.24 112.78 1.324 1.454 1.321 1.467 1.378 122.21 121.57 119.23 125.98 116.56 46.61 77.54 62.28 77.96 56.77 17.33*102 17.43*102 17.30*102 22.95*102 12.87*102 and 2000 for basic KF and AEF-KF techniques, respectively. Also, assume computational time (CT) taken to run the test program is T 0. for i=1:max_itr x = 0.55 + double ((i); x=x + x; x=x/2; x=x*x; x=sqrt(x); x=log(x); x=exp(x); x=x/(x+2); end Step 2: Evaluate the computational time T 1 for the problem (Example). Step 3: Determine complete CT for the algorithm with the same example and consider it T 2. Step 4: Execute Step 3 for five times and get five T 2 values. Also, determine the mean of these five values MT 2. Step 5: Evaluate computational complexity (CC) using CC MT 2−T 1 . T0 = The achieved CT (T 0) for the basic KF and proposed AEF-KF technique is 0.002362 s and 0.002936 s, respectively. The computational complexity of the Examples 1–5 using KF and proposed AEF-KF techniques are reported in Table 8. From Table 8, it is observed that the values of T 1 and MT 2 are too high for the proposed AEF-KF technique compared to basic KF technique. This is because the AEF algorithm takes more time to get the optimal set of KF parameters. Therefore, CC for AEF-KF technique is higher for each example compared to KF. However, AEF-KF results in an accurate identification with faster convergence (takes less than 20 iterations). Moreover, the presented simulation results have outperformed all other reported results. Example 6: Benchmark system: Liquid saturated heat exchanger The practical applicability of the proposed method is tested on a more significant non-linear benchmark plant, the liquid Table 9 Various performance metrics for Example 6 for validation input using different techniques. Algorithm KF PF GA-KF PSO-KF ABC-KF AEF-KF FIT (%) MSE(%) in dB CT(s) q = 2 and N = 5 q = 2 and N = 8 q = 2 and N = 5 q = 2 and N = 8 q = 2 and N = 5 q = 2 and N = 8 62.46 66.44 68.12 70.52 71.86 73.45 72.23 80.21 83.32 85.68 90.15 92.28 −20.6251 −27.7788 −33.5390 −37.0157 −40.1862 −48.2984 −22.2915 −31.6883 −34.4862 −43.1994 −46.8386 −54.8848 2.73 2.75 461.12 446.54 459.65 457.28 4.54 4.61 734.69 721.31 732.15 729.56 13 L. Janjanam, S.K. Saha, R. Kar et al. ISA Transactions xxx (xxxx) xxx Fig. 8. LSHE identification with q = 2, N = 5 and q = 2, N = 8 using KF, PF, GA-KF, PSO-KF, ABC-KF and the proposed AEF-KF techniques (a) input and output data sets for LSHE, (b) normalised input and output data sets for LSHE, (c) actual and estimated outputs with q = 2, N = 5, (d) actual and estimated outputs with q = 2, N = 8, (e) convergence of output MSE(dB) values with q = 2, N = 5, (f) convergence of output MSE(dB) values with q = 2, N = 8. The convergence of MSE (dB) values with iteration using six algorithms for N = 5 and N = 8 are shown in Fig. 8(e)(f), respectively. The corresponding optimum MSE (dB) values are reported in Table 9, where it is shown that the proposed algorithm results in the best MSE (dB) value for both the cases. The CT is taken to identify the LSHE using six techniques for N = 5 and N = 8 are reported in Table 9. From Table 9, it is observed that the CT is almost double for N = 8 compared to N = 5 because the evolutionary algorithms need to optimise 45 kernels. However, the identification accuracy is more for N = 8. Example 7: Benchmark system: Fluid level control system consisting of cascaded tanks A detailed discussion on the fluid level control system consisting of cascaded tanks has been mentioned in [57]. The same practical model has been considered here for the identification 14 L. Janjanam, S.K. Saha, R. Kar et al. ISA Transactions xxx (xxxx) xxx Fig. 9. Cascaded tanks identification with q = 2, N = 8 using KF, PF, GA-KF, PSO-KF, ABC-KF, and proposed AEF-KF techniques (a) Cascaded tanks experimental setup [57], (b) Input and output data set for cascaded tanks (upper), actual and estimated outputs with q = 2, N = 8 (lower). purpose as well as for the comparison of results obtained by different techniques, namely KF, PF, GA-KF, PSO-KF, ABC-KF and the proposed AEF-KF. The cascaded tank consists of two tanks arranged vertically with free outlets, where the outlet of the higher tank goes into the lower tank. The water is pumped from the reservoir to feed into the higher tank and is controlled by the input signal voltage, (u(n)) from where water flows towards the lower tank. The water level is measured as y(n) (i.e., output), and finally, the water is fed back to the reservoir through a small opening of the lower tank. When too high input signal voltage is applied for a specified duration of time, an overflow (saturation) occurs in the higher tank. Then a part of water goes into the lower tank and rest directly flows into the reservoir. The mathematical expressions describing the state–space modelling of the cascaded tank under no saturation condition is given in [57]. In order to model the cascaded water tanks shown in Fig. 9(a), many researchers have utilised the available input/output data sets provided in [57]. The experimental setup is reported in [57] where Schoukens et al. have generated two data sets of length 1024 samples each for model estimation and validation, respectively. The excitation signal is a random phase multisine [60] with a length of 1024 samples, and the sampling frequency is 0.25 Hz. In [61], Birpoutsoukis et al., have identified the Volterra series coefficients for modelling of the cascaded tanks using those data sets. In this paper, the authors have also used the same input/output data sets [57] for modelling of the cascaded system, as shown in Fig. 9(b) (upper). Since, Volterra series with q = 2, N = 8 results in better identification compared to q = 2, N = 5, so for this example, simulation results are verified only for q = 2, N = 8. The comparison between the actual and the estimated output responses of KF, PF, GA-KF, PSO-KF, ABC-KF and AEF-KF with Volterra model (q = 2, N = 8) is shown in Fig. 9(b) (lower). It is observed from Fig. 9(b) that the estimated output using KF deviates from the actual output. However, the estimated outputs for the rest of the algorithms appear very close to the actual output. The optimal fitness percentage (FIT % ) and MSE (dB) values obtained by using all the algorithms are reported in Table 10. From Table 10, it is evident that the proposed AEF-KF method results in superior performance in terms of FIT (84.27%) and Table 10 Performance comparison of different techniques based on FIT (%), MSE (dB) and CT for Example 7. Algorithm KF PF GA-KF PSO-KF ABC-KF Proposed AEF-KF FIT (%) MSE(dB) CT(s) q = 2 and N = 8 q = 2 and N = 8 q = 2 and N = 8 71.52 76.24 78.24 81.78 83.65 84.27 10.13 4.027 −2.615 −10.00 −13.47 −13.91 4.29 4.32 729.21 711.57 725.16 723.86 MSE (−13.91 dB) compared to KF, PF, GA-KF, PSO-KF and ABC-KF methods, respectively. In addition, the CT values for measurement of lower tank water level for 1024 samples input by using the six algorithms are reported in Table 10. From Table 10, it is observed that CT required for the proposed AEF-KF approach is marginally lower than GA-KF, ABC-KF and is slightly more compared to KF, PF and PSO-KF. However, from the achieved FIT (%) and MSE (dB) reported in Table 10, the proposed AEF-KF results in better identification compared to other algorithms. 5. Conclusions In this paper, an evolutionary optimisation algorithm based Kalman filter (KF) has been implemented to estimate the kernels of Volterra system which exactly match with the actual system. The significant role of the evolutionary algorithm is to obtain the optimal set of KF parameters so that proper tuning problem of KF is solved. To evaluate the performance and robustness of the proposed artificial electric field (AEF) algorithm assisted KF (AEFKF), five distinct numerical Volterra models have been accurately identified under different additive noise input levels (10 dB, 20 dB and 30 dB) in terms of convergence speed, computational time, parameter estimation error, MSE (dB), fitness percentage and percentage improvement. The results are found to outperform those of KF, KS, GA-KS, PSO-KS and ABC-KS. The AEF algorithm with the proper balance of exploration and exploitation phases with the help of iteration dependent Coulomb’s constant serves the significant role to optimise the KF parameters. To validate the fact 15 L. Janjanam, S.K. Saha, R. Kar et al. ISA Transactions xxx (xxxx) xxx that the proposed approach meets the real-time characteristics of practical systems, extensive simulations have been carried out for modelling of non-linear benchmark systems (Liquid saturated heat exchanger and cascaded water tanks) based on real data sets. The benchmark systems identified with second-order Volterra model containing different memory sizes N = 5 and N = 8 using KF, PF, GA-KF, PSO-KF, ABC-KF and AEF-KF methods. It has been established from the results that the proposed AEF-KF method is efficient enough for solving unknown system identification problem as compared to PF and GA, PSO, ABC algorithms assisted KF techniques in terms of MSE (dB), fitness percentage and computational time. The identification efficiency is more when fixed order Volterra model memory size is increased. However, the computational complexity is also increased. This paper applies the proposed approach to the Volterra model only; however, it can be easily extended to other model structures such as FIR, IIR and bilinear polynomial filters. [16] Garcia RV, Pardal PCPM, Kuga HK, Zanardi MC. Non-linear filtering for sequential spacecraft attitude estimation with real data: Cubature Kalman Filter, Unscented Kalman Filter and Extended Kalman Filter. Adv Space Res 2019;63:1038–50. http://dx.doi.org/10.1016/j.asr.2018.10.003. [17] Shen Y, Xiangping Z. State estimation in non-linear systems using sequential evolutionary filter. IEEE Trans Ind Electron 2016;63:3786–94. http://dx.doi.org/10.1109/TIE.2016.2522382. [18] Weng B, Barner KE. Time-varying Volterra system identification using Kalman filtering. In: 40th annual conference on information sciences and systems. 2006, p. 1617–22. http://dx.doi.org/10.1109/CISS.2006.286394. [19] Batselier K, Wong N. Matrix output extension of the tensor network Kalman filter with an application in MIMO Volterra system identification. Automatica 2018;95:413–8. http://dx.doi.org/10.1016/j.automatica. 2018.06.015. [20] Batselier K, Chen Z, Wonga N. A tensor network Kalman filter with an application in recursive MIMO Volterra system identification. Automatica 2017;84:17–25. http://dx.doi.org/10.1016/j.automatica.2017.06.019. [21] Yu F, Mao Z, Yuan P, He D, Jia M. Recursive parameter estimation for hammerstein-wiener systems using modified EKF. ISA Trans 2017;70:104–15. http://dx.doi.org/10.1016/j.isatra.2017.05.012. [22] Mazaheri A, Mansouri M, Shooredeli MA. Parameter estimation of Hammerstein–Wiener ARMAX systems using unscented Kalman filter. In: RSI/ISM international conference on robotics and mechatronics. 2014, p. 298–303. http://dx.doi.org/10.1109/ICRoM.2014.6990917. [23] Mehra R. Approaches to adaptive filtering. IEEE Trans Automat Control 1972;17:693–8. http://dx.doi.org/10.1109/TAC.1972.1100100. [24] Li XR, Bar-Shalom Y. A recursive multiple model approach to noise identification. IEEE Trans Aerosp Electron Syst 1994;30:671–84. http://dx. doi.org/10.1109/7.303738. [25] Mohamed A, Schwarz KP. Adaptive Kalman filtering for INS/GPS. J Geod 1999;73:193–203. http://dx.doi.org/10.1007/s001900050236. [26] Karasalo M. Hu X. An optimisation approach adaptive Kalman filtering. Automatica 2011;47:1785–93. http://dx.doi.org/10.1016/j.automatica.2011. 04.004. [27] Gao X, You D, Katayama S. Seam tracking monitoring based on adaptive Kalman filter embedded Elman neural network during high-power fibre laser welding. IEEE Trans Ind Electron 2012;59:4315–25. http://dx.doi.org/ 10.1109/TIE.2012.2193854. [28] Huang YL, Zhang YG, Li N, Chambers J. A robust Gaussian approximate fixed-interval smoother for non-linear systems with heavy-tailed process and measurement noises. IEEE Signal Process Lett 2016;23:468–72. http: //dx.doi.org/10.1109/LSP.2016.2533543. [29] Huang YL, Zhang YG, Wu ZM, Li N, Chambers J. A novel adaptive Kalman filter with the inaccurate process and measurement noise covariance matrices. IEEE Trans Automat Control 2018;63:594–601. http://dx.doi.org/ 10.1109/TAC.2017.2730480. [30] Huang YL, Zhang YG, Xu B, Wu ZM, Chambers J. A new adaptive extended Kalman filter for cooperative localisation. IEEE Trans Aerosp Electron Syst 2018;54:353–68. http://dx.doi.org/10.1109/TAES.2017.2756763. [31] Xu D, Wu Z, Huang Y. A new adaptive Kalman filter with inaccurate noise statistics. Circuits Systems Signal Process 2019;38:4380–404. http: //dx.doi.org/10.1007/s00034-019-01053-w. [32] Wang J, Zhang C, Jia Q, Li M. Suboptimal adaptive Kalman filtering based on the proportional control of prior error covariance. ISA Trans 2020;100:145–54. http://dx.doi.org/10.1016/j.isatra.2019.12.008. [33] Ananthasayanam MR, Mohan MS, Naik N, Gemson RMO. A heuristic reference recursive recipe for adaptively tuning the Kalman filter statistics part-1: formulation and simulation studies. Sadhana 2016;41:1473–90. http://dx.doi.org/10.1007/s12046-016-0562-z. [34] Mnasri S, Nasri N, Bossche AVD, Val T. Improved many-objective optimisation algorithms for the 3D indoor deployment problem. Arab J Sci Eng 2019;44:3883–904. http://dx.doi.org/10.1007/s13369-018-03712-7. [35] Mnasri S, Nasri N, Bossche AVD, Val T. A new multi-agent particle swarm algorithm based on birds accents for the 3D indoor deployment problem. ISA Trans 2019;9:262–80. http://dx.doi.org/10.1016/j.isatra.2019.01.026. [36] Sabet MT, Fathi AR, Mohammadi Daniali HR. Optimal design of the own ship manoeuvre in the bearing-only target motion analysis problem using a heuristically supervised Extended Kalman Filter. Ocean Eng 2016;123:146–53. http://dx.doi.org/10.1016/j.oceaneng.2016.07.028. [37] Ayala HVH, Coelho LS, Reynoso-Meza G. Heuristic Kalman algorithm for multi-objective optimisation. IFAC Papers Online 2017;50:4460–5. http: //dx.doi.org/10.1016/j.ifacol.2017.08.374. [38] Hashlamon I, Erbatur K. An improved real-time adaptive Kalman filter with recursive noise covariance updated rules. Turk J Electr Eng Comput Sci 2016;24:524–40. http://dx.doi.org/10.3906/elk-1309-60. Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper. References [1] Widrow B, Strearns SD. Adaptive signal processing. 1st ed. Englewood Cliffs, NJ: Prentice-Hall; 1985. [2] Montiel O, Castillo O, Supulveda R, Melin P. Application of breeder genetic algorithm for finite impulse filter optimisation. Inform Sci 2004;161:139–58. http://dx.doi.org/10.1016/j.ins.2003.05.003. [3] Upadhyay P, Kar R, Mandal D, Ghoshal SP. A new design method based on the firefly algorithm for IIR system identification problem. J King Saud Univ Eng Sci 2016;28:174–98. http://dx.doi.org/10.1016/j.jksues.2014.03.001. [4] Kumar M, Rawat TK, Aggarwal A. A Adaptive infinite impulse response system identification using modified-interior search algorithm with Lèvy flight. ISA Trans 2017;32:266–79. http://dx.doi.org/10.1016/j.isatra.2016.10. 018. [5] Mathews VJ. Adaptive polynomial filters. IEEE Signal Process Mag 1991;8:10–26. http://dx.doi.org/10.1109/79.127998. [6] Sekar RC, Murugesan K. System of linear second-order Volterra integrodifferential equations using single term walsh series technique. Appl Math Comput 2016;273:484–92. http://dx.doi.org/10.1016/j.amc.2015.09.092. [7] Chen F, Ding F, Sheng J. Maximum likelihood-based recursive parameter estimation for controlled autoregressive ARMA systems using the data filtering technique. J Franklin Inst B 2015;352:5882–96. http://dx.doi.org/ 10.1016/j.jfranklin.2015.09.021. [8] Hafezi Z, Arefi MM. Recursive generalised extended least squares and RML algorithms for identification of bilinear systems with ARMA noise. ISA Trans 2019;88:50–61. http://dx.doi.org/10.1016/j.isatra.2018.12.015. [9] Li L, Ren X. Identification of non-linear wiener–hammerstein systems by a novel adaptive algorithm based on cost function framework. ISA Trans 2018;80:146–59. http://dx.doi.org/10.1016/j.isatra.2018.07.015. [10] Mete S, Ozer S, Zorlu H. System identification using hammerstein model optimised with differential evolution algorithm. Int J Electron Commun (AEU) 2016;70:1667–75. http://dx.doi.org/10.1016/j.aeue.2016.10.005. [11] Cherif I, Fraiech F. Nonlinear system identification with a real–coded genetic algorithm. Int J Appl Math Comput Sci 2015;25:863–75. http: //dx.doi.org/10.1515/amcs-2015-0062. [12] Assis LSD, Junior JRDP, Fontoura AR, Haddad DB. Efficient Volterra systems identification using hierarchical genetic algorithms. Appl Soft Comput 2019;85:1–12. http://dx.doi.org/10.1016/j.asoc.2019.105745. [13] Lu L, Zhao H, Chen B. Improved-variable-forgetting-factor recursive algorithm based on the logarithmic cost for Volterra system identification. IEEE Trans Circuits Syst 2016;63:588–92. http://dx.doi.org/10.1109/TCSII.2016. 2531159. [14] Brown RG, Hwang PYC. Introduction to random signals and applied kalman filtering: With Matlab exercises. 4th ed. John Wiley and Sons; 2012, p. 141–72, [chapter 4]. [15] Xiao M, Zhang Y, Wang Z, Fu H. An adaptive three-stage extended Kalman filter for non-linear discrete-time system in the presence of unknown inputs. ISA Trans 2018;75:101–17. http://dx.doi.org/10.1016/j.isatra.2018. 02.007. 16 L. Janjanam, S.K. Saha, R. Kar et al. ISA Transactions xxx (xxxx) xxx [50] Nayak C, Saha SK, Kar R, Mandal D. An efficient and robust digital fractional-order differentiator based ECG pre-processor design for QRS detection. IEEE Trans Biomed Circuits Syst 2019;13:682–96. http://dx.doi. org/10.1109/TBCAS.2019.2916676. [51] Yang X, Yin S. Variational Bayesian inference for FIR models with randomly missing measurements. IEEE Trans Ind Electron 2017;64:4217–25. http: //dx.doi.org/10.1109/TIE.2016.2562608. [52] Yang X, Yin S, Kaynak O. Robust identification of LPV time-delay system with randomly missing measurements. IEEE Trans Syst Man Cybern Syst 2018;14:2198–208. http://dx.doi.org/10.1109/TSMC.2017.2689920. [53] Yang X, Liu X, Yin S. Robust identification of non-linear systems with missing observations: the case of state-space model structure. IEEE Trans Ind Inf 2019;15:2763–74. http://dx.doi.org/10.1109/TII.2018.2871194. [54] Yang X, Liu X, Li Z. Multimodel approach to robust identification of multiple-input single-output non-linear time-delay systems. IEEE Trans Ind Inf 2020;16:2413–22. http://dx.doi.org/10.1109/TII.2019.2933030. [55] Liang J, Qu B, Suganthan P, Chen Q. Problem definitions and evaluation criteria for the CEC 2015 competition on learning-based real-parameter single-objective optimisation. Technical report 201411A, Computational Intelligence Laboratory, Zhengzhou University, Zhengzhou China and Technical Report, Singapore: Nanyang Technological University; 2014. [56] Bittanti S, Piroddi L. Nonlinear identification and control of a heat exchanger: a neural network approach. J Franklin Inst 1997;334:135–53. http://dx.doi.org/10.1016/S0016-0032(96)00059-2. [57] Schoukens M, Mattson P, Wigren T, Noël JP. Cascaded tanks benchmark combining soft and hard nonlinearities. In: Workshop on nonlinear system identification benchmarks, Brussels. 2016, URLs: http://homepages.vub.ac. be/mschouke/benchmark, http://www.nonlinearbenchmark.org/#Tanks. [58] De Moor B. Database for identification of systems. KU. Leuven: Department of Electrical Engineering; 2004, [Online]. Available from: http://homes.esat. kuleuven.be/~smc/~daisy/. [Accessed 20 Jun 2004]. [59] Sravan Kumar G. Metaheuristic algorithms for the identification of non-linear systems and multivariable PID controller tuning [Ph.D. thesis]. [60] Pintelon R, Schoukens J. System identification: A frequency domain approach. 2nd ed. New Jersey: Wiley-IEEE Press; 2012. [61] Birpoutsoukis G, Csurcsia PZ, Schoukens J. Efficient multidimensional regularisation for Volterra series estimation. J Mech Syst Signal Process 2017;104:896–914. http://dx.doi.org/10.1016/j.ymssp.2017.10.007. [39] Muruganantham A, Tan KC, Vadakkepat P. Evolutionary dynamic multiobjective optimisation via Kalman filter prediction. IEEE Trans Cybern 2016;46:2862–73. http://dx.doi.org/10.1109/TCYB.2015.2490738. [40] Zerdali E, Barut M. The comparisons of optimised extended Kalman filters for speed-sensor less control of induction motors. IEEE Trans Ind Electron 2017;64:4340–51. http://dx.doi.org/10.1109/TIE.2017.2674579. [41] Ahmed M, Armstrong M, Gadoue S, Al-Greer M, Missailidis P. Real-time parameter estimation of DC-DC converters using a self-tuned Kalman filter. IEEE Trans Power Electron 2017;32:5666–74. http://dx.doi.org/10. 1109/TPEL.2016.2606417. [42] Kim T, Adhikaree A, Pandey R. An onboard model-based condition monitoring for lithium-ion batteries. IEEE Trans Ind Appl 2019;55:1835–43. http://dx.doi.org/10.1109/TIA.2018.2881183. [43] Yazid E, Liew MS, Parman S, Kurian VJ. Improving the modelling capacity of Volterra model using evolutionary computing methods based on Kalman smoother adaptive filter. Appl Soft Comput 2015;35:695–707. http://dx. doi.org/10.1016/j.asoc.2015.05.046. [44] Anita Yadav A. Artificial electric field algorithm for global optimisation. Swarm Evol Comput 2019;48:93–108. http://dx.doi.org/10.1016/j.swevo. 2019.03.013. [45] Weng B, Barner KE. Non-linear system identification in impulsive environments. IEEE Trans Signal Process 2005;53:2588–94. http://dx.doi.org/ 10.1109/TSP.2005.849213. [46] Sayadi M, Chaari A, Fnaiech F, Najim M. A fast M-D chandrasekhar algorithm for second-order Volterra adaptive filtering. In: International Conference on Acoustic Speech Signal Processing (ICASSP), Atlanta. 1996, p. 1339–42. http://dx.doi.org/10.1109/ICASSP.1996.543674. [47] Lu L, Zhao H. Adaptive Volterra filter with continuous LP-norm using a logarithmic cost for non-linear active noise control. J Sound Vib 2016;364:14–29. http://dx.doi.org/10.1016/j.jsv.2015.11.029. [48] Tarvainen MP, Hiltunen JK, Ranta-aho PO, Karjalainen PA. Estimation of non-stationary EEG with Kalman smoother approach: an application to event-related synchronisation (ERS). IEEE Trans Biomed Eng 2004;51:516–24. http://dx.doi.org/10.1109/TBME.2003.821029. [49] Shyam MM, Naik Naren, Gemson RMO, Ananthasayanam MR. Introduction to the Kalman filter and tuning its statistics for near-optimal estimates and Cramer Rao bound. TR/EE2015/401, IIT Kanpur. 2015, http://arxiv.org/ abs/1503.04313. 17