Second Order Extended Ensemble Filter for Non-linear Filtering

https://doi.org/10.51867/ajernet.mathematics.5.4.25

Authors

Keywords:

Estimate, Kalman Filter, Non-Linear, Non-Linear Filtering, Second Order Extended Ensemble Kalman Filter

Abstract

Whenever the state of a system must be estimated from noisy information, a state estimator is employed to fuse the data with the model to produce an accurate estimate of the state. When the system dynamics and observation models are linear, the Kalman Filter which is optimal, is used. However, in most applications of interest the system dynamics and observations equations are not- linear and suitable extensions of the Kalman Filter have been developed; for example, the Extended Kalman Filter(EKF). The Extended Kalman Filter is based on linearization by the Taylor series expansion about the mean of the state. This filtering process is however computationally expensive especially in high dimensional data. The cause for this is the high cost of integrating the equation of evolution of covariances. Due to this complexity in integration, new methods were sought known as the particle filters. It replaces linearization of non-linearities with Monte Carlo methods. The particle filter formed a basis for Ensemble Kalman Filter (EnKF) an extension of Kalman filter to non-linear filtering. The EnKF reduced the computational cost but its innovation process does not capture information sufficiently hence there is need to improve its performance. This study has developed a new filter, Second order Extended Ensemble Filter (SoEEF).We derived it from stochastic state models by expansion of expected values to the second order by use of Taylor series together with Monte Carlo method and Matlab. We used Lorenz 63 system of ordinary equations and differential Matlab to test the performance of the new filter. Then we compared its performance with four other filters like Bootstrap Particle Filter (BPF), First order Kalman Bucy Filter (FoEKBF),Second order Kalman Bucy Filter (SoKBF) and First order Extended Ensemble Filter (FoEEF). SoEEKF performs much better than the other four filters.

Dimensions

Angwenyi, D. (2019). Time-continuous state and parameter estimation with application to SPDEs (Doctoral dissertation, PhD Thesis, Institute Fur Mathematik AG Numerische Mathematik, University of Potsdam).

Armstrong, J., Brigo, D., & Hanzon, B. (2024). Optimal projection filters with information geometry. Information Geometry, 7(Suppl 1), 525-540. https://doi.org/10.1007/s41884-023-00108-x DOI: https://doi.org/10.1007/s41884-023-00108-x

Baltieri, M., & Buckley, C. L. (2020). On Kalman-Bucy filters, linear quadratic control and active inference. arXiv preprint arXiv:2005.06269.

Bass, R. W., Norum, V. D., & Schwartz, L. (2012). Optimal multichannel nonlinear filtering. Journal of Mathematical Analysis and Applications, 16(1), 152-164. https://doi.org/10.1016/0022-247X(66)90193-4 DOI: https://doi.org/10.1016/0022-247X(66)90193-4

Bergemann, K., & Reich, S. (2012). An ensemble Kalman-Bucy filter for continuous data assimilation. Meteorologische Zeitschrift, 21(3), 213. https://doi.org/10.1127/0941-2948/2012/0307 DOI: https://doi.org/10.1127/0941-2948/2012/0307

Crisan, D. (2014). The stochastic filtering problem: A brief historical account. Journal of Applied Probability, 51(A), 13-22. https://doi.org/10.1239/jap/1417528463 DOI: https://doi.org/10.1239/jap/1417528463

De Wiljes, J., Reich, S., & Stannat, W. (2018). Long-time stability and accuracy of the ensemble Kalman-Bucy filter for fully observed processes and small measurement noise. SIAM Journal on Applied Dynamical Systems, 17(2), 1152-1181. https://doi.org/10.1137/17M1119056 DOI: https://doi.org/10.1137/17M1119056

Doucet, A. (2001). Sequential Monte Carlo methods in practice. https://doi.org/10.1007/978-1-4757-3437-9 DOI: https://doi.org/10.1007/978-1-4757-3437-9

Dridi, N., Drumetz, L., & Fablet, R. (2021, August). Learning stochastic dynamical systems with neural networks mimicking the Euler-Maruyama scheme. In 2021 29th European Signal Processing Conference (EUSIPCO) (pp. 1990-1994). IEEE. https://doi.org/10.23919/EUSIPCO54536.2021.9616068 DOI: https://doi.org/10.23919/EUSIPCO54536.2021.9616068

Ertel, S. W., & Stannat, W. (2024). Analysis of the ensemble Kalman-Bucy filter for correlated observation noise. The Annals of Applied Probability, 34(1B), 1072-1107. https://doi.org/10.1214/23-AAP1985 DOI: https://doi.org/10.1214/23-AAP1985

Fontenele Magalhães, J. A., Emzir, M. F., & Corona, F. (2023). Approximations to the solution of the Kushner-Stratonovich equation for the stochastic chemostat. bioRxiv, 2023(01). https://doi.org/10.1101/2023.01.17.524503 DOI: https://doi.org/10.1101/2023.01.17.524503

Hornik, G., & Pavliotis, A. (2015). Stochastic processes and applications. Imperial College London.

Jazwinski, A. H. (2007). Stochastic processes and filtering theory. Courier Corporation.

Kalman, R. E., & Bucy, R. S. (1961). New results in linear filtering and prediction theory. Journal of Basic Engineering, 83 (1), 95-108.https://doi.org/10.1115/1.3658902 DOI: https://doi.org/10.1115/1.3658902

Lee, S., Ko, H., & Oh, S. (Eds.). (2018). Multisensor fusion and integration in the wake of big data, deep learning, and cyber physical system: An edition of the selected papers from the 2017 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI 2017) (Vol. 501). Springer. https://doi.org/10.1007/978-3-319-90509-9 DOI: https://doi.org/10.1007/978-3-319-90509-9

Lewis, F. L., Xie, L., & Popa, D. (2017). Optimal and robust estimation: With an introduction to stochastic control theory. CRC Press. https://doi.org/10.1201/9781315221656 DOI: https://doi.org/10.1201/9781315221656

Lorenz, E. N. (1963). Deterministic nonperiodic flow. Journal of Atmospheric Sciences, 20(2), 130-141. https://doi.org/10.1175/1520-0469(1963)020<0130 DOI: https://doi.org/10.1175/1520-0469(1963)020<0130:DNF>2.0.CO;2

Rajawat, R. S., Singh, K. K., & Mishra, V. N. (2024). Approximation by modified Bernstein polynomials based on real parameters. Mathematical Foundations of Computing, 7(3), 297-309. https://doi.org/10.3934/mfc.2023005 DOI: https://doi.org/10.3934/mfc.2023005

Reich, S., & Cotter, C. (2015). Probabilistic forecasting and Bayesian data assimilation. Cambridge University Press. https://doi.org/10.1017/CBO9781107706804 DOI: https://doi.org/10.1017/CBO9781107706804

Sparre, P. (1982). The Lorenz equations: Bifurcations, chaos, and strange attractors. Springer-Verlag. https://doi.org/10.1007/978-1-4612-5767-7 DOI: https://doi.org/10.1007/978-1-4612-5767-7

Published

2024-10-25

How to Cite

Midenyo, K., Angwenyi, D., & Oganga, D. (2024). Second Order Extended Ensemble Filter for Non-linear Filtering. African Journal of Empirical Research, 5(4), 302–316. https://doi.org/10.51867/ajernet.mathematics.5.4.25