Trend detection in time series of measurement data in solving problems in space geodynamics and other research areas

Igor V. Bezmenov; Igor V. Bezmenov

doi:10.3934/mina.2024012

Metascience in Aerospace

2024, Volume 1, Issue 3: 268-291. doi: 10.3934/mina.2024012

Previous Article Next Article

Research article Special Issues

Trend detection in time series of measurement data in solving problems in space geodynamics and other research areas

Igor V. Bezmenov ^,

Russian Metrological Institute of Technical Physics and Radio Engineering, Mendeleevo, Moscow Region, Russia

Received: 05 June 2024 Revised: 24 July 2024 Accepted: 13 August 2024 Published: 28 August 2024

This article discusses the problem of trend detection in time series generated by technical devices. The solution to this problem is closely related to the problem of detecting coarse measurements (outliers), which negatively impact the accuracy of estimates of various physical quantities. These are crucial in many applications in various scientific fields in which the input data are observations, such as space geodynamics, geodesy, and others. Previously, the author proposed a trend-detecting method based on the condition of maximizing the amount of data cleared of outliers and used in further processing. The reference values used for trend construction are determined as a result of a completely convergent iterative process, the core of which is the minimizing sets (MS) method developed earlier by the author. At each step of the iterative process, the trend is approximated by a function from a predefined functional class depending on the physical problem under consideration. The method was tested on trend-detection problems in the power polynomial class. In this article, the set of functions when searching for a trend by the MS method was extended into two additional functional classes: trigonometric functions with a given set of frequencies and harmonic functions with unknown frequencies, phases, and amplitudes. In the latter case, the trend-forming functions are nonlinearly dependent on the sought parameters; their search was carried out by the conjugate gradients method generalized to nonlinear problems. The article considered test tasks on trend search in data obtained by computer simulation.
- information and measuring systems,
- time series,
- data preprocessing,
- outliers,
- data clearing of outliers,
- optimal solution,
- trend detection
Citation: Igor V. Bezmenov. Trend detection in time series of measurement data in solving problems in space geodynamics and other research areas[J]. Metascience in Aerospace, 2024, 1(3): 268-291. doi: 10.3934/mina.2024012

Related Papers:

Abstract

This article discusses the problem of trend detection in time series generated by technical devices. The solution to this problem is closely related to the problem of detecting coarse measurements (outliers), which negatively impact the accuracy of estimates of various physical quantities. These are crucial in many applications in various scientific fields in which the input data are observations, such as space geodynamics, geodesy, and others. Previously, the author proposed a trend-detecting method based on the condition of maximizing the amount of data cleared of outliers and used in further processing. The reference values used for trend construction are determined as a result of a completely convergent iterative process, the core of which is the minimizing sets (MS) method developed earlier by the author. At each step of the iterative process, the trend is approximated by a function from a predefined functional class depending on the physical problem under consideration. The method was tested on trend-detection problems in the power polynomial class. In this article, the set of functions when searching for a trend by the MS method was extended into two additional functional classes: trigonometric functions with a given set of frequencies and harmonic functions with unknown frequencies, phases, and amplitudes. In the latter case, the trend-forming functions are nonlinearly dependent on the sought parameters; their search was carried out by the conjugate gradients method generalized to nonlinear problems. The article considered test tasks on trend search in data obtained by computer simulation.

References

[1]	Dach R, Beutler G, Hugentobler U, et al. (2003) Time transfer using GPS carrier phase: error propagation and results. J Geodesy 77: 1–14. https://doi.org/10.1007/s00190-002-0296-z doi: 10.1007/s00190-002-0296-z
[2]	Donchenko SI, Blinov IY, Norets IB, et al. (2020) Characteristics of the Long-Term Instability of the New-Generation Hydrogen Frequency and Time Standards. Meas Tech 63: 34–37. https://doi.org/10.1007/s11018-020-01746-8 doi: 10.1007/s11018-020-01746-8
[3]	Dach R, Lutz S, Walser P, et al. (2015) Bernese GNSS Software Version 5.2. Bern: Astronomical Institute, University of Bern, Bern Open Publishing, 852. https://doi.org/10.7892/boris.72297
[4]	Pasynok SL (2020) Increase in the Determination Accuracy of the Earth's Rotation Parameters by Combining the Results of Various Types of Measurements in the Main Metrological Center of the State Service of Time, Frequency, and Earth's Rotation Parameters Evaluation. Meas Tech 63: 38–44. https://doi.org/10.1007/s11018-020-01747-7 doi: 10.1007/s11018-020-01747-7
[5]	Zharov VE, Pasynok SL (2021) SAI-VNF VLBI Analysis Center in 2019–2020. International VLBI Service for Geodesy and Astrometry 2019+2020 Biennial Report, Behrend D, Armstrong K.L., Baver K.D. NASA/TP-20210021389,258–259. Availabl from: https://ivscc.gsfc.nasa.gov/publications/br2019+2020/acsai-vniiftri.pdf.
[6]	Ghaderpour E (2020) Least-squares Wavelet and Cross-wavelet Analyses of VLBI Baseline Length and Temperature Time Series: Fortaleza Hartebeesthoek Westford Wettzell. PASP 133: 014502. https://doi.org/10.1088/1538-3873/abcc4e doi: 10.1088/1538-3873/abcc4e
[7]	Global Geodetic Observing System (GGOS) (2015) GGOS Requirements for Core Sites (Revision 2). Draft 3.4. Availabl from: https://cddis.nasa.gov/docs/2015/SiteRecDoc_Rev2_D3.4.pdf.
[8]	International GNSS Service. available from: http://www.igs.org/network.
[9]	Schubert E, Weiler M, Zimek A (2015) Outlier detection and trend detection: two sides of the same coin. 2015 IEEE International Conference on Data Mining Workshop (ICDMW). Proceedings, Atlantic City, NJ, USA, 40–46. https://doi.org/10.1109/ICDMW.2015.79
[10]	Barnett V, Lewis T (1994) Outliers in Statistical Data. Chichester, UK: John Wiley & Sons, XVⅡ, 582.
[11]	Blázquez-García A, Conde A, Mori U, et al. (2021) A review on outlier/anomaly detection in time series data. Acm Comput Surv 54: 1–33. https://doi.org/10.1145/3444690 doi: 10.1145/3444690
[12]	Arthur E (1970) Hoerl and Robert W. Kennard. Ridge Regression: Biased Estimation for Nonorthogonal Problems. Technometrics 12: 55–67.
[13]	Hastie T, Tibshirani R, Friedman J (2009) The Elements of Statistical Learning: Data Mining, Inference, and Prediction. Second Edition, Springer, Corr. 7th printing 2013 edition.
[14]	Hu Z, Zhang L, Lin Z, et al. (2021) Prevalence and risk factors for bone loss in rheumatoid arthritis patients from South China: Modeled by three methods. BMC Musculoskelet Dis 22: 534. https://doi.org/10.1186/s12891-021-04403-5 doi: 10.1186/s12891-021-04403-5
[15]	Vaniček P (1969) Approximate spectral analysis by least-squares fit. Astrophys Space Sci 4: 387–391. https://doi.org/10.1007/BF00651344 doi: 10.1007/BF00651344
[16]	Ghaderpour E, Liao W, Lamoureux MP (2018) Antileakage least-squares spectral analysis for seismic data regularization and random noise attenuation. Geophysics 83: V157–V170. https://doi.org/10.1190/geo2017-0284.1 doi: 10.1190/geo2017-0284.1
[17]	Ghaderpour E (2019) Multichannel antileakage least-squares spectral analysis for seismic data regularization beyond aliasing. Acta Geophys 67: 1349–1363. https://doi.org/10.1007/s11600-019-00320-3 doi: 10.1007/s11600-019-00320-3
[18]	Ghaderpour E, Liao W, Lamoureux MP (2018) Antileakage least-squares spectral analysis for seismic data regularization and random noise attenuation. Geophysics 83: V157–V170. https://doi.org/10.1190/geo2017-0284.1 doi: 10.1190/geo2017-0284.1
[19]	Erten E, Reigber A, Hellwich O (2010) Generation of Three-Dimensional Deformation Maps from InSAR Data Using Spectral Diversity Techniques. ISPRS J Photogramm Remote Sens 65: 388–394. https://doi.org/10.1016/j.isprsjprs.2010.04.005 doi: 10.1016/j.isprsjprs.2010.04.005
[20]	Bernardi MS, Africa PC, de Falco C, et al. (2021) On the Use of Interferometric Synthetic Aperture Radar Data for Monitoring and Forecasting Natural Hazards. Math Geosci 53: 1781–1812. https://doi.org/10.1007/s11004-021-09948-8 doi: 10.1007/s11004-021-09948-8
[21]	Ma P, Zheng Y, Zhang Z, et al. (2022) Building Risk Monitoring and Prediction Using Integrated Multi-Temporal InSAR and Numerical Modeling Techniques. Int J Appl Earth Obs Geoinf 114: 103076. https://doi.org/10.1016/j.jag.2022.103076 doi: 10.1016/j.jag.2022.103076
[22]	Venmans AAM, op de Kelder M, de Jong J, et al. (2020) Reliability of InSAR Satellite Monitoring of Buildings near Inner City Quay Walls. Proc IAHS 382: 195–199. https://doi.org/10.5194/piahs-382-195-2020 doi: 10.5194/piahs-382-195-2020
[23]	Li M, Wu H, Yang M, et al. (2023) Trend Classification of InSAR Displacement Time Series Using SAE–CNN. Remote Sens 16: 54. https://doi.org/10.3390/rs16010054 doi: 10.3390/rs16010054
[24]	Zhou C, Gong H, Chen B, et al. (2017) InSAR Time-Series Analysis of Land Subsidence under Different Land Use Types in the Eastern Beijing Plain, China. Remote Sens 9: 380. https://doi.org/10.3390/rs9040380 doi: 10.3390/rs9040380
[25]	Kermarrec G, Maddanu F, Klos A, et al. (2024) Modeling trends and periodic components in geodetic time series: a unified approach. J Geodesy 98: 17. https://doi.org/10.1007/s00190-024-01826-5 doi: 10.1007/s00190-024-01826-5
[26]	Chang KL, Schultz MG, Lan X, et al. (2021) Trend detection of atmospheric time series: incorporating appropriate uncertainty estimates and handling extreme events. Elem Sci Anth 9: 00035. https://doi.org/10.1525/elementa.2021.00035 doi: 10.1525/elementa.2021.00035
[27]	Melek WW, Lu Z, Kapps A, et al. (2005) Comparison of trend detection algorithms in the analysis of physiological time-series data. Ieee T Bio Med Eng 52: 639–651. https://doi.org/10.1109/TBME.2005.844029. doi: 10.1109/TBME.2005.844029
[28]	Mredula MS, Dey N, Rahman MS, et al. (2022) A review on the trends in event detection by analyzing social media platforms' data. Sensors 22: 4531. https://doi.org/10.3390/s22124531 doi: 10.3390/s22124531
[29]	Bezmenov IV, Naumov AV, Pasynok SL (2018) An Effective Algorithm for Elimination of Outliers from Data Measurements of Global Navigation Satellite Systems. Meas Tech 61: 878–884. https://doi.org/10.1007/s11018-018-1518-y doi: 10.1007/s11018-018-1518-y
[30]	Bezmenov IV (2023) Method of Cleaning Outliers from Measurement Data: Search for the Optimal Solution with the Minimum Number of Rejected Measured Data. Meas Tech 66: 14–23. https://doi.org/10.1007/s11018-023-02184-y doi: 10.1007/s11018-023-02184-y
[31]	Bezmenov IV (2024) Fast algorithm for cleaning highly noisy measurement data from outliers, based on the search for the optimal solution with the minimum number of rejected measurement data. Metascience Aerosp 1: 110–129. https://doi.org/10.3934/mina.2024005 doi: 10.3934/mina.2024005
[32]	Bezmenov IV (2021) Effective algorithms for detection outliers and cycle slip repair in GNSS data measurements. Satellite Systems Design, Modeling, Simulation and Analysis, ed. T.M. Nguyen. London, UK: IntechOpen, 177–209. https://doi.org/10.5772/intechopen.92658.
[33]	Ignatenko I Yu (2020) Mendeleevo, Russia. In: Section 8 ILRS Network of International Laser Ranging Service (ILRS) 2016–2019 Report. Noll C. and Pearlman M. (eds.) 8–68. NASA/TP-20205008530, NASA Goddard Space Flight Center, Greenbelt, MD, USA.
[34]	Katajainen J, Träff JL (1997) A meticulous analysis of mergesort programs, Algorithms and Complexity, Bongiovanni G., Bovet D.P., Di Battista G. (eds); CIAC. Berlin; Heidelberg: Springer, 217–228.
[35]	Bezmenov IV, Drozdov AE, Pasynok SL (2022) A Strategy for Finding Outliers in Noisy Data Series Including an Unknown Trend. Meas Tech 65: 339–345. https://doi.org/10.1007/s11018-022-02085-6 doi: 10.1007/s11018-022-02085-6

Reader Comments

Your name:*

Email:*
© 2024 the Author(s), licensee AIMS Press. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0)