METADATA IN ENGLISH
About the journal
NAUKA I TEKHNOLOGICHESKIE RAZRABOTKI (SCIENCE AND TECHNOLOGICAL DEVELOPMENTS), ISSN: 2079-5165, eISSN: 2410-7948, DOI: 10.21455/std; https://elibrary.ru/title_about.asp?id=32295; http://std.ifz.ru/. The journal was founded in 1992.
COMPREHENSIVE
METHODOLOGY FOR DESCRIBING
AND FILTERING EXOGENOUS EFFECTS IN
MONITORING DATA, TAKING INTO ACCOUNT THE TYPE OF OBSERVATIONS
AND
EXPERIMENTAL DATA DEFECTS
A.V. Desherevskii, A.Ya. Sidorin, E.A. Fattakhov
Schmidt Institute of Physics of the Earth of the Russian Academy of Sciences, Moscow, Russia
Corresponding author: A.Ya. Sidorin, e-mail: al_sidorin@hotmail.com
Highlights
– A comprehensive methodology for filtering exogenous effects in monitoring data is developed
– Algorithms are implemented as open access software
– The methodology is necessary when processing real monitoring data
Abstract. A comprehensive methodology has been developed for high-quality preparation of long-term monitoring data for their processing and analysis. It is shown that the application of this methodology is a necessary step in the processing of any long-term monitoring data in real conditions. The practical significance of the development is significantly enhanced by the fact that the algorithms of the methodology are implemented as a software product that is available for wide use. As an experimental basis for the development, we used the data of geoelectric monitoring by the VES method with the possibility of tracking variations in the electrical resistivity at different depths, as well as the results of operational downhole resistivity measurements, electromagnetic, geoacoustic and inclinomeric observations. Two models are proposed for describing seasonal variations in the electrical resistivity of rocks in a well in the bypass filtration zone of the Chirkey Hydropower Dam in Dagestan: a model of average seasonal functions, which assumes strict constancy of the seasonal course in different years, and an adaptive model that allows changing the amplitude of seasonal effects from year to year. Time series of data are constructed filtered out from seasonal changes. A comprehensive methodology for describing and filtering seasonal effects in monitoring data has also been successfully applied to analyze observational data by other geophysical methods, in particular with inclinometric, geoacoustic and electromagnetic monitoring in different regions of the country. It is concluded that for an accurate assessment of the seasonal course, special data preparation is necessary, taking into account the features of the series.
Keywords: geophysical monitoring, exogenous effects, experimental data defects, filtration
Cite this article as: Desherevskii A.V., Sidorin A.Ya., Fattakhov E.A. Comprehensive methodology for describing and filtering exogenous effects in monitoring data, taking into account the type of observations and experimental data defects, Nauka i Tekhnologicheskie Razrabotki (Science and Technological Developments), 2019, vol. 98, no. 2, pp. 25–60. [Special issue “Methodological problems of geoacoustic and geoelectric studies”]. [in Russian]. https://doi.org/10.21455/std2019.2-2
Abdulaev, Sh.S.O., Aliev, M.M., Idarmachev, Sh.G., Some results of the study of rock deformation by the “Georesistor” station, Vestnik Dagestanskogo nauchnogo tsentra RAN (Herald of Daghestan Scientific Center of the Russian Academy of Sciences), 2008, no. 30, pp. 16–21. [in Russian].
Abramenkova, I.V., Kruglov, V.V., Methods for recovering gaps in data arrays, Programmnye produkty i sistemy (Software & Systems), 2005, no. 2, pp. 18–22. [in Russian].
Aleshin, I.M., Ivanov, S.D., Koryagin, V.N., Kuzmin, Yu.O., Perederin, F.V., Shirokov, I.A., Fattakhov, E.A., Online publication of tiltmeter data based on the SeedLink protocol, Seismic Instruments, 2018, vol. 54, pp. 254–259, https://doi.org/10.3103/S0747923918030027
Aliev, I.A., Idarmachev, Sh.G., Aliev, M.M., Saidov, O.A., Magomedov, A.G., Idarmachev, A.Sh. Comprehensive analysis of geophysical and geochemical research data in the seismically active region of Dagestan, Trudy Instituta geologii Dagestanskogo nauchnogo tsentra RAN (Proceedings of the Institute of Geology, Dagestan Scientific Center of the Russian Academy of Sciences), 2011, no. 57, pp. 283–286. [in Russian].
Descherevskii, A.V., Sidorin, A.Ya., Nekotorye voprosy metodiki otsenki srednesezonnykh funktsii dlya geofizicheskikh dannykh (Some problems of the methodology for estimating seasonal functions for geophysical data), Moscow: OIFZ RAS, 1999. 40 p. ISBN: 5-201-926-3
Descherevskii, A.V., Sidorin, A.Ya., Two models of seasonal variations in geophysical fields, Izvestiya, Physics of the Solid Earth, 2000, vol. 36, no. 6, pp. 449–459.
Desherevskii, A.V., Sidorin, A.Ya., Optimization of calculation algorithm of electrical resistivity temporal variations by the VES monitoring data for increasing accuracy and reliability of results, Nauka i Tekhnologicheskie Razrabotki (Science and Technological Developments), 2019, vol. 98, no. 1, pp. 35–56. [Special issue “Methodological aspects of the application of electromagnetic methods in geophysical research”]. [in Russian]. https://doi.org/10.21455/std2019.1-3
Deshcherevskii, A.V., Zhuravlev, V.I., Nikolsky, A.N., Sidorin, A.Ya., ABD software package: Universal tool for analysis of monitoring data, Nauka i tekhnologicheskie razrabotki (Science and Technological Developments), 2016, vol. 95, no. 4, pp. 35–48. [in Russian]. https://doi.org/10.21455/std2016.4-6
Deshcherevskii, A.V., Zhuravlev, V.I., Nikolsky, A.N., Sidorin, A.Ya., Technologies for analyzing geophysical time series: Part 1. Software requirements, Seismic Instruments, 2017a, vol. 53, no. 1, pp. 46–59. https://doi.org/10.3103/S0747923917010030
Deshcherevskii, A.V., Zhuravlev, V.I., Nikolsky, A.N., Sidorin, A.Ya., Technologies for analyzing geophysical time series: Part 2. WinABD – A software package for maintaining and analyzing geophysical monitoring data, Seismic Instruments, 2017b, vol. 53, no. 3, pp. 203–223, https://doi.org/10.3103/S0747923917030021
Deshcherevskii, A.V., Zhuravlev, V.I., Nikolsky, A.N., Sidorin, A.Ya., Problems in analyzing time series with gaps and their solution with the WinABD software package, Izvestiya, Atmospheric and Oceanic Physics, 2017c, vol. 53, no. 7, pp. 659–678, https://doi.org/10.1134/S0001433817070027
Deshcherevskii, A.V., Zhuravlev, V.I., Nikolsky, A.N., Sidorin, A.Ya., Analysis of rhythms in experimental signals, Izvestiya, Atmospheric and Oceanic Physics, 2017d, vol. 53, pp. 847–858, https://doi.org/10.1134/S0001433817080035
Deshcherevskii, A.V., Modin, I.N., Sidorin, A.Ya., Constructing the optimal model of the geoelectric section using vertical electrical sounding data: Case study of the central part of the Garm research area, Izvestiya, Atmospheric and Oceanic Physics, 2018a, vol. 54, no. 10, pp. 1490–1511, https://doi.org/10.1134/S0001433818100031
Deshcherevskii, A.V., Modin, I.N., Sidorin, A.Ya., Method for constructing a model of a geoelectric section taking into account seasonal variations based on data from long-term vertical electric sounding monitoring in search of earthquake precursors, Seismic Instruments, 2018b, vol. 54, no. 4, pp. 424–436, https://doi.org/10.3103/S0747923918040023
Deshcherevskii, A.V., Modin, I.N., Sidorin, A.Ya., Seasonal variations in specific resistivity in the upper layers of the Earth crust, Seismic Instruments, 2019, vol. 55, pp. 300–312, https://doi.org/10.3103/S0747923919030058
Deshcherevskii, A.V., Idarmachev, Sh.G., Marchenko, M.N., Evaluation of seasonal variation appearing resistivity of rocks in a well on a Chirkey HPP dam with level shifts and interruptions in observation range, Trudy Instituta geologii Dagestanskogo nauchnogo tsentra RAN (Proceedings of the Institute of Geology, Dagestan Scientific Center of the Russian Academy of Sciences), 2019, iss. 78. [in Russian].
Fattakhov, E.A., Spectral-temporal analysis of laser rangefinder observations on the Kamchatka and Ashgabad geodynamic test sites, Vestnik SGUGiT (Vestnik of the Siberian State University of Geosystems and Technologies (SSUGT)), 2017, vol. 22, no. 4, pp. 5–17. [in Russian].
Gavrilov, V., Bogomolov, L., Morozova, Yu., Storcheus, A., Variations in geoacoustic emissions in a deep borehole and its correlation with seismicity, Ann. Geophys., 2008, vol. 51, no. 5/6, pp. 737–753.
Gavrilov, V.A., Panteleev, I.A., Ryabinin, G.V., Morozova, Yu.V., Modulating impact of electromagnetic radiation on geoacoustic emission of rocks, Russ. J. Earth Sci., 2013, vol. 13, https://doi.org/10.2205/2013ES000527
Gavrilov, V.A., The impact of variable electromagnetic fields on geoacoustic processes (empirical laws and physical mechanisms). Autoref. of Sc.D. Diss. (Phys. & Math.), Schmidt Institute of Physics of the Earth of the Russian Academy of Sciences, 2017.
Gavrilov, V.A., Desherevskii, A.V., Poltavtseva, E.V., Sidorin, A.Ya., Seasonal Technologies of preliminary data processing for multidisciplinary geophysical monitoring and a case study of their application in the Kamchatka geoacoustic observation system, Seismic Instruments, 2017, vol. 53, pp. 296–308, https://doi.org/10.3103/S0747923917040053
Grachev, A.V., To the restoration of gaps in experimental data, Vestnik NNGU im. N.N. Lobachevskogo. Ser. Radiofizika Сер. Радиофизика (Vestnik of Lobachevsky State University of Nizhni Novgorod: Radiophysics), 2004, iss. 2, pp. 15–23. [in Russian].
Grunin, A.G., Kuzmin, Yu.O., Fattakhov, E.A., Problematic issues of designing geodynamic test sites in hydrocarbon fields, Marksheiderskii vestnik (Mine Surveying Bulletin), 2014, no. 6, pp. 24–31. [in Russian].
Idarmachev, Sh.G., Arefiev, S.S., Results of dipole electric sounding in the area of the Chirkey water reservoir after its filling, Izvestiya, Physics of the Solid Earth, 2009, vol. 45, pp. 802–811, https://doi.org/10.1134/S1069351309090080
Idarmachev, Sh.G., Idarmachev, I.Sh., Equipment for precision measurements of electrical parameters of rocks in a well, Trudy Instituta geologii Dagestanskogo nauchnogo tsentra RAN (Proceedings of the Institute of Geology, Dagestan Scientific Center of the Russian Academy of Sciences), 2018, no. 2 (73), pp. 49–53. [in Russian].
Idarmachev, I.Sh., Deshcherevskii, A.V., Marchenko, M.N., Idarmachev, Sh.G., Two models of seasonal variations in apparent rock resistivity in a well in the bypass filtration zone of the Chirkey HPP, Trudy Instituta geologii Dagestanskogo nauchnogo tsentra RAN (Proceedings of the Institute of Geology, Dagestan Scientific Center of the Russian Academy of Sciences), 2019, iss. 79. [in Russian].
Kuzmin, Yu.O., The topical problems of identifying the results of the observations in recent geodynamics, Izvestiya, Physics of the Solid Earth, 2014, vol. 50, pp. 641–654, https://doi.org/10.1134/S1069351314050048
Kuzmin, Yu.O., Deshcherevskii, A.V., Fattakhov, E.A., Kuzmin, D.K., Kazakov, A.A., Aman, D.V., Inclinometric Observations at the Korchagin Deposit, Izvestiya, Atmospheric and Oceanic Physics, 2018, vol. 54, pp. 932–940, https://doi.org/10.1134/S0001433818080066
Kvyatkovskaya, S.S., Kuzmin, Yu.O., Nikitin, R.S., Fattakhov, E.A., Analysis of the deformations of the ground surface on Stepnovskaya underground gas storage by methods of satellite and ground-based geodesy, Vestnik SGUGiT (Vestnik of the Siberian State University of Geosystems and Technologies (SSUGT)), 2017, vol. 22, no. 3, pp. 16–32. [in Russian].
Little, R.J.A., Rubin, D.B., Statistical Analysis with Missing Data, Wiley, 1987. 278 p. ISBN: 0471802549
Sidorin, A.Ya. (ed.), Garmskii geofizicheskii poligon (Garm Geophysical Test Site), Moscow: Nauka, 1990. 240 p.
Sidorin, A.Ya., Predvestniki zemletryasenii (Earthquake Precursors), Moscow: Nauka, 1992. 192 p.
Vlasov, Yu.A., Gavrilov, V.A., Denisenko, V.P., Fedoristov, O.V., Telemetry system of multidisciplinary geophysical monitoring network, Seismic Instruments, 2009, vol. 45, pp. 14–18, https://doi.org/10.3103/S0747923909010022
Zloba, E., Yatskiv, I., Statistical methods of reproducing of missed data, Computer Modelling & New Technologies, 2002, vol. 6, no. 1, pp. 51–61.
About the authors
DESHEREVSKII Alexey Vladimirovich – Cand. Sci. (Phys. and Math.), Leading Researcher, Schmidt Institute of Physics of the Earth of the Russian Academy of Sciences. 123242, Moscow, ul. Bolshaya Gruzinskaya 10, stroenie 1. E-mail: adeshere@ifz.ru
SIDORIN Alexander Yakovlevich – Cand. Sci. (Phys. and Math.), Principal Researcher, Head of Laboratory, Schmidt Institute of Physics of the Earth of the Russian Academy of Sciences. 123242, Moscow, ul. Bolshaya Gruzinskaya 10, stroenie 1. E-mail: al_sidorin@hotmail.com
FATTAKHOV Evgeny Albertovich – Junior Researcher, Schmidt Institute of Physics of the Earth of the Russian Academy of Sciences. 123242, Moscow, ul. Bolshaya Gruzinskaya 10, stroenie 1. E-mail: fea@ifz.ru