Analysis of Multi-Temporal Multispectral Aerial Photography Data to Detect the Boundaries of Historical Anthropogenic Impact
Keywords:
multispectral survey, texture segmentation, Haralick texture features, principal component analysis, clustering, k-means, multi-temporal data, growing season, secondary successionAbstract
The article presents the application of a statistical analysis algorithm for multi-temporal multispectral aerial photography data to identify areas of historical anthropogenic impact on the natural environment. The investigated site is located on the outskirts of the urban-type village of Znamenka (Znamensky District, Tambov Region) in a forest-steppe zone with typical chernozem soils, where arable lands were located in the second half of the 19th - early 20th centuries. Grown vegetation as a result of secondary succession in abandoned areas can be a sign for identifying traces of historical anthropogenic impact. Distinctive signs of such vegetation from the surrounding natural environment are its type, age and growth density. Thus, the problem of detecting the boundaries of anthropogenic impact on multispectral images is reduced to the problem of vegetation classification. The initial data were the results of multi-temporal multispectral imaging in green (Green), red (Red), edge of red (RedEdge) and near-infrared (NIR) spectral ranges. The first stage of the algorithm is the calculation of the Haralick texture features on multispectral images, the second stage – reduction in the number of features by the principal component analysis, the third stage – the segmentation of images based on the obtained features by the k-means method. The effectiveness of the proposed algorithm is shown by comparing the segmentation results with the reference data of historical cartographic materials. The study of multi-temporal multispectral images makes it possible to more fully characterize and take into account the dynamics of phytomass growth in different periods of the growing season. Therefore, the obtained segmentation result reflects not only the configuration of areas of an anthropogenic transformed natural environment, but also the features of overgrowth of abandoned arable land.
References
2. Cherepanova E.S. [Historical aspects of the development of forest territories of the Upper Kama basin and their consequences]. Interekspo GEO-Sibir’. 2012. vol. 4. pp. 37–41. (In Russ).
3. Chernov S.Z. [Recommended formats of historical maps of land dachas in medieval Russia of the XIII-XVII centuries. (based on the materials of ancient Radonezh)]. Aktual’nye problemy agrarnoj istorii Vostochnoj Evropy X–XXI vv.: istochniki i metody issledovaniya: materialy XXXII sessii simpoziuma po agrarnoj istorii Vostochnoj Evropy. [Actual problems of the agrarian history of Eastern Europe of the X-XXI centuries: sources and research methods. Collected papers]. Ryazan': Ryaz. gos. un-t im. S.A. Esenina. 2012. pp. 58–78. (In Russ).
4. Rossiya. Polnoe geograficheskoe opisanie nashego Otechestva: nastol'naya i dorozhnaya kniga dlya russkih lyudej. T.2: Srednerusskaya Chernozemnaya oblast': Kurskaya, Orlovskaya, Tul'skaya, Ryazanskaya, Tambovskaya, Voronezhskaya i Penzenskaya gubernii. [Russia. A complete geographical description of our Fatherland: a desktop and travel book for Russian people. Vol. 2: Central Russian Chernozem region: Kursk, Orel, Tula, Ryazan, Tambov, Voronezh and Penza provinces]. SPb.: A.F. Devrien. 1902. 717 p. (In Russ.).
5. Avrekh A.L., Kanishchev V.V. [Natural-historical conditions of modernization of agrarian society. Tambov province, XIX-XX centuries]. Social'naya istoriya rossijskoj provincii v kontekste modernizacii agrarnogo obshchestva v XVIII–XX vv. [The social history of the Russian province in the context of the modernization of agrarian society in the XVIII-XX centuries. Collected papers]. Tambov. 2002. pp. 3–17. (In. Russ).
6. Kanishchev V.V. [Economics, demography, ecology in the context of modernization of agrarian society (Tambov province in the XIX-early XX century)]. Ekonomicheskaya istoriya: Ezhegodnik. [Economic History: Yearbook]. 2002. M.: ROSSPEN. 2003. p. 513–530. (In Russ.).
7. Cincadze N.S. Demograficheskie i ekologicheskie problemy razvitiya agrarnogo obshchestva Rossii vo vtoroj polovine XIX – nachale XX veka v vospriyatii sovremennikov. Monografiya. [Demographic and environmental problems of the development of the agrarian society of Russia in the second half of the XIX-early XX century in the perception of contemporaries. Monograph]. Tambov: Izd. dom TGU im. G.R. Derzhavina. 2012. 286 p. (In Russ.).
8. Monitoring biologicheskogo raznoobrazija lesov Rossii: metodologija i metody [Monitoring of the biological diversity of Russian forests: methodology and methods]. Moscow: Nauka, 2008. 453 p. (In Russ.).
9. Kalinina O., Goryachkin S.V., Lyuri D.I., et.al. Post-agrogenic development of vegetation, soils, and carbon stocks under self-restoration in different climatic zones of European Russia. Catena. 2015. vol. 129. pp. 18–29. DOI: 10.1016/j.catena.2015.02.016.
10. Plan Znamenskoj usad'by i okrestnyh territorij [Plan of the Znamenskaya estate and surrounding areas]. Gosudarstvennyj arhiv Tambovskoj oblasti [State Archive of the Tambov Region]. F. 29. Op. 4. D. 10052. (In Russ.).
11. Kalinina O., Krause S.-E., Goryachkin S.V., et. al. Self-restoration of post-agrogenic chernozems of Russia: Soil development, carbon stocks, and dynamics of carbon pools. Geoderma. 2011. vol. 162. pp. 196–206. DOI: 10.1016/j.geoderma.2011.02.005.
12. Agrojekologicheskoe sostojanie i perspektivy ispol'zovanija zemel' Rossii, vybyvshih iz aktivnogo sel'skohozjajstvennogo oborota [Agroecological state and prospects for the use of Russian lands that have been eliminated from active agricultural turnover]. Ed. by G.A. Romanenko. Moscow.: FGNU “Rosinformagroteh”. 2008. 64 p. (In Russ.).
13. Cao Y., Li G.L., Luo Y.K., et al. Monitoring of sugar beet growth indicators using wide-dynamic-range vegetation index (WDRVI) derived from UAV multispectral im-ages. Computers and Electronics in Agriculture. 2020. vol. 171: 105331. DOI: 10.1016/j.compag.2020.105331.
14. Eng L.S., Ismail R., Hashim W., et al. Vegetation monitoring using UAV: a preliminary study. International Journal of Engineering & Technology. 2018. no.7. pp. 223–227. DOI: 10.14419/ijet.v7i4.35.22736.
15. Liu S., Marinelli D., Bruzzone L., et al. A review of change detection in multitemporal hyperspectral images: current techniques, applications, and challenges. IEEE Geoscience and Remote Sensing Magazine. 2019. vol. 7. no. 2. pp. 140–158. DOI: 10.1109/MGRS.2019.2898520.
16. Wei Z., Gu X., Sun Q., et al. Analysis of the spatial and temporal pattern of changes in abandoned farmland based on long time series of remote sensing data. Remote Sensing. 2021. vol. 13(13): 2549. DOI: 10.3390/rs13132549.
17. Alonso L., Picos J., Armesto J. Forest Land Cover Mapping at a Regional Scale Using Multi-Temporal Sentinel-2 Imagery and RF Models. Remote sensing. 2021. vol. 13(12): 2237. DOI: 10.3390/rs13122237.
18. Possoch M., Bieker S., Hoffmeister D., et al. Multi-temporal crop surface models com-bined with the rgb vegetation index from UAV-based images for forage monitoring in grassland. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences. 2016. vol. XLI-B1. pp. 991–998. DOI:10.5194/isprsarchives-XLI-B1-991-2016.
19. Iersel W., Straatsma M., Middelkoop H., et al. Multitemporal classification of river floodplain vegetation using time series of UAV Images. Remote Sensing. 2018. vol. 10(7): 1144. DOI:10.3390/rs10071144.
20. Senf C., Leitão P.J., Pflugmacher D., et al. Mapping land cover in complex mediterrnean landscapes using Landsat: improved classification accuracies from integrating multi-seasonal and synthetic imagery. Remote Sensing of Environment. 2015. vol. 156. pp. 527–536. DOI: 10.1016/j.rse.2014.10.018.
21. Simonetti D., Simonetti E., Szantoi Z., et. al. First results from the phenology-based synthesis classifier using Landsat 8 imagery. IEEE Geoscience and Remote Sensing Letters. 2015. vol. 12. no. 7. pp. 1496–1500 DOI: 10.1109/LGRS.2015.2409982.
22. Topograficheskij mezhevoj atlas Tambovskoj gubernii 1:84000 (1862) [Topographic boundary atlas of the Tambov province 1:84000 (1862)]. Jeto Mesto [This place]. Available at: http://www.etomesto.ru/karta5623 (accessed 12.07.2021). (In Russ.)
23. Karta RKKA 1:100000 (1935-1941) [Red Army map 1:100000 (1935-1941)]. Jeto Mesto [This place]. Available at: http://www.etomesto.ru/karta2027 (accessed 12.07.2021). (In Russ.).
24. Samodurov I. Kratkoe opisanie imenija grafa Pavla Sergeevicha Stroganova, Tambovskoj gubernii i uezda, pri sele Znamenskom-Karian [A brief description of the estate of Count Pavel Sergeyevich Stroganov, Tambov province and district, near the village of Znamenskoye-Karian]. Moscow: tipo-lit. t-va I.N. Kushnerev i K°. 1895. 19 p. (In Russ.).
25. Xie Q., Dash J., Huang W., et al. Vegetation indices combining the red and red-edge spectral information for leaf area index retrieval. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing. 2018. vol. 11. no. 5. pp. 1482–1493. DOI: 10.1109/JSTARS.2018.2813281.
26. Kondrat'ev K.Y., Fedchenko P.P. Spektral'naya otrazhatel'naya sposobnost' i raspoznavanie rastitel'nosti. [Spectral reflectivity and vegetation recognition]. L.: Gidrometeoizdat. 1982. 215 p. (In Russ.).
27. Roy P.S. Spectral reflectance characteristics of vegetation and their use in estimating productive potential. Proceedings of the Indian Academy of Sciences (Plant Science). 1989. vol. 99. no 1. P. 59 – 81. DOI: 10.1007/BF03053419.
28. Govender M., Chetty K., Bulcock H. A review of hyperspectral remote sensing and its application in vegetation and water resource studies. Water SA. 2007. vol. 33. no. 2. pp. 145–151. DOI:10.4314/wsa.v33i2.49049.
29. Sharma A., Kaur D., Gupta A., et. al. Application and Analysis of Hyperspectal Imaging. IEEE International Conference on Signal Processing, Computing and Control (ISPCC 2k19). 2019. pp. 30–35. DOI: 10.1109/ ISPCC48220.2019.8988436.
30. Gonsales R., Vuds R. Cifrovaya obrabotka izobrazhenij. [Digital image processing]. M.: Tekhnosfera. 2006. 1072 p. (In Russ.).
31. Gao J., Li H., Han Z., et. al. Aircraft Detection in Remote Sensing Images Based on Background Filtering and Scale Prediction. PRICAI 2018: Trends in Artificial Intelligence. Lecture Notes in Computer Science. 2018. vol. 11012. pp. 604–616. DOI: /10.1007/978-3-319-97304-3_46.
32. Andriyanov N.A, Vasiliev K.K., Dement'ev V.E. Analysis of the efficiency of satellite image sequences filtering. Journal of Physics: Conference Series. 2018. vol.1096: 012036. DOI: 10.1088/1742- 6596/1096/1/012036.
33. Bannari, A., Morin, D., Bonn, F, et. al. A review of vegetation indices. Remote Sensing Reviews. 1995. vol. 13. no.1. pp. 95–120. DOI: 10.1080/02757259509532298.
34. Cherepanov A.S. [Vegetation indices]. Geomatics. 2011. №2. p. 98–102. (In Russ.).
35. Haralick R.M., Shanmugam K., Dinstein I. Textural features for image classification. IEEE Transactions on Systems, Man, and Cybernetics. 1973. vol. SMC-3. no. 6. pp. 610–621. DOI: 10.1109/TSMC.1973.4309314.
36. Feng Q., Liu J., Gong J. UAV Remote Sensing for Urban Vegetation Mapping Using Random Forest and Texture Analysis. Remote Sensing. 2015. vol. 7. pp. 1074–1094. DOI: 10.3390/rs70101074.
37. Kwak G.-H., Park N.-W. Impact of Texture Information on Crop Classification with Machine Learning and UAV Images. Applied Science. 2019. vol. 9: 643. DOI: 10.3390/app9040643.
38. Dian Y., Li Z., Pang Y. Spectral and texture features combined for forest tree species classification with airborne hyperspectral imagery. Journal of the Indian Society of Remote Sensing. 2015. vol. 43. pp. 101–107. DOI: 10.1007/s12524-014-0392-6.
39. Bekkari A., Idbraim S., Elhassouny A., et. al. SVM and Haralick features for classification of high resolution satellite images from urban areas. ICISP 2012: Image and Signal Processing. Lecture Notes in Computer Science. 2012. vol. 7340. pp. 17–26. DOI: 10.1007/978-3-642-31254-0_3.
40. Rodarmel C., Shan J. Principal component analysis for hyperspectral image classification. Surveying and Land Information Systems. 2002. vol. 62. no. 2, pp. 115–122.
41. Rejichi S., Chaabane F. Feature extraction using PCA for VHR satellite image time series spatial-temporal classification. IEEE International Geoscience and Remote Sensing Symposium (IGARSS). 2015. pp. 485-488. DOI: 10.1109/IGARSS.2015.7325806.
42. Zlobina A.G., Shaura A.S., Zhurbin I.V., et al. Algorithm for statistical analysis of multispectral survey data to identify the anthropogenic impact of the 19th century on the natural environment. Pattern Recognition and Image Analysis. 2021. vol. 31. no. 2. pp. 344–354. DOI: 10.1134/S1054661821020176.
43. Khalid S., Khalil T., Nasreen S. A survey of feature selection and feature extraction techniques in machine learning. Science and Information Conference. 2014. pp. 372–378. DOI: 10.1109/SAI.2014.6918213.
44. Popescu M.C., Sasu L.M. Feature extraction, feature selection and machine learning for image classification: A case study. 2014 International Conference on Optimization of Electrical and Electronic Equipment (OPTIM). 2014. pp. 968–973. DOI: 10.1109/OPTIM.2014.6850925.
45. Ulaby F.T., Kouyate F., Brisco B., et al. Textural Information in SAR Images. IEEE Transactions on Geoscience and Remote Sensing. 1986. vol. GE-24. no. 2. pp. 235–245. DOI:10.1109/TGRS.1986.289643.
46. Jolliffe I.T. Principal Components Analysis. 2nd ed. N.Y.: Springer-Verlag New York Inc. 2002. 487 p.
47. Kang, B., Jung H., Jeong H., et al. Characterization of three-dimensional channel reservoirs using ensemble Kalman filter assisted by principal component analysis. Petroleum Science. 2020. vol. 17. pp. 182–195. DOI: 10.1007/s12182-019-00362-8.
48. Artoni F., Delorme A., Makeig S. Applying dimension reduction to EEG data by principal component analysis reduces the quality of its subsequent independent component decomposition. NeuroImage. 2018. vol. 175. pp. 176–187. DOI: 10.1016/j.neuroimage.2018.03.016.
49. Huang Z. Extensions to the k-means algorithm for clustering large data sets with categorical values. Data mining and knowledge discovery. 1998. vol. 2. pp. 283–304.
50. Jain A.K. Data clustering: 50 years beyond k-means. Pattern Recognition Letters. 2010. vol. 31. pp. 651–666. DOI: 10.1016/j.patrec.2009.09.011.
Published
How to Cite
Section
Copyright (c) Александр Сергеевич Шаура, Анна Григорьевна Злобина
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms: Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).