ISSN 0474-8662. Information Extraction and Processing. 2021. Issue 49 (125)
Home Back to issue

Analysis of remote sensing images by methods of convolutional neural networks and marked random point fields

Kosarevych R.Ya.
Karpenko Physico-Mechanical Institute of the NAS of Ukraine, Lviv
Alokhina O.V.
Karpenko Physico-Mechanical Institute of the NAS of Ukraine, Lviv
Rusyn B.P.
Karpenko Physico-Mechanical Institute of the NAS of Ukraine, Lviv
Lutsyk O.A.
Karpenko Physico-Mechanical Institute of the NAS of Ukraine, Lviv
Pits N.A.
Karpenko Physico-Mechanical Institute of the NAS of Ukraine, Lviv
Ivchenko D.V.
Karpenko Physico-Mechanical Institute of the NAS of Ukraine, Lviv

https://doi.org/10.15407/vidbir2021.49.045

Keywords: remote sensing, convolutional neural networks, random point fields.

Cite as: Kosarevych R.Ya., Alokhina O.V., Rusyn B.P., Lutsyk O.A., Pits N.A., Ivchenko D.V. Analysis of remote sensing images by methods of convolutional neural networks and marked random point fields. Information Extraction and Processing. 2021, 49(125), 45-51. DOI:https://doi.org/10.15407/vidbir2021.49.045


Abstract

The methodology of remote sensing image analysis for detection of dependences in the process of development of biological species is proposed. Classification methods based on convolutional networks are applied to a set of fragments of the input image. In order to increase the accuracy of classification by increasing the training and test samples, an original method of data augmentation is proposed. For a series of images of one part of the landscape, the fragments of images are classified by their numbers, which coincide with the numbers of the previously classified image of the training and test samples which are created manually. This approach has improved the accuracy of classification compared to known methods of data augmentation. Numerous studies of various convolutional neural networks have shown the similarity of the classification results of the remote sensing images fragments with increasing learning time with the complication of the network structure. A set of image fragment centers of a particular class is considered as random point configuration, the class labels are used as a mark for every point. Marked point field is considered as consisting of several sub-point fields in each of which all points have the same qualitative marks. We perform the analysis of the bivariate point pattern to reveal relationships between points of different types, using the characteristics of marked random point fields. Such relationships can characterize dependences and relative degrees of dominance. A series of remote sensing images are studied to identify the relationships between point configurations that describe different classes to monitor their development.


References

    1. Gomez-Chova, L.; Tuia, D.; Moser, G.; Camps-Valls, G. Multimodal Classification of Remote Sensing Images: a Review and Future Directions, Proceedings of the IEEE, 2015, 103(9), 1560-1584. https://doi.org/10.1109/JPROC.2015.2449668

    2. Li, M.; Zang, S.; Zhang, B.; Li, S.; Wu, C. A review of remote sensing image classification techniques: The role of spatio-contextual information, European Journal of Remote Sensing, 2014, 47(1), 389-411. https://doi.org/10.5721/EuJRS20144723

    3. Alajlan, N.; Bazi, Y.; Melgani, F.; Yager, R. R. Fusion of supervised and unsupervised learning for improved classification of hyperspectral images, Information Sciences, 2012, 217, 39-55. https://doi.org/10.1016/j.ins.2012.06.031

    4. Liu, S.; Luo, H.; Tu, Y.; He, Z.; Li, J. Wide contextual residual network with active learning for remote sensing image classification, In GARSS 2018-2018 IEEE Int. Geoscience and Remote Sensing Symposium, 2018, July, 7145-7148. https://doi.org/10.1109/IGARSS.2018.8517855

    5. Lee, H.; Kwon, H. Going deeper with contextual CNN for hyperspectral image classification, IEEE Transact. on Image Proc., 2017, 26(10), 4843-4855. https://doi.org/10.1109/TIP.2017.2725580

    6. Pashkov, D. P. Analysis of the possibilities of using space systems for remote sensing of the Earth to solve environmental problems, Air Force Science and Technology of the Armed Forces of Ukraine, 2014, 2(15), 184-188. [in Ukrainian]

    7. Vasudevan, K.; Eckel, S.; Fleischer, F.; Schmidt, V.; Cook, F. A. Statistical analysis of spatial point patterns on deep seismic reflection data: a preliminary test, Geophysical J. International, 2007, 171(2), 823-840. https://doi.org/10.1111/j.1365-246X.2007.03572.x

    8. Haase, P. Spatial pattern analysis in ecology based on Ripley's K function: Introduction and methods of edge correction, J. of Vegetation Science, 1995, 6(4), 575-582. https://doi.org/10.2307/3236356

    9. Cheng, Y. F.; Luo, J. L. Statistical analysis of metastable pitting events on carbon steel, British Corrosion Journal, 2000, 35(2), 125-130. https://doi.org/10.1179/000705900101501146

    10. Jiang, S.; Zhao, H.; Wu, W.; Tan, Q. A novel framework for remote sensing image scene classification, International Archives of the Photogrammetry, Remote Sensing & Spatial Information Sciences, 2018, 42(3). https://doi.org/10.5194/isprs-archives-XLII-3-657-2018

    11. Yang, Y.; Newsam, S. Bag-of-visual-words and spatial extensions for land-use classification, Proc. of the 18th SIGSPATIAL Int. Conf. on Adv. in Geographic Information Systems, 2010, November, 270-279. https://doi.org/10.1145/1869790.1869829

    12. Xia, G. S.; Yang, W.; Delon, J.; Gousseau, Y.; Sun, H.; Maitre, H. Structural high-resolution satellite image indexing, In ISPRS TC VII Symposium-100 Years ISPRS, 2010, July, 38, 298-303.

    13. Zou, Q.; Ni, L.; Zhang, T.; Wang, Q. Deep learning based feature selection for remote sensing scene classification, IEEE Geoscience and Remote Sensing Letters, 2015, 12(11), 2321-2325. https://doi.org/10.1109/LGRS.2015.2475299

    14. Cubuk, E. D.; Zoph, B.; Mane, D.; Vasudevan, V.; Le, Q. V. Autoaugment: Learning augmentation policies from data, arXiv Preprint, 2018, arXiv:1805.09501. https://doi.org/10.1109/CVPR.2019.00020

    15. Freeman, I.; Roese-Koerner, L.; Kummert, A. Effnet: An efficient structure for convolutional neural networks, 25th IEEE Int. Conf. on Image Proc., 2018, 6-10. https://doi.org/10.1109/ICIP.2018.8451339

    16. LeCun, Y.; Boser, B.; Denker, J. S.; Henderson, D.; Howard, R. E.; Hubbard, W.; Jackel, L. D. Backpropagation applied to handwritten zip code recognition, Neural Computation, 1989, 1(4), 541-551. https://doi.org/10.1162/neco.1989.1.4.541

    17. Baddeley, A. Spatial Point Process Modelling and Its Applications, Stochastic Geometry, 2007, 1-75.

    18. Kosarevych, R.Ya. An approach to estimating the grain size of a material using point pattern. Computational methods and systems of information transformation, Materials of the II Scientific and Technical Conference, September 20-21, 2012: Lviv, 2012, 110-113. [in Ukrainian]

    19. Clark, P. J.; Evans, F. C. Distance to nearest neighbor as a measure of spatial relationships in populations, Ecology, 1954, 35(4), 445-453. https://doi.org/10.2307/1931034

    20. Stoyan, D.; Penttinen, A. Recent applications of point process methods in forestry statistics, Statistical Science, 2000, 61-78. https://doi.org/10.1214/ss/1009212674