vestnik Журнал "Вестник Сибирского государственного университета геосистем и технологий (СГУГиТ)" 2411-1759 ФГБОУ ВО "Сибирский государственный университет геосистем и технологий (СГУГиТ)" RU https://vestnik.sgugit.ru 10.33764/2411-1759-2022-27-3-74-94 Картография и геоинформатика Анализ методов и средств искусственного интеллекта для анализа и интерпретации данных активного дистанционного зондирования А. А. Колесников Колесников А. А. Сибирский государственный университет геосистем и технологий, г. Новосибирск, Российская Федерация 2022 27 3 74 94 © А. А. Колесников, 2022 2022 А. А. Колесников Эта статья дотупна по лицензии Creative Commons «Attribution» («Атрибуция») 4.0 Всемирная. Данные дистанционного зондирования, как и большинство видов пространственных данных, являются комплексными, динамическими, слабоструктурированными, что затрудняет создание однозначного и универсального процесса их обработки и использования. В то же время развитие аппаратного обеспечения, методов и алгоритмов искусственного интеллекта и машинного обучения привело к тому, что направления информационных технологий находят применение практически во всех областях науки и техники, в том числе и при обработке пространственных данных. В статье сформулированы основные сложности и задачи обработки данных дистанционного зондирования, представлены наиболее распространенные в настоящее время методы и средства их обработки, использующие технологии искусственного интеллекта с целью автоматизации процессов. Рассмотрены возможности использования конкретных алгоритмов и методов искусственного интеллекта для всех этапов обработки данных активного дистанционного зондирования. искусственный интеллект активное дистанционное зондирование обработка данных машинное обучение облака точек artificial intelligence active remote sensing data processing machine learning point clouds 1. Zhu X. X., Tuia D., Mou L., Xia G. S., Zhang L., Xu F., Fraundorfer F. Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources // IEEE Geoscience and Remote Sensing Magazine. – 2017. – P. 8–36. 2. Engelmann F., Kontogianni T., Schult J., Leibe B. Know what your neighbors do: 3D semantic segmentation of point clouds // Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). – 2019. – Vol. 11131 LNCS. – P. 395–409. 3. Yu L., Li X., Fu C. W., Cohen-Or D., Heng P. A. PU-Net: Point Cloud Upsampling Network // IEEE Computer Society Conference on Computer Vision and Pattern Recognition. – 2018. – P. 2790–2799. 4. Dudgeon D. E., Lacoss R. T., Moreira A. An overview of automatic target recognition // The Lincoln Laboratory Journal. – 1993. – Vol. 6. – P. 3–10. 5. Chen S., Wang H. SAR target recognition based on deep learning // International Conference on Data Science and Advanced Analytics. – 2014. – P. 541–547 6. Keydel E. R., Lee S. W., Moore J. T. MSTAR extended operating conditions: a tutorial // SPIE 2757, Algorithms for Synthetic Aperture Radar Imagery III. – 1996. 7. Chen S., Wang H., Xu F., Jin Y. Q. Target classification using the deep convolutionalnetworks for SAR images // IEEE Transactions on Geoscience and Remote Sensing. – Vol. 54, No. 8. – 2016. – P. 4806–4817. 8. Morgan D. Deep convolutional neural networks for ATR from SAR imagery // SPIE 9475, Algorithms for Synthetic Aperture Radar Imagery XXII. – 2015. 9. Ding J., Chen B., Liu H., Huang M. Convolutional neural network with dataaugmentation for SAR target recognition // IEEE Geoscience and Remote Sensing Letters. – Vol. 13, No. 3. – 2016. – P. 364–368. 10. Du K., Deng Y., Wang R., Zhao T., Li N. SAR ATR based on displacement- and rotation-insensitive CNN // Remote Sensing Letters. – 2016. – Vol. 7, No. 9. – P. 895–904. 11. Wilmanski M., Kreucher C., Lauer J. Modern approaches in deep learning for SAR ATR // SPIE 9843, Algorithms for Synthetic Aperture Radar Imagery XXIII. – 2016. 12. Cui Z., Cao Z., Yang J., Ren H. Hierarchical recognition system for target recognitionfrom sparse representations // Mathematical Problems in Engineering. – 2016. – Vol. 2015, No. 527095. 13. Wagner S. A. SAR ATR by a combination of convolutional neural network and supportvector machines // IEEE Transactions on Geoscience and Remote Sensing. – Vol. 52, No. 6. – 2016. – P. 2861–2872. 14. Bentes C., Frost A., Velotto D., Tings B. Ship-iceberg discrimination with con-volutional neural networks in high resolution SAR images // European Conference onSynthetic Aperture Radar (EUSAR). – 2016. 15. Schwegmann C., Kleynhans W., Salmon B., Mdakane L., Meyer R. Very deep learn-ing for ship discrimination in Synthetic Aperture Radar imagery // IEEE InternationalGeoscience and Remote Sensing Symposium (IGARSS). – 2016. 16. Ødegaard N., Knapskog A.O., Cochin C., Louvigne J.C. Classification of ships using real and simulated data in a convolutional neural network // IEEE RadarConference (RadarConf). – 2016. 17. Song Q., Xu F., Jin Y.Q. Deep SAR image generative neural network and auto-construction of target feature space // IEEE International Geoscience and RemoteSensing Symposium (IGARSS). – 2017. 18. Jin Y. Q., Xu F. Polarimetric scattering and SAR information retrieval // Wiley-IEEE. –2013. 19. Xu F., Jin Y.Q., Moreira A. A preliminary study on SAR advanced information retrieval and scene reconstruction // IEEE Geoscience and Remote Sensing Letters. – 2016. – Vol. 13, No. 10. – P. 1443–1447. 20. Hie H., Wang S., Lie K., Lin S., Hou B. Multilayer feature learning for polarimetricsynthetic radar data classification // IEEE International Geoscience and Remote SensingSymposium (IGARSS). – 2014. 21. Geng J., Fan J., Wang H., Ma X., Li B., Chen F. High-resolution SAR image classification via deep convolutional autoencoders // IEEE Geoscience and Remote Sensing Letters. – 2015. – Vol. 12, No. 11. – P. 2351–2355. 22. Geng J., Wang H., Fan J., Ma X. Deep supervised and contractive neural networkfor SAR image classification // IEEE Transactions on Geoscience and Remote Sensing. – 2017. – Vol. 55, No. 4. – P. 2442–2459. 23. Lv Q., Dou Y., Niu X., Xu J., Xu J., Xia F. Urban land use and land cover classification using remotely sensed SAR data through deep belief networks // Journal of Sensors. – 2015. – Vol. 2015, No. 538063. 24. Hou B., Kou H., Jiao L. Classification of polarimetric SAR images using multi-layer autoencoders and superpixels // IEEE Journal of Selected Topics in Applied EarthObservations and Remote Sensing. – 2016. – Vol. 9, No. 7. – P. 3072–3081. 25. Zhang L., Ma W., Zhang D. Stacked sparse autoencoder in PolSAR data classification using local spatial information // IEEE Geoscience and Remote Sensing Letters. – 2016. – Vol. 13, No. 9. – P. 1359–1363. 26. Qin F., Guo J., Sun W. Object-oriented ensemble classification for polarimetric SARimagery using restricted Boltzmann machines // Remote Sensing Letters. – 2017. – Vol. 8, No. 3. – P. 204–213. 27. Zhao Z., Jiao L., Zhao J., Gu J., Zhao J. Discriminant deep belief network for high-resolution SAR image classification // Pattern Recognition. – Vol. 61. – 2017. – P. 686–701. 28. Zhang L., Lu D., Moon W. M. PolSAR Image Classification based on QCEA-optimized BP Neural Network // CGU - CSSS. – 2014. 29. Adam A., Grammatikopoulos L., Karras E., Protopapadakis E., Karantzalos K. A semantic 3D point cloud segmentation approach based on optimal view selection for // The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 6th International Workshop LowCost 3D – Sensors, Algorithms, Applications. Strasbourg. – 2019. – Vol. XLII-2/W17. 30. Riemenschneider H., Bdis-Szomor A., Weissenberg J., Gool L. Learning where to classify in multi-view semantic segmentation // In Proceedings European Conference on Computer Vision. – 2014. 31. Shao Z., Zhang L., Wang L. Stacked Sparse Autoencoder Modeling Using the Synergy of Airborne LiDAR and Satellite Optical and SAR Data to Map Forest Above-Ground Biomass // IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing. – 2017. – Vol. 10, No. 12. – P. 5569–5582. 32. Qi C. R., Su H., Mo K., Guibas L. J. PointNet: Deep learning on point sets for 3D classification and segmentation // Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017. – 2017. – P. 77–85. 33. Li J., Chen B. M., Lee G. SO-Net: Self-Organizing Network for Point Cloud Analysis // Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. – 2018. – P. 9397–9406. 34. Weiss U., Biber P., Laible S., Bohlmann K., Zell A. Plant species classification using a 3D LIDAR sensor and machine learning // 9th International Conference on Machine Learning and Applications, ICMLA 2010. – 2010. – P. 339–345. 35. Yao X., Guo J., Hu J., Cao Q. Using deep learning in semantic classification for point cloud data // IEEE Access. – 2019. 36. Briechle S., Krzystek P., Vosselman G. Semantic labeling of als point clouds for tree species mapping using the deep neural network pointnet++ // International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences – ISPRS Archives 42(2/W13). – 2019. – Vol. 42(2/W13). – P. 951–955. 37. Qi C. R., Yi L., Su H., Guibas L. J. PointNet++: Deep hierarchical feature learning onpoint sets in a metric space // Proceedings Advances in Neural Information Processing Systems. – 2017. 38. Landrieu L., Simonovsky M. Large-scale Point Cloud Semantic Segmentation with Superpoint Graphs // 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. – Salt Lake City. – 2018. 39. Yang M., Förstner W. Plane Detection in Point Cloud Data // Proceedings of the 2nd International Conference on Machine Control Guidance. Bonn. – 2010. – Vol. 1. – P. 95–104. 40. Li C., Zaheer M., Zhang Y., Poczos B., Salakhutdinov R. R. Point cloud GAN // Deep Generative Models for Highly Structured Data, DGS@ICLR 2019 Workshop. – 2019. 41. Marulanda F. G., Libin P., Verstraeten T., Nowé A. IPC-Net: 3D point-cloud segmentation using deep inter-point convolutional layers // International Conference on Tools with Artificial Intelligence, ICTAI. – 2018. – P. 293–301. 42. Uy M. A., Lee G. PointNetVLAD: Deep Point Cloud Based Retrieval for Large-Scale Place Recognition // Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. – 2018. – P. 4470-4479. 43. Zhou Y., Tuzel O. VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection // Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. – 2018. – P. 4490-4499. 44. Yi L., Zhao W., Wang H., Sung M., Guibas L. J. GSPN: Generative shape proposal network for 3D instance segmentation in point cloud // Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. – 2019. – P. 3942–3951. 45. Yang Y., Feng C., Shen Y., Tian D. FoldingNet: Point Cloud Auto-Encoder via Deep Grid Deformation // Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. – 2018. – P. 206215. 46. Yotsumata T., Sakamoto M., Satoh T. Quality improvement for airborne lidar data filtering based on deep learning method // The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences. – 2020. – Vol. XLIII-B2-2020. – P. 355–360. 47. Gülch E., Obrock L. S. Automated semantic modelling of building interiors from images and derived point clouds based on deep learning methods // The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences. – 2020. – Vol. XLIII-B2-2020. – P. 421–426. 48. Tchapmi L. P., Choy C. B., Armeni I., Gwak J. Y., Savarese S. Segcloud: Semantic segmentationof 3d point clouds // International Conference on 3D Vision(3DV). – 2017. 49. Dai A., Chang A. X., Savva M., Halber M., Funkhouser T., Niener M. Scannet: Richly annotated 3D reconstructions of indoor scenes // Proceedings Computer Vision and Pattern Recognition (CVPR). – 2017. 50. Riegler G., Ulusoy A.O., Geiger A. Oct-net: Learning deep 3d representations at high resolutions // Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. – 2017. 51. Su H., Jampani V., Sun D., Maji S., Kalogerakis E., Yang M., Kautz J. SPLATNet: Sparse Lattice Networks for Point Cloud Processing // Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. – 2018. – P. 2530–2539. 52. Graham B. Sparse 3d convolutional neural networks // British Machine Vision Conference. – 2015. 53. Adams A., Baek J., Davis M.A. Fast high-dimensional filtering using the permutohedral lattice // Proceedings Computer Graphics Forum. – 2010. – Vol. 28. – P. 753–762. 54. Hermosilla P., Ritschel T., Vazquez P.P., Vinacua A., Ropinski T. Monte-Carlo convolution for learning on non-uniformly sampled point clouds // ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia 2018). – 2018. 55. Li Y., Rui B., Mungchao S., Wei W., Xinhan D., Baoquan C. PointCNN: Convolution On X-Transformed Points // NeurIPS 2018. – 2018. 56. Pan H., Liu S., Liu Y., Tong X. Convolutional neural networks on 3D surfaces using parallel frames. – 2018. – arxiv preprint arXiv: 1808.04952. 57. Tatarchenko M., Park J., Koltun V., Zhou Q. Tangent convolutions for dense predictionin 3D // CVPR. – 2018. 58. Gall Y. L., Thomas H., Goulette F., Deschaud J., Marcotegui B. Semantic Classification of 3D Point Clouds with Multiscale Spherical Neighborhoods // 2018 International Conference on 3D Vision (3DV). Verone. – 2018. 59. Choy C. B., Xu D., Gwak J., Chen K., Savarese S. 3D-r2n2: A unified approach for single and multiview 3D object reconstruction // Proceedings of the European Conference on Computer Vision (ECCV). – 2016. 60. Zeng A., Song S., Niener M., Fisher M., Xiao J., Funkhouser T. 3Dmatch: Learning the matching of local 3D geometry in range scans // CVPR. – 2017. 61. Zhao Y., Li X., Huang H., Zhang W., Zhao S., Makkie M., Zhang M., Li Q., Liu T. 4D Modeling of fMRI Data via Spatio-Temporal Convolutional Neural Networks (ST-CNN) // IEEE Transactions on Cognitive and Developmental Systems. – 2019. 62. Choy C., Gwak J., Savarese S. 4D Spatio-Temporal ConvNet: Minkowski Convolutional Neural Network // IEEE Conference on Computer Vision and Pattern Recognition (CVPR). – 2019. 63. Абросимов М. А., Бровко А. В. Метод нормализации облака точек, подлежащего обработке с помощью искусственной нейронной сети // Информационно-коммуникационные технологии в науке, производстве и образовании ICIT-2017. – Воронеж, 2017. – С. 262–268. 64. Бабаев А. М. Нейросетевые технологии распознавания трехмерных объектов // Международный журнал гуманитарных и естественных наук. – 2019. – Т. 39, No. 12-2. – C. 74–76. 65. Каздорф С. Я., Першина Ж. С. Алгоритм семантической сегментации трехмерных сцен // Cloud of Science. – 2019. – Vol. 6, No. 3. – P. 451–461. 66. Aoki Y., Goforth H., Srivatsan R. A., Lucey S. Pointnetlk: Robust & efficient point cloud registration using pointnet // Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. – 2019. – P. 7156–7165. 67. Zaganidis A., Sun L., Duckett T., Cielniak G. Integrating Deep Semantic Segmentation into 3-D Point Cloud Registration // IEEE Robotics and Automation Letters. – 2018. – Vol. 3, No. 4. – P. 2942–2949. 68. Neidhart H., Sester M. Identifying building types and building clusters using 3D-laser scanning and GIS-data // Machine Learning. – 2003. 69. Zhang B., Huang S., Shen W., Wei Z. Explaining the PointNet: What Has Been Learned Inside the PointNet? // IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). – 2019. – P. 71–74.