Анализ методов и средств искусственного интеллекта для анализа и интерпретации данных активного дистанционного зондирования

Анализ методов и средств искусственного интеллекта для анализа и интерпретации данных активного дистанционного зондирования

Картография и геоинформатика
УДК: 004.8:528.8
DOI: 10.33764/2411-1759-2022-27-3-74-94
1 Сибирский государственный университет геосистем и технологий, г. Новосибирск, Российская Федерация

Финансирование: -

Аннотация:

Данные дистанционного зондирования, как и большинство видов пространственных данных, являются комплексными, динамическими, слабоструктурированными, что затрудняет создание однозначного и универсального процесса их обработки и использования. В то же время развитие аппаратного обеспечения, методов и алгоритмов искусственного интеллекта и машинного обучения привело к тому, что направления информационных технологий находят применение практически во всех областях науки и техники, в том числе и при обработке пространственных данных. В статье сформулированы основные сложности и задачи обработки данных дистанционного зондирования, представлены наиболее распространенные в настоящее время методы и средства их обработки, использующие технологии искусственного интеллекта с целью автоматизации процессов. Рассмотрены возможности использования конкретных алгоритмов и методов искусственного интеллекта для всех этапов обработки данных активного дистанционного зондирования.

Читать статью Скачать JATS XML

Библиографический список:

  1. Zhu X. X., Tuia D., Mou L., Xia G. S., Zhang L., Xu F., Fraundorfer F. Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources // IEEE Geoscience and Remote Sensing Magazine. – 2017. – P. 8–36.
  2. Engelmann F., Kontogianni T., Schult J., Leibe B. Know what your neighbors do: 3D semantic segmentation of point clouds // Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). – 2019. – Vol. 11131 LNCS. – P. 395–409.
  3. Yu L., Li X., Fu C. W., Cohen-Or D., Heng P. A. PU-Net: Point Cloud Upsampling Network // IEEE Computer Society Conference on Computer Vision and Pattern Recognition. – 2018. – P. 2790–2799.
  4. Dudgeon D. E., Lacoss R. T., Moreira A. An overview of automatic target recognition // The Lincoln Laboratory Journal. – 1993. – Vol. 6. – P. 3–10.
  5. Chen S., Wang H. SAR target recognition based on deep learning // International Conference on Data Science and Advanced Analytics. – 2014. – P. 541–547
  6. Keydel E. R., Lee S. W., Moore J. T. MSTAR extended operating conditions: a tutorial // SPIE 2757, Algorithms for Synthetic Aperture Radar Imagery III. – 1996.
  7. Chen S., Wang H., Xu F., Jin Y. Q. Target classification using the deep convolutionalnetworks for SAR images // IEEE Transactions on Geoscience and Remote Sensing. – Vol. 54, No. 8. – 2016. – P. 4806–4817.
  8. Morgan D. Deep convolutional neural networks for ATR from SAR imagery // SPIE 9475, Algorithms for Synthetic Aperture Radar Imagery XXII. – 2015.
  9. Ding J., Chen B., Liu H., Huang M. Convolutional neural network with dataaugmentation for SAR target recognition // IEEE Geoscience and Remote Sensing Letters. – Vol. 13, No. 3. – 2016. – P. 364–368.
  10. Du K., Deng Y., Wang R., Zhao T., Li N. SAR ATR based on displacement- and rotation-insensitive CNN // Remote Sensing Letters. – 2016. – Vol. 7, No. 9. – P. 895–904.
  11. Wilmanski M., Kreucher C., Lauer J. Modern approaches in deep learning for SAR ATR // SPIE 9843, Algorithms for Synthetic Aperture Radar Imagery XXIII. – 2016.
  12. Cui Z., Cao Z., Yang J., Ren H. Hierarchical recognition system for target recognitionfrom sparse representations // Mathematical Problems in Engineering. – 2016. – Vol. 2015, No. 527095.
  13. Wagner S. A. SAR ATR by a combination of convolutional neural network and supportvector machines // IEEE Transactions on Geoscience and Remote Sensing. – Vol. 52, No. 6. – 2016. – P. 2861–2872.
  14. Bentes C., Frost A., Velotto D., Tings B. Ship-iceberg discrimination with con-volutional neural networks in high resolution SAR images // European Conference onSynthetic Aperture Radar (EUSAR). – 2016.
  15. Schwegmann C., Kleynhans W., Salmon B., Mdakane L., Meyer R. Very deep learn-ing for ship discrimination in Synthetic Aperture Radar imagery // IEEE InternationalGeoscience and Remote Sensing Symposium (IGARSS). – 2016.
  16. Ødegaard N., Knapskog A.O., Cochin C., Louvigne J.C. Classification of ships using real and simulated data in a convolutional neural network // IEEE RadarConference (RadarConf). – 2016.
  17. Song Q., Xu F., Jin Y.Q. Deep SAR image generative neural network and auto-construction of target feature space // IEEE International Geoscience and RemoteSensing Symposium (IGARSS). – 2017.
  18. Jin Y. Q., Xu F. Polarimetric scattering and SAR information retrieval // Wiley-IEEE. –2013.
  19. Xu F., Jin Y.Q., Moreira A. A preliminary study on SAR advanced information retrieval and scene reconstruction // IEEE Geoscience and Remote Sensing Letters. – 2016. – Vol. 13, No. 10. – P. 1443–1447.
  20. Hie H., Wang S., Lie K., Lin S., Hou B. Multilayer feature learning for polarimetricsynthetic radar data classification // IEEE International Geoscience and Remote SensingSymposium (IGARSS). – 2014.
  21. Geng J., Fan J., Wang H., Ma X., Li B., Chen F. High-resolution SAR image classification via deep convolutional autoencoders // IEEE Geoscience and Remote Sensing Letters. – 2015. – Vol. 12, No. 11. – P. 2351–2355.
  22. Geng J., Wang H., Fan J., Ma X. Deep supervised and contractive neural networkfor SAR image classification // IEEE Transactions on Geoscience and Remote Sensing. – 2017. – Vol. 55, No. 4. – P. 2442–2459.
  23. Lv Q., Dou Y., Niu X., Xu J., Xu J., Xia F. Urban land use and land cover classification using remotely sensed SAR data through deep belief networks // Journal of Sensors. – 2015. – Vol. 2015, No. 538063.
  24. Hou B., Kou H., Jiao L. Classification of polarimetric SAR images using multi-layer autoencoders and superpixels // IEEE Journal of Selected Topics in Applied EarthObservations and Remote Sensing. – 2016. – Vol. 9, No. 7. – P. 3072–3081.
  25. Zhang L., Ma W., Zhang D. Stacked sparse autoencoder in PolSAR data classification using local spatial information // IEEE Geoscience and Remote Sensing Letters. – 2016. – Vol. 13, No. 9. – P. 1359–1363.
  26. Qin F., Guo J., Sun W. Object-oriented ensemble classification for polarimetric SARimagery using restricted Boltzmann machines // Remote Sensing Letters. – 2017. – Vol. 8, No. 3. – P. 204–213.
  27. Zhao Z., Jiao L., Zhao J., Gu J., Zhao J. Discriminant deep belief network for high-resolution SAR image classification // Pattern Recognition. – Vol. 61. – 2017. – P. 686–701.
  28. Zhang L., Lu D., Moon W. M. PolSAR Image Classification based on QCEA-optimized BP Neural Network // CGU - CSSS. – 2014.
  29. Adam A., Grammatikopoulos L., Karras E., Protopapadakis E., Karantzalos K. A semantic 3D point cloud segmentation approach based on optimal view selection for // The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 6th International Workshop LowCost 3D – Sensors, Algorithms, Applications. Strasbourg. – 2019. – Vol. XLII-2/W17.
  30. Riemenschneider H., Bdis-Szomor A., Weissenberg J., Gool L. Learning where to classify in multi-view semantic segmentation // In Proceedings European Conference on Computer Vision. – 2014.
  31. Shao Z., Zhang L., Wang L. Stacked Sparse Autoencoder Modeling Using the Synergy of Airborne LiDAR and Satellite Optical and SAR Data to Map Forest Above-Ground Biomass // IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing. – 2017. – Vol. 10, No. 12. – P. 5569–5582.
  32. Qi C. R., Su H., Mo K., Guibas L. J. PointNet: Deep learning on point sets for 3D classification and segmentation // Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017. – 2017. – P. 77–85.
  33. Li J., Chen B. M., Lee G. SO-Net: Self-Organizing Network for Point Cloud Analysis // Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. – 2018. – P. 9397–9406.
  34. Weiss U., Biber P., Laible S., Bohlmann K., Zell A. Plant species classification using a 3D LIDAR sensor and machine learning // 9th International Conference on Machine Learning and Applications, ICMLA 2010. – 2010. – P. 339–345.
  35. Yao X., Guo J., Hu J., Cao Q. Using deep learning in semantic classification for point cloud data // IEEE Access. – 2019.
  36. Briechle S., Krzystek P., Vosselman G. Semantic labeling of als point clouds for tree species mapping using the deep neural network pointnet++ // International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences – ISPRS Archives 42(2/W13). – 2019. – Vol. 42(2/W13). – P. 951–955.
  37. Qi C. R., Yi L., Su H., Guibas L. J. PointNet++: Deep hierarchical feature learning onpoint sets in a metric space // Proceedings Advances in Neural Information Processing Systems. – 2017.
  38. Landrieu L., Simonovsky M. Large-scale Point Cloud Semantic Segmentation with Superpoint Graphs // 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. – Salt Lake City. – 2018.
  39. Yang M., Förstner W. Plane Detection in Point Cloud Data // Proceedings of the 2nd International Conference on Machine Control Guidance. Bonn. – 2010. – Vol. 1. – P. 95–104.
  40. Li C., Zaheer M., Zhang Y., Poczos B., Salakhutdinov R. R. Point cloud GAN // Deep Generative Models for Highly Structured Data, DGS@ICLR 2019 Workshop. – 2019.
  41. Marulanda F. G., Libin P., Verstraeten T., Nowé A. IPC-Net: 3D point-cloud segmentation using deep inter-point convolutional layers // International Conference on Tools with Artificial Intelligence, ICTAI. – 2018. – P. 293–301.
  42. Uy M. A., Lee G. PointNetVLAD: Deep Point Cloud Based Retrieval for Large-Scale Place Recognition // Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. – 2018. – P. 4470-4479.
  43. Zhou Y., Tuzel O. VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection // Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. – 2018. – P. 4490-4499.
  44. Yi L., Zhao W., Wang H., Sung M., Guibas L. J. GSPN: Generative shape proposal network for 3D instance segmentation in point cloud // Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. – 2019. – P. 3942–3951.
  45. Yang Y., Feng C., Shen Y., Tian D. FoldingNet: Point Cloud Auto-Encoder via Deep Grid Deformation // Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. – 2018. – P. 206215.
  46. Yotsumata T., Sakamoto M., Satoh T. Quality improvement for airborne lidar data filtering based on deep learning method // The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences. – 2020. – Vol. XLIII-B2-2020. – P. 355–360.
  47. Gülch E., Obrock L. S. Automated semantic modelling of building interiors from images and derived point clouds based on deep learning methods // The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences. – 2020. – Vol. XLIII-B2-2020. – P. 421–426.
  48. Tchapmi L. P., Choy C. B., Armeni I., Gwak J. Y., Savarese S. Segcloud: Semantic segmentationof 3d point clouds // International Conference on 3D Vision(3DV). – 2017.
  49. Dai A., Chang A. X., Savva M., Halber M., Funkhouser T., Niener M. Scannet: Richly annotated 3D reconstructions of indoor scenes // Proceedings Computer Vision and Pattern Recognition (CVPR). – 2017.
  50. Riegler G., Ulusoy A.O., Geiger A. Oct-net: Learning deep 3d representations at high resolutions // Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. – 2017.
  51. Su H., Jampani V., Sun D., Maji S., Kalogerakis E., Yang M., Kautz J. SPLATNet: Sparse Lattice Networks for Point Cloud Processing // Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. – 2018. – P. 2530–2539.
  52. Graham B. Sparse 3d convolutional neural networks // British Machine Vision Conference. – 2015.
  53. Adams A., Baek J., Davis M.A. Fast high-dimensional filtering using the permutohedral lattice // Proceedings Computer Graphics Forum. – 2010. – Vol. 28. – P. 753–762.
  54. Hermosilla P., Ritschel T., Vazquez P.P., Vinacua A., Ropinski T. Monte-Carlo convolution for learning on non-uniformly sampled point clouds // ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia 2018). – 2018.
  55. Li Y., Rui B., Mungchao S., Wei W., Xinhan D., Baoquan C. PointCNN: Convolution On X-Transformed Points // NeurIPS 2018. – 2018.
  56. Pan H., Liu S., Liu Y., Tong X. Convolutional neural networks on 3D surfaces using parallel frames. – 2018. – arxiv preprint arXiv: 1808.04952.
  57. Tatarchenko M., Park J., Koltun V., Zhou Q. Tangent convolutions for dense predictionin 3D // CVPR. – 2018.
  58. Gall Y. L., Thomas H., Goulette F., Deschaud J., Marcotegui B. Semantic Classification of 3D Point Clouds with Multiscale Spherical Neighborhoods // 2018 International Conference on 3D Vision (3DV). Verone. – 2018.
  59. Choy C. B., Xu D., Gwak J., Chen K., Savarese S. 3D-r2n2: A unified approach for single and multiview 3D object reconstruction // Proceedings of the European Conference on Computer Vision (ECCV). – 2016.
  60. Zeng A., Song S., Niener M., Fisher M., Xiao J., Funkhouser T. 3Dmatch: Learning the matching of local 3D geometry in range scans // CVPR. – 2017.
  61. Zhao Y., Li X., Huang H., Zhang W., Zhao S., Makkie M., Zhang M., Li Q., Liu T. 4D Modeling of fMRI Data via Spatio-Temporal Convolutional Neural Networks (ST-CNN) // IEEE Transactions on Cognitive and Developmental Systems. – 2019.
  62. Choy C., Gwak J., Savarese S. 4D Spatio-Temporal ConvNet: Minkowski Convolutional Neural Network // IEEE Conference on Computer Vision and Pattern Recognition (CVPR). – 2019.
  63. Абросимов М. А., Бровко А. В. Метод нормализации облака точек, подлежащего обработке с помощью искусственной нейронной сети // Информационно-коммуникационные технологии в науке, производстве и образовании ICIT-2017. – Воронеж, 2017. – С. 262–268.
  64. Бабаев А. М. Нейросетевые технологии распознавания трехмерных объектов // Международный журнал гуманитарных и естественных наук. – 2019. – Т. 39, No. 12-2. – C. 74–76.
  65. Каздорф С. Я., Першина Ж. С. Алгоритм семантической сегментации трехмерных сцен // Cloud of Science. – 2019. – Vol. 6, No. 3. – P. 451–461.
  66. Aoki Y., Goforth H., Srivatsan R. A., Lucey S. Pointnetlk: Robust & efficient point cloud registration using pointnet // Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. – 2019. – P. 7156–7165.
  67. Zaganidis A., Sun L., Duckett T., Cielniak G. Integrating Deep Semantic Segmentation into 3-D Point Cloud Registration // IEEE Robotics and Automation Letters. – 2018. – Vol. 3, No. 4. – P. 2942–2949.
  68. Neidhart H., Sester M. Identifying building types and building clusters using 3D-laser scanning and GIS-data // Machine Learning. – 2003.
  69. Zhang B., Huang S., Shen W., Wei Z. Explaining the PointNet: What Has Been Learned Inside the PointNet? // IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). – 2019. – P. 71–74.