DEEP LEARNING FOR 3D BUILDING RECONSTRUCTION: A REVIEW


Creative Commons License

Buyukdemircioglu M., KOCAMAN GÖKÇEOĞLU S., Kada M.

24th ISPRS Congress on Imaging Today, Foreseeing Tomorrow, Nice, France, 6 - 11 June 2022, vol.43-B2, pp.359-366 identifier identifier

  • Publication Type: Conference Paper / Full Text
  • Volume: 43-B2
  • Doi Number: 10.5194/isprs-archives-xliii-b2-2022-359-2022
  • City: Nice
  • Country: France
  • Page Numbers: pp.359-366
  • Keywords: Deep Learning, Machine Learning, 3D City Models, 3D Reconstruction, LoD, CITY MODELS, CLASSIFICATION
  • Hacettepe University Affiliated: Yes

Abstract

3D building reconstruction using Earth Observation (EO) data (aerial and satellite imagery, point clouds, etc.) is an important and active research topic in different fields, such as photogrammetry, remote sensing, computer vision and Geographic Information Systems (GIS). Nowadays 3D city models have become an essential part of 3D GIS environments and they can be used in many applications and analyses in urban areas. The conventional 3D building reconstruction methods depend heavily on the data quality and source; and manual efforts are still needed for generating the object models. Several tasks in photogrammetry and remote sensing have been revolutionized by using deep learning (DL) methods, such as image segmentation, classification, and 3D reconstruction. In this study, we provide a review on the state-of-the-art machine learning and in particular the DL methods for 3D building reconstruction for the purpose of city modelling using EO data. This is the first review with a focus on object model generation based on the DL methods and EO data. A brief overview of the recent building reconstruction studies with DL is also given. We have investigated the different DL architectures, such as convolutional neural networks (CNNs), generative adversarial networks (GANs), and the combinations of conventional approaches with DL in this paper and reported their advantages and disadvantages. An outlook on the future developments of 3D building modelling based on DL is also presented.