Please use this identifier to cite or link to this item: https://doi.org/10.1016/j.jag.2022.102859
Title: 3D building reconstruction from single street view images using deep learning
Authors: Pang, Hui En
Filip Biljecki 
Keywords: 3D geoinformation
GeoAI
Urban morphology
Digital twin
Google Street View
3D GIS
Issue Date: 17-Jun-2022
Citation: Pang, Hui En, Filip Biljecki (2022-06-17). 3D building reconstruction from single street view images using deep learning. International Journal of Applied Earth Observation and Geoinformation 112 : 102859. ScholarBank@NUS Repository. https://doi.org/10.1016/j.jag.2022.102859
Rights: Attribution-ShareAlike 4.0 International
Abstract: 3D building models are an established instance of geospatial information in the built environment, but their acquisition remains complex and topical. Approaches to reconstruct 3D building models often require existing building information (e.g. their footprints) and data such as point clouds, which are scarce and laborious to acquire, limiting their expansion. In parallel, street view imagery (SVI) has been gaining currency, driven by the rapid expansion in coverage and advances in computer vision (CV), but it has not been used much for generating 3D city models. Traditional approaches that can use SVI for reconstruction require multiple images, while in practice, often only few street-level images provide an unobstructed view of a building. We develop the reconstruction of 3D building models from a single street view image using image-to-mesh reconstruction techniques modified from the CV domain. We regard three scenarios: (1) standalone single-view reconstruction; (2) reconstruction aided by a top view delineating the footprint; and (3) refinement of existing 3D models, i.e. we examine the use of SVI to enhance the level of detail of block (LoD1) models, which are common. The results suggest that trained models supporting (2) and (3) are able to reconstruct the overall geometry of a building, while the first scenario may derive the approximate mass of the building, useful to infer the urban form of cities. We evaluate the results by demonstrating their usefulness for volume estimation, with mean errors of less than 10% for the last two scenarios. As SVI is now available in most countries worldwide, including many regions that do not have existing footprint and/or 3D building data, our method can derive rapidly and cost-effectively the 3D urban form from SVI without requiring any existing building information. Obtaining 3D building models in regions that hitherto did not have any, may enable a number of 3D geospatial analyses locally for the first time.
Source Title: International Journal of Applied Earth Observation and Geoinformation
URI: https://scholarbank.nus.edu.sg/handle/10635/227176
ISSN: 0303-2434
DOI: 10.1016/j.jag.2022.102859
Rights: Attribution-ShareAlike 4.0 International
Appears in Collections:Elements
Staff Publications

Show full item record
Files in This Item:
File Description SizeFormatAccess SettingsVersion 
1-s2.0-S1569843222000619-main.pdf20.2 MBAdobe PDF

OPEN

PublishedView/Download

Page view(s)

30
checked on Aug 4, 2022

Download(s)

1
checked on Aug 4, 2022

Google ScholarTM

Check

Altmetric


This item is licensed under a Creative Commons License Creative Commons