Built environment defect mapping, modeling, and management (D3M): A BIM-based integrated framework

Junjie Chen; Weisheng Lu; Donghai Liu

doi:10.26599/JIC.2024.9180008

Journal of Intelligent Construction 2024, 2(1): 9180008 https://doi.org/10.26599/JIC.2024.9180008

Research Article |

Open Access | Issue | Published: 26 February 2024

Built environment defect mapping, modeling, and management (D3M): A BIM-based integrated framework

Show Author's Information Hide Author's Information Junjie Chen^{^a}, Weisheng Lu^{^a}, Donghai Liu^{^b}(

)

aDepartment of Real Estate and Construction, The University of Hong Kong, Hong Kong 999077, China

bState Key Laboratory of Hydraulic Engineering Intelligent Construction and Operation, Tianjin University, Tianjin 300350, China

Keywords:

sustainability, building information modeling, built environment, facility management, defect information modeling

Cite this article:

Chen J, Lu W, Liu D. Built environment defect mapping, modeling, and management (D3M): A BIM-based integrated framework. Journal of Intelligent Construction, 2024, 2(1): 9180008. https://doi.org/10.26599/JIC.2024.9180008

Download citation

EndNote(RIS)

BibTeX

886

Views

156

Downloads

Citations

Crossref

N/A

WoS

N/A

Scopus

N/A

CSCD

Abstract Full text About this article

Abstract

The built environment is subject to various defects as it ages. A well-maintained built environment depends on surveying activities to inspect, document, and rehabilitate the defects that occurred. The advancement of digital technologies paves the pathway towards (1) comprehensive defect inspection by systematic mapping, (2) their consistent documentation by digital modeling, and (3) timely retrofitting by proactive management. However, the three steps of defect mapping, modeling, and management (D3M) remain largely fragmented and have yet to be synergized. Exploiting the pivotal role of building information modeling (BIM) in built asset management, this paper puts forward a cohesive framework for integrated D3M. It leverages the rich geometric-semantic information in BIM to assist defect mapping and enriches the BIM by industry foundation classes (IFCs)-represented defect information. The defect-enriched BIM facilitates defect management in a data-driven manner. The framework was applied in multiple real-life infrastructure and civil works projects. It demonstrates how the BIM-based D3M framework can enhance the maintenance of those that have been built, and ultimately contribute to a safe and sustainable built environment. Future studies are called for to substantiate each of the 3Ms by leveraging BIM as both an enabler and a beneficiary.

Full text

Abstract

Full text

Outline

About this article

Built environment defect mapping, modeling, and management (D3M): A BIM-based integrated framework

Show Author's information Hide Author's Information Junjie Chen^{^a}, Weisheng Lu^{^a}, Donghai Liu^{^b}(

)

aDepartment of Real Estate and Construction, The University of Hong Kong, Hong Kong 999077, China

bState Key Laboratory of Hydraulic Engineering Intelligent Construction and Operation, Tianjin University, Tianjin 300350, China

Abstract

Keywords: sustainability, building information modeling, built environment, facility management, defect information modeling

References(53)

[1]

R. Carvais, A. Guillerme, V. Nègre, J. Sakarovitch. Nuts & Bolts of Construction History: Culture, Technology and Society. Paris (France): Picard, 2012.

[2]

J. A. Vanegas. Road map and principles for built environment sustainability. Environ Sci Technol, 2003, 37: 5363–5372.

DOI Google Scholar

[3]

R. Napolitano, M. Monce. Failure at fidenae: Understanding the site of the largest structural disaster of the roman world. Digit Appl Archaeol Cult Heritage, 2018, 10: e00077.

DOI Google Scholar

[4]

J. A. Manik, J. Yardley. Building collapse in bangladesh leaves scores dead. New York (USA): The New York Times, 2013.

[5]

S. Magdy. Warnings About Libya’s Unsafe Dams Went Unadressed for Years. Toronto (Canada): The Globe and Mail Inc., 2023: p A8.

[6]

G. W. Housner, L. A. Bergman, T. K. Caughey, et al. Structural control: Past, present, and future. J Eng Mech, 1997, 123: 897–971.

DOI Google Scholar

[7]

G. T. Ferraz, J. de Brito, V. P. de Freitas, et al. State-of-the-art review of building inspection systems. J Perform Constr Facil, 2016, 30: 04016018.

DOI Google Scholar

[8]

G. H. R. Wright. Ancient Building Technology: Volume 1: Historical Background. Leiden (The Netherlands): Brill, 2000: 50–68.

DOI

[9]

D. Lattanzi, G. Miller. Review of robotic infrastructure inspection systems. J Infrastruct Syst, 2017, 23: 04017004.

DOI Google Scholar

[10]

D. H. Liu, X. T. Xia, J. J. Chen, et al. Integrating building information model and augmented reality for drone-based building inspection. J Comput Civ Eng, 2021, 35: 04020073.

DOI Google Scholar

[11]

J. J. Chen, W. S. Lu, J. F. Lou. Automatic concrete defect detection and reconstruction by aligning aerial images onto semantic-rich building information model. Comput-Aided Civ Inf Eng, 2023, 38: 1079–1098.

DOI Google Scholar

[12]

Y. LeCun, Y. Bengio, G. Hinton. Deep learning. Nature, 2015, 521: 436–444.

DOI Google Scholar

[13]

M. Artus, C. Koch. Retracted: Object-oriented damage information modeling concepts and implementation for bridge inspection. J Comput Civ Eng, 2022, 36: 04022029.

DOI Google Scholar

[14]

J. J. Chen, W. S. Lu, Y. L. Fu, et al. Automated facility inspection using robotics and BIM: A knowledge-driven approach. Adv Eng Inform, 2023, 55: 101838.

DOI Google Scholar

[15]

D. Kang, Y. J. Cha. Autonomous UAVs for structural health monitoring using deep learning and an ultrasonic beacon system with geo-tagging. Comput-Aided Civ Inf Eng, 2018, 33: 885–902.

DOI Google Scholar

[16]

Y. J. Cha, W. Choi, O. Büyüköztürk. Deep learning-based crack damage detection using convolutional neural networks. Comput-Aided Civ Inf Eng, 2017, 32: 361–378.

DOI Google Scholar

[17]

J. J. Lin, A. Ibrahim, S. Sarwade, et al. Bridge inspection with aerial robots: Automating the entire pipeline of visual data capture, 3D mapping, defect detection, analysis, and reporting. J Comput Civ Eng, 2021, 35: 04020064.

DOI Google Scholar

[18]

C. Eastman, P. Teicholz, R. Sacks, et al. BIM Handbook: A Guide to Building Information Modeling for Owners, Managers, Designers, Engineers and Contractors. 2^nd edn. Hoboken (USA): John Wiley & Sons, 2011.

[19]

J. Douglas, B. Ransom. Understanding Building Failures. London (UK): Routledge, 2013.

DOI

[20]

ISO 15686-1. Buildings and constructed assets—Service life planning: Part 1 General principles and framework. International Organization for Standardization, Switherland, 2011.

[21]

F. Faqih, T. Zayed, E. Soliman. Factors and defects analysis of physical and environmental condition of buildings. J Build Pathol Rehabil, 2020, 5: 1–15.

DOI Google Scholar

[22]

H. Y. Wu, Y. Q. Liu, R. D. Chang, et al. Research status quo and trends of construction robotics: A bibliometric analysis. J Comput Civ Eng, 2024, 38: 03123001.

DOI Google Scholar

[23]

Y. Zhang, Y. L. Ma, Y. L. Li, et al. Intelligent analysis method of dam material gradation for asphalt-core rock-fill dam based on enhanced cascade mask R-CNN and GCNet. Adv Eng Inform, 2023, 56: 102001.

DOI Google Scholar

[24]

Z. L. Qi, D. H. Liu, J. Y. Zhang, et al. Micro-concrete crack detection of underwater structures based on convolutional neural network. Mach Vis Appl, 2022, 33: 74.

DOI Google Scholar

[25]

J. J. Chen, D. H. Liu, X. Li. Extracting water channels from aerial videos based on image-to-BIM registration and spatio-temporal continuity. Autom Constr, 2021, 132: 103970.

DOI Google Scholar

[26]

K. Y. Lin, M. H. Tsai, U. C. Gatti, et al. A user-centered information and communication technology (ICT) tool to improve safety inspections. Autom Constr, 2014, 48: 53–63.

DOI Google Scholar

[27]

Y. T. Lee. Information modeling: From design to implementation. In: Proceedings of the Second World Manufacturing Congress, Durham, UK, 1999: pp 315–321.

[28]

S. Z. Zhao, F. Kang, J. J. Li. Concrete dam damage detection and localisation based on YOLOv5s-HSC and photogrammetric 3D reconstruction. Autom Constr, 2022, 143: 104555.

DOI Google Scholar

[29]

Y. F. Liu, X. Nie, J. S. Fan, et al. Image-based crack assessment of bridge piers using unmanned aerial vehicles and three-dimensional scene reconstruction. Comput-Aided Civ Inf Eng, 2020, 35: 511–529.

DOI Google Scholar

[30]

M. Artus, M. S. H. Alabassy, C. Koch. IFC based framework for generating, modeling and visualizing spalling defect geometries. In: Proceedings of Workshop on Intelligent Computing in Engineering (EG-ICE 2021), Berlin, Germany, 2021: pp 176–186.

[31]

D. Isailović, V. Stojanovic, M. Trapp, et al. Bridge damage: Detection, IFC-based semantic enrichment and visualization. Autom Constr, 2020, 112: 103088.

DOI Google Scholar

[32]

B. Akinci, F. Boukamp, C. Gordon, et al. A formalism for utilization of sensor systems and integrated project models for active construction quality control. Autom Constr, 2006, 15: 124–138.

DOI Google Scholar

[33]

S. I. Yang, D. M. Frangopol, Y. Kawakami, et al. The use of lifetime functions in the optimization of interventions on existing bridges considering maintenance and failure costs. Reliab Eng Syst Saf, 2006, 91: 698–705.

DOI Google Scholar

[34]

X. L. Zhang, X. Lin, W. Zhang, et al. Intelligent recognition of voids behind tunnel linings using deep learning and percussion sound. J Intell Constr, in press, https://doi.org/10.26599/JIC.2023.9180029.

DOI

[35]

M. I. Rafiq, M. K. Chryssanthopoulos, T. Onoufriou. Performance updating of concrete bridges using proactive health monitoring methods. Reliab Eng Syst Saf, 2004, 86: 247–256.

DOI Google Scholar

[36]

International Organization for Standardization. Organization and digitization of information about buildings and civil engineering works, including building information modelling (BIM)—Information management using building information modelling: ISO 19650-4, Part 4: Information exchange. Geneva (Switherland): ISO, 2022.

[37]

J. C. P. Cheng, Q. Q. Lu. A review of the efforts and roles of the public sector for BIM adoption worldwide. J Inf Technol Constr, 2015, 20: 442–478.

Google Scholar

[38]

Z. L. Zhang, S. R. Zhang, Z. Y. Zhao, et al. Hydrobim—Digital design, intelligent construction, and smart operation. J Intell Constr, 2023, 1: 9180014.

DOI Google Scholar

[39]

M. T. Yin, L. Tang, C. Webster, et al. A deep natural language processing-based method for ontology learning of project-specific properties from building information models. Comput-Aided Civ Inf Eng, 2024, 39: 30–45.

DOI Google Scholar

[40]

F. Baek, I. Ha, H. Kim. Augmented reality system for facility management using image-based indoor localization. Autom Constr, 2019, 99: 18–26.

DOI Google Scholar

[41]

M. Kopsida, I. Brilakis. BIM registration methods for mobile augmented reality-based inspection. In: eWork and Ebusiness in Architecture, Engineering and Construction: ECPPM 2016. S. Christodoulou, R. Scherer, Eds. London (UK): Routledge, 2016: pp 201–208.

[42]

R. Sacks, C. M. Eastman, G. Lee, et al. BIM Handbook: A Guide to Building Information Modeling for Owners, Designers, Engineers, Contractors and Facility Managers. 3^rd edn. Hoboken (USA): John Wiley & Sons, 2018.

DOI

[43]

J. M. D. Delgado, L. J. Butler, I. Brilakis, et al. Structural performance monitoring using a dynamic data-driven BIM environment. J Comput Civ Eng, 2018, 32: 04018009.

DOI Google Scholar

[44]

P. Hüthwohl, I. Brilakis, A. Borrmann, et al. Integrating RC bridge defect information into BIM models. J Comput Civ Eng, 2018, 32: 04018013.

DOI Google Scholar

[45]

P. Parsanezhad, J. Dimyadi. Effective facility management and operations via a BIM-based integrated information system. In: Proceedings of CIB Facilities Management Conference, Copenhagen, Denmark, 2013.

[46]

Y. Tan, S. L. Li, H. L. Liu, et al. Automatic inspection data collection of building surface based on BIM and UAV. Autom Constr, 2021, 131: 103881.

DOI Google Scholar

[47]

J. J. Chen, S. Li, D. H. Liu, et al. Indoor camera pose estimation via style-transfer 3D models. Comput-Aided Civ Inf Eng, 2022, 37: 335–353.

DOI Google Scholar

[48]

J. J. Chen, S. Li, W. S. Lu. Align to locate: Registering photogrammetric point clouds to BIM for robust indoor localization. Build Environ, 2022, 209: 108675.

DOI Google Scholar

[49]

Y. J. Wei, B. Akinci. A vision and learning-based indoor localization and semantic mapping framework for facility operations and management. Autom Constr, 2019, 107: 102915.

DOI Google Scholar

[50]

D. H. Kang, Y. J. Cha. Efficient attention-based deep encoder and decoder for automatic crack segmentation. Struct Health Monit, 2022, 21: 2190–2205.

DOI Google Scholar

[51]

J. J. Chen, D. H. Liu, S. Li, et al. Registering georeferenced photos to a building information model to extract structures of interest. Adv Eng Inform, 2019, 42: 100937.

DOI Google Scholar

[52]

J. J. Chen, D. H. Liu. Bottom–up image detection of water channel slope damages based on superpixel segmentation and support vector machine. Adv Eng Inform, 2021, 47: 101205.

DOI Google Scholar

[53]

Q. L. Min, M. C. Li, M. X. Zhang, et al. Node projection strategy for FEM simulating cross-scale crack propagation in massive concrete structures. Eng Struct, 2023, 293: 116665.

DOI Google Scholar

About this article

Publication history

Acknowledgements

Rights and permissions

Publication history

Received: 12 November 2023

Revised: 11 December 2023

Accepted: 21 December 2023

Published: 26 February 2024

Issue date: March 2024

Copyright

Acknowledgements

This research is supported by the HKU Teaching Development Grant (No. 913), HKU Seed Fund for Basic Research (No. 2201100454), and State Key Laboratory of Hydraulic Engineering Intelligent Construction and Operation (No. HESS-2303).

Rights and permissions

The articles published in this open access journal are distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits use, distribution and reproduction in any medium, provided the original work is properly cited.