The Role of Ai-Supported Models in the Damage Detection Process of Historical Buildings: A Review

Mustafa Haki ERASLAN, Mehmet MUTLU

Abstract


The sustainable preservation of historical buildings is of great importance for the future preservation of cultural heritage. The advent of artificial intelligence (AI) technologies in recent years has led to significant advancements in damage detection for historical buildings, resulting in enhanced efficiency and speed. Consequently, there has been a notable proliferation of artificial intelligence-based damage detection models in the extant literature. This study aims to examine the role of artificial intelligence-supported models in the damage detection process of historical buildings. A comprehensive review of the extant literature was conducted, encompassing a total of 97 case studies. The analysis revealed that damages to historic buildings can be categorized into three primary classes: disaster damages, structural damages (including structural health monitoring), and surface damages. The study provides a comprehensive analysis of damage detection methods in historical buildings, offering significant insights into the performance of existing artificial intelligence models in each category. The effectiveness of artificial intelligence-supported models in damage detection for historical buildings has been evaluated, and the strengths and shortcomings in the existing literature have been identified. The study further highlights aspects that require improvement in existing approaches and provides recommendations for future research endeavors. This study emphasizes the significance of artificial intelligence-based damage assessment methods for the conservation of historical buildings, laying the groundwork for future research in this field.

Keywords


Damage Detection; Historical Buildings; Artificial Intelligence; Machine Learning

Full Text:

PDF

References


- F. Gîrbacia, An analysis of research trends for using artificial intelligence in cultural heritage. Electronics 13(18) (2024) 3738. https://doi.org/10.3390/electronics13183738

- M. Mishra, Machine learning techniques for structural health monitoring of heritage buildings: A state-of-the-art review and case studies. J. Cult. Herit. 47 (2021) 227–245. https://doi.org/10.1016/j.culher.2020.09.005

- P. Ghannadi, S. Khatir, S.S. Kourehli, A. Nguyen, D. Boutchicha, M. Abdel Wahab, Finite element model updating and damage identification using semi-rigidly connected frame element and optimization procedure: An experimental validation. Structures 50 (2023) 1173–1190. https://doi.org/10.1016/j.istruc.2023.02.008

- P. Ghannadi, S.S. Kourehli, Efficiency of the slime mold algorithm for damage detection of large-scale structures. Struct. Des. Tall Spec. Build. 31(14) (2022). https://doi.org/10.1002/tal.1967

- P. Ghannadi, S.S. Kourehli, A. Nguyen, Experimental validation of an efficient strategy for FE model updating and damage identification in tubular structures. Nondestruct. Test. Eval. 40(8) (2025) 3424–3463. https://doi.org/10.1080/10589759.2024.2402887

- D.V. Ruiz, C.S.C. de Bragança, B.L. Poncetti, T.N. Bittencourt, M.M. Futai, Vibration-based structural damage detection strategy using FRFs and machine learning classifiers. Structures 59 (2024) 105753. https://doi.org/10.1016/j.istruc.2023.105753

- M. Moravvej, M. El-Badry, Reference-free vibration-based damage identification techniques for bridge structural health monitoring—A critical review and perspective. Sensors 24(3) (2024) 876. https://doi.org/10.3390/s24030876

- D. Nguyen, N.M.T. Nguyen, Numerical and experimental studies on vibration-based damage detection methods in beam structures. J. Mater. Eng. Struct. 11(3) (2024) 255–266.

- R.-S. Rajadurai, S.-T. Kang, Automated vision-based crack detection on concrete surfaces using deep learning. Appl. Sci. 11(11) (2021) 5229. https://doi.org/10.3390/app11115229

- A. Soleymani, H. Jahangir, M.L. Nehdi, Damage detection and monitoring in heritage masonry structures: Systematic review. Constr. Build. Mater. 397 (2023) 132402. https://doi.org/10.1016/j.conbuildmat.2023.132402

- V. Giannuzzi, F. Fatiguso, Historic built environment assessment and management by deep learning techniques: A scoping review. Appl. Sci. 14(16) (2024) 7116. https://doi.org/10.3390/app14167116

- Y. Li, M. Zhao, J. Mao, Y. Chen, L. Zheng, L. Yan, Detection and recognition of Chinese porcelain inlay images of traditional Lingnan architectural decoration based on YOLOv4 technology. Herit. Sci. 12(1) (2024) 137. https://doi.org/10.1186/s40494-024-01227-z

- M.F. Islam, Identifying hurricane damage using explainable compact transformer with convolutional embedding. In: Proceedings of the 25th International Conference on Computer and Information Technology (ICCIT 2022) (2022) 833–838. https://doi.org/10.1109/ICCIT57492.2022.10054917

- R.L. Wood, M.E. Mohammadi, Feature-based point cloud-based assessment of heritage structures for nondestructive and noncontact surface damage detection. Heritage 4(2) (2021) 775–793. https://doi.org/10.3390/heritage4020043

- E. Nazarian, T. Taylor, W. Tang, F. Ansari, Machine-learning-based approach for post event assessment of damage in a turn-of-the-century building structure. J. Civ. Struct. Health Monit. 8(2) (2018) 237–251. https://doi.org/10.1007/s13349-018-0275-6

- F. Elghaish, S.T. Matarneh, S. Talebi, S. Abu-Samra, G. Salimi, C. Rausch, Deep learning for detecting distresses in buildings and pavements: A critical gap analysis. Constr. Innov. 22(3) (2022) 554–579. https://doi.org/10.1108/CI-09-2021-0171

- H.S. Munawar, A.W.A. Hammad, A. Haddad, C.A.P. Soares, S.T. Waller, Image-based crack detection methods: A review. Infrastructures 6(8) (2021) 115. https://doi.org/10.3390/infrastructures6080115

- S. Al Shafian, D. Hu, Integrating machine learning and remote sensing in disaster management: A decadal review of post-disaster building damage assessment. Buildings 14(8) (2024) 2344. https://doi.org/10.3390/buildings14082344

- J. Kallas, R. Napolitano, Automated large-scale damage detection on historic buildings in post-disaster areas using image segmentation. Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci. XLVIII-M-2 (2023) 797–804. https://doi.org/10.5194/isprs-archives-XLVIII-M-2-2023-797-2023

- R. Ramírez Eudave, T.M. Ferreira, R. Vicente, P.B. Lourenço, F. Peña, Parametric and machine learning-based analysis of the seismic vulnerability of adobe historical buildings damaged after the September 2017 Mexico earthquakes. Int. J. Archit. Herit. 18(6) (2024) 940–963. https://doi.org/10.1080/15583058.2023.2200739

- F. Marafini, G. Zini, A. Barontini, M. Betti, G. Bartoli, N. Mendes, A proposal of classification for machine-learning vibration-based damage identification methods. In: Proceedings of the International Conference on Rehabilitation and Restoration of Structures and Buildings, REHABEND 2022, (2023) 593–598. https://doi.org/10.21741/9781644902431-96

- G. Wojciechowska, Ł.J. Bednarz, N. Dolińska, P. Opałka, M. Krupa, N. Imnadze, Intelligent monitoring system for integrated management of historical buildings. Buildings 14(7) (2024) 2108. https://doi.org/10.3390/buildings14072108

- R. Tanida, R. Oiwa, T. Ito, T. Kawahara, Wooden framed house structural health monitoring by system identification and damage detection under dynamic motion with artificial intelligence sensor using a model of house including braces. In: Proceedings of the IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA 2018) (2018). https://doi.org/10.1109/CIVEMSA.2018.8439967

- E. García-Macías, I.A. Hernández-González, E. Puertas, R. Gallego, R. Castro-Triguero, F. Ubertini, Meta-model assisted continuous vibration-based damage identification of a historical rammed earth tower in the Alhambra complex. Int. J. Archit. Herit. 18(3) (2024) 427–453. https://doi.org/10.1080/15583058.2022.2155883

- D. Kwon, J. Yu, Automatic damage detection of stone cultural property based on deep learning algorithm. In: Proceedings of the ISPRS International Conference on Geospatial Information for Disaster Management XLII-2/W15 (2019) 639–643. https://doi.org/10.5194/isprs-archives-XLII-2-W15-639-2019

- E. Valero, A. Forster, F. Bosché, E. Hyslop, L. Wilson, A. Turmel, Automated defect detection and classification in ashlar masonry walls using machine learning. Autom. Constr. 106 (2019) 102846. https://doi.org/10.1016/j.autcon.2019.102846

- M.E. Hatır, İ. İnce, M. Korkanç, Intelligent detection of deterioration in cultural stone heritage. J. Build. Eng. 44 (2021) 102690. https://doi.org/10.1016/j.jobe.2021.102690

- M. Samhouri, L. Al-Arabiat, F. Al-Atrash, Prediction and measurement of damage to architectural heritage façades using convolutional neural networks. Neural Comput. Appl. 34(20) (2022) 18125–18141. https://doi.org/10.1007/s00521-022-07461-5

- S. Bruno, R.A. Galantucci, A. Musicco, Decay detection in historic buildings through image-based deep learning. Vitruvio Int. J. Archit. Technol. Sustain. 8 (2023) 6–17. https://doi.org/10.4995/vitruvio-ijats.2023.18662

- N. Karimi, N. Valibeig, H.R. Rabiee, Deterioration detection in historical buildings with different materials based on novel deep learning methods focusing on Isfahan historical bridges. Int. J. Archit. Herit. 18(6) (2024) 981–993. https://doi.org/10.1080/15583058.2023.2201576

- Wang, X. Zhao, Z. Zou, P. Zhao, F. Qi, Autonomous damage segmentation and measurement of glazed tiles in historic buildings via deep learning. Comput.-Aided Civ. Infrastruct. Eng. 35(3) (2020) 277–291. https://doi.org/10.1111/mice.12488

- Zhang, L. Kong, M.F. Antwi-Afari, Q. Zhang, An integrated method using a convolutional autoencoder, thresholding techniques, and a residual network for anomaly detection on heritage roof surfaces. Buildings 14(9) (2024) 2828. https://doi.org/10.3390/buildings14092828

- L. Yan, Y. Chen, L. Zheng, Y. Zhang, Application of computer vision technology in surface damage detection and analysis of shed-thin tiles in China: A case study of the classical gardens of Suzhou. Herit. Sci. 12(1) (2024). https://doi.org/10.1186/s40494-024-01185-6

- S.-Y. Lee, D. Lee, A deep learning framework for cultural heritage damage detection for preservation: Based on the case of Heunginjimun and Yeongnamnu in South Korea. In: Proceedings of the International Conference on Advanced Communication Technology (ICACT 2024) (2024) 1507–1513. https://doi.org/10.23919/ICACT60172.2024.10471765

- J. Lee, J.M. Yu, Automatic surface damage classification developed based on deep learning for wooden architectural heritage. ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci. X-M-1 (2023) 151–157. https://doi.org/10.5194/isprs-annals-X-M-1-2023-151-2023

- J. Fan, Y. Chen, L. Zheng, Artificial intelligence for routine heritage monitoring and sustainable planning of the conservation of historic districts: A case study on Fujian earthen houses (Tulou). Buildings 14(7) (2024) 1915. https://doi.org/10.3390/buildings14071915

- N. Karimi, M. Mishra, P.B. Lourenço, Deep learning-based automated tile defect detection system for Portuguese cultural heritage buildings. J. Cult. Herit. 68 (2024) 86–98. https://doi.org/10.1016/j.culher.2024.05.009

- C.-X. Yu, Application of deep learning techniques for thermal imagery analysis in abnormal identification of floor tiles in heritage environments. In: Proceedings of the Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC 2023) (2023) 1878–1884. https://doi.org/10.1109/APSIPAASC58517.2023.10317400

- L. Zheng, Y. Chen, L. Yan, Y. Zhang, Automatic detection and recognition method of Chinese clay tiles based on YOLOv4: A case study in Macau. Int. J. Archit. Herit. 18(10) (2024) 1551–1570. https://doi.org/10.1080/15583058.2023.2246029

- H.C. Reis, K. Khoshelham, ReCRNet: A deep residual network for crack detection in historical buildings. Arab. J. Geosci. 14(20) (2021) 2112. https://doi.org/10.1007/s12517-021-08491-4

- L.E. Mansuri, D.A. Patel, Artificial intelligence-based automatic visual inspection system for built heritage. Smart Sustain. Built Environ. 11(3) (2022) 622–646. https://doi.org/10.1108/SASBE-09-2020-0139

- M. Ravichand, R. Kumar, B. Hazela, T. Suthar, Crack on brick wall detection by computer vision using machine learning. In: Proceedings of the 6th International Conference on Electronics, Communication and Aerospace Technology (ICECA 2022) (2022) 1017–1020. https://doi.org/10.1109/ICECA55336.2022.10009343

- P.S. Roy, V. Kukreja, V. Jain, S. Vats, Classification of defective intensity levels of paint in heritage buildings using the CNN-SVM technique. In: Proceedings of the 5th International Conference on Inventive Research in Computing Applications (ICIRCA 2023) (2023) 17–22. https://doi.org/10.1109/ICIRCA57980.2023.10220916

- S. Mehta, V. Kukreja, A. Gupta, Exploring the efficacy of CNN and SVM models for automated damage severity classification in heritage buildings. In: Proceedings of the Second International Conference on Augmented Intelligence and Sustainable Systems (ICAISS 2023) (2023) 252–257. https://doi.org/10.1109/ICAISS58487.2023.10250665

- R.A. Galantucci, A. Musicco, C. Verdoscia, F. Fatiguso, Machine learning for the semi-automatic 3D decay segmentation and mapping of heritage assets. Int. J. Archit. Herit. (2023). https://doi.org/10.1080/15583058.2023.2287152

- M. Mishra, T. Barman, G.V. Ramana, Artificial intelligence-based visual inspection system for structural health monitoring of cultural heritage. J. Civ. Struct. Health Monit. 14(1) (2024) 103–120. https://doi.org/10.1007/s13349-022-00643-8

- E. Alexakis, E.T. Delegou, P. Mavrepis, A. Rifios, D. Kyriazis, A. Moropoulou, A novel application of deep learning approach over IRT images for the automated detection of rising damp on historical masonries. Case Stud. Constr. Mater. 20 (2024) e02889. https://doi.org/10.1016/j.cscm.2024.e02889

- N. Wang, Q. Zhao, S. Li, X. Zhao, P. Zhao, Damage classification for masonry historic structures using convolutional neural networks based on still images. Comput.-Aided Civ. Infrastruct. Eng. 33(12) (2018) 1073–1089. https://doi.org/10.1111/mice.12411

- L. Ali, K. Wasif, K. Chaiyasarn, Damage detection and localization in masonry structure using faster region convolutional networks. Int. J. Geomate. 17(59) (2019). https://doi.org/10.21660/2019.59.8272

- H. Seo, A.D. Raut, C. Chen, C. Zhang, Multi-label classification and automatic damage detection of masonry heritage building through CNN analysis of infrared thermal imaging. Remote Sens. 15(10) (2023) 2517. https://doi.org/10.3390/rs15102517

- X. Yang, L. Zheng, Y. Chen, J. Feng, J. Zheng, Recognition of damage types of Chinese gray-brick ancient buildings based on machine learning. Atmosphere 14(2) (2023) 346. https://doi.org/10.3390/atmos14020346

- Z. Ye, L. Lovell, A. Faramarzi, J. Ninić, SAM-based instance segmentation models for the automation of structural damage detection. Adv. Eng. Inform. 62 (2024) 102826. https://doi.org/10.1016/j.aei.2024.102826

- L. Carnimeo, D. Foti, V. Vacca, On damage monitoring in historical buildings via neural networks. In: Proceedings of the IEEE Workshop on Environmental, Energy, and Structural Monitoring Systems (EESMS 2015) (2015) 157–161. https://doi.org/10.1109/EESMS.2015.7175870

- A.H. Rangkuti, V. Hasbi Athala, F. Haridhi Indallah, E. Tanuar, J. Muliadi Kerta, Optimization of historic buildings recognition: CNN model supported by pre-processing methods. Int. J. Informatics Visual. 7(4) (2023) 2230. https://doi.org/10.62527/joiv.7.4.1359


Refbacks

  • There are currently no refbacks.


Bookmark and Share


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

ISSN 2170-127X

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Based on a work at http://revue.ummto.dz.