Publications
Sort:
Issue
Dam surface crack detection method based on improved DeepLabV3+ network
Journal of Tsinghua University (Science and Technology) 2023, 63 (7): 1153-1163
Published: 15 July 2023
Abstract PDF (11.5 MB) Collect
Downloads:2
Objective

Image analysis is an efficient and accurate method for identifying hydropower dam surface defects. However, due to the complex background of dam crack images and the uneven proportion of cracks and background pixels, the detection effect of traditional algorithms is poor. Moreover, traditional artificial crack inspection is not only inefficient but also costly in the present day. Efficient and accurate dam surface crack detection techniques are crucial for dam maintenance and operation. In order to achieve accurate and efficient dam surface crack detection, a dam surface crack detection method based on an improved DeepLabV3+ model is proposed.

Methods

Model training is carried out for the self-made dam surface crack image dataset of a hydropower station in Southwest China, and the model is evaluated by F1, score, ZMIoU, ZMPA, parameter quantity and other indicators. The following improvements are made to the traditional DeepLabV3+ network model: (1) A three line attention module is added to improve the model's ability to extract crack pixels and reduce proportion imbalance between background pixels and crack pixels. (2) The original pyramid pooling module is cascaded for model optimization so that the model can achieve more intensive pixel sampling, and subsequently obtain more abundant crack features. (3) In order to solve the problem of the significant/too large number of traditional DeepLabV3+ network parameters, MobileNetV2 network is used as the backbone of the model to extract the network, to reduce the network to a lightweight module, and to reduce model parameters. (4) Focal loss and Dice loss are used as the loss functions of the model to overcome the data imbalance and to improve the accuracy of network classification.

Results

The improved DeepLabV3+ network model in this paper could better realize the extraction of crack pixels, reduce the problems caused by the imbalance of pixel proportion, and better ensure the efficient and accurate detection of dam surface cracks. The experiment on the self-made dam surface crack image dataset of a hydropower station in Southwest China showed the following: (1) Compared with the original model, the improved DeepLabV3+ model increased F1, score by 3.33%, ZMIOU by 2.89%, ZMPA by 1.12%, and the parameters were reduced to 3 014 714. This finding showed that the improved model proposed in this paper had stronger performance than the original model, better ability to extract crack pixels, and could better complete the task of crack identification. (2) Compared with other attention mechanisms, the three line attention module proposed in this paper had certain advantages, which could increase the attention of the model to the crack pixels and enable the model to extract the crack features needed.

Conclusions

Through an analysis of the experimental results, the model improved in this paper has stronger segmentation ability, less missing data and false detection, and can effectively complete the dam surface crack segmentation task. The improved method increases the efficiency and accuracy of dam surface crack detection and reduces the model parameters. It can provide powerful data support for crack detection and the safe operation of hydropower projects.

Issue
Semantic segmentation method of hydraulic structure crack based on feature enhancement
Journal of Tsinghua University (Science and Technology) 2023, 63 (7): 1135-1143
Published: 15 July 2023
Abstract PDF (7.9 MB) Collect
Downloads:0
Objective

Scientific, comprehensive, and standardized health monitoring is critical in the operation and maintenance of all types of water conservancy infrastructure. In this study, intelligent equipment is used to capture crack images of concrete dams and corridor hydraulic engineering scenes, and an artificial intelligence algorithm is used to achieve accurate recognition of crack information. However, most current research on concrete crack recognition lacks the analysis of crack information and simply obtains crack features through convolution and pooling to form a feature extraction network. The extracted high-dimensional features are not enhanced further, so the recognition effect cannot be continuously improved. A semantic segmentation technique for feature enhancement is proposed to solve the problem of low accuracy of crack location in the automatic detection of concrete cracks.

Methods

Statistical theory is used in this study to assess the pixel values of the cracked and non-cracked regions in three color channels and the proportion of the cracked region in the image. The size relationship and corresponding distribution of cracked and non-cracked regions on the pixel level are also obtained. Then, the ResNet-152 feature extraction network based on the residual structure is used to extract high-dimensional abstract semantic features from crack images. Due to the particularity of the residual structure, it can effectively reduce the loss of crack information during feature transmission and improve feature interoperability between different layers of the network so as to avoid the problem of gradient disappearance or explosion. Then, based on the results of statistical analysis, high-dimensional abstract features are sampled into two coarse segmentation feature maps corresponding to cracks and non-cracks. The similarity between the high-dimensional abstract features and the coarse segmentation feature map is calculated, the results of which are then used as weights to update high-dimensional abstract features to realize regional clustering of them. Finally, the clustered features are combined with the high-dimensional abstract features to obtain the enhanced features, which improve the crack location performance of the model. Meanwhile, the network loss function is optimized based on the crack information distribution. By controlling the number of samples used in the calculation of loss value, the contribution rate of crack information and non-crack information to the total loss value is balanced. As a result, the recognition accuracy of crack information is improved.

Results

We used an unmanned aerial vehicle and an orbital robot to capture images of two hydraulic engineering scenes, including the dam and the corridor. After image preprocessing and labeling, we obtained a total of 3 000 crack images and labels, including 1 000 dam crack images and 500 corridor crack images. We stratified the data set into a training set, a validation set, and a test set in an 8∶1∶1 ratio. The crack pixel accuracy, recall rate, intersection-over-unions, and overall total pixel accuracy of the model on the test set reached 92.48%, 86.52%, 80.82%, and 99.79%, respectively.

Conclusions

By analyzing the relationship and distribution of pixel values between crack information and non-crack information in crack images and using them as prior information to construct a feature enhancement network and design the objective function of network optimization, the shortcomings of current concrete crack identification methods can be effectively overcome, and the performance of the network to recognize crack information can be improved.

Total 2