Assembly Performance Evaluation for Prefabricated Steel Structures Using k-nearest Neighbor and Vision Sensor

Hyuntae Bang; Byeongjun Yu; Haemin Jeon

doi:10.7734/COSEIK.2022.35.5.259

All Issue

2022 Vol.35, Issue 5 Preview Page Next Page

Research Paper

Assembly Performance Evaluation for Prefabricated Steel Structures Using k-nearest Neighbor and Vision Sensor k-근접 이웃 및 비전센서를 활용한 프리팹 강구조물 조립 성능 평가 기술

31 October 2022. pp. 259-266

PDF XML

Abstract

In this study, we developed a deep learning and vision sensor-based assembly performance evaluation method isfor prefabricated steel structures. The assembly parts were segmented using a modified version of the receptive field block convolution module inspired by the eccentric function of the human visual system. The quality of the assembly was evaluated by detecting the bolt holes in the segmented assembly part and calculating the bolt hole positions. To validate the performance of the evaluation, models of standard and defective assembly parts were produced using a 3D printer. The assembly part segmentation network was trained based on the 3D model images captured from a vision sensor. The sbolt hole positions in the segmented assembly image were calculated using image processing techniques, and the assembly performance evaluation using the k-nearest neighbor algorithm was verified. The experimental results show that the assembly parts were segmented with high precision, and the assembly performance based on the positions of the bolt holes in the detected assembly part was evaluated with a classification error of less than 5%.

Keywords

assembly performance evaluation

deep learning

k-nearest neighbor

vision sensor

prefabricated steel structure

본 논문에서는 프리팹 구조물의 품질관리를 위한 딥러닝 및 비전센서 기반의 조립 성능 평가 모델을 개발하였다. 조립부 검출을 위해 인코더-디코더 형식의 네트워크와 수용 영역 블록 합성곱 모듈을 적용한 딥러닝 모델을 사용하였다. 검출된 조립부 영역 내의 볼트홀을 검출하고, 볼트홀의 위치 값을 산정하여 k-근접 이웃 기반 모델을 사용하여 조립 품질을 평가하였다. 제안된 기법의 성능을 검증하기 위해 조립부 모형을 3D 프린팅을 이용하여 제작하여 조립부 검출 및 조립 성능 예측 모델의 성능을 검증하였다. 성능 검증 결과 높은 정밀도로 조립부를 검출하였으며, 검출된 조립부내의 볼트홀의 위치를 바탕으로 프리팹 구조물의 조립 성능을 5% 이하의 판별 오차로 평가할 수 있음을 확인하였다.

키워드

조립부 성능 평가

딥러닝

k-근접 이웃

비전센서

프리팹 강구조물

References

Géron, A. (2019) Hands-on Machine Learning with Scikit-Learn, Keras, and TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems. O'Reilly Media, Inc, Sebastopol, CA.

He, K., Gkioxari, G., Dollár, P., Girshick, R. (2017) Mask r-cnn, Proc. IEEE International Conference on Computer Vision, Institute of Electrical and Electronics Engineers, pp.2961~ 2969. 10.1109/ICCV.2017.322

Ho, T.K. (1998) The Random Subspace Method for Constructing Decision Forests, IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(8), pp.832~844. 10.1109/34.709601

Kim, M.K., Wang, Q., Park, J.W., Cheng, J.C., Sohn, H., Chang, C.C. (2016) Automated Dimensional Quality Assurance of Full-Scale Precast Concrete Elements using Laser Scanning and BIM, Autom. Constr., 72, pp.102~114. 10.1016/j.autcon.2016.08.035

Krizhevsky, A., Sutskever, I., Hinton, G.E. (2012) Imagenet Classification with Deep Convolutional Neural Networks, Adv. Neural Inf. Process. Syst., 25, pp.1097~1105.

Lacey, A.W., Chen, W., Hao, H., Bi, K. (2018) Structural Response of Modular Buildings-an Overview, J. Build. Eng., 16, pp.45~56. 10.1016/j.jobe.2017.12.008

Liu, S., Huang, D. (2018) Receptive Field Block Net for Accurate and Fast Object Detection, Proc. European Conference on Computer Vision (ECCV), Springer Science & Business Media, pp.385~400. 10.1007/978-3-030-01252-6_24

Liu, X.C., Xu, A.X., Zhang, A.L., Ni, Z., Wang, H.X., Wu, L. (2015) Static and Seismic Experiment for Welded Joints in Modularized Prefabricated Steel Structure, J. Construct. Steel Res., 112, pp.183~195. 10.1016/j.jcsr.2015.05.003

Long, J., Shelhamer, E., Darrell, T. (2015) Fully Convolutional Networks for Semantic Segmentation, Proc. IEEE Conference on Computer Vision and Pattern Recognition, Institute of Electrical and Electronics Engineers, pp.3431~3440. 10.1109/CVPR.2015.7298965

Ma, X., Yang, T., Chen, J., Liu, Z. (2021) k-Nearest Neighbor Algorithm based on Feature Subspace, Int. Conf. Big Data Analysis and Computer Science (BDACS), Institute of Electrical and Electronics Engineers, pp.225~228. 10.1109/BDACS53596.2021.00056

Michalski, R.S., Carbonell, J.G., Mitchell, T.M. (Eds.). (2013) Machine Learning: An Artificial Intelligence Approach, Springer Science & Business Media, Berlin.

Ministry of Land, Infrastructure and Transport in Korea (2013) Standard Specification of Roads and Bridges.

Park, H. S., Lee, H. M., Adeli, H., Lee, I. (2007) A New Approach for Health Monitoring of Structures: Terrestrial Laser Scanning, Computer‐Aided Civil & Infrastruct. Eng., 22(1), pp.19~30. 10.1111/j.1467-8667.2006.00466.x

Peterson, L.E. (2009) K-Nearest Neighbor, Scholarpedia, 4(2), p.1883. 10.4249/scholarpedia.1883

Ren, S., He, K., Girshick, R., Sun, J. (2015) Faster r-cnn: Towards Real-Time Object Detection with Region Proposal Networks, Adv. Neural Inf. Process. Syst., 28, pp.91~99.

Ronneberger, O., Fischer, P., Brox, T. (2015) U-Net: Convolutional Networks for Biomedical Image Segmentation, Proc. Int. Conf. Medical Image Computing and Computer-Assisted Intervention, The Medical Image Computing and Computer Assisted Intervention Society, pp.234~241. 10.1007/978-3-319-24574-4_28

Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., Berg, A.C., Fei-Fei, L. (2015) Imagenet Large Scale Visual Recognition Challenge, Int. J. Comput. Vision, 115(3), pp.211~252. 10.1007/s11263-015-0816-y

Štefanič, M., Stankovski, V. (2018) A Review of Technologies and Applications for Smart Construction, Proc. Inst. Civil Engineers-Civil Eng., Institution of Civil Engineers, 172(2), pp.83~87. 10.1680/jcien.17.00050

Tan, Y., Li, S., Wang, Q. (2020) Automated Geometric Quality Inspection of Prefabricated Housing Units using BIM and LiDAR. Remote Sens., 12(15), 2492. 10.3390/rs12152492

Xu, Z., Kang, R., Lu, R. (2020) 3D Reconstruction and Measurement of Surface Defects in Prefabricated Elements using Point Clouds, J. Comput. Civil Eng., 34(5), 04020033. 10.1061/(ASCE)CP.1943-5487.0000920

Zhang, A.L., Wang, Q., Jiang, Z.Q., Yang, X.F., Zhang, H. (2019) Experimental Study of Earthquake-Resilient Prefabricated Steel Beam-Column Joints with Different Connection Forms, Eng. Struct., 187, pp.299~313. 10.1016/j.engstruct.2019.02.071

Information

Publisher :Computational Structural Engineering Institute of Korea
Publisher(Ko) :한국전산구조공학회
Journal Title :Journal of the Computational Structural Engineering Institute of Korea
Journal Title(Ko) :한국전산구조공학회 논문집
Volume : 35
No :5
Pages :259-266
Received Date : 2022-06-21
Revised Date : 2022-08-08
Accepted Date : 2022-08-24
DOI :https://doi.org/10.7734/COSEIK.2022.35.5.259

Journal of the Computational Structural Engineering Institute of Korea ISSN:1229-3059(Print) 2287-2302(Online) 한국전산구조공학회 논문집

All Issue