Development of a High-Performance Concrete Compressive-Strength Prediction Model Using an Ensemble Machine-Learning Method Based on Bagging and Stacking

Yun-Ji Kwak; Chaeyeon Go; Shinyoung Kwag; Seunghyun Eem

doi:10.7734/COSEIK.2023.36.1.9

All Issue

2023 Vol.36, Issue 1 Preview Page Next Page

Research Paper

Development of a High-Performance Concrete Compressive-Strength Prediction Model Using an Ensemble Machine-Learning Method Based on Bagging and Stacking 배깅 및 스태킹 기반 앙상블 기계학습법을 이용한 고성능 콘크리트 압축강도 예측모델 개발

28 February 2023. pp. 9-18

PDF XML

Abstract

Predicting the compressive strength of high-performance concrete (HPC) is challenging because of the use of additional cementitious materials; thus, the development of improved predictive models is essential. The purpose of this study was to develop an HPC compressive-strength prediction model using an ensemble machine-learning method of combined bagging and stacking techniques. The result is a new ensemble technique that integrates the existing ensemble methods of bagging and stacking to solve the problems of a single machine-learning model and improve the prediction performance of the model. The nonlinear regression, support vector machine, artificial neural network, and Gaussian process regression approaches were used as single machine-learning methods and bagging and stacking techniques as ensemble machine-learning methods. As a result, the model of the proposed method showed improved accuracy results compared with single machine-learning models, an individual bagging technique model, and a stacking technique model. This was confirmed through a comparison of four representative performance indicators, verifying the effectiveness of the method.

Keywords

high-performance concrete

compression strength

machine-learning method

ensemble technique

bagging

stacking

고성능 콘크리트(HPC) 압축강도는 추가적인 시멘트질 재료의 사용으로 인해 예측하기 어렵고, 개선된 예측 모델의 개발이 필수적이다. 따라서, 본 연구의 목적은 배깅과 스태킹을 결합한 앙상블 기법을 사용하여 HPC 압축강도 예측 모델을 개발하는 것이다. 이 논문의 핵심적 기여는 기존 앙상블 기법인 배깅과 스태킹을 통합하여 새로운 앙상블 기법을 제시하고, 단일 기계학습 모델의 문제점을 해결하여 모델 예측 성능을 높이고자 한다. 단일 기계학습법으로 비선형 회귀분석, 서포트 벡터 머신, 인공신경망, 가우시안 프로세스 회귀를 사용하고, 앙상블 기법으로 배깅, 스태킹을 이용하였다. 결과적으로 본 연구에서 제안된 모델이 단일 기계학습 모델, 배깅 및 스태킹 모델보다 높은 정확도를 보였다. 이는 대표적인 4가지 성능 지표 비교를 통해 확인하였고, 제안된 방법의 유효성을 검증하였다.

키워드

고성능 콘크리트

압축강도

기계학습법

앙상블 기법

배깅 기법

스태킹 기법

References

Ahmad, S., Alghamdi, S.A. (2014) A Statistical approach to Optimizing Concrete Mixture Design, The Scientific World J., 2014. 10.1155/2014/56153924688405PMC3934445

Alpaydin, E. (2020) Introduction to Machine Learning, MIT Press, p.683.

Apostolopoulou, M., Armaghani, D.J., Bakolas, A., Douvika, M. G., Moropoulou, A., Asteris, P.G. (2019) Compressive Strength of Natural Hydraulic Lime Mortars using Soft Computing Techniques, Procedia Struct. Integr., 17, pp.914~ 923. 10.1016/j.prostr.2019.08.122

Asteris, P.G., Kolovos, K.G., Douvika, M.G., Roinos, K. (2016) Prediction of Self-Compacting Concrete Strength using Artificial Neural Networks, Eur. J. Environ. & Civil Eng., 20(sup1), pp.s102~s122. 10.1080/19648189.2016.1246693

Asteris, P.G., Mokos, V.G. (2020) Concrete Compressive Strength using Artificial Neural Networks, Neural Comput. & Appl., 32(15), pp.11807~11826. 10.1007/s00521-019-04663-2

Asteris, P.G., Skentou, A.D., Bardhan, A., Samui, P., Pilakoutas, K. (2021) Predicting Concrete Compressive Strength using Hybrid Ensembling of Surrogate Machine Learning Models, Cement & Concr. Res., 145, 106449. 10.1016/j.cemconres.2021.106449

Atici, U. (2011) Prediction of the Strength of Mineral Admixture Concrete using Multivariable Regression Analysis and an Artificial Neural Network, Expert Syst. with Appl., 38(8), pp.9609~9618. 10.1016/j.eswa.2011.01.156

Breiman, L. (1996) Bagging Predictors, Mach. Learn., 24(2), pp.123~140. 10.1007/BF00058655

Burges, C.J. (1998) A Tutorial on Support Vector Machines for Pattern Recognition, Data Min. & Knowl. Discov., 2(2), pp. 121~167.

Cheng, M.Y., Chou, J.S., Roy, A.F., Wu, Y.W. (2012) High- Performance Concrete Compressive Strength Prediction using Time-Weighted Evolutionary Fuzzy Support Vector Machines Inference Model, Automat. Constr., 28, pp.106~115. 10.1016/j.autcon.2012.07.004

Chou, J.S., Chiu, C.K., Farfoura, M., Al-Taharwa, I. (2011) Optimizing the Prediction Accuracy of Concrete Compressive Strength based on a Comparison of Data-Mining Techniques, J. Comput. Civil Eng., 25(3), pp.242~253. 10.1061/(ASCE)CP.1943-5487.0000088

Gartner, E. (2004) Industrially Interesting Approaches to "low- CO2" Cements, Cem. & Concr. Res., 34(9), pp.1489~1498. 10.1016/j.cemconres.2004.01.021

Jerath, S. (1983) Computer-aided Concrete Mix Proportioning, J. Proc., 80(4), pp.312~317. 10.14359/10854

Juenger, M.C.G., Winnefeld, F., Provis, J.L., Ideker, J.H. (2011) Advances in Alternative Cementitious Binders, Cem. & Concr. Res., 41(12), pp.1232~1243. 10.1016/j.cemconres.2010.11.012

Kasperkiewicz, J., Racz, J., Dubrawski, A. (1995) HPC Strength Prediction using Artificial Neural Network, J. Comput. Civil Eng., 9(4), pp.279~284. 10.1061/(ASCE)0887-3801(1995)9:4(279)

Kwag, S., Gupta, A., Dinh, N. (2018) Probabilistic Risk Assessment based Model Validation Method using Bayesian Network, Reliab. Eng. & Syst. Safety, 169, pp.380~393. 10.1016/j.ress.2017.09.013

Lam, L., Wong, Y.L., Poon, C.S. (1998) Effect of Fly Ash and Silica Fume on Compressive and Fracture behaviors of Concrete, Cem. & Concr. Res., 28(2), pp.271~283. 10.1016/S0008-8846(97)00269-X

McClelland, J.L., Rumelhart, D.E., Hinton, G.E. (1986) The Appeal of Parallel Distributed Processing, MIT Press, Cambridge MA, 3, 44.

Neshat, M., Adeli, A., Sepidnam, G., Sargolzaei, M. (2012) Predication of Concrete Mix Design using Adaptive Neural Fuzzy Inference Systems and Fuzzy Inference Systems, Int. J. Adv. Manuf. Technol., 63(1), pp.373~390. 10.1007/s00170-012-3914-9

Ozbay, E., Gesoglu, M., Guneyisi, E. (2011) Transport Properties Based Multi-Objective Mix Proportioning Optimization of High Performance Concretes, Mater. & Struct., 44(1), pp. 139~154. 10.1617/s11527-010-9615-7

Öztaş, A., Pala, M., Özbay, E., Kanca, E., Çagˇlar, N., Bhatti, M. A. (2006) Predicting the Compressive Strength and Slump of High Strength Concrete using Neural Network, Constr. & Build. Mater., 20(9), pp.769~775. 10.1016/j.conbuildmat.2005.01.054

Rasmussen, C.E. (2003) Summer School on Machine Learning, Gaussian Processes in Machine Learning, Springer, Berlin, Heidelberg. pp.63~71. 10.1007/978-3-540-28650-9_4

Rutkowska, G., Wichowski, P., Franus, M., Mendryk, M., Fronczyk, J. (2020) Modification of Ordinary Concrete using Fly Ash from Combustion of Municipal Sewage Sludge, Mater., 13(2), 487. 10.3390/ma1302048731963952PMC7013712

Sun, L., Koopialipoor, M., Jahed Armaghani, D., Tarinejad, R., Tahir, M.M. (2021) Applying a Meta-Heuristic Algorithm to Predict and Optimize Compressive Strength of Concrete Samples, Eng. Comput., 37(2), pp.1133~1145. 10.1007/s00366-019-00875-1

Syarif, I., Zaluska, E., Prugel-Bennett, A., Wills, G. (2012) Application of Bagging, Boosting and Stacking to Intrusion Detection, In International Workshop on Machine Learning and Data Mining in Pattern Recognition, Springer, Berlin, Heidelberg, pp.593~602. 10.1007/978-3-642-31537-4_46

Yeh, I.C. (1998) Modeling of Strength of High-Performance Concrete using Artificial Neural Networks, Cem. & Concr. Res., 28(12), pp.1797~1808. 10.1016/S0008-8846(98)00165-3

Yilmaz, I., Erik, N.Y., Kaynar, O. (2010) Different Types of Learning Algorithms of Artificial Neural Network (ANN) Models for Prediction of Gross Calorific Value (GCV) of Coals, Sci. Res. & Essays, 5(16), pp.2242~2249.

Zain, F.M., Abd, M.S. (2009) Multiple Regression Model for Compressive Strength Prediction of High Performance Concrete, J. Appl. Sci., 9(1), pp.155~160. 10.3923/jas.2009.155.160

Zhang, J., Huang, Y., Wang, Y., Ma, G. (2020) Multi-Objective Optimization of Concrete Mixture Proportions using Machine Learning and Metaheuristic Algorithms, Constr. & Build. Mater., 253, 119208. 10.1016/j.conbuildmat.2020.119208

Information

Publisher :Computational Structural Engineering Institute of Korea
Publisher(Ko) :한국전산구조공학회
Journal Title :Journal of the Computational Structural Engineering Institute of Korea
Journal Title(Ko) :한국전산구조공학회 논문집
Volume : 36
No :1
Pages :9-18
Received Date : 2022-08-11
Revised Date : 2022-12-06
Accepted Date : 2022-12-27
DOI :https://doi.org/10.7734/COSEIK.2023.36.1.9

Journal of the Computational Structural Engineering Institute of Korea ISSN:1229-3059(Print) 2287-2302(Online) 한국전산구조공학회 논문집

All Issue