AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Powered by AMiner. Clicking this button will take you away from SciOpen.
Home Building Simulation Article
Article Link
Cite
EndNote(RIS) BibTeX
Collect
Submit Manuscript
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Research Article

Evaluating different levels of information on the calibration of building energy simulation models

Siyu Cheng1, Zeynep Duygu Tekler1, Hongyuan Jia2, Wenxin Li3, Adrian Chong1( )
Department of the Built Environment, College of Design and Engineering, National University of Singapore, 4 Architecture Drive, Singapore 117566, Singapore
School of Civil Engineering and Architecture, Chongqing University of Science and Technology, Chongqing 401331, China
School of Energy and Environment, Southeast University, Nanjing 210096, China
Show Author Information

Abstract

A poorly calibrated model undermines confidence in the effectiveness of building energy simulation, impeding the widespread application of advanced energy conservation measures (ECMs). Striking a balance between information-gathering efforts and achieving sufficient model credibility is crucial but often obscured by ambiguities. To address this gap, we model and calibrate a test bed with different levels of information (LOI). Beginning with an initial model based on building geometry (LOI 1), we progressively introduce additional information, including nameplate information (LOI 2), envelope conductivity (LOI 3), zone infiltration rate (LOI 4), AHU fan power (LOI 5), and HVAC data (LOI 6). The models are evaluated for accuracy, consistency, and the robustness of their predictions. Our results indicate that adding more information for calibration leads to improved data fit. However, this improvement is not uniform across all observed outputs due to identifiability issues. Furthermore, for energy-saving analysis, adding more information can significantly affect the projected energy savings by up to two times. Nevertheless, for ECM ranking, models that did not meet ASHRAE 14 accuracy thresholds can yield correct retrofit decisions. These findings underscore equifinality in modeling complex building systems. Clearly, predictive accuracy is not synonymous with model credibility. Therefore, to balance efforts in information-gathering and model reliability, it is crucial to (1) determine the minimum level of information required for calibration compatible with its intended purpose and (2) calibrate models with information closely linked to all outputs of interest, particularly when simultaneous accuracy for multiple outputs is necessary.

Keywords

calibrationenergy conservation measure (ECM)field measurementsbuilding energy simulation (BES)level of information

References

 

Angelotti A, Mazzarella L, Cornaro C, et al. (2023). Calibrating the dynamic energy simulation model for an existing building: Lessons learned from a collective exercise. Energies, 16: 2979.
Crossref Google Scholar
 

Arendt PD, Apley DW, Chen W, et al. (2012). Improving identifiability in model calibration using multiple responses. Journal of Mechanical Design, 134: 100909.
Crossref Google Scholar
 

Asadi S, Mostavi E, Boussaa D, et al. (2019). Building energy model calibration using automated optimization-based algorithm. Energy and Buildings, 198: 106–114.
Crossref Google Scholar
 
ASHRAE (2002). Guideline 14: Measurement of energy and demand savings. Atlanta, GA, USA: American Society of Heating, Refrigerating, and Air-Conditioning.
 
Bell SA (2001). A Beginner’s Guide to Uncertainty of Measurement. National Physical Laboratory, UK.
 
Bertagnolio S (2012). Evidence-based model calibration for efficient building energy services. PhD Thesis, Université de Liège, Belgium.
 

Beven K, Freer J (2001). Equifinality, data assimilation, and uncertainty estimation in mechanistic modelling of complex environmental systems using the GLUE methodology. Journal of Hydrology, 249: 11–29.
Crossref Google Scholar
 
Building and Construction Authority (2018). Super low energy building technology roadmap. Technical Report. Available at https://www1.bca.gov.sg/docs/default-source/docs-corp-buildsg/sustainability/sle-tech-roadmap-report--published-ver1-1.pdf?sfvrsn=f2df22ed_0.
 

Cacabelos A, Eguía P, Febrero L, et al. (2017). Development of a new multi-stage building energy model calibration methodology and validation in a public library. Energy and Buildings, 146: 182–199.
Crossref Google Scholar
 

Chong ZMA, Wong NH, Ignatius M, et al. (2013). Predicting the envelope performance of commercial office buildings in Singapore. Energy and Buildings, 66: 66–76.
Crossref Google Scholar
 

Chong A, Menberg K (2018). Guidelines for the Bayesian calibration of building energy models. Energy and Buildings, 174: 527–547.
Crossref Google Scholar
 
Chong A, Chao S (2019). A framework for the continuous calibration of building energy models with uncertainty. In: Proceedings of the 16th International IBPSA Building Simulation Conference, Rome, Italy.
 

Chong A, Gu Y, JiaH (2021). Calibrating building energy simulation models: A review of the basics to guide future work. Energy and Buildings, 253: 111533.
Crossref Google Scholar
 
Coakley D, Raftery P, Molloy P, et al. (2011). Calibration of a detailed BES model to measured data using an evidence-based analytical optimisation approach. In: Proceedings of the 12th International IBPSA Building Simulation Conference, Sydney, Australia.
 

Coakley D, Raftery P, Keane M (2014). A review of methods to match building energy simulation models to measured data. Renewable and sustainable energy reviews, 37: 123–141.
Crossref Google Scholar
 

da Silva PPF, Neto AH, Sauer IL (2021). Evaluation of model calibration method for simulation performance of a public hospital in Brazil. Energies, 14: 3791.
Crossref Google Scholar
 

De Jaeger I, Reynders G, Ma Y, Saelens D (2018). Impact of building geometry description within district energy simulations. Energy, 158: 1060–1069.
Crossref Google Scholar
 
de Moura Scortegagna E, Martins N, Lamberts R (2023). Can we trust building energy performance models’ results? In: Proceedings of the 18th International IBPSA Building Simulation, Shanghai, China.
Crossref
 

Derakhti M, O’Brien W, Bucking S (2022). Impact of measured data frequency on commercial building energy model calibration for retrofit analysis. Science and Technology for the Built Environment, 28: 628–644.
Crossref Google Scholar
 
DOE (2001). International performance measurement & verification protocol: Concepts and options for determining energy and water savings, Volume I. Department of Energy, USA.
 
DOE (2015a). An assessment of energy technologies and research opportunities. Quadrennial Technology Review. Department of Energy, USA.
 
DOE (2015b). M&V guidelines: Measurement and verification for performance-based contracts, version 4.0. Federal Energy Management Program, Department of Energy, USA.
 
DOE (2018). About building energy modeling. Department of Energy, USA. Available at https://www.energy.gov/eere/buildings/about-building-energy-modeling.
 

Ekström T, Burke S, Wiktorsson M, et al. (2021). Evaluating the impact of data quality on the accuracy of the predicted energy performance for a fixed building design using probabilistic energy performance simulations and uncertainty analysis. Energy and Buildings, 249: 111205.
Crossref Google Scholar
 

Gaetani I, Hoes PJ, Hensen JLM (2016). Occupant behavior in building energy simulation: Towards a fit-for-purpose modeling strategy. Energy and Buildings, 121: 188–204.
Crossref Google Scholar
 

Garrett A, New J (2015). Scalable tuning of building models to hourly data. Energy, 84: 493–502.
Crossref Google Scholar
 
Heo Y (2011). Bayesian calibration of building energy models for energy retrofit decision-making under uncertainty. PhD Thesis, Georgia Institute of Technology, USA.
Crossref
 

Heo Y, Choudhary R, Augenbroe GA (2012). Calibration of building energy models for retrofit analysis under uncertainty. Energy and Buildings, 47: 550–560.
Crossref Google Scholar
 

Heo Y, Augenbroe G, Graziano D, et al. (2015). Scalable methodology for large scale building energy improvement: relevance of calibration in model-based retrofit analysis. Building and Environment, 87: 342–350.
Crossref Google Scholar
 

Homer J (2014). Levels of evidence in system dynamics modeling. System Dynamics Review, 30: 75–80.
Crossref Google Scholar
 

Hong T, Kim J, Jeong J, et al. (2017). Automatic calibration model of a building energy simulation using optimization algorithm. Energy Procedia, 105: 3698–3704.
Crossref Google Scholar
 

Hu M, Stephen B, Browell J, et al. (2023). Impacts of building load dispersion level on its load forecasting accuracy: Data or algorithms? Importance of reliability and interpretability in machine learning. Energy and Buildings, 285: 112896.
Crossref Google Scholar
 
IEA (2020). Energy Technology Perspectives 2020. International Energy Agency.
 
IEA (2022). Buildings. Available at https://www.iea.org/reports/buildings.
 
ISO (2014). ISO 9869-1: Thermal insulation, building elements, in-situ measurement of thermal resistance and thermal transmittance-Part 1: Heat flow meter method.
 
ISO (2017). ISO 12569: Thermal performance of buildings and materials—Determination of specific airflow rate in buildings—Tracer gas dilution method.
 

Kim Y-J, Park C-S (2016). Stepwise deterministic and stochastic calibration of an energy simulation model for an existing building. Energy and Buildings, 133: 455–468.
Crossref Google Scholar
 

Lim H, Zhai ZJ (2018). Influences of energy data on Bayesian calibration of building energy model. Applied Energy, 231: 686–698.
Crossref Google Scholar
 
Mathur A (2020). Towards a framework for developing fit-for-purpose Urban Energy Models: A case study for Ahmedabad. PhD Thesis, CEPT University Ahmedabad, India.
 
Mehta UB, Eklund DR, Romero VJ, et al. (2016). Simulation credibility: Advances in verification, validation, and uncertainty quantification. Technical report, The National Aeronautics and Space Administration, USA.
 
Menberg K, Heo Y, Choudhary R (2017). Efficiency and reliability of Bayesian calibration of energy supply system models. In: Proceedings of the 15th International IBPSA Building Simulation Conference, San Francisco, USA.
Crossref
 

Mihai A, Zmeureanu R (2017). Bottom-up evidence-based calibration of the HVAC air-side loop of a building energy model. Journal of Building Performance Simulation, 10: 105–123.
Crossref Google Scholar
 

Mustafaraj G, Marini D, Costa A, et al. (2014). Model calibration for building energy efficiency simulation. Applied Energy, 130: 72–85.
Crossref Google Scholar
 
NREL (2012). International Performance Measurement and Verification Protocol. EVO 10000 – 1: 2012: Concepts and Options for Determining Energy and Water Savings. Efficiency Valuation Organization. National Renewable Energy Lab. (NREL), Golden, CO, USA. Available at https://evo-world.org/en/products-services-mainmenu-en/protocols/ipmvp.
 

Oraiopoulos A, Howard B (2022). On the accuracy of Urban Building Energy Modelling. Renewable and Sustainable Energy Reviews, 158: 111976.
Crossref Google Scholar
 

Pachano JE, Bandera CF (2021). Multi-step building energy model calibration process based on measured data. Energy and Buildings, 252: 111380.
Crossref Google Scholar
 
Philip S, Tran T, Tanjuatco L (2011). eppy: Scripting language for E+. EnergyPlus (version 0.46). Available at https://pypi.python.org/pypi/eppy/0.4.
 
R Core Team (2021). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. Available at https://www.R-project.org/.
 

Raftery P, Keane M, Costa A (2011a). Calibrating whole building energy models: Detailed case study using hourly measured data. Energy and Buildings, 43: 3666–3679.
Crossref Google Scholar
 

Raftery P, Keane M, O’Donnell J (2011b). Calibrating whole building energy models: An evidence-based methodology. Energy and Buildings, 43: 2356–2364.
Crossref Google Scholar
 
Reddy TA, Saman NF, Claridge DE, et al. (1997). Baselining methodology for facility-level monthly energy use. Part 1: Theoretical aspects. Technical report. Atlanta, GA, USA: American Society of Heating, Refrigerating and Air-Conditioning Engineers.
 

Reddy TA, Claridge DE (2000). Uncertainty of “measured” energy savings from statistical baseline models. HVAC&R Research, 6: 3–20.
Crossref Google Scholar
 

Reddy TA (2006). Literature review on calibration of building energy simulation programs: Uses, problems, procedures, uncertainty, and tools. ASHRAE Transactions, 112(1): 226–240.
Google Scholar
 

Reddy TA, Maor I, Panjapornpon C (2007). Calibrating detailed building energy simulation programs with measured data—part Ⅰ: general methodology (RP-1051). HVAC&R Research, 13: 221–241.
Crossref Google Scholar
 

Risch S, Remmen P, Müller D (2021). Influence of data acquisition on the Bayesian calibration of urban building energy models. Energy and Buildings, 230: 110512.
Crossref Google Scholar
 
Robertson J, Polly B, Collis J (2013). Evaluation of automated model calibration techniques for residential building energy simulation. Technical Report. National Renewable Energy Lab. (NREL), Golden, CO, USA.
Crossref
 

Saad MM, Eicker U (2023). Investigating the reliability of building energy models: Comparative analysis of the impact of data pipelines and model complexities. Journal of Building Engineering, 71: 106511.
Crossref Google Scholar
 

Shamsi MH, O’Grady W, Ali U, O’Donnell J (2017). A generalization approach for reduced order modelling of commercial buildings. Energy Procedia, 122: 901–906.
Crossref Google Scholar
 

Sun K, Hong T, Taylor-Lange SC, et al. (2016). A pattern-based automated approach to building energy model calibration. Applied Energy, 165: 214–224.
Crossref Google Scholar
 

Sun K, Hong T (2017). A framework for quantifying the impact of occupant behavior on energy savings of energy conservation measures. Energy and Buildings, 146: 383–396.
Crossref Google Scholar
 

Sun K, Hong T, Kim J, et al. (2022). Application and evaluation of a pattern-based building energy model calibration method using public building datasets. Building Simulation, 15: 1385–1400.
Crossref Google Scholar
 

Taner T (2015). Optimisation processes of energy efficiency for a drying plant: A case of study for Turkey. Applied Thermal Engineering, 80: 247–260.
Crossref Google Scholar
 
Turner C, Frankel M (2008). Energy performance of LEED for new construction buildings. New Buildings Institute, White Salmon, WA, USA.
 

Tüysüz F, Sözer H (2020). Calibrating the building energy model with the short term monitored data. Energy and Buildings, 224: 110207.
Crossref Google Scholar
 

Van Dronkelaar C, Dowson M, Spataru C, et al. (2016). A review of the regulatory energy performance gap and its underlying causes in non-domestic buildings. Frontiers in Mechanical Engineering, 1: 17.
Crossref Google Scholar
 
Van Rossum G (2007). Python programming language. In: Proceedings of USENIX Annual Technical Conference.
 

Yang Z, Becerik-Gerber B (2015). A model calibration framework for simultaneous multi-level building energy simulation. Applied Energy, 149: 415–431.
Crossref Google Scholar
 

Ye Y, Hinkelman K, Lou Y, et al. (2021). Evaluating the energy impact potential of energy efficiency measures for retrofit applications: A case study with U.S. medium office buildings. Building Simulation, 14: 1377–1393.
Crossref Google Scholar
 

Yin R, Kiliccote S, Piette MA (2016). Linking measurements and models in commercial buildings: A case study for model calibration and demand response strategy evaluation. Energy and Buildings, 124: 222–235.
Crossref Google Scholar
 
Zhan S, Chakrabarty A, Christopher R, et al. (2023). A virtual testbed for robust and reproducible calibration of building energy simulation models. In: In: Proceedings of the 18th International IBPSA Building Simulation, Shanghai, China.
Crossref
 

Zhang Q, Tian Z, Ma Z, et al. (2020). Development of the heating load prediction model for the residential building of district heating based on model calibration. Energy, 205: 117949.
Crossref Google Scholar
 

Zuhaib S, Hajdukiewicz M, Goggins J (2019). Application of a staged automated calibration methodology to a partially-retrofitted university building energy model. Journal of Building Engineering, 26: 100866.
Crossref Google Scholar
Building Simulation
Volume 17 Issue 4,
April 2024
Pages 657-676
DOI: 10.1007/s12273-024-1115-8
Cite this article:
Cheng S, Tekler ZD, Jia H, et al. Evaluating different levels of information on the calibration of building energy simulation models. Building Simulation, 2024, 17(4): 657-676. https://doi.org/10.1007/s12273-024-1115-8

152

Views

2

Crossref

1

Web of Science

2

Scopus

0

CSCD

Altmetrics
Received: 27 November 2023
Revised: 21 January 2024
Accepted: 04 February 2024
Published: 24 February 2024
© Tsinghua University Press 2024
Return