AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Article Link
Collect
Submit Manuscript
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Research Article

Metabolic rate estimation method using image deep learning

Hooseung NaHaneul ChoiTaeyeon Kim( )
Department of Architectural Engineering, Yonsei University, Seoul 03722, R.O. Korea
Show Author Information

Abstract

Thermal comfort is an important factor in evaluating indoor environmental quality. However, accurately evaluating thermal comfort conditions is challenging owing to the lack of suitable methods for measuring individual factors such as the metabolic rate (M value). In this study, a M value evaluation method was developed using deep learning. The metabolic equivalent of task was measured for eight typical indoor tasks based on the ASHRAE Standard 55 (lying down, sitting, cooking, walking, eating, house cleaning, folding clothes, and handling 50 kg books) in 31 subjects (males: 16; and females: 15); the measurements were analyzed in terms of gender and body mass index (BMI). The experimental results were assessed using the reliability of the measured data, the M value difference in terms of gender and BMI, and the measurement accuracy. We developed a M value self-evaluation model using artificial intelligence, which achieved an average coefficient of variation (CV) of 12%. A third-party evaluation model was used to evaluate the M value of one subject based on the learning data acquired from the other 30 subjects; this model yielded a low CV of 54%. For high-activity tasks, males generally had higher M values than females, and the higher the BMI was, the higher was the M value. Contrarily, for low-activity tasks, the lower the BMI was, the higher was the M value. The breakthrough M value evaluation method presented herein is expected to improve thermal comfort control.

Electronic Supplementary Material

Download File(s)
12273_2020_707_MOESM1_ESM.pdf (2.9 MB)

References

 
Abobakr A, Hossny M, Nahavandi S (2016). Body joints regression using deep convolutional neural networks. In: Proceedings of the 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Budapest, Hungary.
 
Ainsworth BE, Haskell WL, Leon AS, Jacobs JD Jr, Montoye HJ, et al. (1993). Compendium of physical activities: Classification of energy costs of human physical activities. Medicine and Science in Sports and Exercise, 25(1): 71-80.
 
ASHRAE (2002). ASHRAE Guideline 14-2002: Measurement of Energy and Demand Savings. Atlanta: American Society of Heating, Refrigerating, and Air-Conditioning Engineers.
 
ASHRAE (2010). ASHRAE Standard 62.1-2010: Ventilation for Acceptable Indoor Air Quality. Atlanta: American Society of Heating, Refrigerating and Air-Conditioning Engineers.
 
ASHRAE (2017). ASHRAE Standard 55: Thermal Environmental Conditions for Human Occupancy. Atlanta: American Society of Heating, Refrigerating, and Air Conditioning Engineers.
 
Bae C, Chun C (2009). Research on seasonal indoor thermal environment and residents’ control behavior of cooling and heating systems in Korea. Building and Environment, 44: 2300-2307.
 
Bottou L (2010). Large-scale machine learning with stochastic gradient descent. In: Proceedings of COMPSTAT’2010, Paris, France.
 
Calvaresi A, Arnesano M, Pietroni F, Revel GM (2018). Measuring metabolic rate to improve comfort management in buildings. Environmental Engineering and Management Journal, 17: 2287-2296.
 
Calvino F, La Gennusa M, Rizzo G, Scaccianoce GJE (2004). The control of indoor thermal comfort conditions: Introducing a fuzzy adaptive controller. Energy and Buildings, 36(2): 97-102.
 
Chaudhuri T, Soh YC, Li H, Xie L (2019). A feedforward neural network based indoor-climate control framework for thermal comfort and energy saving in buildings. Applied Energy, 248: 44-53.
 
Chen X, Wang Q, Srebric J (2015). Model predictive control for indoor thermal comfort and energy optimization using occupant feedback. Energy and Buildings, 102: 357-369.
 
Choi J, Aziz A, Loftness V (2010). Investigation on the impacts of different genders and ages on satisfaction with thermal environments in office buildings. Building and Environment, 45: 1529-1535.
 
Choi JH, Loftness V, Aziz A (2012). Post-occupancy evaluation of 20 office buildings as basis for future IEQ standards and guidelines. Energy and Buildings, 46: 167-175.
 
Clarke R, Coladarci T, Minium E (1999). Elements of Statistical Reasoning. Hoboken, NJ, USA: John Wiley & Sons.
 
Cosma AC, Simha R (2019). Machine learning method for real-time non-invasive prediction of individual thermal preference in transient conditions. Building and Environment, 148: 372-383.
 
d’Ambrosio Alfano FR, Palella BI, Riccio G (2011). The role of measurement accuracy on the thermal environment assessment by means of PMV index. Building and Environment, 46: 1361-1369.
 
Dai C, Zhang H, Arens E, Lian Z (2017). Machine learning approaches to predict thermal demands using skin temperatures: Steady-state conditions. Building and Environment, 114: 1-10.
 
Dalal N, Triggs B (2005). Histograms of oriented gradients for human detection. In: Proceedings of the International Conference on Computer Vision & Pattern Recognition (CVPR’05), San Diego, CA, USA.
 
Deng J, Dong W, Socher R, Li L, Li K, et al. (2009). ImageNet: A large-scale hierarchical image database. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.
 
Deurenberg P, Weststrate JA, Seidell JC (1991). Body mass index as a measure of body fatness: Age- and sex-specific prediction formulas. British Journal of Nutrition, 65: 105-114.
 
Diaz KM, Krupka DJ, Chang MJ, Peacock J, Ma Y, et al. (2015). Fitbit®: An accurate and reliable device for wireless physical activity tracking. International Journal of Cardiology, 185: 138-140.
 
El-Amrawy F, Nounou MI (2015). Are currently available wearable devices for activity tracking and heart rate monitoring accurate, precise, and medically beneficial? Healthcare Informatics Research, 21: 315.
 
Fan C, Xiao F, Zhao Y (2017). A short-term building cooling load prediction method using deep learning algorithms. Applied Energy, 195: 222-233.
 
Fanger PO (1970). Thermal Comfort: Analysis and Applications in Environmental Engineering. Copenhagen, Denmark: Danish Technical Press.
 
Ferguson T, Rowlands AV, Olds T, Maher C (2015). The validity of consumer-level, activity monitors in healthy adults worn in free-living conditions: A cross-sectional study. International Journal of Behavioral Nutrition and Physical Activity, 12: 42.
 
Fitabase (2017). 500 Fitbit Studies, Activity Logs, New Projects & More! Available at https://www.fitabase.com/research-library.
 
Gan M, Wang C, Zhu C (2016). Construction of hierarchical diagnosis network based on deep learning and its application in the fault pattern recognition of rolling element bearings. Mechanical Systems and Signal Processing, 72-73: 92-104.
 
Giedraityte L, Holmér I, Gavhed D (2001). Validation of methods for determination of metabolic rate in the Edholm scale and ISO 8996. International Journal of Occupational Safety and Ergonomics, 7: 135-148.
 
Hasan MH, Alsaleem F, Rafaie M (2016). Sensitivity study for the PMV thermal comfort model and the use of wearable devices biometric data for metabolic rate estimation. Building and Environment, 110: 173-183.
 
He K, Zhang X, Ren S, Sun J (2016). Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.
 
Ioffe S, Szegedy CJ (2015). Batch normalization: Accelerating deep network training by reducing internal covariate shift. In: Proceedings of the 32nd International Conference on Machine Learning, Lille, France.
 
Irshad K, Khan AI, Irfan SA, Alam MM, Almalawi A, et al. (2020). Utilizing artificial neural network for prediction of occupants thermal comfort: A case study of a test room fitted with a thermoelectric air-conditioning system. IEEE Access, 8: 99709-99728.
 
ISO (2004). ISO 8996: 2004. Ergonomics of the Thermal Environment— Determination of Metabolic Rate. International Organization for Standardization. Available at http://www.iso.org/standard/34251.html.
 
Kang S, Ou D, Mak CM (2017). The impact of indoor environmental quality on work productivity in university open-plan research offices. Building and Environment, 124: 78-89.
 
Krizhevsky A, Sutskever I, Hinton GE (2012). ImageNet classification with deep convolutional neural networks. In: Proceedings of the 25th International Conference on Neural Information Processing Systems, Siem Reap, Cambodia.
 
Lee K, Schiavon S (2014). Influence of three dynamic predictive clothing insulation models on building energy use, HVAC sizing and thermal comfort. Energies, 7: 1917-1934.
 
Lee J-G, Jun S, Cho Y-W, Lee H, Kim GB, et al. (2017). Deep learning in medical imaging: General overview. Korean Journal of Radiology, 18: 570.
 
Lee K, Choi H, Choi JH, Kim T (2019). Development of a data-driven predictive model of clothing thermal insulation estimation by using advanced computational approaches. Sustainability, 11: 5702.
 
Lee K, Choi H, Kim H, Kim DD, Kim T (2020). Assessment of a real-time prediction method for high clothing thermal insulation using a thermoregulation model and an infrared camera. Atmosphere, 11: 106.
 
Liu S, Schiavon S, Das HP, Jin M, Spanos CJ (2019). Personal thermal comfort models with wearable sensors. Building and Environment, 162: 106281.
 
Long CM, Suh HH, Catalano PJ, Koutrakis P (2001). Using time- and size-resolved particulate data to quantify indoor penetration and deposition behavior. Environmental Science & Technology, 35: 2089-2099.
 
Lowe DG (1999). Object recognition from local scale-invariant features. In: Proceedings of the 7the IEEE International Conference on Computer Vision, Kerkyra, Greece.
 
Luo M, Wang Z, Ke K, Cao B, Zhai Y, et al. (2018). Human metabolic rate and thermal comfort in buildings: The problem and challenge. Building and Environment, 131: 44-52.
 
Lv Y, Duan Y, Kang W, Li Z, Wang F (2015). Traffic flow prediction with big data: A deep learning approach. IEEE Transactions on Intelligent Transportation Systems, 16: 865-873.
 
Metzmacher H, Wölki D, Schmidt C, Frisch J, van Treeck C (2018). Real-time human skin temperature analysis using thermal image recognition for thermal comfort assessment. Energy and Buildings, 158: 1063-1078.
 
Miura J, Demura M, Nishi K, Oishi S (2019). Thermal comfort measurement using thermal-depth images for robotic monitoring. Pattern Recognition Letters, .
 
Moon JW, Kim JJ (2010). ANN-based thermal control models for residential buildings. Building and Environment, 45: 1612-1625.
 
Na H, Choi J-H, Kim H, Kim T (2019). Development of a human metabolic rate prediction model based on the use of Kinect-camera generated visual data-driven approaches. Building and Environment, 160: 106216.
 
Ngarambe J, Yun GY, Santamouris M (2020). The use of artificial intelligence (AI) methods in the prediction of thermal comfort in buildings: Energy implications of AI-based thermal comfort controls. Energy and Buildings, 211: 109807.
 
Nieman DC, Trone GA, Austin MD (2003). A new handheld device for measuring resting metabolic rate and oxygen consumption. Journal of the American Dietetic Association, 103: 588-593.
 
Nieman DC, Austin MD, Benezra L, Pearce S, McInnis T, et al. (2006). Validation of Cosmed’s FitMate™ in measuring oxygen consumption and estimating resting metabolic rate. Research in Sports Medicine, 14: 89-96.
 
Ning H, Wang Z, Ji Y (2016). Thermal history and adaptation: Does a long-term indoor thermal exposure impact human thermal adaptability? Applied Energy, 183: 22-30.
 
Olesen BW, Parsons KC (2002). Introduction to thermal comfort standards and to the proposed new version of EN ISO 7730. Energy and Buildings, 34: 537-548.
 
Park BR, Choi EJ, Choi YJ, Moon JW (2020). Accuracy analysis of DNN-based pose-categorization model and activity-decision algorithm. Energies, 13: 839.
 
Patsadu O, Nukoolkit C, Watanapa B (2012). Human gesture recognition using Kinect camera. In: Proceedings of the 9th International Conference on Computer Science and Software Engineering (JCSSE), Bangkok, Thailand.
 
Polson NG, Sokolov VO (2017). Deep learning for short-term traffic flow prediction. Transportation Research Part C: Emerging Technologies, 79: 1-17.
 
Ravussin E, Burnand B, Schutz Y, Jéquier E (1982). Twenty-four-hour energy expenditure and resting metabolic rate in obese, moderately obese, and control subjects. The American Journal of Clinical Nutrition, 35: 566-573.
 
Ruiz I, Sprowls M, Deng Y, Kulick D, Destaillats H, et al. (2018). Assessing metabolic rate and indoor air quality with passive environmental sensors. Journal of Breath Research, 12: 036012.
 
Schofield WN (1985). Predicting basal metabolic rate, new standards and review of previous work. Human Nutrition Clinical Nutrition, 39: 5-41.
 
Shotton J, Fitzgibbon A, Cook M, Sharp T, Finocchio M, et al. (2011). Real-time human pose recognition in parts from single depth images. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Colorado Springs, CO, USA.
 
Simonyan K, Zisserman AJ (2014). Very deep convolutional networks for large-scale image recognition. In: Proceedings of the International Conference on Learning Representations (ICLR), San Diego, CA, USA.
 
Staudenmayer J, Pober D, Crouter S, Bassett D, Freedson P (2009). An artificial neural network to estimate physical activity energy expenditure and identify physical activity type from an accelerometer. Journal of Applied Physiology, 107: 1300-1307.
 
Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, et al. (2015). Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.
 
Vakalopoulou M, Karantzalos K, Komodakis N, Paragios N (2015). Building detection in very high resolution multispectral data with deep learning features. In: Proceedings of the 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Milan, Italy.
 
Wang R, Blackburn G, Desai M, Phelan D, Gillinov L, et al. (2017). Accuracy of wrist-worn heart rate monitors. JAMA Cardiology, 2: 104-106.
 
Zhai Y, Li M, Gao S, Yang L, Zhang H, et al. (2018). Indirect calorimetry on the metabolic rate of sitting, standing and walking office activities. Building and Environment, 145: 77-84.
Building Simulation
Pages 1077-1093
Cite this article:
Na H, Choi H, Kim T. Metabolic rate estimation method using image deep learning. Building Simulation, 2020, 13(5): 1077-1093. https://doi.org/10.1007/s12273-020-0707-1

566

Views

14

Crossref

N/A

Web of Science

13

Scopus

0

CSCD

Altmetrics

Received: 15 December 2019
Accepted: 06 August 2020
Published: 02 September 2020
© Tsinghua University Press and Springer-Verlag GmbH Germany, part of Springer Nature 2020
Return