Small Sample Building Energy Consumption Prediction Using Contrastive Transformer Networks

Sensors (Basel). 2023 Nov 19;23(22):9270. doi: 10.3390/s23229270.

Abstract

Predicting energy consumption in large exposition centers presents a significant challenge, primarily due to the limited datasets and fluctuating electricity usage patterns. This study introduces a cutting-edge algorithm, the contrastive transformer network (CTN), to address these issues. By leveraging self-supervised learning, the CTN employs contrastive learning techniques across both temporal and contextual dimensions. Its transformer-based architecture, tailored for efficient feature extraction, allows the CTN to excel in predicting energy consumption in expansive structures, especially when data samples are scarce. Rigorous experiments on a proprietary dataset underscore the potency of the CTN in this domain.

Keywords: contrastive learning; energy consumption prediction; small sample learning.