首页|A reinforcement learning approach for thermostat setpoint preference learning

A reinforcement learning approach for thermostat setpoint preference learning

扫码查看
Occupant-centric controls(OCC)is an indoor climate control approach whereby occupant feedback is used in the sequence of operation of building energy systems.While OCC has been used in a wide range of building applications,an OCC category that has received considerable research interest is learning occupants'thermal preferences through their thermostat interactions and adapting temperature setpoints accordingly.Many recent studies used reinforcement learning(RL)as an agent for OCC to optimize energy use and occupant comfort.These studies depended on predicted mean vote(PMV)models or constant comfort ranges to represent comfort,while only few of them used thermostat interactions.This paper addresses this gap by introducing a new off-policy reinforcement learning(RL)algorithm that imitates the occupant behaviour by utilizing unsolicited occupant thermostat overrides.The algorithm is tested with a number of synthetically generated occupant behaviour models implemented via the Python API of EnergyPlus.The simulation results indicate that the RL algorithm could rapidly learn preferences for all tested occupant behaviour scenarios with minimal exploration events.While substantial energy savings were observed with most occupant scenarios,the impact on the energy savings varied depending on occupants'preferences and thermostat use behaviour stochasticity.

reinforcement learningpreference learningoccupant-centric controlssmart thermostatsoff-policy learning

Hussein Elehwany、Mohamed Ouf、Burak Gunay、Nunzio Cotrufo、Jean-Simon Venne

展开 >

Department of Environmental Engineering,Carleton University,Ottawa,Canada

Department of Building,Civil,and Environmental Engineering,Concordia University,Montreal,Canada

BrainBox AI Inc.,Montreal,Canada

Brainbox AI Incexcellent research networking provided by IEA EBC Annex 79

2024

建筑模拟(英文版)

建筑模拟(英文版)

EI
ISSN:1996-3599
年,卷(期):2024.17(1)
  • 57