The Performance of Reinforcement Learning for Indoor Climate Control Devices according to the Level of Outdoor Air Particulate Matters

As people spend more than 90% of their time indoors, indoor environmental quality (IEQ) has become an important factor in maintaining a healthy space for the occupants. There are many indoor climate control devices for improving IEQ. However, it is difficult to maintain an appropriate IEQ with chang...

Full description

Bibliographic Details
Main Authors: Sun Ho Kim, Hyeun Jun Moon
Format: Article
Language:English
Published: MDPI AG 2023-12-01
Series:Buildings
Subjects:
Online Access:https://www.mdpi.com/2075-5309/13/12/3062
Description
Summary:As people spend more than 90% of their time indoors, indoor environmental quality (IEQ) has become an important factor in maintaining a healthy space for the occupants. There are many indoor climate control devices for improving IEQ. However, it is difficult to maintain an appropriate IEQ with changing outdoor air conditions and occupant behavior in a building. This study proposes a reinforcement learning (RL) algorithm to maintain indoor air quality (IAQ) with low energy consumption in a residential environment by optimally operating indoor climate control devices such as ventilation systems, air purifiers, and kitchen hoods. The proposed artificial intelligence algorithm (AI2C2) employs DDQN (double deep Q-network) to determine the optimal operation of various indoor climate control devices, reflecting IAQ and energy consumption via different outdoor levels of particulate matter. This approach considers the outdoor air condition and occupant activities in training the developed algorithm, which are the most significant factors affecting IEQ and building energy performance. A co-simulation platform using Python and EnergyPlus is applied to train and evaluate the model. As a result, the proposed approach reduced energy consumption and maintained good IAQ. The developed RL algorithm for energy and IAQ showed different performances based on the outdoor PM 2.5 level. The results showed the RL-based control can be more effective when the outdoor PM 2.5 level is higher (or unhealthy) compared to moderate (or healthy) conditions.
ISSN:2075-5309