Abstract
The United Nations launched sustainable development goals in 2015 that include goals for sustainable energy. From global energy consumption, households consume 20–30% of energy in Europe, North America and Asia; furthermore, the overall global energy consumption has steadily increased in the recent decades. Consequently, to meet the increased energy demand and to promote efficient energy consumption, there is a persistent need to develop applications enhancing utilization of energy in buildings. However, despite the potential significance of AI in this area, few surveys have systematically categorized these applications. Therefore, this paper presents a systematic review of the literature, and then creates a novel taxonomy for applications of smart building energy utilization. The contributions of this paper are (a) a systematic review of applications and machine learning methods for smart building energy utilization, (b) a novel taxonomy for the applications, (c) detailed analysis of these solutions and techniques used for the applications (electric grid, smart building energy management and control, maintenance and security, and personalization), and, finally, (d) a discussion on open issues and developments in the field.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
Overall, households account for 20–30% of energy consumption in Europe, North America and Asia. Heating and cooling, lighting, and electric appliances are the three major contributors of this consumption [1, 2]. Moreover, the recent regulation in the EU and China has required buildings to utilize less energy and, at the same time, utilize more renewable energy [3, 4]. To promote efficient and comfortable energy consumption in smart buildings, there is a need to develop and deploy machine learning (ML) applications, neural network (NN) applications and other AI applications coupled with systematic data. However, despite the potential significance of AI in this area, few surveys or reviews have systematically categorized machine learning applications for energy utilization in smart buildings.
The purpose of this study is to review the application segments of the smart energy of buildings since 2009 using a mapping study to scope the topic, and, then, to concentrate on the review of the applications and techniques within that scope. We present our method in Sect. 2. We present our mapping study results and answer the related research questions in Sect. 3. In Sect. 4 we present our literature review results and in Sect. 5 answer the related research questions. We present the open issues and future work in Sect. 6 and our conclusions in Sect. 7.
2 Method
This study has been undertaken as a mixed study starting with a mapping study to scope the study topic and continuing with a related systematic literature review [5, 6]. The first goal of this study is to assess the status of application segments for the smart energy of buildings. This part of the study can be categorized as a mapping study. Then, the second goal of this study is to review the applications and the machine learning techniques identified through the mapping study. This part of the study can be categorized as a systematic literature review. The steps of the mapping and systematic literature review are presented below.
2.1 Research Questions
The research questions addressed by this study are:
-
RQ1: How much smart building energy activity utilizing machine learning has there been in 2009-2021?
-
RQ2: Who leads smart building energy research?
-
RQ3: What research topics are addressed?
-
RQ4: What are the open questions and limitations of the current research?
With respect to the research question concerning the amount (RQ1) of the research, the mapping study addresses this. We limited the search to the period 2009–2021. We recognize that the number of review papers prior to 2009 was scarce. However, there were relevant studies also prior to 2009, and we looked in few of them to have an idea of the prior research [7, 8]. To answer the RQ1, we identified the number of papers on smart building energy and the journals that published them. With respect to the research questions concerning the origins (RQ2) of the research, the mapping study addresses this. We considered the fields of science, to which researchers were affiliated, and the country, in which the organization was situated.
With respect to the research topics (RQ3), they were addressed both in the mapping study and the literature review. In the mapping study we identified the candidates for the taxonomy. The taxonomy was then proposed based on the mapping study and the literature review results. This was an iterative process. Furthermore, in the literature review we considered the scope of each article (i.e., whether it addressed taxonomy, whether it considered applications, and whether it looked at a machine learning centered research question). Consequently, we considered several issues:
-
RQ3.1: What are the discussed topics for smart building energy utilization?- This research question is answered in the mapping study.
-
RQ3.2: What are the existing taxonomies utilized for smart building energy utilization and what are their characteristics?- This research question is answered in the literature review.
-
RQ3.3: What is the taxonomy proposed for the applications for smart building energy utilization?- This research question is answered in the literature review.
-
RQ3.4: What are the characteristics of the applications and the parameters to compare the application areas?- This research question is answered in the literature review.
-
RQ3.5: Which are the techniques utilized for the applications of smart energy for buildings?- This research question is answered in the literature review.
-
RQ3.6: How are the techniques manifested in electric grid, building control, maintenance and security, and personalization? What are the issues?- This research question is answered in the literature review.
With respect to the limitations of this study and future directions of the research (RQ4), the Sect. 6 addresses this question. We considered both the applications and the machine learning techniques.
2.2 Search Process
The search process was initiated by comparing Web of Science and Scopus databases. We selected Scopus as it yielded more results when we proceeded with the first steps of the search process.
With respect to the mapping study, the search process was an automated search of reviews in 2009–2021 with broadly defined search keyword from 34 publications in Scopus including Renewable And Sustainable Energy Reviews, Energy And Buildings, Energies, IEEE Access, Building And Environment, IEEE Internet Of Things Journal, Sustainable Cities And Society, ACM Computing Surveys, and Journal Of Network And Computer Applications. The journals were selected because they were known to include either empirical studies or literature surveys, and to contain machine learning topics. Furthermore, three bibliographic analysis programs were compared (Bibliometrix, CiteSpace, and VOSviewer). We selected VOSviewer as it was the most stable one and had relevant references for the methods utilized [9].
With respect to the literature review, to extract any details about the taxonomies proposed so far, the search was a manual search of specific survey and review papers. The journals selected were the same as above. Each review publication was reviewed by the main author and the papers that addressed taxonomies for smart energy of buildings of any type were identified as potentially relevant. Then, the main author applied the detailed inclusion and exclusion criteria to the relevant papers (refer to Sect. 2.3), and another round of reading the paper abstracts, conclusions, problem statements and taxonomies was done.
With respect to the literature review, to extract more details about the applications and machine learning techniques, the search was a manual search of specific conference proceedings, journal papers, and research papers. The journals selected were the same as above. Each review publication was reviewed by the main author and the papers that addressed applications for smart energy of buildings of any type were identified as potentially relevant. Then, the main author applied the detailed inclusion and exclusion criteria to the relevant papers (refer to Sect. 2.3), and another round of reading the paper abstracts, conclusions and problem statements was done.
2.3 Inclusion and Exclusion Criteria
For the mapping study, all peer-reviewed surveys and literature reviews from 2009–2021 were included using the search string ("smart building" AND ("energy" OR "energy-efficiency" OR "comfort" OR "anomaly detection")) AND ("machine learning" OR "supervised learning" OR "unsupervised learning" OR "neural networks" OR "reinforcement learning"). Primary research articles were excluded. For the related bibliometric analysis, a term was included if it had a minimum of 25 occurrences and a membership in the 100 most relevant terms. The relevancy was based on the full counting method of the bibliometric tool. Too generic terms (problem, condition), repetitive terms (IoT, IoT system), and irrelevant terms (review, study) were excluded.
For the literature review, the above mentioned studies as well as research articles from 2009–2021 were included. We included some articles that were cited in the surveys or literature reviews if the topic had only few search results. Furthermore, a paper had to have over 8 citations and it had to have some reference to the data utilized. For the inclusion criteria, the emphasis was on energy applications for existing buildings and their dwellers. We excluded healthcare, IoT, and smart city articles, articles concerning the initial design and construction of buildings as well as articles concerning the final reuse of building materials. We also excluded smart energy articles that exceed the topic identified. Finally we excluded repetitive articles with only a minor difference from the perspective of this study if there were several articles concerning similar application or methodology.
2.4 Data Collection and Analysis
With respect to the mapping study, the data extracted from each review was:
-
The source journal
-
The author(s), their institution and the country where it is situated
-
Titles, abstracts and citations
-
The number of co-occurrence of terms in reviews
A co-occurrence is the number of publications in which two terms occur together [9]. The data was summarized in graphs and tables to show:
-
The number of reviews published per year (addressing RQ1).
-
Countries of the authors and the fields of the surveys (addressing RQ2).
-
The clusters of terms in the data, i.e., candidates for application areas in the taxonomy (addressing RQ3.1).
-
The proposed taxonomy (addressing RQ3.2).
With respect to the literature review, the data extracted from each article was the same as above as well as:
-
Conclusions of the articles
-
Problem and issue statements concerning the topic in the text body
-
Taxonomy proposed (surveys and reviews only)
The data was summarized in graphs, tables, and analyzed in text format to address the remaining questions:
-
The existing taxonomies for the applications and their characteristics (addressing RQ3.3).
-
The characteristics of the application areas and their parameters (addressing RQ3.4).
-
Methods utilized in applications for the smart energy of buildings (addressing RQ3.5).
-
Applications reporting the most issues and issues related to them (addressing RQ3.6).
3 Results and Discussion for the Mapping Search
This section summarizes the results and answers the research questions related to the mapping search.
Figure 1 presents the number of articles that were identified in the search process. This answers the research question: How much smart building energy activity utilizing machine learning has there been in 2009–2021? In total 483 surveys or literature review articles were identified. The trend for the number of articles is rising, especially in the years since 2018.
Table 1 shows the 12 top countries of origin for the authors of these articles with the respective number of documents and citations. Furthermore, Fig. 2 shows the fields of the surveys according to Scopus. These answer the research question: Who leads smart building energy research? In respect to the countries, the United States, China and the United Kingdom are the three leading origins of the articles. There are clear differences between the countries in the number of citations. In average, an article from Denmark gets more citations than an article from Spain, for example. For the fields of surveys, engineering, computer science and energy are the top three fields.
The results of the bibliographic analysis applied on the mapping are presented in Fig. 3. This answers the research question: What are the discussed topics for smart building energy utilization? There are three major topics or clusters of terms. Moreover, with respect to the applications, many terms specific to an application emerge, such as ’microgrid’, and ’smart grid’. With respect to the machine learning techniques utilized for the applications, three terms emerge: machine learning, deep learning, and blockchains. However, any other terms related to supervised, unsupervised and reinforcement learning (RL) methods, that were part of the search string, are missing.
For the articles identifying the clusters, we limited the search only to the reviews which still resulted in a large number of papers. This means that machine learning techniques, that are often described in more detail in research articles, may have been missed with this search process. However, this gives some balance to the results on the scoping of the application areas.
For the bibliographical study, there are some logical overlaps as the bibliographic analysis program does not combine related terms, such as heating and ventilation vs. HVAC (heating, ventilation and air conditioning) or energy system vs. energy management.
For the machine learning techniques, analysis of the techniques is not feasible based on the results of the mapping study, and, therefore, is left to the literature review.
4 Results for the Literature Review
This section summarizes the results for the literature review.
4.1 Results for the Taxonomy
Table 2 summarizes the search results of the previous studies. Figure 4 shows the taxonomy proposed here. It is based on results of the mapping search and literature review (taxonomy) search. It was iterated during the consequent steps of the search process.
For the articles investigated for the taxonomy, we systematically went from the highest cited surveys to lowest cited surveys. However, for the emerging studies (e.g., personalization), we had to select articles with fewer citations, or had fewer articles in our disposal, than for well-established areas (e.g. smart grid).
4.2 Results for the Applications
Table 3 summarizes the search results for applications. The columns Application domain, Application area, Objectives, and Related articles are the relevant ones for this section.
In respect to energy management systems, a further result was that 49% of the EMS applications are related to a whole building’s energy load, while the rest 51% to its other loads, such as heating or cooling. Adjacently, the time horizon is less than 24 h for 41%, one day for 35%, and longer for 24% of the applications [31].
For the research articles and conference papers investigated for the applications, we started from 5120 articles and systematically went from the highest cited articles to lowest cited surveys. However, for the emerging areas (e.g., blockchain contracts), we had to select articles with fewer citations, or had fewer articles in our disposal, than for well-established areas (e.g. microgrids). This is a bit disappointing and resulted in missing some possibilities to quantitative analysis for some application areas, but a quantitative analysis is difficult to do for emerging topics. The applications are discussed in more detail in the Sect. 5.2.
4.3 Results for the Machine Learning Techniques
This section summarizes the results for the machine learning techniques.
Table 3 presents the results of the search for the techniques utilized for the applications. We identified 85 articles by the search process. Potentially relevant studies were excluded according to the inclusion and exclusion criteria. Furthermore, from these articles, we identified the following techniques: Artificial Neural Network (ANN), Autoregressive Moving Average (ARMA), Bayes, Bee Colony, Blockchains, Classification and Regression trees (CART), Clustering, Convolutional Neural Networks (CNN), data analysis, Deep Belief Network (DBN), Deep Neural Network (DNN), hybrid models (e.g., Deep Neural Network and Long-Short-Term Memory (DNN-LSTM)), Deep Reinforcement Learning (DRL), ensemble methods (e.g., severals ANNs), Extreme Gradient Boosting (XGB), Firefly, Fuzzy Logic, Generative Adversarial Networks (GAN), Genetic Algorithm (GA), Gradient Boosting (GB), K-Nearest Neighbors (kNN), Nash Equilibrium, Particle Swarm Optimization (PSO), Random Forest (RF), Recurrent Neural Networks (RNN), Reinforcement Learning (RL), Support Vector Machines (SVM), and Support Vector Machines with Dragonfly. Noteworthy, several algorithms have been applied to energy management systems and microgrids. Undoubtedly, this reflects the bigger amount of research done in these areas.
For the application domains, we tried to identify a relationship with the machine learning techniques utilized. Overall, out of all 85 applications, 33% utilize RL or DRL, 22% other neural networks and 45% other methods. Applications concerning both load and money objectives utilize prominently reinforcement learning method in both smart grid and energy management domains. Out of the 27 related solutions, 48% utilize RL or DRL, 22% other neural networks and 30% other machine learning or analytical methods. Applications concerning personal comfort utilize to a noticeable extent reinforcement learning method. Out of the 12 related solutions, 33% utilize RL or DRL, 8% other neural networks and 58% other machine learning or analytical methods.
Table 4 presents the results for the issues identified for the applications and techniques. We identified 19 topic types that were divided into 34 topic areas based on an analysis of the search results. We tried to identify a relationship with the issues and either the applications or the techniques. The reported issues for the techniques and related models were predominant in comparison to the issues for the application (design) as such.
In respect to energy management systems, a further result is that the selected time-horizon affects the yielded results. For example, [129] compares deep reinforcement learning and common supervised models with a shorter or longer time-horizon concluding that there was a trend of rising model error with multi-step forecasts and with longer time-horizons. Finally, to make more data, [63] proposes a way of synthesizing rule-based controllers with simple rules and with simulated data utilizing support vector machines and AdaBoost; however, the practical applicability of this was not proven at that point of time (2014).
5 Discussion on the Literature Review
5.1 Discussion on the Taxonomy
In this section, we discuss the answers to our research questions related to the taxonomy.
5.1.1 What are the Existing Taxonomies Utilized for Smart Building Energy Utilization and What Are Their Characteristics?
Overall, we identified 21 relevant sources during the search (Table 2). The applications constitute various application domains, such as smart grid, several types of building energy controls and managements, personalization, and maintenance and security. The issues and challenges faced are heterogeneous. We have analyzed them in more detail in the context of the techniques in Sect. 4.3 as many of them turned out to be technique related. The applications were arranged into taxonomies, classifications or frameworks.
Finally, at this step of our survey, we identified a research gap: we did not discover a taxonomy that covers the domain of energy utilization (electric grid, smart building energy management and control, personalization, and maintenance and security) for smart buildings.
5.1.2 What is the Taxonomy Proposed for the Applications for Smart Building Energy Utilization?
Figure 4 shows the proposed taxonomy that was based on the analysis of the mapping study and the literature survey. It consists of the electric grid, the smart building energy management and control, the personalization, and maintenance, the security, and the data application domains with several applications types for each of them. The taxonomy was iterated during the literature review to show more details.
Notice that the taxonomy uses terms as they appear in the articles, albeit often in abbreviated form. The exception is the term ’cost-aware scheduling’ that this study adopted. As the energy load prediction as such has evolved to scheduling of devices and to taking into account the cost factors, there is a need for defining terminology. Even though some of the identified articles propose applications to these current aims, they mostly do not articulate this in precise terms.
This taxonomy is different from the existing ones, as the taxonomy of some surveys concentrate on a type of machine learning, for instance, neural networks [24], or on an application area of a smart building, for instance building load [30]. Moreover, [27] considers operation, control and retrofit; however, it does not include the human-in-the-loop as such in its taxonomy. Even though, for example, [130] presents solutions that incorporate building occupants in sensing and control frameworks, it does not include other smart building components. [2] concentrates on energy management systems, but not on the related energy components.
5.2 Discussion on the Applications
In this section, we discuss the answers to our research questions related to the applications.
5.2.1 What are the Characteristics of the Applications and the Parameters to Compare the Application Areas?
Overall, for the four main application domains of the taxonomy, each of them contains many applications (Table 3). In the following we present the applications for the smart grid, the building energy control and management, the personalization, and the maintenance and security domains.
The first strand of literature presents smart grid (electric grid) related solutions in smart buildings. In contrast to traditional grids, the smart grids with demand side management can deploy tasks to manage electricity load or improve energy efficiency [131]. According to the surveys [132,133,134] the main components of a smart grid are advanced control to utilize data, integrated appliances, integrated renewable energy sources, integrated energy storages, optimization of the grid use, and safety measures. The main objectives for the applications of the smart grid are to flatten the load peaks either by reduction of consumption during high demand or by shifting of load to low demand periods [25, 135]. The broader objectives include also lower greenhouse gas emissions and design of adequate interfaces to AI applications, for instance.
Reducing peak load demand that increases the grid capacity and reliability is called demand side management [102]. The smart building owners are involved in participating in the demand side management through different demand-response (DR) programs of a smart grid. As stated by the United States Department of Energy, DR refers to “a tariff or program [...] to induce lower electricity usage at times of high market prices or when grid reliability is jeopardized” [136]. The demand-response programs are broadly divided into incentive-based schemes and price-based schemes. The incentive-based schemes are further divided to direct control and indirect control schemes where the former refers to a mechanism, by which a utility remotely adjusts or disrupts energy consumption of controllable appliances in a short notice (1 s–1 min). The indirect control refers to a mechanism, by which a utility notifies end-users and asks them voluntarily to reduce the peak load with prior notification (up to some hours). Both of these incentive-based schemes offer monetized rewards for the end-users and can include different kinds of bidding mechanisms or commitments [137].
In turn, the pricing schemes are further divided into time-of-use, real-time pricing, and critical peak pricing schemes. Time-of-use pricing scheme settles a group of prices in advance and then applies them to different predefined intervals of a calendar day [138, 139]. Critical peak pricing is according to the United States Federal Energy Commission a scheme that “encourages reduced consumption during periods of high wholesale market prices or system contingencies by imposing a pre-specified high rate or price for a limited number of days or hours” [140]. For instance, critical peak pricing can be used together with pre-set prices, but the trigger to change the price is dynamic, such as a change in wind-power generation [104]. Real-time pricing responds continually to the energy spot market, because of which it changes constantly. The utility may reveal the price a day ahead or an hour ahead so the end-users can adjust their energy consumption accordingly [133, 141]. An overview of the demand-response framework is in Fig. 5.
Other techniques to enable load reallocation can include, for example, smart meters that can be utilized, on the other hand, by the grid operator for clustering the energy consumption pattern, and on the other, by the local producer-consumer (also known as prosumer) for trading the energy based on the current state of the renewables, market prices and energy consumption [16, 142]. That is, a smart meter is a component that enables communications between the grid and a smart building which is utilized for forecasting, clustering, classification and optimization [16, 143]. However, there were relatively few papers concerning smart meters in the smart building area; the focus was more on the utility price-setting.
Demand-response framework overview. Source [137]
For pricing and incentive schemes, to address the lack of motivation of the end-users, the grid operators have run demand-response trials with customers, such as in New Zealand in 2007-2020, which concluded that raising awareness of the system was one of the main goals [144]. However, if the personal monetary incentives are small, sacrificing the comfort level in exchange for financial incentives is not accepted by the majority of the residential dwellers [117, 118]. (See also Table 4 for more issues).
A second prominent strand of literature presents energy management systems (EMS) and other control systems for smart buildings. An energy management system consists of hardware (sensors, actuators, information technology components) as well as software for operating logic (controls and alarms). These systems are called with several resembling terms (building energy management, home energy management, building automation and control systems); however, these terms are broadly considered to be close synonyms to each other [134]. From a functional perspective, energy management systems are tools to shift, and constrain energy consumption and production profiles automatically in a smart building at defined times. An EMS usually creates an optimal consumption and production schedule by considering multiple objectives such as energy costs, environmental concerns, load profiles, and consumer comfort [12]. That is, the objectives of an EMS of a smart building include typically energy cost reduction, user-comfort maximization, energy load (and generation) profiling, and emissions cut [12]. However, depending on the EMS, the system can utilize a different set of objectives, such as user-comfort, energy savings, or indoor air quality omitting, for instance, emissions [10, 11].
In turn, occupancy is a significant aspect that is related to a considerable amount of applications for energy management and personal comfort [31, 122, 145]. Some stand-alone aspects of a building’s energy control, such as energy load as such, or lighting, can also be a focus of an application.
In turn, microgrids are a prominent topic in the literature of energy management [13, 146]. Microgrids are defined by the US Department of Energy as: “A group of interconnected loads and distributed energy resources (DERs) with clearly defined electrical boundaries that acts as a single controllable entity with respect to the grid and can connect and disconnect from the grid to enable it to operate in both grid-connected or island modes” [147]. In other words, microgrids for smart buildings consist of electric appliances, local (renewable) energy sources, utility energy sources, and energy storage systems as well as advanced controls (Fig. 6). Moreover, scheduling the charging-discharging of electric vehicles (EVs) can be part of building energy management [14]. The main objectives of a microgrid are energy-efficiency and cost-efficiency for a smart building and its owner. Moreover, the utilization of microgrids contributes to the smart grid stability and reliability [15, 133]. The concept is close to the energy management systems, but with a more focused definition than the definitions of various energy management systems.
Overview of a microgrid in a smart building. Source [24]
A third strand of literature presents the personalization in smart buildings which relates to comfortable utilization of buildings, or, some other personal aspects, such as (personal) energy market participation that the smart grid concept has enabled recently.
Figure 7 presents the main components to manage personal comfort indoors. The models have evolved in the last ten years from classification of human activity, to construct more explicit models utilizing human signals and activity to predict the comfort experienced [148]. These personal comfort applications save energy with the reasoning that they increase the utilization rates of the buildings. That is, people tend to prefer comfortable environments [149]. Furthermore, in practice the control models seldom interact directly with building users. However, there are ideas on buildings that ’talks to me’, or takes into account the personalities of the users [126, 150].
Being the most studied domain of comfort, the human thermal comfort comprises several factors impacting it as depicted in Fig. 8 [77]. Moreover, balancing between the thermal comfort and energy costs is a common dual target for comfort modeling [128]. Noteworthy, use-comfort evaluation is predominantly based on a majority opinion as defined in standards. For example, ASHRAE or ISO15251 standards specify the combinations of indoor thermal and personal parameter values that will produce thermal environmental conditions acceptable to a majority of the occupants within the space [151, 152].
A graph with environmental and human factors impacting thermal comfort for making a model and predicting the thermal preference. Source: [77]
As for the benefits, [22] yielded a result based on field-studies that occupant voting and preference profiling in comfort-aware HVAC operations illustrated a median of 20% of energy savings. However, in practice, personalization is often limited to lighting. An exapmle of this is, at least according to the information available, a so-called smart building in Amsterdam opened in 2014 [153].
In turn, smart building measurements can be utilized for formulating recommendations. For instance, [28, 142] present applications for anomaly detection of energy consumption in buildings. Some solutions can detect anomalies in specific hours in the day, or specific days on building level; hence they can provide end-users with a personalized feedback to reduce wasted energy. Furthermore, [19, 22] present anomaly detection to identify occupancy and comfort, which can be utilized for user-centric operations of HVAC systems.
This kind of information can be extracted from energy control and management systems to evaluate personal thermal comfort as well. For example, occupancy behavior and possible recommendations can be gained from the system that [17] presents. This application for energy demand flexibility has a range of information on subjects, such as photovoltaic cells and wind, as well as heating, ventilation, air conditioning (HVAC) systems, energy storage, building thermal mass, appliances, and mechanisms to learn occupant behaviors. Buildings can become more flexible in terms of power demand from the power grid if all of these measures are considered from the beginning in modeling.
In turn, energy market participation can be regarded as part of the personalization of smart building energy utilization. For instance, blockchains that can be utilized for decentralized energy trading and that fulfill privacy, security and trust objectives [154] (See Fig. 9). Also machine learning based solutions may be utilized for energy market participation [17].
Overview of blockchain technology in energy peer-to-peer trading. Source: [155]
A fourth major strand of literature concerns instabilities, faults and intrusion of building energy systems, that is, maintenance and security. For instance, [156] presents solutions for integration of power systems that include instabilities and security concerns that machine learning solutions can solve. Recently, blockchains have been introduced to ensure together data security and privacy for smart building applications [157]. Moreover, at building level, [18] presents several unsupervised learning methods for analysis of performance that benefits maintenance, such as clustering, novelty detection, motif and discord detection, rule extraction, and visual analysis. Information retrieved can be used for both maintenance and security applications.
Preventive maintenance includes several applications. A maintenance solution can combine several domains, so that anomaly detection can be utilized not only in cases of power transmission failures but also in cases of intrusion[21, 156].
A fifth strand of the literature presents big data (issues) for smart building energy utilization [26, 119, 120]. All solutions based on machine models require applicable data. Hence, an underlying data model for buildings and people is necessary. Moreover, the topic of data models is a pervasive theme in the smart energy application papers surveyed here; therefore, it is discussed. The big data includes data on monitoring, control, maintenance, automation, and personalization of energy utilization in smart buildings. [26] classifies data to the following seven classes including, but not restricted to, energy savings, appliance recognition, occupancy detection, user preference detection, anomaly detection, energy disaggregation and energy demand prediction. Moreover, typically, the system components communicate over a centralized hub via a common interface [158]. For instance, a typical interface in the European Union is the REST API [159] that specifies the data transfer between an appliance and a machine learning algorithm.
For human related data, [160] summarizes a disparity in human modeling studies: some focus on occupant behavior in order to model that, while, on the other hand, some focus on occupants’ interaction with given buildings and devices in order to develop interfaces. This disparity raises the question how to adequately combine these human data models for applications developed. One noteworthy development is that mobile and portable technologies have made it possible to provide personal recommendations. The present smart building equipment controls can be connected to interactive (mobile) applications, such as thermostats [161].
Even though not included in this study, we recognize that Internet of Things and multi-agent systems provide data and tools to management systems, for example, by providing data from sensors [162, 163]. Moreover, there are several ways to achieve the objectives, not necessarily related to an application utilizing machine learning. For example, for personalization of the immediate environment can be achieved with personal gadgets, such as personal fan or heating device. [164] proposes using a heated and cooled chair to increase comfort. However, while providing the answer to the personalizing, in a strict sense, this proposal does not belong to the domain of learning models for buildings that we scrutinize here. At the same time; in spite of the above, these kinds of gadgets could be integrated as part of a recommendation (model) for personal comfort.
Finally, as a generic summary for building operations, the United Nations has defined some broad goals for sustainable cities and communities [165, 166].
5.2.2 Juxtaposing the Definitions of Some Terms
As the mapping study suggested, the number of topics for articles has grown, especially since 2018. The literature study indicated that the solutions have become more specialized, and perhaps even more overlapped. To make an analysis on ‘smart building’, we need to scrutinize this concept. We noted that it is close to ‘smart energy, ‘smart grid’, and ’smart city’ according to the literature review; therefore, we juxtapose all of them. The definition of smart building covers energy conservation, safety, comfort, lighting, heating, and appliances. Machine learning is part of smart building concept as models used to control smart buildings learn from data gathered from sensors and smart devices in contrast to buildings relying on a pre-programmed models [167,168,169]. More recent definitions of smart buildings consist of heterogeneous artificial intelligence (AI) models to solve problems related not only to buildings directly but also to personalization, electric grid, and data security according to [134, 170]. Utilizing these models requires that the building has advanced control mechanisms that can ensure the reliability and operating points for the models. This control system is often referred to as (building) energy management systems, but some other system, such as average voltage control, can be deployed as well [133, 133]. In this paper, we have discussed energy applications for smart buildings having the advanced controls in the broad definition of the term.
In turn, the basis for present-day energy systems in most countries is a simple scheme, where energy resources are converged to meet the demand; moreover, increased demand is met with increased utilization of resources [171]. Notwithstanding this simple scheme, ‘smart energy’, ‘smart energy systems’, or sometimes ‘intelligent energy’, is defined as sustainable energy scheme within the electricity, gas, building, and industrial sectors where a few of these solutions utilize renewable energy sources, energy storages, and national or local energy systems that are energy-efficient in a flexible manner [24, 171, 172]. In turn, smart grid refers to advanced electric power grid infrastructure for improved efficiency, enhanced reliability and safety involving the electricity generation and utilization [133, 134]. Finally, ’smart city’ can be defined as networked infrastructure coupled with high technologies, creative social and environmental industries, that focuses on achieving sustainability. ’smart city’ incorporates a wide range of intelligent systems from education to waste management [133, 134].
In this study, we have concentrated on the ’smart building’ and the ’smart grid’ concepts.
5.3 Discussion on the Literature Survey for the Machine Learning Techniques
In this section, we discuss the answers to our research questions related to the machine learning techniques.
5.3.1 Which are the Techniques Utilized for the Applications of Smart Energy for Buildings?
According to the search results in Table 3, the application to solve problems related to the smart building energy utilization consisted of machine learning and neural network applications, and to a lesser extent, pure data analysis based solutions. The machine learning and neural networks are utilized to develop classification and regression models where classification refers to a method that predicts a discrete class label output for the given task, while regression predicts a continuous quantity output for the given task. Both of these two common methods are part of supervised learning [173]. However, other methods were also applied. For example, unsupervised learning methods were utilized for some problems, mostly to discover more about the task in hand. Unsupervised learning refers to a method that uses machine learning algorithms to analyze unlabeled data and cluster it to smaller sets. Moreover, unsupervised learning can extract associations between the pieces of data [174]. In turn, a combination of supervised and unsupervised methods, so-called semi-supervised learning, was also utilized by algorithms that, for example, actively querying users for labels, such as personal comfort experience [175]. Finally, reinforcement learning methods were applied to some problems, such as complex real-time learning tasks with rewards and punishments that try to find an optimal policy for the model.
Choosing a machine learning technique matters as a method has some inherent issues associated with it. Overall, a desired outcome is that a model created in one environment (building) can be used in another environment without significant degradation in its results. This is called model generalization capability.
For design criteria, the following article raises application design criteria unlike many other articles [64]. These six major design criteria for a smart energy application are implementation feasibility, usability, computational time, accuracy, randomization, and adaptability. An example of a definition for one of these criteria is the implementation feasibility that is defined as the level of ease to implement the technique in the restricted amount of time and resources.
In respect to the energy management systems, the current heating, ventilation and air conditioning (HVAC) systems are still operated by simple feedback controls, such as on-off control or proportional-integral-derivative (PID) controls to a large extent. These simple control strategies are proven; however they do not consider predictive information, which affects their energy performance. Optimal control strategies such as Model Predictive Control (MPC) address these drawbacks by iterative optimization of an objective function over a receding time horizon. However, the MPC models do not adapt well to different buildings. Recently, several reinforcement learning models to predict the load combined with cost function models to predict the costs have been introduced for energy management systems to enhance the energy and cost efficiency of smart buildings [103, 176].
In respect to renewable energy generation, the sun related phenomena (solar radiation, wind) supply energy intermittently due to changes of weather. Therefore, renewable energy sources need to be integrated by a suitable solution design. Time-series forecasting is typically applied to energy management [121] but other machine learning methods are applied as well [30].
In respect to occupancy applications, implementation and utilization of applications vary; hence, doing a comparison for the models derived is arduous as concluded in the comparison of 19 papers for forecasting occupancy [177].
In respect to personalization applications, there are mixed results on their use. The results of [82] indicate, only around 30% of the occupants’ thermal comfort improved, and it decreased in 70% cases, when the user-driven control strategy was implemented in a disheveled manner. The problem identified was that performance of the demand-driven control strategy was mainly influenced by insufficient and poorly distributed data, as well as the effect of thermal expectations on occupants’ thermal responses.
In respect to maintenance and security, blockchains have been introduced to ensure together data security and privacy for smart building applications [157].
5.3.2 How are the Techniques Manifested in Electric Grid, Building Control, Maintenance and Security, and Personalization? What are the Issues?
Overall, machine learning applications are suitable for non-linear modeling and are often more accurate and faster than traditional deterministic models in the domain of energy utilization; hence there will be more of them in the field in the future [121].
According to the results in Table 4, there are several issues related to the techniques ranging from generic ones to more method related ones. Here we raise prominent topics to further discussion.
In respect to the generic issues identified, there is a tendency for machine learning research to claim to deliver better performance compared with previous studies as a survey of 144 recent research papers states [27]. The results of this literature survey agree with this piece of findings. This is partly due to the lack of common metrics. Moreover, evaluation of the quality of the results or the applicability of the results are often limited or missing. This is due to deficient reporting of the issues; moreover, for a proportionally large number of studies, these aspects were absent in the abstract part so that a systematic literature review utilizing database tools was not able to retrieve them. However, there are some exceptions, such as [59] that explicitly evaluate the applicability of the model in a critical manner.
In respect to techniques, reinforcement learning has recently been applied to a proportionally large number of the advanced building control solutions. It is probably utilized because it provides a way to avoid the tedious work of developing and calibrating a detailed model, as yielded by, for example, traditional Model Predictive Control (MPC) of buildings that has been in use since the 1970 s [122, 128, 176]. There have been some claimed problems with the reinforcement model generalizability (Table 4). However, at the same time some other literature states the opposite is true as some aspects of the modeled applications are general. An adequate policy gradient (a mapping from state to action) generalizes well; for example, turning on the heating when the indoor temperature is low remains the same for almost every building regardless of the other possible goals. Therefore, a rising trend is to study using policy gradient [103] or some other technique claimed to generalize well, such as actor-critic [178] technique and apply them to so-called transfer learning [179]. Moreover, an additional benefit here is programming efficiency. Rather than training a RL controller for every individual building, it can be more efficient to train RL controllers on a small number of buildings and then apply them to a stock of buildings.
In respect to the time-series, they are long-proven and still utilized for volatile phenomena, such as natural phenomena (e.g., wind, sun radiation) and human behavior (e.g., electric vehicle charging patterns, lighting, occupancy).
In respect to data analysis, a prominent application field for these is the human thermal comfort approximation. There is a comprehensive effort to collect enough statistical data to form credible analytical or machine learning models to this end (more about the databases in question further below).
In respect to blockchains, the results indicated a new trend: recently blockchains have been utilized for safe contracts and their applicability to the other application fields is also being scrutinized.
In respect to many other machine learning techniques utilized, they are more or less evenly distributed among the applications.
Finally, in respect to the data, the quality of data has an impact on the model results. [121] yielded a result that models utilizing field-collected data and taking the time-aspect into account achieve more accurate predictions than simulation-based models. Many surveys emphasize the importance of relevant (recent) data; furthermore, some emphasize model explainability, for example, through so-called grey box models, where machine learning models are combined with the physics-based equations and exogenous data for the model. However, to form a common ground and ameliorate the research preconditions, some preliminary efforts exist to provide more open data. These include, for instance, the ASHRAE Global Thermal Comfort Database [180] on personal behavior and comfort data, and the Building Data Genome Project [181] on building data.
5.4 Limitations
The procedures used in this study have deviated from the advice presented in Kitchenham’s guidelines in several ways:
-
The search related to the literature review was organized as a manual search process of a specific set of journals and conference proceedings and not as an automated search process. This was consistent with the other research aiming at identifying research trends and wider topics as opposed to a pure quantitative technology evaluation.
-
A single researcher was responsible for selecting the candidate studies.
The adapted process implies that we may have missed some relevant studies, and thus underestimate the extent of the related application areas or technologies. However, in this study, there was a systematic tertiary survey part on literature surveys, as there were relatively few primary studies for certain application areas (personalization and blockchain contracts), and the data extracted from the selected survey articles are considered to be relatively objective, so we do not expect several data extraction errors.
6 Open Questions
We discovered several unsolved issues and challenges while conducting this study. Several issues are common for the majority of solutions while each method or application may have specific problems of its own. This section answers the research question: What are the open questions and limitations of the current research?
-
1.
Smart energy solutions for buildings are based on data from several sources, including building variables (energy load, for example). Even though there are some databases that have this data, the lack of applicable data is perhaps the primary issue when making applications. What properties of buildings to report? How many buildings to include? What kind of appliance and energy load model to utilize? What parameters of energy are needed (voltages, currents, phase shifts)? What is an applicable measurement frequency? How long measurement periods are adequate?
-
2.
Moreover, the models include data on occupancy information and consumer preferences. How to define the control system for occupants (what is controlled and how is it controlled?)? What comprises a full predictive control? How to define and measure consumer preferences? Are preferences pre-set, or is there human-in-the-loop directly or indirectly?
-
3.
Applications for smart energy for buildings utilize models created to solve tasks related to not only to energy utilization directly, but also to building users and possible anomalies that may affect the energy utilization. How to apply the collected data to train and validate models? How to adequately label data for different uses? For example, how to create a model, which allows a model trained with a data-rich building to be used in another building with limited data (and is this even feasible)? How to develop a robust model for one building or buildings that can be generalized to others (assuming the same level of data richness)?
-
4.
Each new piece of machine learning research tends to claim to deliver better performance compared with previous studies. How to define a common metric to compare the created models?
-
5.
The applications connect the buildings into the communications networks. How to detect and resolve intrusions? How to integrate fault detection and preventive maintenance into building operations?
-
6.
Energy management solutions may require quick response due to rapid changes in the energy needs. How to adapt to real-time data to enable quick response?
-
7.
The decentralized database of blockchains has consensus mechanisms that can be applied to data security, for example when making contracts. How to apply blockchains to solutions so that they are safe and keep privacy? How do they work in smart grids? Is there a need for more standards?
These open issues also turn into summary of future challenges to be researched in the field. One current challenge includes short-term energy savings by controlling the building energy usage to mitigate the peak loads in the grid as the energy shortages have affected, especially, the European Union. This challenge is related to the above open issue 6. Finally, this section has answered the last research question: what open questions remain?
7 Conclusions
This paper has presented a comprehensive study about prevailing machine learning applications for smart building energy utilization. As the application areas are heterogeneous, various methods and techniques have been proposed to solve the questions on smart grid, smart building energy management and control, personalization and maintenance and security solutions. Furthermore, this paper has proposed a taxonomy for machine learning applications for smart buildings covering the application domains identified. The predominant application domain includes energy management systems and microgrids. This study has highlighted some energy management systems with different architectures; noteworthy, one that includes building energy load, local renewable energy sources, local energy storage system, and electric vehicles. Satisfying the two major and, to some extent, conflicting objectives for an energy management system, that are user-comfort and energy-costs, has resulted in models that are sometimes complex. Moreover, intrusion, faults, and personal involvement are apparent challenges and require smart building applications of their own as smart buildings are required, by definition, to interact with their environment. In turn, a comparative analysis on machine learning approaches and pros and cons in each application domain has been presented. Although solutions are frequently developed using machine learning methods, sometimes pure data analysis approaches are applied at least as a part of a solution. The overall open issues for the smart building energy utilization have also been presented toward the end of this survey, as similar challenges occurred in many of the papers. They are often related to lack of labeled data or other data quality. However, the open issues also relate to the overall objectives, data privacy, model generalization, and some issues of local vs. distributed applications. These open issues also turn into summary of future challenges to be researched in the field.
References
anon.: 2021 Energy Statistics Pocketbook. Series E No.4. United Nations, New York (2021)
Aguilar Castro JL, Garcés Jiménez A, Rodríguez Moreno MD, García R et al (2021) A systematic literature review on the use of artificial intelligence in energy self-management in smart buildings. Renew Sustain Energy Rev 151:111530
Recast E (2010) Directive 2010/31/eu of the European parliament and of the council of 19 May 2010 on the energy performance of buildings (recast). Off J Eur Union 18(06):2010
Zhang S-C, Yang X-Y, Xu W, Fu Y-J (2021) Contribution of nearly-zero energy buildings standards enforcement to achieve carbon neutral in urban area by 2060. Adv Clim Chang Res 12(5):734–743
Grant MJ, Booth A (2009) A typology of reviews: an analysis of 14 review types and associated methodologies. Health Inform Libraries J 26(2):91–108
Kitchenham B, Charters S (2007) Guidelines for performing systematic literature reviews in software engineering
Braun JE, Chaturvedi N (2002) An inverse gray-box model for transient building load prediction. HVAC &R Res 8(1):73–99
Rutishauser U, Joller J, Douglas R (2004) Control and learning of ambience by an intelligent building. IEEE Trans Syst Man Cyber Part A: Syst Hum 35(1):121–132
Eck NJ van, Waltman L (2011) Text mining and visualization using vosviewer. arXiv preprint arXiv:1109.2058
Dounis AI, Caraiscos C (2009) Advanced control systems engineering for energy and comfort management in a building environment-a review. Renew Sustain Energy Rev 13(6–7):1246–1261
Shaikh PH, Nor NBM, Nallagownden P, Elamvazuthi I, Ibrahim T (2014) A review on optimized control systems for building energy and comfort management of smart sustainable buildings. Renew Sustain Energy Rev 34:409–429
Beaudin M, Zareipour H (2017) Home energy management systems: A review of modelling and complexity. Energy Solutions to Combat Global Warming, pp 753–793
Parhizi S, Lotfi H, Khodaei A, Bahramirad S (2015) State of the art in research on microgrids: a review. IEEE Access 3:890–925
Yang Z, Li K, Foley A (2015) Computational scheduling methods for integrating plug-in electric vehicles with power systems: a review. Renew Sustain Energy Rev 51:396–416
Khan AA, Naeem M, Iqbal M, Qaisar S, Anpalagan A (2016) A compendium of optimization objectives, constraints, tools and algorithms for energy management in microgrids. Renew Sustain Energy Rev 58:1664–1683
Yildiz B, Bilbao JI, Dore J, Sproul AB (2017) Recent advances in the analysis of residential electricity consumption and applications of smart meter data. Appl Energy 208:402–427
Chen Y, Xu P, Gu J, Schmidt F, Li W (2018) Measures to improve energy demand flexibility in buildings for demand response (dr): a review. Energy Build 177:125–139
Miller C, Nagy Z, Schlueter A (2018) A review of unsupervised statistical learning and visual analytics techniques applied to performance analysis of non-residential buildings. Renew Sustain Energy Rev 81:1365–1377
Naylor S, Gillott M, Lau T (2018) A review of occupant-centric building control strategies to reduce building energy use. Renew Sustain Energy Rev 96:1–10
Tronchin L, Manfren M, Nastasi B (2018) Energy efficiency, demand side management and energy storage technologies-a critical analysis of possible paths of integration in the built environment. Renew Sustain Energy Rev 95:341–353
Hossain E, Khan I, Un-Noor F, Sikander SS, Sunny MSH (2019) Application of big data and machine learning in smart grid, and associated security concerns: a review. IEEE Access 7:13960–13988
Jung W, Jazizadeh F (2019) Human-in-the-loop HVAC operations: a quantitative review on occupancy, comfort, and energy-efficiency dimensions. Appl Energy 239:1471–1508
O’Dwyer E, Pan I, Acha S, Shah N (2019) Smart energy systems for sustainable smart cities: current developments, trends and future directions. Appl Energy 237:581–597
Zhang Z, Zhang D, Qiu RC (2019) Deep reinforcement learning for power system applications: an overview. CSEE J Power Energy Syst 6(1):213–225
Antonopoulos I, Robu V, Couraud B, Kirli D, Norbu S, Kiprakis A, Flynn D, Elizondo-Gonzalez S, Wattam S (2020) Artificial intelligence and machine learning approaches to energy demand-side response: a systematic review. Renew Sustain Energy Rev 130:109899
Himeur Y, Alsalemi A, Bensaali F, Amira A (2020) Building power consumption datasets: Survey, taxonomy and future directions. Energy Build 227:110404
Hong T, Wang Z, Luo X, Zhang W (2020) State-of-the-art on research and applications of machine learning in the building life cycle. Energy Build 212:109831
Himeur Y, Ghanem K, Alsalemi A, Bensaali F, Amira A (2021) Artificial intelligence based anomaly detection of energy consumption in buildings: a review, current trends and new perspectives. Appl Energy 287:116601
Mariano-Hernández D, Hernández-Callejo L, Zorita-Lamadrid A, Duque-Pérez O, García FS (2021) A review of strategies for building energy management system: model predictive control, demand side management, optimization, and fault detect & diagnosis. J Build Eng 33:101692
Zhang L, Wen J, Li Y, Chen J, Ye Y, Fu Y, Livingood W (2021) A review of machine learning in building load prediction. Appl Energy 285:116452
Runge J, Zmeureanu R (2019) Forecasting energy use in buildings using artificial neural networks: a review. Energies 12(17):3254
Aslam S, Khalid A, Javaid N (2020) Towards efficient energy management in smart grids considering microgrids with day-ahead energy forecasting. Electric Power Syst Res 182:106232
Lan T, Jermsittiparsert K, Alrashood ST, Rezaei M, Al-Ghussain L, Mohamed MA (2021) An advanced machine learning based energy management of renewable microgrids considering hybrid electric vehicles’ charging demand. Energies 14(3):569
Chiş A, Lundén J, Koivunen V (2016) Reinforcement learning-based plug-in electric vehicle charging with forecasted price. IEEE Trans Veh Technol 66(5):3674–3684
Marzband M, Azarinejadian F, Savaghebi M, Guerrero JM (2015) An optimal energy management system for islanded microgrids based on multiperiod artificial bee colony combined with markov chain. IEEE Syst J 11(3):1712–1722
Reynolds J, Ahmad MW, Rezgui Y, Hippolyte J-L (2019) Operational supply and demand optimisation of a multi-vector district energy system using artificial neural networks and a genetic algorithm. Appl Energy 235:699–713
Ebell N, Heinrich F, Schlund J, Pruckner M (2018) Reinforcement learning control algorithm for a pv-battery-system providing frequency containment reserve power. In: 2018 ieee international conference on communications, control, and computing technologies for smart grids (SmartGridComm), IEEE pp 1–6
Wolff B, Kühnert J, Lorenz E, Kramer O, Heinemann D (2016) Comparing support vector regression for pv power forecasting to a physical modeling approach using measurement, numerical weather prediction, and cloud motion data. Sol Energy 135:197–208
Zeng J, Qiao W (2013) Short-term solar power prediction using a support vector machine. Renew Energy 52:118–127
Duhirwe PN, Hwang JK, Ngarambe J, Kim S, Kim K, Song K, Yun GY (2021) A novel deep learning-based integrated photovoltaic, energy storage system and electric heat pump system: Optimising energy usage and costs. Int J Energy Res 45(6):9306–9325
Sabzehgar R, Amirhosseini DZ, Rasouli M (2020) Solar power forecast for a residential smart microgrid based on numerical weather predictions using artificial intelligence methods. J Build Eng 32:101629
Liu L, Zhao Y, Wang Y, Sun Q, Wennersten R (2019) A weight-varying ensemble method for short-term forecasting pv power output. Energy Proc 158:661–668
Kramer O, Gieseke F (2011) Short-term wind energy forecasting using support vector regression. In: Soft computing models in industrial and environmental applications, 6th international conference SOCO. Springer
Ahmad T, Zhang D, Huang C (2021) Methodological framework for short-and medium-term energy, solar and wind power forecasting with stochastic-based machine learning approach to monetary and energy policy applications. Energy 231:120911
Akhter MN, Mekhilef S, Mokhlis H, Muhammad MA (2021) A day-ahead power output forecasting of three pv systems using regression, machine learning and deep learning techniques. In: AI and IOT in Renewable Energy, Springer, pp 1–14
François-Lavet V, Taralla D, Ernst D, Fonteneau R (2016) Deep reinforcement learning solutions for energy microgrids management. In: European workshop on reinforcement learning (EWRL 2016)
Schreiber T, Eschweiler S, Baranski M, Müller D (2020) Application of two promising reinforcement learning algorithms for load shifting in a cooling supply system. Energy Build 229:110490
Nguyen H, Moayedi H, Jusoh WAW, Sharifi A (2020) Proposing a novel predictive technique using m5rules-pso model estimating cooling load in energy-efficient building system. Eng Comput 36(3):857–866
Fu G (2018) Deep belief network based ensemble approach for cooling load forecasting of air-conditioning system. Energy 148:269–282
Fan C, Xiao F, Zhao Y (2017) A short-term building cooling load prediction method using deep learning algorithms. Appl Energy 195:222–233
Ruelens F, Claessens BJ, Vrancx P, Spiessens F, Deconinck G (2019) Direct load control of thermostatically controlled loads based on sparse observations using deep reinforcement learning. CSEE J Power Energy Syst 5(4):423–432
De Somer O, Soares A, Vanthournout K, Spiessens F, Kuijpers T, Vossen K (2017) Using reinforcement learning for demand response of domestic hot water buffers: A real-life demonstration. In: 2017 IEEE PES Innovative Smart Grid Technologies Conference Europe (ISGT-Europe), pp 1–7. https://doi.org/10.1109/ISGTEurope.2017.8260152
Sholahudin S, Han H (2016) Simplified dynamic neural network model to predict heating load of a building using Taguchi method. Energy 115:1672–1678
Costanzo GT, Iacovella S, Ruelens F, Leurs T, Claessens BJ (2016) Experimental analysis of data-driven control for a building heating system. Sustain Energy Grids Netw 6:81–90
Zeng Y, Zhang Z, Kusiak A (2015) Predictive modeling and optimization of a multi-zone HVAC system with data mining and firefly algorithms. Energy 86:393–402
Rehmani MAA, Aslam S, Tito SR, Soltic S, Nieuwoudt P, Pandey N, Ahmed MD (2021) Power profile and thresholding assisted multi-label NILM classification. Energies 14(22):7609
Khan M, Seo J, Kim D (2020) Towards energy efficient home automation: a deep learning approach. Sensors 20(24):7187
Bot K, Santos S, Laouali I, Ruano A, Ruano MDG (2021) Design of ensemble forecasting models for home energy management systems. Energies 14(22):7664
Mathew A, Jolly MJ, Mathew J (2021) Improved residential energy management system using priority double deep q-learning. Sustain Cities Soc 69:102812
Tian C, Li C, Zhang G, Lv Y (2019) Data driven parallel prediction of building energy consumption using generative adversarial nets. Energy Build 186:230–243
Moreno M, Dufour L, Skarmeta AF, Jara AJ, Genoud D, Ladevie B, Bezian J-J (2016) Big data: the key to energy efficiency in smart buildings. Soft Comput 20(5):1749–1762
Godinho X, Bernardo H, de Sousa JC, Oliveira FT (2021) A data-driven approach to forecasting heating and cooling energy demand in an office building as an alternative to multi-zone dynamic simulation. Appl Sci 11(4):1356
Domahidi A, Ullmann F, Morari M, Jones CN (2014) Learning decision rules for energy efficient building control. J Process Control 24(6):763–772
Truong LHM, Chow KHK, Luevisadpaibul R, Thirunavukkarasu GS, Seyedmahmoudian M, Horan B, Mekhilef S, Stojcevski A et al (2021) Accurate prediction of hourly energy consumption in a residential building based on the occupancy rate using machine learning approaches. Appl Sci 11(5):2229
Habib U, Hayat K, Zucker G (2016) Complex building’s energy system operation patterns analysis using bag of words representation with hierarchical clustering. Complex Adapt Syst Model 4(1):1–20
Ruelens F, Claessens BJ, Quaiyum S, De Schutter B, Babuška R, Belmans R (2016) Reinforcement learning applied to an electric water heater: from theory to practice. IEEE Trans Smart Grid 9(4):3792–3800
Isiugo K, Jandarov R, Cox J, Chillrud S, Grinshpun SA, Hyttinen M, Yermakov M, Wang J, Ross J, Reponen T (2019) Predicting indoor concentrations of black carbon in residential environments. Atmos Environ 201:223–230
Skön J, Johansson M, Raatikainen M, Leiviskä K, Kolehmainen M (2012) Modelling indoor air carbon dioxide (co2) concentration using neural network. Methods 14(15):16
Kim MK, Kim Y-S, Srebric J (2020) Impact of correlation of plug load data, occupancy rates and local weather conditions on electricity consumption in a building using four back-propagation neural network models. Sustain Cities Soc 62:102321
Huchuk B, Sanner S, O’Brien W (2019) Comparison of machine learning models for occupancy prediction in residential buildings using connected thermostat data. Build Environ 160:106177
Kim S, Song Y, Sung Y, Seo D (2019) Development of a consecutive occupancy estimation framework for improving the energy demand prediction performance of building energy modeling tools. Energies 12(3):433
Kavousi-Fard A, Almutairi A, Al-Sumaiti A, Farughian A, Alyami S (2021) An effective secured peer-to-peer energy market based on blockchain architecture for the interconnected microgrid and smart grid. Int J Electr Power Energy Syst 132:107171
Tsolakis AC, Moschos I, Votis K, Ioannidis D, Dimitrios T, Pandey P, Katsikas S, Kotsakis E, García-Castro R (2018) A secured and trusted demand response system based on blockchain technologies. In: 2018 innovations in intelligent systems and applications (INISTA), pp 1–6. IEEE
Aitzhan NZ, Svetinovic D (2016) Security and privacy in decentralized energy trading through multi-signatures, blockchain and anonymous messaging streams. IEEE Trans Dependable Secure Comput 15(5):840–852
Chen T, Su W (2018) Indirect customer-to-customer energy trading with reinforcement learning. IEEE Trans Smart Grid 10(4):4338–4348
Park S, Lee J, Hwang G, Choi JK (2017) Event-driven energy trading system in microgrids: aperiodic market model analysis with a game theoretic approach. IEEE Access 5:26291–26302
Lee S, Karava P, Tzempelikos A, Bilionis I (2019) Inference of thermal preference profiles for personalized thermal environments with actual building occupants. Build Environ 148:714–729
Zhou Y, Li D, Spanos CJ (2015) Learning optimization friendly comfort model for hvac model predictive control. In: 2015 IEEE international conference on data mining workshop (ICDMW), pp 430–439. IEEE
Schmidt M, Moreno MV, Schülke A, Macek K, Mařík K, Pastor AG (2017) Optimizing legacy building operation: the evolution into data-driven predictive cyber-physical systems. Energy Build 148:257–279
Choi J-HC, Yeom D (2017) Study of data-driven thermal sensation prediction model as a function of local body skin temperatures in a built environment. Build Environ 121:130–147
Liu S, Schiavon S, Das HP, Jin M, Spanos CJ (2019) Personal thermal comfort models with wearable sensors. Build Environ 162:106281
Aguilera JJ, Kazanci OB, Toftum J (2019) Thermal adaptation in occupant-driven HVAC control. J Build Eng 25:100846
Cho Y, Seo J, Lee H, Choi S, Choi A, Sung M, Hur Y (2020) Platform design for lifelog-based smart lighting control. Build Environ 185:107267
Park JY, Dougherty T, Fritz H, Nagy Z (2019) Lightlearn: an adaptive and occupant centered controller for lighting based on reinforcement learning. Build Environ 147:397–414
Cheng Z, Zhao Q, Wang F, Jiang Y, Xia L, Ding J (2016) Satisfaction based q-learning for integrated lighting and blind control. Energy Build 127:43–55
Konstantakopoulos IC, Barkan AR, He S, Veeravalli T, Liu H, Spanos C (2019) A deep learning and gamification approach to improving human-building interaction and energy efficiency in smart infrastructure. Appl Energy 237:810–821
Kontogiannis D, Bargiotas D, Daskalopulu A (2021) Fuzzy control system for smart energy management in residential buildings based on environmental data. Energies 14(3):752
Shin W, Han J, Rhee W (2021) Ai-assistance for predictive maintenance of renewable energy systems. Energy 221:119775
Zhou Z, Chen H, Li G, Zhong H, Zhang M, Wu J (2021) Data-driven fault diagnosis for residential variable refrigerant flow system on imbalanced data environments. Int J Refrig 125:34–43
Yang C, Shen W, Chen Q, Gunay B (2018) A practical solution for HVAC prognostics: failure mode and effects analysis in building maintenance. J Build Engi 15:26–32
Han H, Zhang Z, Cui X, Meng Q (2020) Ensemble learning with member optimization for fault diagnosis of a building energy system. Energy Build 226:110351
Mahoor M, Khodaei A (2018) Data fusion and machine learning integration for transformer loss of life estimation. In: 2018 IEEE/PES transmission and distribution conference and exposition (T &D), IEEE, pp 1–9
Majzoobi A, Mahoor M, Khodaei A (2017) Machine learning applications in estimating transformer loss of life. In: 2017 IEEE Power & energy society general meeting, IEEE. pp 1–5
Huotari M, Arora S, Malhi A, Främling K (2021) Comparing seven methods for state-of-health time series prediction for the lithium-ion battery packs of forklifts. Appl Soft Comput 111:107670
Sakhnini J, Karimipour H, Dehghantanha A (2019) Smart grid cyber attacks detection using supervised learning and heuristic feature selection. In: 2019 IEEE 7th international conference on smart energy grid engineering (SEGE), IEEE, pp 108–112.
Pan S, Morris T, Adhikari U (2015) Developing a hybrid intrusion detection system using data mining for power systems. IEEE Trans Smart Grid 6(6):3104–3113
Farajzadeh-Zanjani M, Hallaji E, Razavi-Far R, Saif M, Parvania M (2021) Adversarial semi-supervised learning for diagnosing faults and attacks in power grids. IEEE Trans Smart Grid 12(4):3468–3478. https://doi.org/10.1109/TSG.2021.3061395
Zheng Z, Yang Y, Niu X, Dai H-N, Zhou Y (2017) Wide and deep convolutional neural networks for electricity-theft detection to secure smart grids. IEEE Trans Industr Inf 14(4):1606–1615
Wen L, Zhou K, Li J, Wang S (2020) Modified deep learning and reinforcement learning for an incentive-based demand response model. Energy 205:118019
Lu R, Hong SH (2019) Incentive-based demand response for smart grid with reinforcement learning and deep neural network. Appl Energy 236:937–949
Babar M, Nguyen PH, Ćuk V, Kamphuis I, Bongaerts M, Hanzelka Z (2017) The evaluation of agile demand response: an applied methodology. IEEE Trans Smart Grid 9(6):6118–6127
Awais M, Javaid N, Shaheen N, Iqbal Z, Rehman G, Muhammad K, Ahmad I (2015) An efficient genetic algorithm based demand side management scheme for smart grid. In: 2015 18th international conference on network-based information systems. IEEE, pp 351–356
Chen B, Cai Z, Bergés M (2019) Gnu-rl: A precocial reinforcement learning solution for building hvac control using a differentiable mpc policy. In: Proceedings of the 6th ACM international conference on systems for energy-efficient buildings, Cities, and Transportation, pp 316–325
Park SC, Jin YG, Song HY, Yoon YT (2015) Designing a critical peak pricing scheme for the profit maximization objective considering price responsiveness of customers. Energy 83:521–531. https://doi.org/10.1016/j.energy.2015.02.057
Claessens BJ, Vrancx P, Ruelens F (2016) Convolutional neural networks for automatic state-time feature extraction in reinforcement learning applied to residential load control. IEEE Trans Smart Grid 9(4):3259–3269
Kim S, Lim H (2018) Reinforcement learning based energy management algorithm for smart energy buildings. Energies 11(8):2010
Ji Y, Wang J, Xu J, Fang X, Zhang H (2019) Real-time energy management of a microgrid using deep reinforcement learning. Energies 12(12):2291
Du Y, Li F (2019) Intelligent multi-microgrid energy management based on deep neural network and model-free reinforcement learning. IEEE Trans Smart Grid 11(2):1066–1076
Tabatabaei SM, Dick S, Xu W (2016) Toward non-intrusive load monitoring via multi-label classification. IEEE Trans Smart Grid 8(1):26–40
Remani T, Jasmin E, Ahamed TI (2018) Residential load scheduling with renewable generation in the smart grid: a reinforcement learning approach. IEEE Syst J 13(3):3283–3294
Ghasemkhani A, Yang L (2018) Reinforcement learning based pricing for demand response. In: 2018 IEEE international conference on communications workshops (ICC Workshops), IEEE, pp 1–6
Wan Z, Li H, He H (2018) Residential energy management with deep reinforcement learning. In: 2018 international joint conference on neural networks (IJCNN), IEEE, pp 1–7
Mocanu E, Mocanu DC, Nguyen PH, Liotta A, Webber ME, Gibescu M, Slootweg JG (2018) On-line building energy optimization using deep reinforcement learning. IEEE Trans Smart Grid 10(4):3698–3708
Apostolopoulos PA, Tsiropoulou EE, Papavassiliou S (2021) Demand response management in smart grid networks: a two-stage game-theoretic learning-based approach. Mobile Netw Appl 26(2):548–561
Ullah I, Ahmad R, Kim D (2018) A prediction mechanism of energy consumption in residential buildings using hidden Markov model. Energies 11(2):358
Zhou D, Balandat M, Tomlin C (2016) A bayesian perspective on residential demand response using smart meter data. In: 2016 54th annual allerton conference on communication, control, and computing (Allerton), IEEE, pp 1212–1219
Yan X, Ozturk Y, Hu Z, Song Y (2018) A review on price-driven residential demand response. Renew Sustain Energy Rev 96:411–419
Chadoulos S, Koutsopoulos I, Polyzos GC (2020) Mobile apps meet the smart energy grid: a survey on consumer engagement and machine learning applications. IEEE Access 8:219632–219655
Ghorbanian M, Dolatabadi SH, Siano P (2019) Big data issues in smart grids: a survey. IEEE Syst J 13(4):4158–4168
Atmaca A (2016) Life cycle assessment and cost analysis of residential buildings in south east of turkey: part 1-review and methodology. Int J Life Cycle Assess 21(6):831–846
Deb C, Zhang F, Yang J, Lee SE, Shah KW (2017) A review on time series forecasting techniques for building energy consumption. Renew Sustain Energy Rev 74:902–924
Wang Z, Hong T (2020) Reinforcement learning for building controls: the opportunities and challenges. Appl Energy 269:115036
Sierla S, Pourakbari-Kasmaei M, Vyatkin V (2022) A taxonomy of machine learning applications for virtual power plants and home/building energy management systems. Autom Constr 136:104174
Uther W (2017) In: Sammut C, Webb GI (eds.) Markov decision processes, Springer, Boston, MA. pp 793–798. https://doi.org/10.1007/978-1-4899-7687-1_512
Alaa M, Zaidan AA, Zaidan BB, Talal M, Kiah MLM (2017) A review of smart home applications based on internet of things. J Netw Comput Appl 97:48–65
Ahmadi-Karvigh S, Ghahramani A, Becerik-Gerber B, Soibelman L (2017) One size does not fit all: understanding user preferences for building automation systems. Energy Build 145:163–173
Paudel P, Kim S, Park S, Choi K-H (2020) A context-aware IOT and deep-learning-based smart classroom for controlling demand and supply of power load. Electronics 9(6):1039
Han M, May R, Zhang X, Wang X, Pan S, Yan D, Jin Y, Xu L (2019) A review of reinforcement learning methodologies for controlling occupant comfort in buildings. Sustain Cities Soc 51:101748
Liu T, Tan Z, Xu C, Chen H, Li Z (2020) Study on deep reinforcement learning techniques for building energy consumption forecasting. Energy Build 208:109675
Lee S, Karava P (2020) Towards smart buildings with self-tuned indoor thermal environments-a critical review. Energy Build 224:110172
Balijepalli VM, Pradhan V, Khaparde SA, Shereef R (2011) Review of demand response under smart grid paradigm. In: ISGT2011-India, IEEE, pp 236–243
Nafi NS, Ahmed K, Gregory MA, Datta M (2016) A survey of smart grid architectures, applications, benefits and standardization. J Netw Comput Appl 76:23–36
Alotaibi I, Abido MA, Khalid M, Savkin AV (2020) A comprehensive review of recent advances in smart grids: a sustainable future with renewable energy resources. Energies 13(23):6269
Al Dakheel J, Del Pero C, Aste N, Leonforte F (2020) Smart buildings features and key performance indicators: a review. Sustain Cities Soc 61:102328
Tuballa ML, Abundo ML (2016) A review of the development of smart grid technologies. Renew Sustain Energy Rev 59:710–725
Qdr Q (2006) Benefits of demand response in electricity markets and recommendations for achieving them. US Dept. Energy, Washington, DC, USA, Tech. Rep 2006
Wu Y-K, Tang K-T (2019) Frequency support by demand response - review and analysis. Energy Proc 156:327–331. https://doi.org/10.1016/j.egypro.2018.11.150
Li R, Wang Z, Gu C, Li F, Wu H (2016) A novel time-of-use tariff design based on gaussian mixture model. Appl Energy 162:1530–1536. https://doi.org/10.1016/j.apenergy.2015.02.063
Xie H, Bie Z, Hua B, Li G (2013) Reliability assessment of distribution power systems considering the tou pricing. In: 2013 IEEE international conference of IEEE region 10 (TENCON 2013), pp 1–4. https://doi.org/10.1109/TENCON.2013.6719049
Commission, U.S.F.E.R., et al. (2008) Federal energy regulatory commission assessment of demand response & advanced metering. Technical report, Research report 2017
Caramanis MC, Bohn RE, Schweppe FC (1982) Optimal spot pricing: practice and theory. IEEE Trans Power Appar Syst 9:3234–3245
Völker B, Reinhardt A, Faustine A, Pereira L (2021) Watt’s up at home? smart meter data analytics from a consumer-centric perspective. Energies 14(3):719
Wang Y, Chen Q, Hong T, Kang C (2018) Review of smart meter data analytics: applications, methodologies, and challenges. IEEE Trans Smart Grid 10(3):3125–3148
anon.: Distributed Energy Resources and Flexibility Services. Link. Web page on the demand-response application trial 2007–2020 and the next development. (2022). https://www.transpower.co.nz/our-work/distributed-energy-resources-and-flexibility-services
Amasyali K, El-Gohary NM (2018) A review of data-driven building energy consumption prediction studies. Renew Sustain Energy Rev 81:1192–1205
Zia MF, Elbouchikhi E, Benbouzid M (2018) Microgrids energy management systems: a critical review on methods, solutions, and prospects. Appl Energy 222:1033–1055
EErE D (2012) Summary report: 2012 department of energy microgrid workshop. Chicago, Illinois
Lara OD, Labrador MA (2012) A survey on human activity recognition using wearable sensors. IEEE Commun Surv Tutorials 15(3):1192–1209
Ihasalo H (2021) Interview at Aalto library. Discussions on the building automation and artificial intelligence applications for it with Professor of Practise Heikki Ihasalo from Aalto University
Kayo G, Suzuki N (2021) Interview at Aalto library. Discussions on the building automation and artificial intelligence applications for it with Associate Professor Genku Kayo from Tokyo City University and Nop Kayo (2021)
Ashrae A (2017) Standard 55–2017: Thermal environmental conditions for human occupancy. Refrigerating, and Air-Conditioning Engineers, Inc., Atlanta, American Society of Heating
Indoor environmental input parameters for design and assessment of energy performance of buildings addressing indoor air quality, thermal environment, lighting and acoustics . Standard, International Organization for Standardization (2007)
anon.: The edge. Link. A smart building from 2014 with high sustainability scoring (BREEAM-NL) (2022). https://edge.tech/developments/the-edge
Mollah MB, Zhao J, Niyato D, Lam K-Y, Zhang X, Ghias AMYM, Koh LH, Yang L (2021) Blockchain for future smart grid: a comprehensive survey. IEEE Internet Things J 8(1):18–43. https://doi.org/10.1109/JIOT.2020.2993601
Saxena S, Farag H, Brookson A, Turesson H, Kim H (2019) Design and field implementation of blockchain based renewable energy trading in residential communities. In: 2019 2nd international conference on smart grid and renewable energy (SGRE), pp. 1–6 (2019). IEEE
Alimi OA, Ouahada K, Abu-Mahfouz AM (2020) A review of machine learning approaches to power system security and stability. IEEE Access 8:113512–113531
Tanwar S, Bhatia Q, Patel P, Kumari A, Singh PK, Hong W-C (2019) Machine learning adoption in blockchain-based smart applications: the challenges, and a way forward. IEEE Access 8:474–488
Metzmacher H, Syndicus M, Warthmann A, van Treeck C (2022) Exploratory comparison of control algorithms and machine learning as regulators for a personalized climatization system. Energy Build 255:111653
Fielding R (2000) Architectural styles and the design of network-based software architectures. PhD thesis, University of California, Irvin). https://www.ics.uci.edu/ fielding/pubs/dissertation/top.htm
Carlucci S, De Simone M, Firth SK, Kjærgaard MB, Markovic R, Rahaman MS, Annaqeeb MK, Biandrate S, Das A, Dziedzic JW et al (2020) Modeling occupant behavior in buildings. Build Environ 174:106768
anon.: Itron mobile thermostat. Link. Press release. (2022). https://www.itron.com/na/company/newsroom/2022/03/29/itron-and-emerson-collaborate-to-offer-smart-thermostats-for-demand-response-programs
Osifeko MO, Hancke GP, Abu-Mahfouz AM (2020) Artificial intelligence techniques for cognitive sensing in future iot: State-of-the-art, potentials, and challenges. J Sens Actuator Netw 9(2):21
Calvaresi D, Marinoni M, Sturm A, Schumacher M, Buttazzo G (2017) The challenge of real-time multi-agent systems for enabling iot and cps. In: Proceedings of the International Conference on Web Intelligence, pp 356–364
Zhang H, Arens E, Fard SA, Huizenga C, Paliaga G, Brager G, Zagreus L (2007) Air movement preferences observed in office buildings. Int J Biometeorol 51(5):349–360
UN, of Public Information, D.: The MDG Gap Task Force Report 2015. Online. 2015-09-18 (2015). https://www.un.org/millenniumgoals/
of Global Communications, U.N.D.: The 17 goals. Online. 2015-09-18 (2019). https://sustainabledevelopment.un.org/?menu=1300
Cretu L-G (2012) Smart cities design using event-driven paradigm and semantic web. Informatica Economica 16(4):57
Sharples S, Callaghan V, Clarke G (1999) A multi-agent architecture for intelligent building sensing and control. Sensor Review
Anon.: The intelligent building definition. I.B.I. Intelligent Buildings Institute, ??? (1988)
Lê Q, Nguyen HB, Barnett T (2012) Smart homes for older people: positive aging in a digital world. Future Internet 4(2):607–617
Connolly D, Lund H, Mathiesen BV (2016) Smart energy Europe: the technical and economic impact of one potential 100% renewable energy scenario for the european union. Renew Sustain Energy Rev 60:1634–1653
Lund H, Østergaard PA, Connolly D, Mathiesen BV (2017) Smart energy and smart energy systems. Energy 137:556–565
Russell S, Norvig P (2002) Artificial intelligence: a modern approach
Hastie T, Tibshirani R, Friedman J (2017) The elements of statistical learning the elements of statistical learning. URL: https://web.stanford.edu/%7B\(\sim\)%7Dhastie/Papers/ESLII. pdf
Settles B (2009) Active learning literature survey
Morari M, Lee JH (1999) Model predictive control: past, present and future. Comput Chem Eng 23(4–5):667–682
Mulia MT, Supangkat SH, Hariyanto N (2017) A review on building occupancy estimation methods. In: 2017 international conference on ICT for smart society (ICISS), IEEE pp 1–7
Juliani A (2022) Simple Reinforcement Learning with Tensorflow Part 8: Asynchronous Actor-Critic Agents (A3C). Link. Web page on Tensorflow Actor-critic method. https://medium.com/emergent-future/simple-reinforcement-learning-with-tensorflow-part-8-asynchronous-actor-critic-agents-a3c-c88f72a5e9f2
Vilalta R, Giraud-Carrier C, Brazdil P, Soares C (2010) In: Sammut, C., Webb, G.I. (eds.) Inductive Transfer, pp. 545–548. Springer, Boston, MA). https://doi.org/10.1007/978-0-387-30164-8_401
Födváry Ličina V, Cheung T, Zhang H, de Dear R, Parkinson T, Arens E, Chun C, Schiavon S, Luo M, Brager G et al (2018) Development of the Ashrae global thermal comfort database II. Build Environ 142:502–512. https://doi.org/10.1016/j.buildenv.2018.06.022
Miller C, Meggers F (2017) The building data genome project: an open, public data set from non-residential building electrical meters. Energy Proc 122:439–444
Funding
Open Access funding provided by Aalto University. Placement holder.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Huotari, M., Malhi, A. & Främling, K. Machine Learning Applications for Smart Building Energy Utilization: A Survey. Arch Computat Methods Eng (2024). https://doi.org/10.1007/s11831-023-10054-7
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s11831-023-10054-7