Abstract
Methods for short-term voltage stability (STVS) assessment based on phasor measurement unit (PMU) data have become quite abundant. However, most of them are challenged to deal with the commonly encountered incomplete PMU data. Existing models for STVS assessment of incomplete PMU data mostly have the disadvantages of high computational complexity and large impact from the level of data missing. This paper proposes a multi-task learning method that performs stability assessment and missing data completion in parallel. The Transformer Encoder is used as the shared feature extractor, a GRU structure is used to output complete PMU data sequences, and a BP neural network is used to output stability assessment results. The loss function used for the missing completion task considers the accuracy in both the shape and time domains. A comparison with relevant models shows that the model proposed in this paper achieves the best performance in all indicators and is minimally affected by the observation windows and the level of data loss, demonstrating good robustness.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Avoid common mistakes on your manuscript.
Introduction
The widespread application of large-scale power systems has become an important foundation for the operation of society. The stability of power systems faces many challenges from both internal and external factors, such as equipment failures and extreme weather conditions [1]. Many examples have shown that instability in the power system will cause significant economic losses and many other complex problems for society. The importance of power system stability assessment is becoming increasingly prominent. As part of power system stability, short-term voltage stability (STVS) represents the ability of the power system to quickly restore the voltage of each bus to an acceptable level after a fault [2]. Predicting the voltage instability of the power system in real time can provide more time for protective measures to be taken, thereby reducing losses as much as possible.
As an effective means of realizing digital management of the power grid and enhancing system safety, phasor measurement units (PMUs) have been widely used in actual power grids in recent years [3]. Meanwhile, with the development of data science technologies such as machine learning and deep learning and the advancement of communication technology, data-driven STVS assessment methods have been rapidly developed and gradually applied in engineering practice.
Literature review
PMUs dynamically collect various data from the power system in real time, producing a high-dimensional time series. Based on the extensive grid running information contained in the PMU signal sequence, data-driven STVS assessment models have undergone a rich development. Time-domain simulation (TDS) is the traditional method for STVS assessment [4]. This method portrays the power system structure and the input information by constructing complex mathematical models. However, due to its high computational complexity, TDS cannot meet the high requirements of STVS assessment in terms of computational delay and has many disadvantages, such as low accuracy. It is gradually being replaced by new methods based on machine learning [5].
In the literature, many classical machine learning models have been introduced into the field of STVS assessment and have been reported with good performance. Support vector machine (SVM) [6] and decision tree (DT) [7] have been successively introduced into the field of STVS assessment, while based on these two types of classical model structures, Zhang et al. [8] used random forest for STVS assessment. The method proposed by Zhu et al. further optimizes the response speed of the model [9]. Classical machine learning models are highly dependent on additional expert knowledge and feature engineering, which limits the application of the model in complex real-world environments. The structure of recurrent neural networks (RNNs) can effectively capture the temporal information of sequence data. Models utilizing RNNs often exhibit concise and direct structures and demonstrate exceptional performance across various sequence tasks. James J Q et al. and Gupta A et al. constructed STVS assessment models based on long short-term memory (LSTM) [10] and gated recurrent units (GRUs) [11], respectively, and achieved good results.
The above studies assume that the input PMU data are complete. For instance, in RNN-based models, the computation of each cell's output only involves the previous output's hidden state and the current input, implying that RNN-based models require input time series data with identical sampling intervals [12]. However, in practical engineering environments, the PMU data received by the models often experience random losses due to network delays, equipment malfunctions, and other reasons, as shown in Fig. 1. This means that the PMU sequence data input to the model has randomly irregular intervals, and the interval between two sampling points may even be vastly different. In addition, since each PMU measures different parts of the power grid, the random missing PMUs cause the measured topology of the power grid in each frame of the input sequence to be inconsistent [13]. Weerakody et al. [14] have already noted that most existing time series models, especially RNN-based models, cannot directly handle this type of data. Some studies have proposed filling in incomplete PMU data using a certain method during data preprocessing, enabling the use of classification evaluation models that are applicable to complete data. For example, Gao et al. [15] used a matrix completion method, and Ren et al. [16] used deep residual learning.
Obviously, simple missing data imputation methods result in a decrease in model classification accuracy, while complex imputation methods significantly increase the computational complexity of model inference. In addition, since the PMU measurement sequence exhibits different characteristics during a stable power grid and during an unstable power grid, using the same method to impute missing data in both types of sequences will inevitably introduce bias. This results in a significant performance degradation of these models when faced with more severe missing data situations.
Some other models are capable of directly performing STVS assessment based on incomplete PMU data. Such methods are generally constructed based on classical machine learning algorithms, especially tree models [17]. Guo and Milanović [18] designed special splitting rules to enable the tree model to handle incomplete PMU data and Zhang et al. [13], recovered the system topology represented by the data as much as possible through a clustering rule. However, to minimize the impact of incomplete data, these models actually construct a large number of submodels, which also significantly increase the computational complexity. This reduces the practical value of the models.
A fully attention-based Transformer, proposed by Vaswani et al. [19], provides a new approach for handling incomplete PMU data. The Transformer is insensitive to the order of input sequences. Its flexible position encoding, which only serves as auxiliary information, makes it possible to describe the relative relationships between data points in a sequence. The multi-head attention mechanism of the Transformer has been shown to have good robustness on incomplete data [20]. It can automatically learn how to restructure the original topology of the data based on incomplete information. Based on this, the Transformer has shown great potential in directly extracting the information contained in incomplete PMU measurements.
Contributions
Both the complete PMU signal sequence and STVS assessment are highly applicable in the power grid. In the existing studies, to obtain STVS assessment results, filling must be performed first to obtain the complete PMU signal sequence, which causes a large computing overhead. In addition, there is no model that can simultaneously obtain both complete PMU signal sequence prediction and STVS assessment. This paper recognizes the relationship between the two tasks and the Transformer;s ability to adapt to incomplete PMU signal sequences based on its weak assumption about input sequences. We introduce Transformer into the field of STVS assessment, and based on this, we fuse two tasks of missing completion and stability classification, thus proposing a multi-task learning model that can handle both tasks simultaneously for the first time. In addition, the contributions of this paper include the following:
-
1.
The proposed model in this paper shows a significant improvement in single-task performance compared to traditional single-task models, demonstrating stronger generalization ability and robustness. It performs well even in short observation windows and high data missing rate scenarios that are challenging for traditional single-task models.
-
2.
Due to the hard sharing mechanism to share the underlying parameters, the number of parameters and the computational complexity of the proposed model are significantly reduced compared with the single-task model, while the use of submodels can be selected to further save inference time according to different practical needs. This makes the model of high practical value.
-
3.
This paper shows the necessity and rationality of constructing and training multi-task learning models by combining two tasks through a hard sharing mechanism, attention mechanism, and dynamic weight average (DWA).
Methodology
The framework of multi-task learning
The comparative display of Fig. 2 illustrates the differences in the PMU signal sequences under conditions of system stability and instability. In most cases, when the system remains stable throughout, the voltage signal sequence remains stable as well. However, when the system is on the verge of instability, the voltage signal sequence exhibits complex fluctuations. This proves that there is an underlying correlation between the PMU missing data filling task and the STVS classification task, which also demonstrates the necessity of constructing a multi-task learning model to extract the implicit connection between the two tasks.
Multi-task learning can be considered a form of transfer learning, which is equivalent to adding additional constraints to each of these tasks [21]. With proper design, a multi-task learning model, by optimizing the objectives of two different tasks, can enable the model to better extract the information embedded in the data and avoid overfitting while reducing the computational complexity of the model as well as the training difficulty (e.g., avoiding falling into local optima)
The two main challenges in building a multi-task learning model are choosing the right way to share parameters and the loss function balancing mechanism. Traditionally, multi-task learning models can be divided into two categories, as shown in Fig. 3: (a) hard sharing and (b) soft sharing [22]. In the hard sharing mechanism, each task has the same underlying hidden layer, while a few specific task output layers are retained to output the results of different tasks simultaneously. The soft sharing mechanism is more flexible, also known as “constraint-based sharing”, and its method of associating subtasks is achieved by compressing the distance of parameters between models through regularization. The hard sharing mechanism is suitable when the relationship between tasks is strong, while the soft sharing mechanism is suitable when the relationship between tasks is weak. In addition, since the computational complexity of the soft sharing mechanism is too large, it is not suitable for the STVS assessment task that requires high timeliness. The model proposed in this paper adopts the hard sharing mechanism.
The differences that exist in the nature of the two tasks of missing filling and stability classification need to be considered. The hard sharing mechanism often struggles to address problems where the differences between subtasks are too large. Liu et al. [23] used the soft-attention mechanism [24, 25] in their proposed multi-task attention network (MTAN) model to make task-specific selections on the features extracted from the shared layers, allowing shared underlying features to be input into specific task submodels with focused selection and combination. This relaxes the assumption of intertask variation for multi-task learning.
The two tasks of missing data filling and sequence classification are regression and classification tasks, respectively, and the loss functions used have different metric spaces. For this reason, the balance of the loss functions needs to be carefully designed to avoid difficulties in training multi-task learning models due to the different convergence rates of different tasks. The DWA method proposed in [23] is used to dynamically adjust the weights of each task during the training process. The weight \({\lambda }_{k}(t)\) of task \(k\) at epoch \(t\) can be calculated according to Eqs. (1) and (2):
where \({\mathcal{L}}_{k}\left(t\right)\) is the average loss of task \(k\) at epoch \(t\), \(T\) is a relaxation factor, and a larger \(T\) indicates a larger difference between tasks. Due to the existence of exponential operations in Eq. (2), the log-sum-exp stabilization trick shown in Eq. (3) is used in the actual calculation to avoid overflow by noting \( b = \max _i x_i \):
Proposed method composition
Shared feature extraction submodel
For incomplete PMU data \({\varvec{x}}\in {\mathbb{R}}^{f}\) with input feature number \(f\), the Transformer first performs embedding. This operation projects \({\varvec{x}}\) to a \(d\)-dimensional space \({\varvec{Y}}\in {\mathbb{R}}^{f\times d}\). In the model implementation, position information is represented through an additional positional encoding \({\varvec{P}}\in {\mathbb{R}}^{f\times d}\). The positional encoding has the same dimension as \({\varvec{Y}}\), so it can be directly added. In this paper, the sine–cosine encoding shown in Eq. (4) is used to represent the relative position relationship:
where \({w}_{j}=\frac{i}{{{10{,}000}}^{\frac{2j}{d}}} , j\in \left[1,{\frac{d}{2}}-1\right] \).
Considering two positional encoding vectors \({\varvec{P}}\left(i\right)={\left({\varvec{P}}\left(i,2j\right),{\varvec{P}}\left(i,2j+1\right)\right)}^{T}\) and \({\varvec{P}}\left(i+k\right)={\left({\varvec{P}}\left(i,2j\right),{\varvec{P}}\left(i,2j+1\right)\right)}^{T}\) with a relative position of \(k\), \({\varvec{P}}(i+k)\) can be obtained from \({\varvec{P}}(i)\) through a simple linear transformation, as shown in Eq. (5):
This shows that the Transformer can capture the relative positional information of incomplete PMU voltage signal sequences. In addition, this positional encoding maintains consistency across time sequences of different lengths, which is one reason why the model proposed in this paper has good adaptability to data with different missing rates.
Multihead attention is the core of Transformer. Each self-attention head independently focuses on different portions in the abstract space \({\mathbb{R}}^{f\times d}\). The Transformer concatenates the information extracted by each self-attention head to capture long-range and short-range dependencies and effectively extract information at different levels and different position combinations in the sequence [26]. Obviously, the information extracted by the feature extraction submodel (FES) has the same dimension as the input, and in this paper, the extracted information is denoted as \({\varvec{E}}\in {\mathbb{R}}^{f\times d}\).
Missing completion submodel and stability classification submodel
The missing completion submodel (MCS) in this paper is in fact the decoder part of "sequence to sequence" (seq2seq) [27], as the Transformer Encoder is used as the FES. The MCS is required to directly output the complete PMU data \(\mathcal{Z}\in {\mathbb{R}}^{t\times b}\) with observation windows \(t\) and number of buses \(b\). Since the complete PMU signal sequence is no longer unequally spaced, while the grid topology information contained in the sequence remains unchanged, traditional RNN-like models have been shown to perform well for this task. In practice, the decoder structure can be either the decoder part of the Transformer or a model based on the traditional RNN structure. Compared to the more complex Transformer decoder structure, using GRU [28], which achieves “state of the art” (SOTA) in RNN-like models, as a decoder has shown excellent results in practice and is easier to train. Figure 4 is a schematic of the seq2seq structure, where \({\varvec{z}}\) is a row vector of \(\mathcal{Z}\).
For the task of missing voltage signal sequence completion, an important objective is the shape similarity between the forecasted sequence and the ground truth. As described in “The framework of multi-task learning”, the shape of the voltage signal sequence contains important information about the state of the power grid, and if the shape of the filled voltage signal sequence differs significantly from the real one, it will invalidate other subsequent analyses using these data. Traditional MSE loss functions calculate the distance between two sequences point to point, while the dynamic time warping (DTW) index, as shown in Fig. 5, can better capture the shape similarity between two sequences [29]. A smaller DTW indicates that the two sequences have more similar shapes. The challenge of using DTW as a loss function in the past is that the classical DTW index is not differentiable and therefore cannot be directly used as the loss function for a neural network model. Cuturi et al. [30] proposed the differentiable Soft-DTW loss function, and Le Guen et al. [31] subsequently proposed the distortion loss, including the shape and time (DILATE) loss function, which further incorporates an evaluation of temporal accuracy based on Soft-DTW. Le Guen et al. [31] have shown that this helps the model to find the optimal DTW index without ignoring the optimization of “point-to-point” indexes such as MSE, which represent temporal differences, and thus better meet the objective of voltage signal sequence missing completion.
Similar to the MCS, in the proposed method, the stability classification submodel (SCS) can use any suitable machine learning classification model. In the proposed method, a more straightforward approach is used to output the probabilities of belonging to two classes after the features extracted by the soft-attention mechanism selection are sequentially passed through the fully connected and dropout layers based on the consideration of reducing the number of model parameters. The loss function used in the stability classification task is the cross-entropy loss.
Proposed method summary
The method proposed in this paper, illustrated in Fig. 6, fully considers the computational complexity and actual online application. A multi-task learning model dealing with two subtasks of incomplete PMU data voltage stability assessment and missing completion is constructed on a hard sharing mechanism. We note the respective characteristics of Transformer and GRU. The Transformer Encoder is used to form a FES. Incomplete PMU sequence data are fed into the model and first passed through an embedding layer. Multihead attention automatically extracts different aspects of the information contained in the input data. Before the task-specific submodel is introduced, self-attention is used to select and combine the underlying information that the two tasks need separately. The SCS consists of a fully connected layer and associated ReLU activation function and dropout layers. In the MCS, the GRU sequentially gives the predicted values of the complete sequence. In addition, as an open framework, the above specific models can be replaced by other similar models. This paper uses the DILATE loss function, which considers both the similarity of the predicted sequence shape and the accuracy of the time domain. It is more suitable for the practical requirements of PMU voltage signal sequences. DWA is introduced to balance the weights of the two tasks in the model training process.
Experiment
Datasets and configurations
The IEEE New England 10-machine 39-bus test case power system is a benchmark for research on power system stability [32]. In this paper, a dataset of incomplete PMU signal data is constructed based on the open dataset proposed by Sarajcev et al. [33]. The dataset is obtained by simulation using the MATLAB®/Simulink electromechanical transient simulation toolbox and contains 9360 valid samples that systematically cover different load levels, different fault types, and different fault locations, with a balanced number of stable and unstable samples and good representativeness. The PMU data are recorded at a 1/60 s sampling rate and have a total record length of 3 s. Different levels of missing data are obtained by randomly dropping a specific amount of data points as shown in Fig. 1 (e.g., a missing data percentage of 20% means that 20% of the \(39\times \mathrm{sequence length}\) data points are randomly dropping). The missing data percentage can be expressed by Eq. (6):
In addition, 80% of the valid samples are used as the training set, and 20% are used as the test set.
The observation windows of the input data determine the practical value of the model. Although a long observation window improves the accuracy of the model, it shortens the time for taking protective measures before power system failure, while a short observation window makes it more difficult to determine the true performance of the model under incomplete PMU measurement data [34]. Figure 7 shows the distribution of the unstable samples from the time of fault clearance to the time at which the power system loses stability in the dataset proposed by Sarajcev et al. In subsequent tests, this paper determines the observation windows to be 20 sample points (0.33 s) and 25 sample points (0.42 s) after the fault is cleared to complete the prediction before 99% and 95% of the power system loses stability, respectively.
The main hyperparameters used in the follow-up tests are shown in Table 1.
In addition to the model hyperparameters mentioned above, following the research of Le Guen et al. [31], the compromise parameter \(\alpha \) in the DILATE loss function is set to 0.5, and the smoothing parameter \(\gamma \) is set to 0.01 to balance the model’s ability to fill in missing values in both temporal and shape domains. Consistent with the original setting of DWA proposed by Liu et al. [23], the relaxation factor \(T\) in DWA is set to 5. The Adam optimizer is used for training.
Experimental analysis
Multi-task learning training process
Figure 8 shows the variation in the loss function values during the training process when the observation window is set to 0.42 s and the missing data level is 50%, using fixed weights and DWA, respectively. Figure 8 shows that the two loss functions with DWA have a more coordinated rate of descent, which makes it easier to determine a common convergence point for the two tasks. This shows that the DWA works to balance the loss functions of the two tasks.
The abrupt surge in Fig. 8 is due to the change in the loss function for the missing data completion task. This is because during the experiment, it was found that directly using the DILATE loss function has the disadvantages of slow convergence and computation in the incomplete PMU data missing completion task. Therefore, we first train the model for 20 epochs using the MSE loss function and then use the DILATE loss function for subsequent training. As a compensatory training trick for the drawbacks of the DILATE loss function, this only affects the number of model training iterations without changing the final performance of the model.
Performance of missing completion subtask
In this paper, the root mean square error (RMSE), mean average percentage error (MAPE), and DTW indexes are used to measure the performance of the missing completion task submodel. DTW have been discussed in “Missing completion submodel and stability classification submodel”, and Eqs. (7) and (8) show the definitions of RMSE and MAPE:
where \({x}_{t}\) is the true value, \(\widehat{{x}_{t}}\) is the predicted value and \(n\) is the length of the sequence. RMSE characterizes the absolute deviation of the predicted value from the true value, and MAPE characterizes the relative deviation of the predicted value from the true value. A smaller of the two metrics indicates better performance [35].
In this paper, two types of experiments are designed to verify the effectiveness of the proposed model on subtasks. Using the Transformer Encoder for constructing the FES and using soft-DTW as the loss function for the missing completion task is one of the core parts of the proposed method. The first type of experiment was used to check whether they were beneficial to the model over traditional components. The performance of the model obtained by changing the FES to BiGRU- and LSTM-based and the loss function of the missing completion task to MSE is shown in Table 2. The performances of the modified models are all weaker than that of the proposed model. The proposed method with a combination of Transformer Encoder and soft-DTW loss not only achieves high DTW, but also outperforms the comparison method in terms of the “point-to-point” metrics (RMSE and MAPE). This demonstrates the ability of the proposed method to focus on both shape and temporal accuracy of complementary sequence.
The second part of the experiment is a comparison with established representative PMU signal sequence missing completion models or missing preprocessing methods in STVS assessment based on incomplete PMU data. Two commonly used methods are selected as benchmarks for comparison. (1) LSTM is the main method for current models to perform missing value filling before STVS assessment through incomplete PMU data [34, 36]. (2) The extreme gradient boosting tree (XGBoost) [37] has been proven to have good performance in many applications and is widely used in various engineering practices. Most of the existing models for incomplete PMU data processing are based on tree models. We use XGBoost as a representative tree model. Table 3 and Fig. 9 show the performance of MCS under different experiment settings and the comparison with other methods.
Of the three models, XGBoost performed the worst, particularly in the two indexes of RMSE and DTW, where it had the highest errors. Although the LSTM is similar to the proposed method in the RMSE and DTW metrics, the variance of its performance on different observation windows is larger. The proposed method performs best in all three indexes. RMSE is less than 0.001, MAPE is less than 1%, and DTW is less than 0.01, with performance improvements of over 20–50% compared to the comparison models in each indicator and different scenarios. The performance of the proposed method is almost unaffected by the level of data missing and has the smallest variance under different observation windows, with the best performance.
Performance of stability classification subtask
Similar to “Performance of missing completion subtask”, the experiments in this section also include two parts, an validation of the model components and a comparison with established models in the domain. The results in Table 4 show that the models using the other structures or methods also perform weaker than the model proposed in this paper in the stability assessment task. Using the Transformer for FES also improved the performance of the proposed model on the stability classification subtask. It is noteworthy that the proposed modification for the missing completion task (using soft-DTW loss) also improves the accuracy of the stability classification task. This is one of the evidences that the two subtasks are related and suggests that optimisation on sequence morphology would be beneficial for STVS assessment. This, together with the results in Table 2, demonstrates the effectiveness of the proposed method structure in this paper.
Five representative models that performed STVS assessment were used for comparison with the model presented in this paper.
-
1.
Super-resolution perception-based incremental broad learning (SRP-BL) is a SOTA model that has performed STVS assessment in the past. This model is mainly based on a broad learning model for STVS assessment [16].
-
2.
Robust feature ensemble learning (RFEL) includes a clustering method for incomplete data and then constructs many submodels to give STVS assessment results. RFEL is a popular machine learning STVS assessment model [13].
-
3.
LSTM-based reinforcement learning (LSTM-RL) uses double deep Q-Learning in conjunction with LSTM to give STVS assessment results [34].
-
4.
A recurrent convolutional neural network (RCNN) [38] automatically captures temporal and spatial features in PMU measurement sequences for STVS assessment.
-
5.
Mean imputation (MI) [39] uses the mean value of each feature to fill in the missing values. This is the baseline for handling missing values, and here, it represents the model composed of MI as MCS.
Figure 10 illustrates the accuracy of the voltage stability assessment for different models with different observation windows and missing data levels. The proposed model in this paper achieves more than 99% assessment accuracy in all scenarios, which has the highest accuracy compared to the comparison models and is minimally affected by different observation windows and missing data rates.
To quantify the magnitude of the decrease in classification accuracy as the model performance increases with the level of missing data, Zhang Y et al. [40] proposed using the average accuracy drop slope \(\overline{s }\), as shown in Eq. (9) for the metric:
where \(D\) is the number of different missing data levels tested, \({d}_{i}\) is the \(i\)th missing data level, \({A}_{i}\) is the average classification accuracy of the model at the \(i\)th missing data level with different observation windows, and \({A}_{0}\) is the classification accuracy achieved by the model when the data are complete. The comparison in Table 5 and Fig. 11 shows that the proposed method has obvious advantages over the established models and is minimally affected by changes in the missing data levels. The filling method of MI is equivalent to adding noise to the STVS assessment task, which is similar to the additional constraints introduced by other tasks in a multi-task model if there is no implicit relationship between the tasks. The comparison of the proposed model to MI in this paper also provides further evidence that there is indeed an association between the two tasks.
Conclusion
In practical applications, PMU data are often missing due to a variety of factors, which makes the traditional STVS assessment method ineffective. The existing STVS assessment methods for incomplete PMU data have the disadvantage of computational complexity and are highly influenced by the level of missing data. At the same time, complete PMU data can help the analysis of other power system information. In this paper, we propose a multi-task learning model that performs the two tasks of stability classification and missing data completion in parallel, which significantly reduces the number of model parameters and training difficulty.
In the proposed model, the self-attention mechanism is introduced to address the problem of large differences between tasks, and the DWA method is used to balance the weights of the two tasks during training. In this paper, we use the order-insensitive Transformer Encoder as the shared layer for feature extraction, and the SCS consists of a BP network. The MCS consists of a GRU and uses the DILATE loss function, which allows the model to focus on both shape and temporal differences between the forecasted sequence and the ground truth. As an open framework, other possible models with similar properties can replace the Transformer and GRU structures mentioned above.
The simulation experiments and comparisons with other related models show the following conclusions: (1) the proposed model fills the missing data with high accuracy and focuses on the differences with the real sequence shape and time domain at the same time, with MAPE less than 1% and DTW less than 0.01. The performance improvement is generally more than 20–50% compared with the benchmarks. (2) The proposed model achieves high stability classification accuracy, and the classification accuracy reaches more than 99% in different scenarios. (3) The performance of the proposed model is least affected by the observation windows and the missing data rate, especially the large missing data rate. The above conclusions indicate that the two tasks of missing completion and stability assessment can be effectively combined in parallel by a multi-task learning model based on the attention mechanism, and the proposed model has good robustness and high application value.
Data availability
Data associated with this study have been deposited at Data: https://doi.org/10.5281/zenodo.4521886.
References
Pan F, Li J, Tan B et al (2018) Stacked-GRU based power system transient stability assessment method. Algorithms 11(8):121
Hatziargyriou N, Milanovic J, Rahmann C et al (2020) Definition and classification of power system stability–revisited & extended. IEEE Trans Power Syst 36(4):3271–3281
Wang B, Fang B, Wang Y et al (2016) Power system transient stability assessment based on big data and the core vector machine. IEEE Trans Smart Grid 7(5):2561–2570
Zhang R, Xu Y, Dong ZY et al (2015) Post-disturbance transient stability assessment of power systems by a self-adaptive intelligent system. IET Gener Transm Distrib 9(3):296–305
Alimi OA, Ouahada K, Abu-Mahfouz AM (2020) A review of machine learning approaches to power system security and stability. IEEE Access 8:113512–113531
Ye S, Li X, Wang X et al (2012) Power system transient stability assessment based on adaboost and support vector machines. In: 2012 Asia-pacific power and energy engineering conference. IEEE, pp 1–4
Mohammadi H, Dehghani M (2015) PMU based voltage security assessment of power systems exploiting principal component analysis and decision trees. Int J Electr Power Energy Syst 64:655–663
Zhang C, Li Y, Yu Z et al (2016) A weighted random forest approach to improve predictive performance for power system transient stability assessment. In: 2016 IEEE PES Asia-pacific power and energy engineering conference (APPEEC). IEEE, pp 1259–1263
Zhu L, Lu C, Dong ZY et al (2017) Imbalance learning machine-based power system short-term voltage stability assessment. IEEE Trans Ind Inf 13(5):2533–2543
James JQ, Hill DJ, Lam AYS et al (2017) Intelligent time-adaptive transient stability assessment system. IEEE Trans Power Syst 33(1):1049–1058
Gupta A, Gurrala G, Sastry PS (2017) Instability prediction in power systems using recurrent neural networks. In: IJCAI international joint conference on artificial intelligence, pp 1795–1801
Neil D, Pfeiffer M, Liu SC (2016) Phased LSTM: accelerating recurrent network training for long or event-based sequences. Adv Neural Inf Process Syst 29
Zhang Y, Xu Y, Dong ZY (2017) Robust ensemble data analytics for incomplete PMU measurements-based power system stability assessment. IEEE Trans Power Syst 33(1):1124–1126
Weerakody PB, Wong KW, Wang G et al (2021) A review of irregular time series data handling with gated recurrent neural networks. Neurocomputing 441:161–178
Gao P, Wang M, Ghiocel SG et al (2015) Missing data recovery by exploiting low-dimensionality in power system synchrophasor measurements. IEEE Trans Power Syst 31(2):1006–1013
Ren C, Xu Y, Zhao J et al (2021) A super-resolution perception-based incremental learning approach for power system voltage stability assessment with incomplete PMU measurements. CSEE J Power Energy Syst 8(1):76–85
Zhu R, Ciren G, Tang B et al (2023) Power system short-term voltage stability assessment based on improved CatBoost with consideration of model confidence. Energy Sci Eng 11(2):783–795
Guo T, Milanović JV (2013) The effect of quality and availability of measurement signals on accuracy of on-line prediction of transient stability using decision tree method. In: IEEE PES ISGT Europe 2013. IEEE, pp 1–5
Vaswani A, Shazeer N, Parmar N et al (2017) Attention is all you need. Adv Neural Inf Process Syst 30
Naseer MM, Ranasinghe K, Khan SH et al (2021) Intriguing properties of vision transformers. Adv Neural Inf Process Syst 34:23296–23308
Caruana R (1997) Multi-task learning. Mach Learn 28(1):41–75
Sun T, Shao Y, Li X et al (2020) Learning sparse sharing architectures for multiple tasks. In: Proceedings of the AAAI conference on artificial intelligence, vol 34(05), pp 8936–8943
Liu S, Johns E, Davison AJ (2019) End-to-end multi-task learning with attention. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 1871–1880
Yang Z, Yang D, Dyer C et al (2016) Hierarchical attention networks for document classification. In: Proceedings of the 2016 conference of the North American chapter of the association for computational linguistics: human language technologies, pp 1480–1489
Zhang M, Hu H, Li Z et al (2021) Attention-based encoder-decoder networks for workflow recognition. Multimed Tools Appl 80:34973–34995
Yang J, Li C, Zhang P et al (2021) Focal self-attention for local-global interactions in vision transformers. arXiv:2107.00641
Sutskever I, Vinyals O, Le QV (2014) Sequence to sequence learning with neural networks. Adv Neural Inf Process Syst 27
Cho K, Van Merriënboer B, Gulcehre C et al (2014) Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv:1406.1078
Keogh E, Ratanamahatana CA (2005) Exact indexing of dynamic time warping. Knowl Inf Syst 7:358–386
Cuturi M, Blondel M (2017) Soft-DTW: a differentiable loss function for time-series. In: International conference on machine learning. PMLR, pp 894–903
Le Guen V, Thome N (2019) Shape and time distortion loss for training deep time series forecasting models. Adv Neural Inf Process Syst 32
Moeini A, Kamwa I, Brunelle P et al (2015) Open data IEEE test systems implemented in SimPowerSystems for education and research in power grid dynamics and control. In: 2015 50th international universities power engineering conference (UPEC). IEEE, pp 1–6
Sarajcev P, Kunac A, Petrovic G et al (2021) Power system transient stability assessment using stacked autoencoder and voting ensemble. Energies 14(11):3148
Liu A, Guan X, Sun D et al (2021) Short term voltage stability assessment with incomplete data based on deep reinforcement learning in the internet of energy. In: Wireless algorithms, systems, and applications: 16th international conference, WASA 2021, Nanjing, China, June 25–27, 2021, Proceedings, Part II 16. Springer, pp 225–236
Armstrong JS, Collopy F (1992) Error measures for generalizing about forecasting methods: empirical comparisons. Int J Forecast 8(1):69–80
Tan B, Yang J, Zhou T et al (2020) Spatial-temporal adaptive transient stability assessment for power system under missing data. Int J Electr Power Energy Syst 123:106237
Chen T, Guestrin C (2016) Xgboost: a scalable tree boosting system. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, pp 785–794
Tapia EA, Colomé DG, Rueda Torres JL (2022) Recurrent convolutional neural network-based assessment of power system transient stability and short-term voltage stability. Energies 15(23):9240
Batista GE, Monard MC (2003) An analysis of four missing data treatment methods for supervised learning. Appl Artif Intell 17(5–6):519–533
Zhang Y, Xu Y, Zhang R et al (2018) A missing-data tolerant method for data-driven short-term voltage stability assessment of power systems. IEEE Trans Smart Grid 10(5):5663–5674
Acknowledgements
This research received no external funding.
Author information
Authors and Affiliations
Contributions
Conceptualization, TL; methodology, XJ; formal analysis, TL; data curation, TL; supervision, XJ; writing—original draft preparation, TL; writing—review and editing, XJ. All the authors have read and agreed to the published version of the manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Luo, T., Jiang, X. A novel multi-task learning method for evaluating short-term voltage stability with incomplete PMU measurements. Complex Intell. Syst. 10, 1971–1983 (2024). https://doi.org/10.1007/s40747-023-01252-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40747-023-01252-8