Background

Polysomnography (PSG) has been regarded as the gold standard for sleep monitoring. In PSG recording, sleep stages and wakefulness are determined by electroencephalogram (EEG), electrooculogram (EOG) and chin electromyogram (EMG). PSG recording requires well-trained sleep experts, a controlled hospital environment, and a relatively long setup time, resulting in high costs. To overcome the disadvantages of PSG, in recent years, the need for home-based sleep monitoring has been specifically proposed [13]. In order to be successful, home-based sleep monitoring systems should be sensitive and sufficiently reliable to detect awake or sleep stages without depending on EEG.

In general sleep monitoring systems, the results include sleep stages, sleep disorders, sleep duration, sleep fragmentation, sleep efficiency, sleep quality, etc. Among them, the continuous low sleep efficiency (numerous sleep disturbances) can lead to daytime fatigue [4], diabetes [5], headaches [6], and psychiatric disorders [7]. Therefore, it is important to precisely monitor sleep/wake patterns and sleep efficiency. In sleep efficiency measurement, actigraphy is the simplest device and has been used to estimate sleep/wake patterns in recent studies [8]. However, the validity of actigraphy to measure sleep efficiency is uncertain due to its limited ability to detect wakefulness [9]. The low specificity (around 50%) to wakefulness is basically caused by the assumption of the sleep state when subjects are simply inactive. Because of this drawback, other studies have proposed alternative ways to estimate the sleep/wake pattern without using an accele-ration sensor. These include the use of a heart rate measuring device [10], a mattress [11], a photographic monitoring device [12], mandible activity signals [13] and under-bed accelerometers [14]. In general, waking from sleep can be identified using physiological signal changes such as an abrupt increase in anterior tibialis EMG activities or heart rate [15, 16]. The wake stage is usually accompanied by a relatively high tonic anterior tibialis EMG (shown in Figure 1). Also, a gradual diminution of the anterior tibialis EMG signal amplitude occurs during the transition from light to deep sleep [17]. However, use of anterior tibialis EMG signal changes to estimate sleep or wake patterns has rarely been studied.

Figure 1
figure 1

EMG amplitude changes during PSG recording from subject #1. The wake state is usually accompanied by a relatively high amplitude of EMG, as seen in the top figure. The bottom panel shows the hypnogram for comparison.

In this paper, we assumed that sleep/wake estimation using actigraphy and EMG signals would show different patterns because the actigram is a collection of mechanical signals, whereas EMG signals are electrical. So we analysed EMG patterns in each state (sleep and wake during sleep).

This study was administered in two steps of sleep/wake pattern estimation. The first step was to establish methods for sleep/wake pattern estimation using only anterior tibialis EMG signals without EEG recordings. The second step was to confirm that the result of our methods is comparable to that of PSG.

Methods

Subjects and PSG data collection

Seven healthy subjects and five patients with sleep-related disorder participated in our study. Two patients (1 mild and 1 moderate) were diagnosed with obstructive sleep apnea (OSA) and the others were patients with periodic lime movement disorder (PLMD). A summary of the subject- and sleep- related parameters is shown in Table 1. Healthy subjects were free from any sleep-related disorders and it was verified by sleep physicians. All subjects reported no use of drugs or caffeine that could affect sleep and were given all the information about the purpose and methods of the study. All subjects have agreed that their PSG data, excluding personal information, will be used only for research purposes. PSG data were recorded and scored by registered polysomnographic technologists and physicians at Seoul National University Hospital according to the criteria described by Rechtschaffen and Kales [15]. A board certified sleep medicine physician made the final review of the PSG. The PSG data of all subjects were collected for about eight hours using the standard PSG routine and 15 channels of data. EEG electrodes were placed at the C3-A2 and O2-A1 positions based on the international 10–20 system. The following data were collected: EMG from the chin and bilateral tibialis anterior muscles, bilateral EOG, lead II electrocardiogram (ECG), nasal airflow, abdominal and thoracic movements, snoring, and blood oxygen saturation (SaO2). The PSG data were simultaneously acquired with the NI-DAQ 6221 (National Instruments, Austin, Texas) and sampling rate was 250 Hz. Based upon PSG data scoring, sleep stages were categorised into two criterions: wake and sleep. Stages 1, 2, 3, 4 and stage REM (rapid eye movement) were regarded as sleep.

Table 1 Summary of the sleep-related parameters of the subjects

Electromyography (EMG) signals

In the study, EMG signals from anterior tibialis muscles were chosen as indicators for our sleep/wake estimation methods because these signals reflect the awake movements. Therefore, EMG signals from each anterior tibialis muscle were used to estimate wakefulness using movement information. Differences in the sleep versus wake anterior tibialis EMG signal amplitude from subject #1 is shown in Figure 1. In accordance with the method of previous study [18], the EMG signal amplitudes during sleep and wake states were quantified after amplitude normalisation. As shown in Figure 2, the anterior tibialis EMG amplitude histogram shows significant differences between sleep and wake states: wake states show relatively high anterior tibialis EMG amplitudes compared with those in sleep states. Based on the anterior tibialis EMG amplitude differences between sleep and wake states, we were able to estimate sleep/wake cycles.

Figure 2
figure 2

Mean and standard deviation values of the normalised EMG amplitude histogram. *Significant differences in normalised EMG amplitude between sleep and wake states (p < 0.05).

Leave-one-out-cross-validation (LOOCV)

Leave-one-out-cross-validation method was used in this study. For the method, eleven EMG recordings were selected as a training set. Threshold selection factors (TSF) were computed based on training set data, and then threshold was applied to the last one (a testing set). This procedure was conducted twelve times (12 subjects participated in our study) and each result was obtained.

Sleep/wake estimation methods: time domain analysis (TDA)

In TDA, the squared values of the anterior tibialis EMG signals from training sets were calculated, and all of the 250 samples of data were summed. In the following equation (1), xj denotes the anterior tibialis EMG signals, yk represents the summed data per second, at a sampling rate of 250 Hz. In Equation (2), zl represents the sum of the yk data per epoch (30 seconds).

y k = j = ( k 1 ) × 250 + 1 k × 250 x j 2
(1)
z l = k = ( l 1 ) × 30 + 1 l × 30 y k
(2)

From the training set EMG data, TSFTDA1 and TSFTDA2 which showed the best sleep/wake estimation performance in the training set data were calculated and applied to the testing set data. In subject #4 case (i.e. data from subject #4 was testing set), for example, TSFTDA1 and TSFTDA2 were 4 and 25, respectively. Consequently, the constant value 4 was multiplied by the average of zl for 51 epochs (previous 25 epochs, current one epoch, subsequent 25 epochs) as a threshold Tm for the estimation (equation (3), m denotes the number of epoch). In this way, we were able to obtain the adaptive amplitude threshold of EMG signals for each epoch.

Threshold , T m = T S F TDA 1 × 1 ( 2 × T S F TDA 2 + 1 ) ( l = ( m T S F TDA 2 ) + 1 l + T S F TDA 2 z l )
(3)

The number of samples exceeding the threshold per epoch was calculated and named HEMGm. In equation (4), sgn(x) is 1 if x > 0; otherwise, it is 0. In the mth epoch, if HEMGm (the number of yk over the threshold Tm) exceeded the average of HEMGm, we estimated the mth epoch as wake; otherwise, it was estimated as sleep. Figure 3 and Figure 4 show the data for yk, threshold Tm, HEMGm and the average HEMGm.

The Number of High EMG Amplitude Sample , HEM G m = k = ( m 1 ) × 30 + 1 m × 30 ( sgn ( y k T m ) )
(4)
Average HEM G m = 1 N ( m = 1 N HEM G m ) , N : total number of epochs
(5)
Figure 3
figure 3

An example of y k , threshold T m and HEMG m in subject #1. (a) yk signals from the 392th epoch to the 397th epoch; T395 was about 60. Bold lines indicate the yk signals of each epoch, and the dashed line indicates the threshold Tm. (b) Enlarged figure of epoch 395 in panel (a). In this case, HEMG395 was six.

Figure 4
figure 4

HEMG m and the average HEMG m of the whole sleep period in subject #1. (a) Bold lines indicate the HEMGm of each epoch, and the dashed line indicates the average HEMGm. In the case of subject #1, the average HEMGm was five. (b) Sleep/wake estimation using HEMGm and the average of HEMGm. In the mth epoch, if the HEMGm exceeded the average of HEMGm, a wake state was concluded; otherwise, it was estimated as sleep.

Sleep/wake estimation methods: Frequency domain analysis (FDA)

In FDA, first, the total power of anterior tibialis EMG spectrum of each epoch from training sets was obtained using fast Fourier transform (FFT) and then the useless frequency powers (around 60 Hz, lower than 10 Hz, greater than 75 Hz) were ignored using MATLAB software (MathWorks, USA). Figure 5 shows a typical spectrum of the anterior tibialis EMG signals in subject #7. As shown in Figure 5 (a) and (b), the spectra of the anterior tibialis EMG signals measured during wake and sleep epochs are clearly different. Therefore, the total powers of the anterior tibialis EMG spectra of the sleep/wake epochs were easily differentiated.

t p m = total power of the EMG spectrum of the m th epoch
(6)
Figure 5
figure 5

Typical power spectrum density (PSD) of the EMG signals. In this case, EMG data from the left tibialis muscles of subject #7 was used. PSD of each epoch were obtained using FFT and then the useless frequency powers (around 60 Hz, lower than 10 Hz, greater than 75 Hz) were ignored. (a) PSD of the EMG signals measured during wake epoch. (b) PSD of the EMG signals measured during sleep epoch.

For sleep/wake estimation, tpm (as defined in equation (6)) was compared with the spectral threshold. The spectral threshold was calculated as in equation (7). TSFFDA1 for average of the tpm and TSFFDA2 for standard deviation of tpm were decided from training set data. For instance, TSFFDA1 and TSFFDA1 were 0.5 and 3.5 in subject #1, respectively. We estimated the mth epoch as wake if tpm exceeded the spectral threshold and as sleep otherwise. The tpm and spectral threshold are shown in Figure 6.

Spectral Threshold = TS F FDA 1 × mean ( t p m ) + T S F FDA 2 × std ( t p m )
(7)
Figure 6
figure 6

Sleep/wake estimation with spectral threshold in subject #7. (a) The total powers of the EMG spectrum of each epoch and the spectral threshold. (b) If tpm exceeded the spectral threshold, the mth epoch was estimated as wake; otherwise, it was estimated as sleep.

Statistical analysis

Epoch-by-epoch statistical analyses between PSG and the outcomes of our sleep/wake estimation algorithms were performed. For statistical analyses, seven statistical parameters (sensitivity [TP/(TP + FN)], specificity [TN/(FP + TN)], positive predictive value [TP/(TP + FP)], negative predictive value [TN/(TN + FN)], accuracy, kappa statistic and F-measure) were used. TP, TN, FP, and FN were further classified as ‘true positive,’ ‘true negative,’ ‘false positive,’ or ‘false negative,’ respectively. In our study, the sensitivity represents the proportion of correctly identified sleep states, while the specificity represents the proportion of correctly identified wake states. The kappa statistic value is most commonly used for studies that measure the agreement between two separate evaluators [19]. A kappa value in the range from 0.41 to 0.60 indicates moderate agreement, and one from 0.61 to 0.80 indicates substantial agreement. We also quantified the system performance using the F-measure, which considers both the precision and the recall of the test. Thus, this value indicates the harmonic mean of the sensitivity and specificity between two systems [20]. An F-measure score close to 1 signifies higher agreement between the two systems.

Results

Our results from the two types of method for sleep/wake estimation were compared with PSG data. As shown in Table 2, the mean and standard deviations of the kappa value obtained via time and frequency domain analyses using EMG from bilateral tibialis muscles were 0.64 (0.06) and 0.67 (0.04) for normal subjects, respectively. For patient cases, corresponding values were 0.64 (0.00), 0.67 (0.01) in OSA and 0.39 (0.11), 0.46 (0.09) in PLMD. Six normal subjects (#1, 2, 3, 5, 6 and 7) and all OSA patients (#8 and 9) showed substantial agreement with regard to FDA. Six normal subjects (#1, 2, 3, 4, 5 and 6) and all OSA patients (#8 and 9) showed substantial agreement with regard to TDA. All other normal subjects demonstrated moderate agreement. For PLMD, subject #10 (in FDA) and 12 (in TDA) showed fair agreement.

Table 2 Statistical results of time and frequency domain analyses using EMG data from bilateral tibialis muscles

Figure 7 shows the sleep/wake estimation results from subject #3 (normal), 8 (OSA) and 12 (PLMD). The top figures indicate estimated sleep/wake patterns in TDA and the bottom figures show reference sleep/wake patterns from PSG. For PLMD patient, our proposed methods tended to overestimate the wake state.

Figure 7
figure 7

Sleep/wake estimation results from subject #3, 8 and 12. Sleep/wake patterns from the PSG recording are shown for reference. For these results, TDA method was used.

Sleep/wake estimation results based on sleep postures are shown in Table 3. As shown in Table 3, there were no significant differences in sleep postures except prone posture (no one slept in prone posture). Kappa statistics showed similar value in the supine, right-lateral and left-lateral postures. In this analysis, TDA method was used.

Table 3 Sleep/wake estimation results based on sleep postures

Sleep efficiency indexes from our methods were compared with the ones from PSG. Absolute and relative differences between each sleep efficiency index were calculated and the results are shown in Table 4. In this table, FDA method was applied and the mean values of relative differences were 0.8%. Especially, there were no difference between PSG and FDA for subject #4. For subject #10, the relative difference was 2.7% and it was the biggest difference in the whole case.

Table 4 Sleep efficiency index from PSG and our methods

Results from proposed methods in this study were compared with other sleep/wake estimation methods cited in the introduction section. In Table 5, results from heart rate-based method had similar performance as compared with our methods. In other cases (actigraphy, mandible activity, under-bed accelerometers), sensitivity and specificity from other methods were lower than those from our proposed methods. However, actigraphy- and under-bed accelerometers- based methods showed higher accuracy than our systems. In actigraphy-, heart rate- and under bed accelerometers- based studies, all participants were normal sleepers [9, 10, 14]. In mandible activity based method, all subjects were patients with sleep disorders [13].

Table 5 Overall sleep/wake estimation results from previous studies and ours

Discussion

The agreement between our system and PSG

In this paper, we used anterior tibialis EMG signals to estimate the sleep/wake cycle and proposed two types of sleep/wake estimation methods using anterior tibialis EMG only: time domain analysis (TDA) and frequency domain analysis (FDA). Both TDA and FDA were applied and tested, and each estimation method showed high concordance with PSG. When EMG signals from bilateral tibialis muscle were used for sleep/wake cycle estimation, the mean kappa values of both methods revealed substantial agreement (above 0.61) for normal subjects and OSA patients. With both methods and in all subjects, kappa statistics showed greater than moderate agreement (above 0.41) except patient #10 and 12. Consequently, our sleep/wake estimation methods for normal subject and OSA patients proved to be comparable to PSG. Furthermore, the threshold was set according to subject anterior tibialis EMG tone and variance; therefore, the individual adaptive threshold could be applied to each subject and to each epoch. Because the proposed algorithms are simple and do not require trained sleep experts, if there exists with tibialis EMG recording, this approach can be used for portable or long-term (via a data storage device) sleep/wake pattern monitoring purpose. Moreover, these methods can support wake event detection during sleep in PSG recording.

Sensitivity, specificity and kappa value

As shown in Tables 2, the specificity was lower than the sensitivity. Generally, in normal healthy subjects, the percentage of wake epochs is markedly less than the percentage of sleep epochs [17]. When we estimated the wake epochs, the specificity values were considerably reduced despite only a few wrong estimations. This may be due to the relative scarcity of wake epochs (see Table 1). So, in a non-symmetrical case of sleep/wake events, the accuracy cannot be used as an objective indicator [19]; therefore, we used kappa statistics to evaluate the performance of the sleep/wake estimation methods. Also, there were differences in sleep/wake estimation performance according to the subject. Figure 8 shows anterior tibialis EMG amplitude changes during the transition from sleep to wake. As shown, the anterior tibialis EMG amplitude changes of subject #4 were relatively small compared with those of subject #6. Therefore, in subject #4, the sleep/wake estimation performance was lower than that in subject #6 because our sleep/wake estimation methods were based on amplitude and frequency changes in anterior tibialis EMG signals. In this study, results were excellent when subjects were relatively active in the wake state and stayed immobile in the sleep state.

Figure 8
figure 8

EMG amplitude changes in sleep and wake states. The top figure indicates EMG of subject #6 (699 to 702 epochs). The bottom figure indicates EMG of subject #4 (574 to 577 epochs). In the case, EMG signals from the left tibialis anterior muscles were used.

Sleep efficiency index and sleep posture

In addition to the epoch-by-epoch analyses between PSG and our results, sleep efficiency indexes from our methods were calculated and these were compared with the ones from PSG (Table 4). Average of relative differences between each index was 0.8% and average absolute differences showed similar results. These results revealed that our systems are not only good estimator for the sleep/wake patterns but also useful estimator for the sleep efficiency index. Furthermore, in this study, we analysed the effects of sleep postures that could have influence on our sleep/wake estimation results (Table 3). However, there were no significant differences depending on sleep postures because the EMG electrodes were attached to the subject’s tibialis anterior muscles. Also, prone posture did not appear for all subject’s case. In PSG recording, a large number of electrodes are attached to the subject’s body (especially in the face) and this is why subjects can’t take the prone posture during sleep. So, in this analysis, sleep/wake estimation results in the prone posture could not be obtained.

Patients with sleep-related disorder

Our proposed methods were applied to data of patients with sleep disorders. The results from OSA patients (1 mild severity and 1 moderate severity) showed similar results from healthy subjects (sensitivity: 0.99 ± 0.00, specificity: 0.76 ± 0.01, kappa: 0.67 ± 0.01, in FDA) because sleep/wake EMG patterns from OSA patients were no different from normal subjects. However, the sleep/wake estimation results from PLMD patients were lower than those from healthy groups (sensitivity: 0.97 ± 0.03, specificity: 0.66 ± 0.05, kappa: 0.46 ± 0.09, in FDA). For PLMD patients, our proposed methods tended to overestimate the wake state because it was based on the EMG tone and variance. In this case, the results showed moderate or fair agreement. PLMD is generally evaluated by measuring the EMG at the tibialis muscle [17]. So, for PLMD, our proposed systems may be more suitable for whole night anterior tibialis EMG signal tracking to detect PLM instead of sleep/wake pattern estimation. In previous studies, actigraphy signal or mandible activity based sleep/wake estimation methods had some ineffectiveness in the patients with PLMD or sleep-related breathing disorders [8, 13, 21].

Anterior tibialis EMG signals and REM sleep

In normal adult humans, REM sleep is identified by a dearth of activity in the chin muscles, periodic bursts of rapid eye movement and the simultaneous existence of a relatively low-voltage cortical EEG [17]. Although anterior tibialis EMG signals are used to assess certain sleep-related disorders in general PSG, anterior tibialis EMG tone changes during REM sleep have not been established. In this study, tonic suppression of EMG signals from muscles beneath the chin was revealed in the transition from NREM sleep to REM sleep, but specific changes of anterior tibialis EMG tone were not occurred. So, to score macro sleep architecture (NREM, REM and wake) without EEG recordings, chin EMG signals are considered compulsory.

Isometric muscular activity

Anterior tibialis EMG signal bursts are created by body movement; also, bursting anterior tibialis EMG signals are observed when subjects in the wake state lie immobile in bed, an occurrence known as ‘isometric muscular activity’ [22, 23]. Therefore, anterior tibialis EMG signals might provide more data than actigraphy for inactive subjects in the wake state because actigraphy estimates sleep/wake patterns based on mechanical signals [9, 24]. Consequently, our proposed methods showed better sleep/wake estimation performance than did actigraphy in previous studies with regard to specificity (actigraphy: around 50%, our system: around 70%) and showed high concordance with PSG [9, 25].

Drawbacks

Despite their advantages, our methods also have limitations. For patients with periodic limb movement in sleep (PLMS), our methods tend to estimate the sleep state as wake because they are anterior tibialis EMG tone and variance based and are influenced by body movement. Our proposed system may not be as user-friendly as actigraphy because EMG electrodes must be attached to the tibialis anterior muscles. To overcome these drawbacks, non-intrusive sensors for PLM detection and physiological signal monitoring [26, 27] can be applied in our system.

Conclusions

Our proposed methods show that it is possible to estimate sleep/wake states using only anterior tibialis EMG data. Using the surface EMG electrodes, we were able to obtain a sleep/wake estimation performance comparable to that of PSG. We plan to focus our future study on non-intrusive sleep/wake estimation using EMG in order to relieve the inconvenience of electrode attachment.