Background

Since the outbreak of severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2) in 2019, more than 700 million cases and almost seven million deaths have been confirmed worldwide [1]. Most patients develop a mild disease with a good prognosis, while over 20% develop a serious or even critical illness [2]. The clinical characteristics and pathogenesis of patients with coronavirus disease 2019 (COVID-19) at the acute phase have been well described, but the long-term consequences are still not fully understood [3].

Previous studies show that some patients do not fully recover after a SARS-CoV-2 infection. Patients who report symptoms that occur 3 months after the acute illness, persist for over 2 months and have no other explanation, have been described as having ‘long-COVID’ or ‘post COVID-19 condition’ [4, 5]. Fatigue seems to be a dominant feature of post COVID-19 condition, along with other symptoms, like cough and dyspnea [5]. In the Netherlands, the prevalence of post COVID-19 condition is estimated at 12.7% at 90–150 days after infection [6].

A recent systematic literature review, mainly including studies examining previously hospitalized COVID-19 patients, has reported the persistence of at least one symptom in 72.5% of the patients, and 49.2% of the patients reported three or more symptoms after ≥ 60 days [7]. Other studies have shown that fatigue, breathlessness and cough are the most common persistent symptoms in post COVID-19 patients [8,9,10,11]. Additionally, a study in Arabic countries, who included 965 participants aged ≥ 18 years, found that post COVID-19 patients score significantly higher on fatigue severity, compared to healthy individuals [12]. The number of patients with persistent symptoms seems to decline over time. Indeed, the number of patients with persistent symptoms at day 30 and 180 were 16.9% and 11.7% [9], respectively.

Most studies assessed fatigue with short questionnaires or only studied whether fatigue was present. These types of questionnaires are either not detailed enough or not validated [8,9,10, 13, 14]. The DePaul Symptom Questionnaire-2 (DSQ-2) is a validated questionnaire to measure myalgic encephalomyelitis/chronic fatigue syndrome (ME/CFS) symptomatology [15]. Perrin et al. [16] suggests that a proportion of COVID-19 patients might develop long-term symptoms similar to ME/CFS. However, only a few case reports of probable or confirmed ME/CFS in post COVID-19 patients have been reported [17] and there still seems to be a lot of variability in immune dysfunction between ME/CFS patients and post COVID-19 patients [18]. ME/CFS is a very complex multi-system disease, often characterized by fatigue that lasts for at least 6 months [19], for which no clear definition is available yet. Instead, there are several criteria, where the most commonly used are The Fukuda CFS Criteria [20], the Canadian ME/CFS Criteria (CCC) [21], the ME International Consensus Criteria (ME-ICC) [22], and the Institute of Medicine Criteria (IOM) [23]. The DSQ-2 may give a good overview of the symptoms in different domains of ME/CFS in patients with post COVID-19 condition.

The aim of this study is therefore to determine the prevalence of fatigue and other symptoms in post COVID-19 patients 3 to 6 months after either hospitalization or a positive SARS-CoV-2 polymerase chain reaction (PCR) test and 9 to 12 months later. The second aim is to determine the number of post COVID-19 patients that meet the ME/CFS criteria according to different definitions. The third aim is to identify clusters in patients with post COVID-19 condition based on the frequency and severity of symptoms and to compare these clusters with clusters observed in a ME/CFS cohort.

Methods

Study design and subjects

Precision Medicine for more Oxygen (P4O2) COVID-19 is a multicentre, prospective, observational cohort study. This study was approved by the ethical board of the Amsterdam University Medical Centre (UMC), reference number NL74701.018.20. Details of the study design have been described by Baalbaki et al. [24]. In brief, 95 patients were recruited between May 2021 and September 2022 from post-COVID-19 outpatient clinics in five hospitals in the Netherlands: the Amsterdam UMCs (locations AMC and VUmc), Leiden University Medical Centre, Spaarne Gasthuis in Haarlem, and VieCuri Medical Centre in Venlo.

The post-COVID-19 outpatient clinic was part of standard follow-up care after hospitalization for COVID-19 in the Netherlands. Ex-COVID-19 patients were invited at 3 to 6 months after hospital discharge if they suffered from any persisting symptoms. Additionally, ex-COVID-19 patients who were not hospitalized but suffered from persisting symptoms were referred to the outpatient clinic by their general practitioner at 3 to 6 months after the date of positive PCR or serology test for SARS-CoV-2.

The inclusion criteria for the P4O2 COVID-19 study were: aged 40–65 years, proven ex-COVID-19 (either a positive PCR test, a serology test, and/or a COVID-19 Reporting and Data System (CORADS) score 4/5), the ability to provide informed consent, having access to the internet and understanding the Dutch language. All patients gave their written informed consent. A total of 95 patients were included in the P4O2 COVID-19 study. In the present study, only patients who completed the Fatigue Severity Scale (FSS) at either study visit 1 or 2 or at both study visits were included.

Study visits

Clinical data about the acute phase of COVID-19 were collected from electronic medical records. The first study visit was planned in parallel to the outpatient clinic visit 3 to 6 months after SARS-CoV-2 infection. During this study visit, general characteristics such as demographics, educational level, smoking, medical history, and medication use were assessed using questionnaires. Additionally, two validated fatigue questionnaires (FSS and DSQ-2) were administered. A second study visit took place 9–12 months later, where the same measurements were performed and the same questionnaires were administered.

Fatigue severity scale

Patients completed the FSS questionnaire at both study visits. This questionnaire is used to assess the severity of fatigue [25]. Patients rated nine statements on a 7-point Likert scale to assess whether they agree with the statement (1 = strongly disagree, 7 = strongly agree). An average score between 1 and 7 points was calculated, where a higher score means more fatigued. Moderate to high fatigue is defined as having a FSS score ≥ 4 and was used as the cut-off value for further analysis [25].

DePaul symptom questionnaire-2

When patients scored ≥ 4 on the FSS, they also completed the DSQ-2. This is a self-reported measure of ME/CFS symptomatology, which includes the frequency and severity of 79 symptoms. Both frequency (0 = none of the time, 4 = all of the time) and severity (0 = symptom not present, 4 = very severe) were rated on a 5-point Likert scale. The DSQ-2 has demonstrated to have a strong reliability and validity [15]. First, a composite score was calculated by averaging the frequency and severity score per symptom and multiplying it by 25. This score ranged from 0 to 100 with a higher score indicating a higher symptom burden. Second, a binary “2/2 threshold” was calculated by examining the frequency and severity of each symptom. Patients who reported a score of two or higher for both frequency and severity were considered to have the symptom. Post-exertional malaise (PEM) is defined as the worsening of symptoms following even minor physical or mental exertion and was assessed by examining whether one of the following symptoms met the binary “2/2 threshold”: heavy feeling after starting to exercise, next-day soreness or fatigue after daily activities, mentally or physically tired after minimum exercise, or physically drained after mild activity (Q14, Q15, Q16, Q17 or Q18 of the DSQ-2) [26]. The DSQ-2 can also be used to determine whether patients meet the criteria for the Fukuda case definition, Canadian Consensus Criteria (CCC), International Consensus Criteria for ME (ME-ICC) and/or IOM case definition. A more detailed description on the different criteria can be found in Additional file 1.

Statistics

Descriptive statistics were reported as mean ± standard deviation (SD) or median (25th–75th percentiles) for continuous data and as frequency (%) for categorical data. Symptom scores were calculated in two ways by using the DSQ-2.

Thereafter, the number of patients that met one or more of the four different definitions for ME/CFS was calculated by using the DSQ-2. Symptoms that were taken into account to calculate these definitions, were e.g. neurological/cognitive problems, unrefreshing sleep, joint pain, sore lymph nodes, muscle aches, PEM, headaches, and a sore throat.

A self-organizing map (SOM) was used to visualize the clustering of patients based on the severity and frequency of 79 symptoms, meaning each patient had 158 features. The SOM method is a non-parametric regression technique that converts multi-dimensional data spaces into lower dimensional abstractions. A SOM generates a non-linear representation of the data distribution and allows to identify homogenous data groups [28]. Missing data were imputed using the Multivariate Imputation by Chained Equations (MICE) package in R studio. Thereafter, the clustering was performed in MATLAB, following its default SOM setting, except for the number of iterations for training the SOM, which was set at 1000 [28]. The default random number generation of MATLAB was used to initialize all competitive units of the SOM, meaning that with the same input and SOM settings, the results are always the same. Vaes et al. [29] clustered 337 ME/CFS patients in the Netherlands into clusters based on their symptom scores. The symptom scores of the post-COVID 19 patients were applied to these clusters to examine whether the same or different clusters were found.

Independent t-tests and chi-square tests were used to test differences in patient characteristics between the two largest clusters.

All analyses were performed with R studio version 4.0.3 (R Foundation for Statistical Computing, Vienna, Austria) and MATLAB (R2022a, MathWorks, MA, USA).

Results

In total, 91 post COVID-19 patients who either completed the FSS at visit 1, visit 2, or at both visits were included in this study. The mean time between infection and visit 1 is 168 days. The mean age was 53.9 ± 6.1 years and 46 (50.6%) patients were male (Table 1). Of these patients, 81 (89.0%) were hospitalized with a median duration of 8 days and 57 patients (63.3%) reported at least one pre-existing comorbidity. Most reported comorbidities were cardiovascular disease (CVD) (26.4%), asthma (16.5%) and diabetes (14.3%).

Table 1 General characteristics of the cohort, n = 91

FSS

At the first study visit, 87 patients completed the FSS. The mean ± SD FSS-score of the total population was 5.1 ± 1.6. Of these patients, 66 (75.9%) had a FSS-score of ≥ 4, indicating moderate to high fatigue. A FSS score of ≥ 4 was reported in 31 (68.9%) males and in 35 (83.3%) females. At the second study visit, 76 patients completed the FSS. The mean ± SD FSS-score at the second study visit was 4.4 ± 1.7 and 44 (57.9%) patients had a score ≥ 4. In total, 72 patients completed the FSS at both visits and 38 (52.8%) patients had a score ≥ 4 at both study visits.

DSQ-2

In total, 61 patients at visit 1 and 39 patients at visit 2 completed the DSQ-2 (Table 2). The DSQ-2 was completed at both visits by 34 patients. Of the patients who scored ≥ 4 on the FSS, 85.0% were also fatigued according to the DSQ-2 at the first study visit, while this percentage was 94.4% at the second study visit. PEM was also a frequently reported symptom, with 72.4% of the patients experiencing PEM at the first visit, and 69.2% reporting it during the second study visit.

Table 2 DSQ-2 symptoms at visit 1 and visit 2

Furthermore, the most reported symptoms at visit 1 and visit 2 were, respectively, unrefreshing sleep in 63.3% and 59.0% of the patients, problems staying asleep in 58.3% and 51.3%, shortness of breath in 53.3% and 31.6%, physically tired after minimum exercise in 50.8% and 38.5%, and joint pain in 50.8% and 56.4% (Table 2).

ME/CFS case definitions

Additional file 2: Fig S1 shows the number of patients that met the different criteria for ME/CFS at study visit 1 and study visit 2. At the first study visit, six (9.8%) patients met all four different case definitions, whilst 21 (34.4%) of the patients met none of the case definitions. At the second study visit, six (15.4%) patients met all four different case definitions, whilst eight (20.5%) of the patients met none of the case definitions.

Clustering

Previously, Vaes and colleagues clustered 337 patients with ME/CFS into 45 unique clusters based on their DSQ-2 symptom scores [29]. The scores of the participants of the P4O2 COVID-19 cohort at study visit 1 were applied to these clusters. The post COVID-19 patients occurred in 11 of the ME/CFS clusters (Fig. 1). The five most frequently reported symptoms per cluster with five or more patients can be found in Additional file 3: Table S1.

Fig. 1
figure 1

Symptom-based clusters at visit 1 using self-organizing maps. All clusters of patients are displayed in the direction of left to right and bottom to top. Each hexagon represents a cluster, and the number within a hexagon shows the number of patients in the cluster. The x-axis and y-axis indicate the number of clusters, starting from 0. In particular, coordinate (0,0) corresponds to Cluster 1, coordinate (1,0) corresponds to Cluster 2, etc.

The characteristics of the two clusters with ≥ 10 patients (clusters 19 and 37) are shown in Table 3. Cluster 19 (n = 12) included more females (75.0%) and patients had on average a slightly higher body mass index (BMI) (33.9 kg/m2) compared to the total group that scored ≥ 4 for the FSS (n = 66) where 53.0% were female and the average BMI was 30.9 kg/m2. Additionally, cluster 19 contained less patients that worked full time (16.7%) and less patients had a comorbidity (50.0%) compared to the total group with FSS ≥ 4. Cluster 37 (n = 24) contained nearly all current smokers (12.5%), and there were more patients with a comorbidity (70.8%) and more severe acute COVID-19 cases (33.3%). However, all of these characteristics were not statistically significantly different between the two clusters. The mean FSS score in cluster 19 was 6.15 and in cluster 37 was 5.67 (p = 0.04), meaning the patients in cluster 19 were statistically significantly more fatigued.

Table 3 Characteristics of patients with FSS ≥ 4 and per cluster that included ≥ 10 patients

When clustering the patients at visit 2, (i.e., 12–18 months after SARS-CoV-2 infection), the same two largest clusters are again observed (clusters 19 and 37) (Fig. 2). However, only nine (26.5%) patients were included in the same cluster at both study visits.

Fig. 2
figure 2

Symptom-based clusters at visit 2 using self-organizing maps. All clusters of patients are displayed in the direction of left to right and bottom to top. Each hexagon represents a cluster, and the number within a hexagon shows the number of patients in the cluster. The x-axis and y-axis indicate the number of clusters, starting from 0. In particular, coordinate (0,0) corresponds to Cluster 1, coordinate (1,0) corresponds to Cluster 2, etc.

Discussion

The current study confirms that fatigue and PEM are prominent symptoms in many post COVID-19 patients, which partly recover over time. Furthermore, sleep disturbances, pain, and neurocognitive symptoms were frequently reported. Two-thirds of the post COVID-19 patients met one or more internationally-known ME/CFS definitions. Applying the post COVID-19 data to symptoms-based ME/CFS clusters, we have shown that several ME/CFS clusters do occur in post COVID-19 patients, and that these clusters persisted over time.

The findings of our study are in line with literature. Other studies also report high persistence of fatigue after a SARS-CoV-2 infection. For example, Fortini et al. [11] found fatigue in 42.2% of the cohort at 3–6 months after hospital discharge. This is slightly lower compared to our cohort, however they did not include ICU patients. Tleyjeh et al. showed that 6% of the hospitalized patients reported chronic fatigue syndrome. This is lower than what we found in our cohort (52.7%). This could be due to the use of a different fatigue questionnaire in that study. Another cohort study showed that the rate of post-COVID fatigue decreased over time, only 46.9% of the patients reported this symptom after 6 months compared to 53% at 3 months [10]. Although the percentage of fatigue in our cohort is higher, the decrease over time is in line with our results. When comparing our results with another study conducted in the Netherlands, the percentage of fatigued patients at 3–6 months after acute COVID-19 is more similar [30]. They found 69% to be fatigued, compared to 76% that we found.

PEM is also a highly prevalent symptom in our cohort. Twomey et al. [26] also demonstrated that 94.8% of the post COVID-19 patients experienced PEM, focussing on the presence of one of the first five PEM symptoms of the DSQ-2. In our cohort we observed 72.4% of the patients experiencing PEM during the first study visit. This difference could be due to the selection of participants in this study, since they included patients ≥ 4 weeks post COVID-19 and symptoms could be worse shorter after the acute infection.

At first, it seems reasonable to assume that post COVID-19 patients have similar symptoms as patients with ME/CFS. Nevertheless, one-third of the post COVID-19 patients did not fulfil internationally-known definitions of ME/CFS, which could mean that there are differences between both conditions. However, there are still very few studies that compared both conditions. Jason et al. [31] showed that COVID-19 patients scored higher on e.g. chest pain, shortness of breath and loss of hair, where ME/CFS patients scored higher on neurocognitive symptoms. Next to that, COVID-19 patients showed more improvement over time compared to ME/CFS patients. Then again, several symptoms-based ME/CFS clusters (Vaes et al. [29]) did occur in the post COVID-19 patients, suggesting that several symptom patterns are very similar between both conditions. Therefore, a search for trans-diagnostic predisposing factors of fatigue seems reasonable, which may result in a trans-diagnostic interventions.

Interestingly, the top five features of the post-COVID clusters with five or more patients (Additional file 3: Table S1), show a large variation in the type of symptoms and/or their frequency and severity. These findings again demonstrate the large clinical heterogeneity in daily symptoms, which partly explain the large variation in the challenges patients experience daily.

When comparing the characteristics of the two largest clusters, there were some differences. In cluster 19 there are more females and patients had on average a slightly higher body mass index (BMI) compared to the total group that scored ≥ 4 for the FSS. There were less patients working full time and less patients had a comorbidity. Cluster 37 contained almost all current smokers, and there were more patients with a comorbidity and more severe acute COVID-19 cases.

The biggest ME/CFS cluster (n = 43) was not observed in the P4O2 COVID-19 cohort. This cluster was characterized by high frequency and severity scores for sensitivity to sound, sleeping problems and symptoms after exercise.

Strengths and limitations

This study has some limitations. First, the sample size is relatively small, which may affect the number and/or size of the post COVID-19 clusters. Larger studies are needed to validate and extend our findings. Specifically, increasing the sample size for clustering analysis could give more reliable comparisons with the ME/CFS cohort. Another limitation of this study is that we did not have a second dataset to validate our findings. This could enhance the external validity of the results and increase the generalizability to other countries and populations. Moreover, we only have two time points where we examined post COVID-19 patients. Since we are interested in the comparison with ME/CFS, a condition that may last for years, it will be of interest to extend the follow-up period in future research to study the progression of symptoms in post COVID-19 patients and make a better comparison with ME/CFS on the long term.

A third limitation is the inconsistency observed in patients’ responses. It was assumed that all patients who completed the DSQ-2 experienced moderate to high fatigue because they all had a FSS score of 4 or higher, yet not all patients reported fatigue on the DSQ-2. This may suggest reporting bias or variations in how patients perceive and express their symptoms and could lead to a degree of outcome misclassification.

A fourth limitation is that we do not know the health status of patients before COVID-19, therefore we do not know whether patients were already fatigued prior to their infection. Also, we did not have a control group with healthy participants. This could have strengthen the results that patients are more fatigue after COVID-19 than before.

Lastly, not all patients who completed the FSS at visit 1, completed the questionnaire at visit 2 and vice versa. This resulted in missing values for the FSS and DSQ-2 at both study visits. However, we did decide to include all data available on the FSS and DSQ-2, otherwise the sample size would be smaller.

An important strength of this study is the use of the DSQ-2, which is an extended, validated questionnaire that assesses not only fatigue but also a broad range of other symptoms. This allows for a more detailed examination of post COVID-19 condition symptoms, beyond just fatigue.

Another strength of this study is the comparison with a cohort of patients suffering from ME/CFS. This provides a better insight into potential overlap and differences between post COVID-19 condition and ME/CFS. This could contribute to a better understanding of post COVID-19 symptomatology and can therefore lead to more targeted treatment of post COVID-19 and ME/CFS.

Conclusion

This study shows the persistence of fatigue, PEM, and other post COVID-19 symptoms in the P4O2 COVID-19 cohort. The symptom patterns of post COVID-19 patients are similar to a subgroup of patterns known in ME/CFS. These findings highlight the necessity for more research to identify the mechanisms underlying persistent fatigue in post COVID-19 patients in order to prevent it from occurring. These findings highlight the necessity for more research that aims to identify the mechanisms underlying persistent fatigue in post COVID-19. Moreover, at this stage it is hard describe the clinical implications of our findings, since there is still a lot unknown. However, our study does highlight that more research is needed for post COVID-19 condition and ME/CFS, which may lead to better treatment options and an increased quality of life of these patients. For example, intervention studies could be set up to examine whether patients might benefit from certain treatments.