Background

Patient satisfaction is an important and commonly utilized measure for healthcare quality and research [1, 2]. Most theories and formulations about patient satisfaction are based on marketing theories. Generally, patient satisfaction is defined as the extent to which health services meet patients’ expectations [3]. Patient satisfaction is relevant to clinical medicine as higher levels of it can lead to better adherence with treatment recommendations [4]. Understanding the determinants of patient satisfaction can help improve patient satisfaction, which can in turn improve clinical outcomes, patient retention, rehospitalization [5,6,7], patient complaints, and lawsuits [8].

Many factors have been associated with patient satisfaction in psychiatry. A study conducted in the U.S. in the early 1980’s found that high quality medical staff was the greatest source of satisfaction, while the cost of care was associated with the most dissatisfaction in a private hospital [9]. Another study in the 1990’s found nurses were seen as the most helpful healthcare professionals patients encountered [10]. While most surveys found psychiatric patient satisfaction was good or high [11, 12], and better than patients with non-psychiatric disorders, some found the contrary. In one study, the authors used survey data from the 1991 Medicare Current Beneficiary Survey. They found aged and disabled beneficiaries with psychiatric disorders were significantly less likely than those without disorders to be satisfied with the overall quality of health care, follow-up care, and the physician’s concern for their overall health [13]. With respect to psychiatric diagnosis, some studies found that patients with schizophrenia were less satisfied than patients with other psychiatric disorders [14,15,16,17], while other studies showed the opposite trend [11, 18]: patients with schizophrenia were more satisfied compared to those without schizophrenia.

Other factors associated with patient satisfaction have also been studied, including the provision of treatment information [12], psychiatrist-patient ratio [17], severity of disease and the number of prescribed drugs [16, 18], clinical improvement and seclusion [19], involuntary admission and functioning [20], coercive treatment, ward environment, and staff relationships [21, 22].

There have only been a few studies examining psychiatric patient satisfaction in China. Overall, the satisfaction levels of psychiatric patients in those studies were rather high. For example, a survey of 153 patients in a psychiatric hospital in Hebei province, found that the overall satisfaction score for nursing services was 89.5/100 [23]. Another survey, included 9718 discharged psychiatric patients in Liaoning province and found that the average satisfaction score was 99.2/100 [24]. Another similar survey included 4063 discharged patients from a tertiary psychiatric hospital in Hubei province and found that the satisfaction score was 95.7% [25]. Of note, all the above three studies were based in one local hospital and they all used a locally developed satisfaction scale. None of them reported correlates associated with patient satisfaction.

To address the gap in research, we conducted a nation-wide survey with the goal of determining the amount of satisfaction overall and for different aspects of the patients’ hospitalization. We also aimed to identify the clinical and institutional correlates with patient satisfaction levels.

Methods

Study design, setting and study sample

This study was a part of a larger research project, the National Survey for the Evaluation of Psychiatric Hospital Performance [26]. We selected one provincial psychiatric hospital under the jurisdiction of the Ministry of Health in the capital city of each province, except Beijing (where 3 were selected) and Anhui Province (2 were selected). Gansu and Tibet were not included because there were no psychiatric hospitals in their capital cities at the time of survey. Hospitals within the jurisdiction of the Ministry of Public Security (Forensic psychiatric hospitals) and the Ministry of Social Welfare (Safety net hospitals) were not selected. In total, 32 psychiatric hospitals from 29 provinces and autonomous regions in mainland China were selected. We included all psychiatric inpatients who were discharged from December 25 to 27, 2017.

The patients were interviewed by clinicians who were not directly involved in the patients’ care. Interviewers were trained on all of the aspects of the study protocol, including the research aims and how to use the study questionnaires. In this study, we included all adult patients who were older than 18 years old, and had stayed longer than 24 h and were discharged from hospitals from 25 to 27 December 2017. We excluded inpatients who were younger than 18 years old or those who stayed in hospitals less than one day. We also excluded patients who were missing one or more items on the satisfaction questionnaire.

Patient satisfaction questionnaire

Currently, there were no international patient satisfaction scale available for psychiatric patients in Chinese language, so we developed a psychiatric inpatient satisfaction questionnaire for this study. Based on a literature review and expert opinions, three authors, FJ, YLT and HZL, developed the questionnaire. Then, a pilot study, which included 127 inpatients, was conducted to gather users’ feedback to improve the readability and reliability. Based on existing literature, the psychiatric inpatient satisfaction questionnaires have generally involved five domains: quality of care, interpersonal relations, costs of care, non-medical services, and global satisfaction [27]. The final version of our questionnaire was composed of the following questions: (1) How satisfied were you with the doctor-patient communication during your hospitalization? (communication subscore). (2) How satisfied were you with privacy-protection during your hospitalization? (privacy protection subscore). (3) How satisfied were you with medical services during your hospitalization? (medical services subscore). (4) How satisfied were you with hospitalization costs? (cost subscore). (5) How satisfied were you with your hospitalization overall? (global score).

All items were measured using the balanced 5-point Likert scale: very dissatisfied = 1, dissatisfied = 2, neutral = 3, satisfied = 4 and very satisfied = 5. The total score ranged from 5 (very dissatisfied for all items) to 25 (very satisfied for all items). The Cronbach’s α coefficient of the questionnaire was 0.90 and the test-retest reliability in the pilot study was 0.76.

To ensure confidentiality, psychiatric inpatients responded anonymously and items on personal identifiable information were kept to a minimum. A few open-ended questions were included, such as: what other comments/suggestions would you like to provide regarding this topic?

Other study measures

Patients’ demographic information and clinical features were collected by site-based research staff using semi-structured interviews and discharge medical records. The retrieved data included age, sex, marital status, education level, primary clinical diagnosis according to International Classification of Diseases and Related Health Problems 10th revision (ICD-10) [28], the Global Assessment of Functioning (GAF) scale score at admission [29], and the treatment response measured by the Clinical Global Impression(CGI) scale [30]. Other data included days of hospitalization, number of psychological treatment sessions, physical restraint times, seclusion times, and number of electroconvulsive therapy (ECT) sessions. In China, the concept of psychological treatment is broad and inclusive. They often include individual therapy with either a psychiatrist or a psychologist (the number of social workers is very limited in psychiatric hospitals in China). They can also include group therapy led by a psychologist or sometimes a registered nurse. The commonly used approaches include psychoeducation, supportive, cognitive behavioral therapy, or dynamic approach. Number of psychological treatment sessions means the total number of psychological treatments the patients received. Hospital level data were retrieved from the Hospital Information System (HIS) and included the number of beds, physicians (including psychiatrists), nurses, and psychologists.

Statistical analysis

Summary statistics were used to describe the data. Comparisons of total satisfaction score and dimension score in various subgroups were calculated using Mann-Whitney U test or Kruskal-Wallis test, as appropriate. Associations between patient satisfaction scores and the continuous variables were analyzed using Spearman’s correlation tests. The SPSS version 22.0 software package (SPSS Inc., Chicago, IL, USA) was used to perform the basic statistical analyses.

Because patients were nested in 32 hospitals, and because of the advantages of the multilevel model [31], this study applied multilevel linear regression with MLwiN 2.30 (Centre for Multilevel Modelling, University of Bristol, UK).

All of the tests were two-sided and statistical significance was defined as P < 0.05.

Results

Sample characteristics

One thousand seven hundred eighty psychiatric patients participated in the survey across 32 hospitals, 117 were excluded due to missing data, and 1663 were included in the final analysis. Patients characteristics are shown in Table 1. The mean age of participants was 41.9 years old, 51.7% were female, 52.6% were married, 26.1% had college or above education. 48.8% had a diagnosis of schizophrenia or related disorders, 43.1% were hospitalized psychiatrically for the first time, 48.9% were involuntarily admitted, 27.4% had received physical restraints during this hospital stay, 8.2% had received seclusion, and the median length of hospitalization stay was 32 days (interquartile range: 20–54 days). 57.5% were rated as having marked improvement on the day of discharge by their treating team.

Table 1 Sociodemographic and clinical characteristics of 1663 psychiatric inpatients

Twelve hospitals were selected from East China, which is more population-dense and socio-economically developed, while 10 hospitals were from the less developed West China. Three hospitals were from Northeast China, and 7 hospitals were from Middle China. The hospital sizes varied, with bed number ranging from 169 to 2134 (median = 810). The doctor/bed ratios also varied, ranging from 0.1 to 0.3 (median = 0.2). The nurse/bed ratios ranged from 0.1 to 0.6 (median = 0.4), and psychologist/bed ratios ranged from 0 to 7.7% (median = 1.2%).

Patients satisfaction

Total satisfaction scores were generally high across 32 participating hospitals, with a mean score of 23.3 ± 2.4 out of 25. Table 2 summarizes the total satisfaction scores by each hospital.

Table 2 Total satisfaction score by site (N = 32)

Focusing on the five dimensions, the mean score for global satisfaction was 4.7 out of 5, costs 4.6, medical services 4.7, privacy protection 4.7, and communication 4.7.

We investigated the total satisfaction scores and the five-dimension subscores further Table 3. There were significant differences among treatment response subgroups in total satisfaction scores and subscores. Patients with marked improvement (N = 956) had the highest mean total satisfaction score (23.5) and those who were rated as “no change or worse” (N = 8) on discharge had the lowest total satisfaction (22.5, P = 0.003). Compared to patients who were rated as having “no change or worse”, those who were rated as having “marked improvement”, “improvement”, or “some improvement” on discharge had significantly higher total satisfaction scores (23.5, 23.4, 23.1 vs 22.5, P = 0.003), higher scores on global satisfaction (4.7, 4.6, 4.5 vs 4.4, P = 0.002), medical services (4.7, 4.7, 4.6 vs 4.5, P = 0.001), privacy protection (4.8, 4.7, 4.7 vs 4.6, P = 0.010) and doctor-patient communication (4.7, 4.6, 4.6 vs 4.4, P = 0.003).

Table 3 Total satisfaction score and dimension score in subgroups and association analysis (mean ± standard deviation)

Based on a bivariate analysis, patient’s education levels were also associated with satisfaction scores, as patients with a college education or above reported a significantly higher privacy protection subscore than lower education levels (4.8 vs 4.7, 4.7, 4.7, P = 0.046). Patients with schizophrenia or related disorders had the lowest communication subscore (4.6), compared to patients with mood disorders or another diagnosis (4.7, 4.7, P = 0.016). The GAF score was positively associated with doctor-patient communication satisfaction scores (coefficient = 0.1, P = 0.001).

Number of seclusions while admitted was significantly associated with total satisfaction scores (coefficient = − 0.1, P < 0.001), medical services satisfaction scores (coefficient = − 0.1, P = 0.002), privacy protection satisfaction scores (coefficient = 0.1, P < 0.001) and doctor-patient communication satisfaction scores (coefficient = − 0.1, P < 0.001).

The number of psychological therapy sessions was positively associated with total satisfaction scores (coefficient = 0.1, P = 0.007), global satisfaction scores (coefficient = 0.1, P = 0.005), cost scores (coefficient = 0.1, P = 0.005), medical service scores (coefficient = 0.1, P = 0.003) and privacy protection scores (coefficient = 0.1, P = 0.002).

The number of ECT treatments was inversely associated with total satisfaction scores (coefficient = − 0.0, P = 0.048) and with doctor-patient communication satisfaction scores (coefficient = − 0.1, P = 0.022).

Correlates of patient satisfaction in multilevel analysis

A multilevel analysis was used to examine associations between individual-level and institution-level factors and satisfaction scores. In the null model, the intra-class correlation [32] was 22.6%, so multilevel analysis was necessary.

As shown in Table 4, global satisfaction scores were positively associated with college or above education level (coefficient = 0.2, P = 0.002), having “marked improvement” (coefficient = 0.6, P = 0.004), “improvement” (coefficient = 0.5, P = 0.016), and “some improvement” in response to treatment (coefficient = 0.6, P = 0.010). Cost satisfaction subscores were positively associated with college or above education level (coefficient = 0.1, P = 0.039); privacy protection satisfaction subscores were positively associated with college or above education level (coefficient = 0.2, P = 0.003) and number of psychological therapy sessions (coefficient = 0.0, P = 0.046); doctor-patient communication satisfaction scores were positively associated with having had “marked improvement” (coefficient = 0.5, P = 0.025), “improvement” (coefficient = 0.5, P = 0.050), or “some improvement” in response to treatment (coefficient = 0.5, P = 0.050), and GAF score (coefficient = 0.0, P = 0.003).

Table 4 Factors associated with total satisfaction score and dimensions score: multilevel analysis

Total satisfaction scores and all five-dimension subscores were positively associated with institution-level factors, including psychiatrist-bed ratio, nurse-bed ratio and psychologist-bed ratio.

Discussion

This study aimed to explore psychiatric inpatients’ satisfaction and the clinical and institutional correlates with satisfaction. To the best of our knowledge, this is the first national, cross-sectional survey in China with a sample this large. Our findings showed that the overall levels of satisfaction among psychiatric inpatients in China were high, with a mean score of 23.3 out of 25. This satisfaction level, which was measured by a different tool from other studies, is in line with surveys of psychiatric inpatients from other countries, such as India [33], Thailand [34], Finland [35], Israel [36], and Nigeria [37]. It is also consistent with a few local surveys of Chinese samples [24, 25].

Patient satisfaction is often affected by patient expectation: The high patient satisfaction in our study may have been due to low patient expectations. Since low expectations are more easily met, patients are likely to be satisfied with their experience [38]. In the context of widespread discrimination against psychiatric patients and the poor public image of psychiatric hospitals, the patient expectation for mental health hospitals was assumed to be low [39]. Measurements of patient’s expectations on the day of admission would help clarify this relationship.

Our study identified important factors associated with psychiatric inpatient satisfaction, some of which are at the individual level and others at the institutional level. Some are modifiable and can be used to improve psychiatric services which may in turn improve patient satisfaction.

At the patient level, treatment response was the most important factor associated with global patient satisfaction and with doctor-patient communication satisfaction. Although the differences of satisfaction score among patients with different treatment responses were statistically significant, the differences might not be clinically significant and could be due to the large sample sizes in each treatment response group. Regarding patient satisfaction, its relationship to treatment response makes sense as improvement in the patient’s illness is usually the patient’s goal for being in the hospital. Additionally, it aligns with findings from other studies [19, 40]. Regarding the doctor-patient communication, reductions in certain symptoms and improved interpersonal functioning would allow the patient to perceive the doctor as more helpful. Alternatively, the doctors may relate better and feel less frustrated by those who are showing a treatment response.

We found that patients with higher education levels had higher scores on global satisfaction, cost satisfaction, and privacy protection satisfaction. The literature on this topic is somewhat mixed. For example, one study found education level was not significantly associated with psychiatric patients’ satisfaction [16], another one found successful education increases patient satisfaction and results in improved adherence to treatment and thus to a better outcome [8], yet a third study showed patient satisfaction was significantly associated with less education [2]. Possible explanations for this inconsistency include the different measures of satisfaction used and the different patient populations recruited within these studies.

The current survey found that the GAF score and the number of psychological therapy sessions were significantly associated with patient satisfaction. Specifically, GAF was associated with the doctor-patient communication subscore, while therapy sessions were associated with privacy protection satisfaction. To our surprise, we did not find associations between the other clinical characteristics measured and patient satisfaction. This is quite different from other published reports in other countries [2, 16, 21, 41, 42]. It is possible that the expectations of patients in China are different from other countries, due to the differences in socio-culture and healthcare systems [43]. As suggested by previous studies, health needs may vary by ethnic groups [44]. For example, Vietnamese patients reported they had received better general practice care than other ethnic groups, and they also reported lower expectations [38]. Another possible explanation for the lack of associations between several clinical factors and patient satisfaction could be due to the statistical method we used. The multilevel analysis is often considered more stringent in variable selection than classical statistical analysis [31].

We found a few significant factors contributing to patient satisfaction at the hospital level. These factors, while important, are simply reflecting how well a hospital is professionally staffed. As expected, the quality of healthcare providers in a hospital would contribute to higher levels of patient satisfaction. We found that psychiatrist-bed ratio, nurse-bed ratio, and psychologist-bed ratio were all positively associated with patients’ total satisfaction and all five subscores. This is consistent with the findings reported by another study [17]. As mental health staff/patient ratios increased, psychiatric patients may have a higher likelihood of receiving higher quality psychiatric services and more clinical attention overall. Our findings suggest that, especially for those with inadequate staffing, the first step to improve patient satisfaction is to improve the number and quality of healthcare providers.

Limitations

There are a few limitations about this study that need to be acknowledged. First, we only focused on patient-related variables and institutional variables. We did not have data on the healthcare providers (e.g. the psychiatrists, psychologists, nurses, etc), therefore we are unable to examine if there was any association between patient satisfaction and healthcare provider-related variables. This should be explored further in future studies. Second, this survey was conducted in the psychiatric hospitals under the jurisdiction of the Ministry of Health (Health Section) located in the capital cities. As a result, the data may not be generalizable to hospitals outside of the health sections, or in district/county level hospitals, hospitals located in rural areas, or in general hospitals. Third, our study used a self-reported psychiatric inpatient satisfaction instrument, in which response bias cannot be excluded. Patients involved may have reported greater satisfaction than they actually felt, as they may have believed that higher scores were more acceptable. Another limitation is the distribution of the questionnaires at patient discharge. Although some research has shown that satisfaction scores are lower if data are collected at a patient’s home [45], it was recommended that the satisfaction scale be administered before discharge in order to increase our response rate [27]. Furthermore, this research did not measure patients’ expectations, which were believed to be related to patient satisfaction. Additionally, as a new scale for the assessment of satisfaction was used in this research, it is difficult to compare our findings with those from earlier studies.

Conclusion

In conclusion, based on a nationwide survey of psychiatric inpatients in China, we found that our respondents were very satisfied overall with their treatment. Additionally, we identified some potential determinants of patient satisfaction in China. At the individual level, a better education and a better treatment response were both associated with higher satisfaction scores, while at the institutional level, factors, such as the adequacy of staffing, were also related to higher satisfaction scores. To optimize patients’ satisfaction, the Chinese government should provide more resources to hospitals so that they may hire more mental health professionals and offer more psychological therapy. Future studies of psychiatric inpatients’ satisfaction should pay more attention to the patients’ expectations at the time of admission and should establish whether the associations reported in this analysis are observed in longitudinal studies.