Introduction

Pigmented villonodular synovitis (PVNS) is a rare benign but locally aggressive giant cell tumour deriving from synovium, either localized giant cell tumour of tendon sheath (GCT-TS) or diffuse-type giant cell tumour (Dt-GCT) [1, 2]. It is most commonly found in the knee (75 %; Fig. 1) and hip (15 %) [1, 3]. Treatment may consist of arthroscopic or open synovectomy, intra-articular radioactive colloids, radiation therapy or systemic targeted therapy [4, 5].

Fig. 1
figure 1

MR images of a 27 year old male patient with recurrent diffuse PVNS in the knee after previous anterior arthroscopic synovectomy and 90Yttrium instillation show multiple intra-articular lesions dorsal to the posterior cruciate ligament, with low signal intensity on T1-weighted sequences (A) and heterogeneous intermediate signal intensity on T2-weighted sequences (B) with artefacts due to haemosiderin depositions being characteristic for PVNS.

Rare diseases, including PVNS, are difficult to investigate as published case series are generally small, of retrospective nature and often describe research periods of several decades with a short follow-up duration. Therefore, these studies only provide levels of evidence III-IV, and clear evidence is lacking as meta-analysis of gathered data is often not warranted.

With a growing number of patients using social media as a source of medical information, online patient platforms can also be used as a powerful educational tool. Gathering patient data via crowdsourcing on social media can be especially promising and useful in the evaluation of rare diseases, as large study populations may become easily available to researchers. Crowdsourcing is the practice of obtaining services, ideas or content by collecting contributions from a large group of people from an online community rather than from traditional data suppliers. This is already increasingly being used for meeting the needs of consumers, and we wanted to investigate if it could be used to evaluate patient satisfaction, functional outcome and quality of life for patients with PVNS. Crowdsourcing to obtain big data can be useful in all fields of medicine, especially regarding the evaluation of rare diseases and patient reported outcome measures (PROMs). Open online surveys may also be more attractive and quick to complete for the modern patient than conventional questionnaires on paper via regular mail.

Several small communities of patients with PVNS exist on Facebook; however, there is only one community with over 1100 patients at the time of study (>2000 at the time of writing). On this forum, patients share information on their disease, experiences with treating physicians, surgery or other treatments and clinical outcome, and seek support from fellow patients. From this forum, we learned that adequate patient information on PVNS is deficient and that there is a desire among patients to interact with other patients and professionals and a growing demand for taking part in scientific research projects on PVNS. This is also reflected by recent initiatives such as PatientsLikeMe (www.patientslikeme.com), in which patients can track their outcomes by sharing their data and by participating in the design and implementation of patient-centred trials [6, 7]. Such online patient communities may allow researchers rapid access to large study populations that are otherwise hard to assemble in rare diseases.

The aim of this study was to investigate whether we could use crowdsourcing via Facebook and online surveys for medical research purposes on PVNS. More specifically, we set out to correlate functional outcome and quality of life (QOL) to patient characteristics, surgical procedures and oncological outcome in patients with PVNS who were enrolled in a patient community on Facebook.

Materials and methods

In this open survey observational study, patients were recruited to complete questionnaires on their disease through a patient-initiated campaign on a PVNS patient community on Facebook (1112 members at time of consulting; https://www.facebook.com/groups/91851410592/?ref=ts&fref=ts). A first online survey on demographics, clinical presentation, findings on imaging and biopsy material, type and localization of disease, surgical and adjuvant treatment, local recurrences, post-operative complications, functional outcome, quality of life (QOL) and follow-up was open from December 2012 to April 2014 (group 1). A second online survey using standardized and validated questionnaires on patient-reported outcome measures (PROMs) [8], to evaluate functional outcome and QOL, was open from August 2013 to February 2014 (group 2). The latter included range of motion (ROM), knee injury and osteoarthritis outcome score (KOOS) [9, 10], hip disability and osteoarthritis outcome score (HOOS) [11], Toronto extremity salvage score (TESS) [12] and short form-36 health survey (SF-36) [13]. Mean follow-up after index surgery was 70 months (range 12–374). The surveys were developed via SurveyMonkey® (https://www.surveymonkey.com) and usability and technical functionality were tested by the researchers. The surveys were announced on the Facebook community wall with a first notice of the study, and repeated requests for compilation after one, two, five, six and ten months. It was a voluntary survey and no incentives were offered. All responses were anonymous and automatically captured into an SPSS 20.0 file, which was password protected and only accessible to the researchers. Completeness checks were performed through JAVAScript and only fully completed surveys were included in the analysis. Respondents were able to review and change their answers before submitting. Unique site visitors were determined by IP addresses, and in case of duplicate entries only the most recent ones were included in the analysis. Propensity scores to adjust for a non-representative sample were not used in this study, but results were compared with previous results from the literature. The checklist for Reporting Results of Internet E-Surveys (CHERRIES) was used (Appendix 1) [14, 15]. None of the patients were recalled for this study. In the present study, data were not verified by contacting treating physicians or patients. By completing the surveys, patients gave their informed consent for this study. All procedures performed were in accordance with the ethical standards of Dutch law (Medical Research involving Human Subjects Act) and with the 1964 Helsinki declaration and its later amendments. For this type of study formal consent is not required.

Statistical analysis

Differences in dichotomous data were calculated with Chi-squared and Fisher’s exact tests and in numerical data with Mann–Whitney U tests. Multivariable logistic regression analyses were performed to identify factors of influence on recurrence, including diffuse or localized disease, localization and type of surgery. To determine whether the results of this study are reliable, we performed consistency tests by evaluating intra-rater agreement for patients’ answers between both online surveys. We used Cohen’s kappa statistic to perform consistency checks by determining intra-rater agreement for patients that could be cross-linked by IP address in the two online surveys. Outstanding agreement was defined as κ > 0.80; substantial agreement as κ = 0.60–0.79; moderate agreement as κ = 0.40–0.59; and poor agreement as κ < 0.40 [16]. Data from the two surveys were not combined but analysed separately; hence, the occurrence of repeated measures was not accounted for. We used SPSS 20.0 (SPSS Inc, Armonk, NJ, USA) for statistical analyses. The level of statistical significance was set at p < 0.05.

Results

All 1112 members of the PVNS patient community on Facebook, at the time of consulting, could view the online open survey. Participation rate was 26.3 % (293/1112) in the first survey; and 11.8 % (131/1112) for SF-36, 5.3 % (59/1112) for KOOS, 0.8 % (9/1112) for HOOS and 3.1 % (34/1112) for TESS in the second survey. Completion rate was 92.8 % (272/293) in the first survey; and 84.7 % (111/131) for SF-36, 86.4 % (51/59) for KOOS, 100 % (9/9) for KOOS and 100 % (34/34) for TESS in the second survey.

From group 1, 272 patients were included (Table 1). They originated from 23 countries and underwent arthroscopic or open synovectomy between 1982 and 2012. Primary surgery was arthroscopic synovectomy (n = 118), open synovectomy (n = 97), combined arthroscopic and open synovectomy (hybrid synovectomy; n = 10) or unknown (n = 47). One hundred twenty two patients reported at least one local recurrence, 124 patients had no recurrences (Table 2). Mean number of surgeries was 2.6 (1–9). Final surgery was open synovectomy (n = 52), arthroscopic synovectomy (n = 36), hybrid synovectomy (n = 10) or unknown (n = 24). Total hip arthroplasty was required in 13/25 and total knee arthroplasty in 17/199 (p < 0.001). Adjuvant treatment was radiation therapy (n = 30), radioactive colloid instillation with 90Yttrium (n = 18), M-CSFR targeted tyrosine kinase inhibitor imatinib (n = 8) or nilotinib (n = 2), cryosurgery (n = 3) or methotrexate (n = 1).

Table 1 Patient, tumour and treatment characteristics
Table 2 Local recurrences after synovectomy for PVNS in the knee or hip

From group 2, 72 patients with PVNS in the knee or hip joint and a minimum follow-up of one year were included (Table 1). The knee was affected in 64 patients (52 diffuse; 12 localized) and the hip in eight (six diffuse; two localized). Other localizations (n = 18; e.g. ankle, elbow and shoulder) were excluded from PROMs analyses, as we wanted to focus on the two most common localizations; however, they were used for consistency checks between both surveys. Primary surgery was arthroscopic synovectomy (n = 38) or open synovectomy (n = 34). Recurrence rates are listed in Table 2. Mean number of surgeries was 2.5 (1–9). Recurrences were treated with open synovectomy (n = 16), arthroscopic synovectomy (n = 15) or complete resection and joint arthroplasty (n = 12). Total hip arthroplasty was required in 6/8 and total knee arthroplasty in 7/64 (p = 0.004). Adjuvant treatment was radiation therapy (n = 12), 90Yttrium (n = 9), imatinib (n = 1) or nilotinib (n = 1). Diffuse disease increased recurrence risk (odds ratio [OR] = 16; 95 % confidence interval [CI] = 3.2–85; p = 0.001; Table 3). Mean functional and QOL results did not differ significantly after primary arthroscopic or open synovectomy (Table 4). Final surgery resulted in a mean TESS of 88 after arthroscopic synovectomy, 68 after open synovectomy and 69 after total joint arthroplasty (p = 0.017). Joint replacement surgery resulted in lower functional scores compared with joint salvage: TESS 69 vs. 82 (p = 0.010), KOOS 34 vs. 55 (p = 0.031) and SF-36 49 vs. 66 (p = 0.020). Mean ROM was lower for patients with diffuse disease (117 vs. 151 degrees; p = 0.024) and for recurrent disease requiring repeat surgery (113 vs. 138 degrees; p = 0.046).

Table 3 Factors of influence on recurrence rate after synovectomy for PVNS in the knee or hip
Table 4 Functional outcome and QOL after primary synovectomy for PVNS in the knee or hip

Consistency checks were performed with Cohen’s kappa statistic for intra-rater agreement; 66 patients could be cross-linked between both surveys through IP address. Cohen’s kappa statistic for the two online surveys was outstanding for tumour localization with κ = 0.95 (p < 0.001), joint arthroplasty with κ = 0.88 (p < 0.001) and adjuvant treatment with κ = 0.82 (p < 0.001); and substantial for primary surgical treatment with κ = 0.78 (p < 0.001) and recurrences with κ = 0.68 (p < 0.001).

Discussion

In this study, we investigated whether we could use crowdsourcing via Facebook and online surveys for medical research purposes on PVNS. We set out to correlate functional outcome and QOL to patient characteristics, surgical procedures and oncological outcome in patients with PVNS who were enrolled in a patient community on Facebook. We concluded that the recurrence risk was highest for diffuse disease and after arthroscopic synovectomy. Lower functional results were reported for patients with diffuse disease, for patients with recurrences requiring repeat surgery, and for patients eventually requiring joint replacement surgery.

To determine whether the results of this study are reliable and whether crowdsourcing via social media is feasible in medical research, we performed consistency tests by evaluating intra-rater agreement for patients’ answers between both online surveys, which was substantial to outstanding for most study variables. The somewhat lower agreement in follow-up questions can be explained by the time interval between the two surveys as patients may have experienced a recurrence after filling out the first survey. In addition, we compared our results with previous publications on PVNS to assess the representativeness of our sampling frame [17] (Tables 3 and 5). An advantage of this comparison may be the determination of accurateness of the use of crowdsourcing and the reliability of the obtained data. Possible disadvantages of crowdsourcing may include selection bias through the sampling method, inhibiting comparison of results with previously published reports. The average age of 32 years at onset of disease in this study matches known epidemiology of PVNS (<40 years) [1, 2, 36]. Localization of PVNS in this study (73 % knee, 9 % hip, 18 % other) was also comparable to percentages described in literature (75 % knee, 15 % hip, 10 % other). Multifocal PVNS is rare and was not reported in this study [36]. Women were over-represented (78 %) when compared with known epidemiology of PVNS; possibly indicating that women are more likely to be on Facebook and to seek information via support groups [37]. All study variables were distributed equally between men and women. Women scored somewhat lower on SF-36 subdomains physical functioning, pain and PCS; all other functional and QOL scores did not differ between men and women (results not shown). Proportions of arthroscopic and open synovectomy [4] and total knee or hip arthroplasty were comparable to those previously published [38, 39].

Table 5 Literature overview on oncological and functional results after arthroscopic and open synovectomy for PVNS

Mean follow-up of approximately six years (range 1–31) was longer when compared with the majority of previously published reports [3, 19, 23, 29, 31, 32]. Together with the relatively high recurrence rates in this study (58–77 % after arthroscopic and 36–64 % after open synovectomy), this may indicate that to date, an underestimate of the true local recurrence rate of PVNS has been published.

Functional results after surgical treatment for PVNS have been reported (Table 5) [3, 1832], but comparison is difficult, as functional results were not specified for diffuse and localized disease, type of surgery, primary or recurrent disease and different localizations. In this study, there was no difference in functional outcome and QOL between patients who underwent primary arthroscopic or open synovectomy. However, the long course of disease and the need for multiple surgeries has previously been reported to result in worse functional results in a large number of patients [23]; and in this study, lower functional results were also reported for patients with diffuse disease, with recurrences requiring repeat surgery, and for patients eventually requiring joint replacement surgery.

Our study has several limitations. First, the low participation rate in this study (26.3 %) may be explained by several arguments, including the voluntary character of the survey, and the attention paid to the survey by the Facebook members; maybe they didn’t see the requests on their wall, didn’t have time to compile the questionnaires or didn’t feel the need to add to a scientific research project. This is also of concern when similar studies involving social media are performed in medicine, as it may induce selection bias. In regards to this potential selection bias, patients who are currently unsatisfied with their situation may be more likely to enrol in a patient community on Facebook and to complete online surveys concerning functional and QOL results. However, the opposite may also be true for satisfied patients who are willing to share their experience and to improve awareness on this rare disease. Second, patients were not uniformly diagnosed and treated for PVNS, as they were collected from 23 different countries and treated by various surgeons without distinguishing between peripheral and tertiary referral centres. However, we believe that it represents a randomly chosen group of patients, perfectly reflecting the current worldwide situation and underlining the importance of centralization of care for musculoskeletal tumours [40]. Third, the accuracy of surgical data is subjective to the understanding of patients; data obtained from patients were not verified by contacting treating physicians. We considered this beyond the scope of the current study but we deem it valuable in future crowdsourcing studies via social media. Yet, PROMs are considered more reliable in reporting subjective patient outcomes when compared to the evaluation by treating physician, and are more often required by the FDA [8, 41].

In addition to using social media for crowdsourcing purposes in rare diseases, it may also increase the readership and impact of scientific publications apart from the indexed impact factor.

An increasing number of scientific papers can be found through social media such as Facebook, Twitter, LinkedIn and ResearchGate; and journals should explore these platforms and use it in a constructive way to increase the scientific exposure [42].

In conclusion, gathering data via crowdsourcing in a patient community on Facebook seems a promising and innovative way of evaluating rare diseases, as it provides for a representative and large sample of patients with long-term follow-up and valid clinical outcome data. The results of this study suggest that local recurrence risk and functional outcome were both negatively influenced by diffuse disease, which comprises a large part of the joint, is difficult to resect completely and often requires repeat surgery, especially after arthroscopic synovectomy.