Abstract
Background
Evaluate the performance of the Focalpoint system in identifying and classifying cervical cytology alterations from samples collected from patients treated with Radiotherapy (RT).
Methods
The reproducibility of manual and automated screening by cytotechnologists using the BD Focalpoint GS Imaging System was examined. Samples were collected from May 2010 to August 2011.
Results
A total of 378 treated with RT and 8,967 cytology samples from patients without previous RT, were evaluated. The kappa values for cytological diagnoses read manually and automated in cases without previous RT were as follows: < ASC-H vs. ≥ ASC-H = 0.71; < LSIL vs. ≥ LSIL = 0.66; and < HSIL vs. ≥ HSIL = 0.67. The kappa for cytological diagnoses in post-RT women have showed: < ASC-H vs. ≥ ASC-H = 0.71; < LSIL vs. ≥ LSIL = 0.65; < HSIL vs. ≥ HSIL = 0.57.
Conclusions
There was no significant difference among the kappa values we found. Post-RT cytology showed small diagnostic agreement between manual and automated examination.
Virtual Slides
The virtual slide(s) for this article can be found here: http://www.diagnosticpathology.diagnomx.eu/vs/13000_2014_231
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Background
Radiotherapy (RT) is commonly used to treat invasive cervical cancer and other gynaecological malignancies and has high treatment efficacy [1]. RT, however, can induce important changes in cellular morphology that can generate bizarre cell shapes that persist for several years [2]. Despite some controversies, cervicovaginal cytology remains an auxiliary tool for diagnosing gynaecological tumour recurrence after radiotherapy [1]. Nevertheless, most abnormalities related to radiation exposure should be carefully evaluated to avoid misinterpretation [1]. Atypical mitosis, dyskaryosis, severe keratinisation, vacuoles mimicking Chlamydia infection, and koilocytosis-like structures mimicking human papillomavirus (HPV) infection are frequently observed after radiotherapy and represent sources of cytological misdiagnosis [3-5].
The difficulties in interpreting post-RT cervical samples, usually obtained from conventional Pap test smears, were also observed in liquid-based cytology (LBC) preparations. However, patients’ cells are generally well-preserved in LBC samples. Wright and colleagues [5] reported an index of satisfactory samples similar to that of non-irradiated samples (approximately 97%), and associated benign alterations after radiation were found in approximately 50% of cases. Despite the well-known limitations of cytology in precisely categorising cytological findings after RT, the frequency of positive Pap tests for HSIL or squamous cell carcinoma (SCC) after RT is generally low, which minimises the potential errors [6].
Currently, automated screening has been suggested as a useful tool with which to safely accelerate an accurate cytological screening. Although there is limited evidence, the sensitivity of automated screening seems similar to that of manual screening [7]. The available data, however, are conflicting. Nevertheless, to achieve acceptable performance in relation to automated screening, manual screening must be restricted to very low workloads (≤41 slides/day) [8]. The efficacy of the Pap test in revealing cytological abnormalities largely depends on the time spent on the screening in addition to the professional skill of the cytotechnologists [8]. Regardless, automated screening is an important option for an internal quality control system, as the number of cytotechnologists has recently been decreasing, and the HPV vaccine is likely to reduce the accuracy of cytological examination due to the associated decreasing number of cervical abnormalities [9,10]. Consequently, automation seems to be a promising tool to assure the quality of a cytology laboratory and avoid errors. Moreover, positive effects of automation on productivity have been reported [9]. All together, these findings seem realistic for ordinary samples but not necessarily for those from post-RT patients. Preneoplastic changes in women undergoing radiotherapy due to genital cancers were proven to be HPV-related lesions, demonstrating that the candidate HPV assay is a powerful ancillary test for cytology [11].
This study aimed to compare the cytological interpretation of samples collected from women who did or did not undergo previous pelvic RT analysed manually versus samples analysed under Focalpoint (FPGS) guidance.
Methods
The cytological samples were prepared and examined at the Barretos Cancer Hospital between May 2010 and August 2011. A total of 9,345 cervicovaginal cytologies preserved in SurePath™ solution were analysed. The samples were prepared in the BD PrepStain™ System (Burlington, NC, USA) according to the manufacturer’s instructions.
The manual screening of the slides was routinely performed using light optical microscopes by well-trained cytotechnologists. These slides were re-analysed under guidance of the Focalpoint system (Burlington, NC, USA) and randomly and blindly re-evaluated after 12 months by the same group of cytotechnologists using the automated screening Guided Screening Review Station (GS) of the BD Focalpoint GS Imaging System (FPGS). No additional training was applied for the cytotechnologists between the first and the second round of slides’ review.
Cytology classification followed the Bethesda system [12]. Prevalence ratios were calculated and compared based on their 95% confidence intervals. The kappa coefficients and the respective 95% confidence intervals were calculated to evaluate the diagnostic agreement among the cytotechnologists for both manual and computer-guided screenings.
We also evaluated the frequency and prevalence ratio of cytological results and compare with biopsy CIN 2 +.
All women enrolled in this study signed informed consent forms to participate in the study, which was approved by the Ethics committee of the Barretos Cancer Hospital (id number 244/2009).
Results
Of the 9,345 liquid-based Pap tests available for this analysis, 378 were collected from women who had been previously treated with RT. Tables 1 and 2 shows the frequency and prevalence ratio of cytological results according to RT status read manually and under FPGS assistance, respectively. Cytological abnormalities were more frequent in the RT arm for both screening tools: manual and automated. In Table 1 the prevalence ratios were significantly higher in the RT group for the following diagnoses: ASC-H + AGC (5.0), LSIL (2.4), and HSIL or worse (3.5) and in Table 2 ASC-H + AGC (4.0), LSIL (1.8), and HSIL or worse (4.8).
Tables 3 and 4 compares the biopsy CIN2+ rates distributed according to RT status and cytology results read manually and under FPGS assistance, respectively. No significant difference was found in the CIN2+ proportion between the groups with and without previous radiotherapy for all cytological categories.
We also evaluated the diagnostic concordance among cytotechnologists in manual and automated screening. Table 5 shows the kappa coefficients according to RT status. There was no difference in the kappa values according to RT status and cytologic abnormality (< ASC-H vs. ≥ ASC-H; < LSIL vs. ≥ LSIL; < HSIL vs. ≥ HSIL).
Figures 1 and 2 shows the morphological post-radiotherapy effects on the cells preserved in liquid medium.
Discussion
The results obtained in this study are unique and original in Brazil. The results demonstrated that previous radiotherapy could introduce important morphological changes that inhibit the specific classification of cellular alterations and favours the cytological categorisation of uncertainty.
In our laboratory, we introduced the concept of internal quality control in cytology supported by an automated method of analysis in order to improve cytological interpretation, theoretically reducing the errors of cytological classification. The subjectivity of manual screening performed by cytotechnologists was examined critically and accurately, and the results obtained in this study provide interesting data to support a significant change in the paradigm of cervical cancer prevention in our hospital, whereby automation can serve concurrently as an option for primary screening and/or as an important tool for internal quality control of cytological diagnosis. Our findings demonstrated, however, that automated screening offers diagnostic performance similar to that of the manual method, even in cases of high-grade lesions, when performed by highly well-trained professionals. These results enabled the automated system FPGS to be introduced into the routine protocol of the cytology laboratory of the Department of Pathology of Barretos Cancer Hospital.
The post-radiation cytology assessment performed in the present study offered substantial data concerning the quality and limitations of cytological examination by automated equipment. The frequencies of lesions found after radiotherapy were as follows: ASC (ASCUS, ASC-H, and AGC), 6.1%; LSIL, 2.9%; and HSIL or worse, 4.5% read manually and read under FPGS orientation were: ASC 8,2%, LSIL 2,9% and HSIL or worse 4,8%. These results are different from those obtained by Wright and colleagues [5], who reported lower frequencies of HSIL or worse than our study (ASCUS, 5.1%; LSIL, 1.0%; HSIL, 0.3%; and carcinoma, 0.7%). Our results are also different from an Italian study, where frequencies ranged from 9.2% for cancer to 13.8% for atypical squamous cells of undetermined significance [13]. These large variations among studies clearly emphasise the difficulties of categorising the effects induced in cervical cells by radiation. The biopsy study of these alterations (Tables 3 and 4), however, reflects the under- and over-estimation that these ionising effects induce, as most of the cytological results are not corroborated by histopathological evaluation. In our study, numerous cases of post-radiation high-grade lesions identified by cytology were not confirmed by biopsy. This finding illustrates that cytological alterations did not correspond to tissue modifications compatible with the diagnosis of intraepithelial lesions. Accordingly, ancillary methods for diagnosis and monitoring of post-radiotherapy patients are necessary to avoid alarming patients and performing unnecessary invasive biopsies.
It is also relevant to emphasise that the manual screening in this study occurred under routine conditions, but for the automated screenings, which were executed almost one year after the initial diagnoses, the cytotechnologists read all the slides blinded of any clinical and laboratorial information of patient (including RT status), which could certainly have influenced the morphological classification. This is especially true for dubious cytological alterations that are frequently found in cases of cell atrophy alterations and post-radiotherapy cytological preparations. For this reason, the analyses of diagnostic reproducibility were performed separately for patients who had and had not undergone RT.
The agreement between the manual and automated screening techniques demonstrated that there was substantial agreement among the cytotechnologists regarding patients who had not undergone RT, but the level of agreement varied significantly for patients who had undergone RT, ranging from substantial agreement with regard to ASC-H and LSIL classifications to moderate agreement for HSIL categorisation. Not surprisingly, the results showed similar kappa values among all observers except for cases of high-grade lesions in patients who had undergone RT, which yielded lower kappa values. Lower concordance from patients’ samples after RT is expected due to the bias that radiation induces, which favours the cytological categorisation of uncertainty.
To the best of our knowledge, no study focusing on FPGS use in post-radiotherapy cervical samples has been reported. Few recent studies evaluating the reproducibility of cytological screening using liquid-based preparations have demonstrated interesting results with image digitalisation. Tsilalis and colleagues [14] studied the performance of a group of pathologists who analysed digital cytology images; this same group reassessed the same images after 12 and 24 months, and the agreement between the readings varied from substantial to excellent, with kappa values varying between 0.79 and 0.97. Through the quality program in Austria, the Pap tests of patients with invasive cervical carcinoma collected in the 5 years prior to disease detection were re-evaluated. The kappa values found between the original and re-assessed readings of the slides were only moderate [15].
A moderate reproducibility has been the most common finding in reports related to the interobserver interpretations of cervical cytological under different scenarios [14]. Our study demonstrated interesting data regarding the performance of cytotechnologists, as most of the results showed substantial reproducibility. Additionally, the significant reproducibility with different kappa values between the two screening techniques shows that the replacement of manual screening with automated screening does not cause loss of positive cases, with high levels of agreement between the manual and automated screening.
Liquid-based cytology has also additional value introducing the molecular biology approach among different lesions from several regions with diverse types of cytological samples. Of note, the relevance of hTERC amplification are feasible to be analysed by FISH technique associated with more progressive CIN3 and carcinoma if present in HPV positive cases in cervical material [16]. Similarly, the genomic amplification pattern of human telomerase RNA gene test was demonstrated to be highly sensitive and suitable for cervical cancer screening in samples preserved in liquid medium, but not C-MYC test because of its lower sensitivity [17]. New options of cellular staining are currently available to improve the quality of the traditional staining protocols observations [18]. In the near future we can speculate that these new staining tools could be also used with the ancillary assistance of computerized screening.
Conclusion
The potential use of automation in underserved regions is a good option to compensate for the absence of well-trained professionals for slide reading. Moreover, automated reading can improve both the primary screening and/or internal quality control of cytological diagnosis by selecting appropriate fields of observation for cytotechnologists in samples with and without RT effects.
References
Wagner A, Jhingran A, Gaffney D. Intensity modulated radiotherapy in gynecologic cancers: hope, hype or hyperbole? Gynecol Oncol. 2013;130:229–36.
Rimel BJ, Ferda A, Erwin J, Dewdney SB, Seanon L, Gao F, et al. Cervicovaginal cytology in the detection of recurrence after cervical cancer treatment. Obstet Gynecol. 2011;118:548–53.
Longatto Filho A, Maeda MY, Oyafuso MS, Alves VA, Kanamura CT, Bortolan J. Cytomorphologic evidence of human papillomavirus infection in smears from the irradiated uterine cervix. Acta Cytol. 1997;41:1079–84.
Longatto Filho A, Maeda MY, Oyafuso MS, Kanamura CT, Alves VA. Herpes simplex virus in postradiation cervical smears: a morphologic and immunocytochemical study. Acta Cytol. 1990;34:652–6.
Wright JD, Herzog TJ, Mutch DG, Gibb RK, Rader JS, Davila RM, et al. Liquid-based cytology for the postirradiation surveillance of women with gynecologic malignancies. Gynecol Oncol. 2003;91:134–8.
Chien CR, Ting LL, Hsieh CY, Lai MS. Post-radiation Pap smear for Chinese patients with cervical cancer: a ten-year follow-up. Eur J Gynaecol Oncol. 2005;26:619–22.
Stein MD, Fregnani JH, Scapulatempo C, Mafra A, Campacci N, Longatto-Filho A, et al. Performance and reproducibility of gynecologic cytology interpretation using the FocalPoin system: results of the RODEO Study Team. Am J Clin Pathol. 2013;140:567–71.
Renshaw AA, Elsheikh TM. Assessment of manual workload limits in gynecologic cytology: reconciling data from 3 major prospective trials of automated screening devices. Am J Clin Pathol. 2013;139:428–33.
Sweeney BJ, Wilbur DC. Effects on cervical cytology screening productivity associated with implementation of the BD FocalPoint™ Guided Screener Imaging System. Acta Cytol. 2013;57:147–52.
Franco EL, Cuzick J. Cervical cancer screening following prophylactic human papillomavirus vaccination. Vaccine. 2008;26:A16–23.
Barzon L, Pizzighella S, Corti L, Mengoli C, Palù G. Vaginal dysplastic lesions in women with hysterectomy and receiving radiotherapy are linked to high-risk human papillomavirus. J Med Virol. 2002;67:401–5.
Solomon DA, Nayar R. The Bethesda System for Reporting Cervical Cytology. 2nd ed. New York: Springer; 2004.
Zannoni GF, Vellone VG. Accuracy of Papanicolaou smears in cervical cancer patients treated with radiochemotherapy followed by radical surgery. Am J Clin Pathol. 2008;130:787–94.
Tsilalis T, Archondakis S, Meristoudis C, Margari N, Pouliakis A, Skagias L, et al. Assessment of static telecytological diagnoses’ reproducibility in cervical smears prepared by means of liquid-based cytology. Telemed J E Health. 2012;18:516–20.
Cibas ES. Cervical and vaginal citology. In: Cibas ES, Ducatman BS, editors. Cytology: Diagnostic Principles and Clinical Corrrelates. Edinburgh: Saunders; 2003. p. 52–4.
Liu H, Liu S, Wang H, Xie X, Chen X, Zhang X, et al. Genomic amplification of the human telomerase gene (hTERC) associated with human papillomavirus is related to the progression of uterine cervical dysplasia to invasive cancer. Diagn Pathol. 2012;7:147.
Chen S, Yang Z, Zhang Y, Qiao Y, Cui B, Zhang Y, et al. Genomic amplification patterns of human telomerase RNA gene and C-MYC in liquid-based cytological specimens used for the detection of high-grade cervical intraepithelial neoplasia. Diagn Pathol. 2012;7:40.
Idelevich P, Elkeles A, Okon E, Kristt D, Terkieltaub D, Rivkin I, et al. Novel dual-function Cell Detect® staining technology: wedding morphology and tinctorial discrimination to detect cervical neoplasia. Diagn Pathol. 2010;5:70.
Acknowledgments
The authors are indebted to BD Brazil, which partially supported the study by providing the SurePath™ collection kits and equipment. The study design, screening, statistical analyses, and manuscript writing were independently performed by the Center for the Researcher Support of the Barretos Cancer Hospital.
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
MDS: conducted all steps of the study, including review of the manuscript and examination. of the cytological slides. JHF: Statistical analyses and critical review of the manuscript. CSN: Cyto-histological correlation and review of the manuscript. ALF: Conception of the study and draft of the manuscript. All authors read and approved the final manuscript.
Rights and permissions
This article is published under an open access license. Please check the 'Copyright Information' section either on this page or in the PDF for details of this license and what re-use is permitted. If your intended use exceeds what is permitted by the license or if you are unable to locate the licence and re-use information, please contact the Rights and Permissions team.
About this article
Cite this article
Stein, M.D., Fregnani, J.H., Scapulatempo-Neto, C. et al. Cervicovaginal cytology in patients undergoing pelvic radiotherapy using the Focalpoint system: results from the RODEO study. Diagn Pathol 10, 1 (2015). https://doi.org/10.1186/s13000-014-0231-7
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13000-014-0231-7