Molecular testing for mutations in the EGFR gene is commonplace for patients with non-small cell lung cancer (NSCLC). These patients are often very sick and management decisions need to be made urgently. In many cases, the results of molecular testing are needed the same day, in order to start targeted therapy and allow maximum benefit for patients. The Idylla™ EGFR Mutation Test offers rapid results within three hours of requesting. This study aimed to assess the concordance of Idylla™ EGFR Mutation Test results with current standard tests. Forty formalin-fixed, paraffin-embedded NSCLC tumour cases (20 EGFR mutant and EGFR 20 wild type) were analysed by the Idylla™ EGFR Mutation Test (CE-IVD) and compared with PCR and NGS methodologies. The overall concordance between Idylla™ and standard testing was 92.5% (95% CI 80.14% to 97.42%) and the specificity of Idylla™ was 100% (95% CI 83.89% to 100%). The sensitivity was affected by loss of tumour content in tissue blocks in a small number of NGS cases; however, comparing Idylla™ with PCR alone, there was 100% concordance (95% CI 89.85% to 100%). The Idylla™ EGFR Mutation Test shows comparative accuracy to routine PCR testing for the most common EGFR mutations in NSCLC. The Idylla™ also offers significantly reduced turn-around times compared with existing modalities and therefore the platform would be a useful addition to many molecular diagnostics units.
Lung cancer is the third most common cancer in the UK with around 46,000 cases diagnosed each year. The prognosis for these patients is extremely poor with the overall 10-year survival at only 5% . Non-small cell lung carcinoma (NSCLC) accounts for 85% of these tumours  and while surgery and chemoradiotherapy remain the conventional management for most patients, newer targeted therapies have shown great promise in specific subgroups. Around 16% of NSCLC patients have somatic mutations in the epidermal growth factor receptor (EGFR) gene and these patients show a greater response to EGFR-tyrosine kinase inhibitors (EGFR-TKi), such as gefitinib, than they do to traditional chemotherapies. Conversely, patients without such mutations respond better to conventional drugs. In the UK, guidance from the National Institute for Health and Care Excellence (NICE) recommends that EGFR testing is therefore carried out for all adults with previously untreated, locally advanced or metastatic NSCLC in order to inform clinical management in these patients. A number of next-generation sequencing (NGS) and polymerase chain reaction (PCR) tests for detecting (EGFR) mutations are approved by NICE; however, these all generally involve long preparation, require significant staff training, result in a turn-around time of several days (usually due to the need to batch cases), require large tissue volumes and invariably incur high cost [3,4,5].
The Idylla™ EGFR Mutation Test is a novel test to detect EGFR mutations in lung cancer, covering all the clinically relevant mutations in exons 18 to 21 (Table 1). The test is a single-use disposable cartridge that can carry out automated PCR on a single section of formalin-fixed paraffin-embedded (FFPE) tissue containing as little as 10% tumour cells. This requires minimal skill and equipment and can achieve an on-demand result within three hours from the time of the pathologist requesting the test . There have been a number of publications to date showing the high diagnostic accuracy of the Idylla™ System for mutations in BRAF and KRAS in various tissues, but fewer publications exist for EGFR testing with the platform [10,11,12,13,14,15,16]. Recent evidence demonstrates high concordance of the prototype (non-CE marked, research use only) Idylla™ EGFR Mutation Test with conventional methods [17,18,19,20]. This study evaluated the new CE-IVD approved Idylla™ EGFR Mutation Test with the main aim to verify the previous validations of the RUO test in a small cohort of patients who have undergone routine PCR testing. We also included a small set of NGS-tested samples to get an indication of how the Idylla would fair against such sequencing assays that are becoming popular and have very low limits of detection.
Materials and methods
Ethical approval was granted by the National Research and Ethics Service (Ethical Application Reference 04/Q1604/21; Expiry Date 04/06/2021). Anonymised cases of FFPE lung NSCLC were drawn from the histopathology diagnostic archive at Birmingham Heartlands Hospital and the Cambridge Human Research Tissue Bank, Addenbrooke’s Hospital, Cambridge. For the validation, 40 cases were selected: 20 EGFR mutant and 20 EGFR wild type, as determined retrospectively by the local standard care test. In Birmingham, PCR was the reference standard and this was either the cobas EGFR Mutation Test (Roche Molecular Systems Inc.) or the therascreen EGFR RGQ PCR Kit (Qiagen), depending upon when the test was carried out. For cases from Cambridge, the reference test was the Ion AmpliSeq™ Cancer Hotspot Panel v2 (Life Technologies). The original H&E sections were examined by a histopathologist and the same tissue area for Idylla™ testing was selected as was originally tested with the reference standard. Idylla™ testing was carried out retrospectively at the John Radcliffe Hospital in Oxford. The general principles and methods for Idylla™ testing have been described previously . Briefly, formalin-fixed paraffin-embedded (FFPE) tumour tissue was either enriched with macro-dissection (resection specimens) from single 5-μm unstained sections on glass slides or unenriched single 5-μm unstained FFPE rolls (small biopsies) were directly submitted for each test. All Idylla™ testing samples met the minimum requirement of tissue with > 10% tumour nuclei content (no minimum tissue dimensions are specified by the manufacturer but a minimum of 2 mm2 was used in all cases). FFPE tissue for testing was placed between wetted blotting paper inside an Idylla™ cartridge, which was loaded onto the Idylla™ system for processing. The Idylla™ console software auto-analysed the fluorescent amplification signal to report the presence or absence of a mutation. The presence of a mutation was considered a positive Idylla™ test and wild type was considered negative .
The analysis focused on concordance between testing modalities, but also estimated the sensitivity and specificity of the system. Statistical calculations were carried out using standard formulae with Microsoft Excel.
The raw data from the comparison of Idylla™ and reference testing can be found in Table 2. Twelve cases were biopsies, 28 were resections. There were two cases of squamous cell carcinoma and 38 cases of adenocarcinoma. There was agreement between Idylla™ and standard testing in 37 of the 40 cases giving an overall concordance of 92.5% (95% CI 80.14% to 97.42%) (Table 3). The estimated technical sensitivity given this was 85% (95% CI 63.96% to 94.76%), while the estimated technical specificity was 100% (95% CI 83.89% to 100%).
Idylla™ agreed with standard testing in all 34 PCR reference-tested cases (14 of 23 therascreen cases mutant, two of 11 cobas cases mutant), giving 100% concordance (95% CI 89.85% to 100%) with routine (cobas/therascreen) PCR.
The NGS (AmpliSeq) cohort was only six cases (four mutant cases, two wild-type cases), making a subgroup statistical analysis of these of limited value, however, of note was there were three discordant cases. The concordance of Idylla with NGS therefore was only 50%. The three samples were small lung biopsies from lung adenocarcinoma, all of which were called mutant by NGS (see Table 2). The codon changes detected by NGS but designated wild type by Idylla™ in the three cases were exon 20 T790M (low level 4%), exon 20 S768I and exon 21 L861Q (low level 2%). One of the three cases (same case as T790M mutation) also had an incidental exon 18 E709_T710delinsD detected by NGS. This mutation is not covered by the Idylla panel and was considered to be of no clinical importance.
EGFR testing is now an integral part of respiratory pathology practice  and the clinical demand for urgent (i.e. fast) testing in these patients with a short median survival time is understandably high . The approach to molecular diagnostics for lung cancer differs from centre to centre. In addition to EGFR, ALK-rearrangement testing is also routine and there are a number of targeted therapies for tumours harbouring the EML4-ALK fusion gene . PD-1/PD-L1 and ROS1 are now also becoming routine [24, 25]. Some centres perform both EGFR and ALK testing and some centres are using the more widely available KRAS testing options to compliment screening (KRAS mutations are generally mutually exclusive with EGFR and ALK mutations, reducing the number of EGFR/ALK tests needed). Many laboratories find this easier as lung cancer cases can be batched with other (e.g. colorectal cancer) cases undergoing KRAS testing, rather than waiting for sufficient EGFR or ALK testing samples. Practice is variable, however, and guidelines are not yet fully established for KRAS testing . For centres, using the RAS testing approach, the Idylla™ KRAS Mutation Test could be integrated into this protocol—although accuracy data for the test in this tissue needs to be generated. ALK, PD-1/PD-L1 and ROS1 testing are not yet available on the Idylla™ platform, however more traditional approaches (immunohistochemistry and/or fluorescence in situ hybridization techniques) already work well [21, 24, 25].
In this study, we evaluated the Idylla™ platform for EGFR testing in a representative range of lung cancer histopathology FFPE specimens. This is the first such study to do this for the now commercially available CE-IVD approved for clinical use Idylla™ EGFR Mutation Test. The results demonstrate high agreement (92.5%) with commonly used molecular tests, although there were three discordant test results. The Idylla™ also showed high estimated specificity (100%) for EGFR mutation detection, although this finding is limited by a small sample size and non-random case selection.
There were three discordant cases in this study and this affected the concordance and overall sensitivity of the test. All three cases had EGFR mutations that are covered by the Idylla panel. These results were at odds with those reported by others for EGFR and Idylla in general and were initially surprising [16, 18]. These results can be explained methodologically. The comparisons were performed on small biopsies with very limited tissue remaining in the block at the time of Idylla™ testing. A pre-Idylla testing H&E was not prepared in order to preserve tissue for the assay, but the original H&E section before NGS testing showed greater than 40% tumour nuclei in all three cases. A follow-up H&E section was cut and stained for the three discordant cases after Idylla testing and these showed that in all three blocks, there were no tumour cells remaining. It is likely that in these cases, there was no tumour DNA present in the samples assayed and that these results do not reflect true discordance. The data could have been improved with a greater number of NGS cases for comparison, but unfortunately, in this small evaluation, there was no funding to cover this. The power of the results could be improved by excluding NGS cases from the statistical analysis altogether; however, it was preferred by the authors to openly publish all data—the inference of the exclusion can still be drawn in the subgroup analysis of the results for PCR alone. This does show the high concordance of Idylla™ with routine PCR.
Although the discordant results were likely due to methodological limitations, some evaluation of the clinical relevance of these (if true discordances) can be speculated. The exon 21 mutation was present at a level of only 2% in the NGS assay and the exon 20 T790M mutation was only detected at 4%; therefore, it is unlikely that cobas or therascreen PCR (the more commonly used assays) would have detected these either. Clinical trial data are limited on the response to initial therapy in patients with these three mutations and so it is not clear if the discordance with Idylla™ is clinically important in these samples anyway [9, 26,27,28,29,30]. Furthermore, T790 is generally more important as a resistance mutation, following EGFR-TKi therapy .
The Idylla™ EGFR Mutation Test compared with cobas and therascreen PCR assays alone (34 cases) showed 100% concordance. Thus, if NGS cases were excluded from the analysis, this gives an estimated technical sensitivity and specificity of 100%. The main aim of this study was to compare the Idylla with routine PCR because this is probably still the most widely used methodology in Europe (NGS panels are rarely CE approved). The results demonstrate that Idylla is at least as good as the standard care CE–marked testing that is in common use. In light of the fact that the majority of centres are probably still using PCR-based tests, it can be said that the Idylla™ EGFR Mutation Test performs equally well as standard care tests for the majority of common and well-characterised lung cancer EGFR mutations. The system also offers significant advantages in terms of turn-around times. With the future shift to NGS being extremely likely, some centres may opt for a rapid PCR-based EGFR screening test initially in urgent cases and follow this up with NGS later. In this scenario, the Idylla™ would be best suited.
NICE primarily recommends using FFPE tumour biopsy tissue for EGFR testing, but acknowledges that often these samples are very small and that testing cytological material may be useful where no tissue is available after the histological assessment has been carried out . A larger study that includes cytological and fresh tissue samples with Idylla™ may therefore be warranted. NICE does not specifically comment on the financial implications of different testing modalities. The Idylla™ EGFR Mutation Test costs around £170 per test (Europe-wide average, depending on pricing structure) and is therefore comparable with most conventional EGFR PCR assays. In comparison, the cost of NGS gene panels is currently around £300. Therefore, depending on the local arrangements, Idylla™ could potentially reduce costs for some institutions, but for others, this might not be cost effective and the additional financial commitment would need to be balanced against the clinical benefits of reduced turn-around time (which may also be cost saving). A full health economics evaluation of molecular testing in lung cancer could be very helpful.
CRUK. Lung cancer statistics. Available from: http://www.cancerresearchuk.org/health-professional/cancer-statistics/statistics-by-cancer-type/lung-cancer. (cited 2018 March 1st)
Chen Z, Fillmore CM, Hammerman PS, Kim CF, Wong K-K (2014) Non-small-cell lung cancers: a heterogeneous set of diseases. Nat Rev Cancer 14(8):535–546
Lynch TJ, Bell DW, Sordella R, Gurubhagavatula S, Okimoto RA, Brannigan BW, Harris PL, Haserlat SM, Supko JG, Haluska FG, Louis DN, Christiani DC, Settleman J, Haber DA (2004) Activating mutations in the epidermal growth factor receptor underlying responsiveness of non–small-cell lung Cancer to Gefitinib. N Engl J Med 350(21):2129–2139
Ellison G, Zhu G, Moulis A, Dearden S, Speake G, McCormack R (2012) EGFR mutation testing in lung cancer: a review of available methods and their use for analysis of tumour tissue and cytology samples. J Clin Pathol
NICE. EGFR-TK mutation testing in adults with locally advanced or metastatic non-small-cell lung cancer. Available from: https://www.nice.org.uk/guidance/dg9/chapter/3-Clinical-need-and-practice. (cited 2018, March 1st)
Thermo Fisher Scientific Inc. Ion AmpliSeq™ Cancer Hotspot Panel v2. Available from: http://www.thermofisher.com/order/catalog/product/4475346. (cited 2016, November 28th)
Biocartis. About Idylla. Available from: https://www.biocartis.com/idylla. (cited 2016, November 28th)
Thermo Fisher Scientific Inc. Ion Torrent. Available from: https://www.thermofisher.com/uk/en/home/brands/ion-torrent.html. (cited 2016, November 28th)
Biocartis. Idylla™ EGFR Mutation Assay (CE-IVD). Available from: https://biocartis.com/idylla-egfr-mutation-test. (cited 2018, March 1st)
Colling R, Wang LM, Soilleux E (2016) Automated PCR detection of BRAF mutations in colorectal adenocarcinoma: a diagnostic test accuracy study. J Clin Pathol 69(5):398-402. https://doi.org/10.1136/jclinpath-2015-203345
Solassol J, Vendrell J, Markl B, Haas C, Bellosillo B, Montagut C, Smith M, O'Sullivan B, D'Haene N, Le Mercier M, Grauslund M, Melchior LC, Burt E, Cotter F, Stieber D, Schmitt FL, Motta V, Lauricella C, Colling R, Soilleux E, Fassan M, Mescoli C, Collin C, Pages JC, Sillekens P (2016) Multi-center evaluation of the fully automated PCR-based Idylla KRAS mutation assay for rapid KRAS mutation status determination on formalin-fixed paraffin-embedded tissue of human colorectal Cancer. PLoS One 11(9):e0163444
de Biase D, de Luca C, Gragnano G, Visani M, Bellevicine C, Malapelle U, Tallini G, Troncone G (2016) Fully automated PCR detection of KRAS mutations on pancreatic endoscopic ultrasound fine-needle aspirates. J Clin Pathol. https://doi.org/10.1136/jclinpath-2016-203696
Harlé A, Salleron J, Franczak C, Dubois C, Filhine-Tressarieu P, Leroux A, Merlin JL (2016) Detection of BRAF mutations using a fully automated platform and comparison with high resolution melting, real-time allele specific amplification, immunohistochemistry and next generation sequencing assays, for patients with metastatic melanoma. PLoS One 11(4):e0153576
Janku F, Huang HJ, Claes B, Falchook GS, Fu S, Hong D, Ramzanali NM, Nitti G, Cabrilo G, Tsimberidou AM, Naing A, Piha-Paul SA, Wheler JJ, Karp DD, Holley VR, Zinner RG, Subbiah V, Luthra R, Kopetz S, Overman MJ, Kee BK, Patel S, Devogelaere B, Sablon E, Maertens G, Mills GB, Kurzrock R, Meric-Bernstam F (2016) BRAF Mutation Testing in Cell-Free DNA from the Plasma of Patients with Advanced Cancers Using a Rapid, Automated molecular diagnostics system. Mol Cancer Ther 15(6):1397–1404
Schiefer AI, Parlow L, Gabler L, Mesteri I, Koperek O, von Deimling A, Streubel B, Preusser M, Lehmann A, Kellner U, Pauwels P, Lambin S, Dietel M, Hummel M, Klauschen F, Birner P, Mobs M (2016) Multicenter evaluation of a novel automated rapid detection system of BRAF status in formalin-fixed, paraffin-embedded tissues. J Mol Diagn 18(3):370–377
Uguen A, Troncone G (2018) A review on the Idylla platform: towards the assessment of actionable genomic alterations in one day. J Clin Pathol 71:757–762
Thomas De Montpreville V, Ghigna MR, Lacroix L, Lemoine A, Besse B, Mercier O, Fadel E, Dorfmuller P, Le Chevalier T (2017) EGFR and KRAS molecular genotyping for pulmonary carcinomas: feasibility of a simple and rapid technique implementable in any department of pathology. Pathol Res Pract 213(7):793–798
De Luca C, Gragnano G, Pisapia P, Vigliar E, Malapelle U, Bellevicine C, Troncone G (2017) EGFR mutation detection on lung cancer cytological specimens by the novel fully automated PCR-based Idylla EGFR mutation assay. J Clin Pathol 70(4):295–300
Lambros L, Caumont C, Guibourg B, Barel F, Quintin-Roue I, Marcorelles P, Merlio JP, Uguen A (2017) Evaluation of a fast and fully automated platform to diagnose EGFR and KRAS mutations in formalin-fixed and paraffin-embedded non-small cell lung cancer samples in less than one day. J Clin Pathol 70(6):544–549
Ilie M, Butori C, Lassalle S, Heeke S, Piton N, Sabourin J-C, Tanga V, Washetine K, Long-Mira E, Maitre P, Yazbeck N, Bordone O, Lespinet V, Leroy S, Cohen C, Mouroux J, Marquette CH, Hofman V, Hofman P (2017) Optimization of EGFR mutation detection by the fully-automated qPCR-based Idylla system on tumor tissue from patients with non-small cell lung cancer. Oncotarget 8(61):103055–103062
The Royal College Pathologists. Dataset for lung cancer histopathology reports, 5th edn. Available from: https://www.rcpath.org/resourceLibrary/g048-lungdataset-sep16-pdf.html. (cited 2018, March 1st)
Lindeman NI, Cagle PT, Beasley MB, Chitale DA, Dacic S, Giaccone G, Jenkins RB, Kwiatkowski DJ, Saldivar JS, Squire J, Thunnissen E, Ladanyi M (2013) Molecular testing guideline for selection of lung Cancer patients for EGFR and ALK tyrosine kinase inhibitors: guideline from the College of American Pathologists, International Association for the Study of Lung Cancer, and Association for Molecular Pathology. J Thorac Oncol 8(7):823–859
Sullivan I, Planchard D (2016) ALK inhibitors in non-small cell lung cancer: the latest evidence and developments. Ther Adv Med Oncol 8(1):32–47
Bubendorf L, Büttner R, Al-Dayel F, Dietel M, Elmberger G, Kerr K, López-Ríos F, Marchetti A, Öz B, Pauwels P, Penault-Llorca F, Rossi G, Ryška A, Thunnissen E (2016) Testing for ROS1 in non-small cell lung cancer: a review with recommendations. Virchows Arch 469(5):489–503
Cree IA, Booton R, Cane P, Gosney J, Ibrahim M, Kerr K, Lal R, Lewanski C, Navani N, Nicholson AG, Nicolson M, Summers Y (2016) PD-L1 testing for lung cancer in the UK: recognizing the challenges for implementation. Histopathology 69(2):177–186
My Cancer Genome. EGFR c.2303G>T (S768I) Mutation in lung cancer. Available from: https://www.mycancergenome.org/content/disease/lung-cancer/egfr/348/. (cited 2018, March 1st)
My Cancer Genome. EGFR c.2582T>A (L861Q) Mutation in non-small cell lung cancer. Available from: https://www.mycancergenome.org/content/disease/lung-cancer/egfr/6/. (cited 2018, March 1st)
My Cancer Genome. EGFR c.2369C>T (T790M) Mutation in non-small cell lung cancer. Available from: https://www.mycancergenome.org/content/disease/lung-cancer/egfr/4/. (cited 2018, March 1st)
Masago K, Fujita S, Irisa K, Kim YH, Ichikawa M, Mio T, Mishima M (2010) Good clinical response to gefitinib in a non-small cell lung cancer patient harboring a rare somatic epidermal growth factor gene point mutation; codon 768 AGC > ATC in exon 20 (S768I). Jpn J Clin Oncol 40(11):1105–1109
Mitsudomi T, Yatabe Y (2010) Epidermal growth factor receptor in relation to tumor development: EGFR gene and cancer. FEBS J 277(2):301–308
Pao W, Miller VA, Politi KA, Riely GJ, Somwar R, Zakowski MF, Kris MG, Varmus H (2005) Acquired resistance of lung adenocarcinomas to gefitinib or erlotinib is associated with a second mutation in the EGFR kinase domain. PLoS Med 2(3):e73
Soilleux EJ, Wotherspoon A, Eyre TA, Clifford R, Cabes M, Schuh AH (2016) Diagnostic dilemmas of high-grade transformation (Richter's syndrome) of chronic lymphocytic leukaemia: results of the phase II National Cancer Research Institute CHOP-OR clinical trial specialist haemato-pathology central review. Histopathology 69(6):1066–1076
Eyre TA, Clifford R, Bloor A, Boyle L, Roberts C, Cabes M, Collins GP, Devereux S, Follows G, Fox CP, Gribben J, Hillmen P, Hatton CS, Littlewood TJ, McCarthy H, Murray J, Pettitt AR, Soilleux E, Stamatopoulos B, Love SB, Wotherspoon A, Schuh A (2016) NCRI phase II study of CHOP in combination with ofatumumab in induction and maintenance in newly diagnosed Richter syndrome. Br J Haematol 175(1):43–54
The Idylla™ system was kindly loaned by Biocartis. Biocartis contributed free test cartridges. The authors would like to thank the Department of Histopathology at Birmingham Heartlands Hospital and the Cambridge Human Research Tissue Bank, Addenbrooke’s Hospital, Cambridge, UK, for providing lung cancer samples and the clinical molecular results from NGS testing.
Ethical approval was granted by the National Research and Ethics Service (Ethical Application Reference 04/Q1604/21; Expiry Date 04/06/2021).
Conflict of interest
The authors declare that they have no conflict of interest.
• EGFR testing in lung cancer is now routine and guideline driven, but has long turn-around times
• The Idylla EGFR Mutation Test offers rapid, same-day testing
• This study demonstrates high concordance of Idylla with routine PCR methodologies for molecular testing in lung cancer
• The small number of NGS discordance results was likely due to tissue exhaustion
About this article
Cite this article
Colling, R., Bancroft, H., Langman, G. et al. Fully automated real-time PCR for EGFR testing in non-small cell lung carcinoma. Virchows Arch 474, 187–192 (2019). https://doi.org/10.1007/s00428-018-2486-y
- Lung cancer
- Molecular pathology