Abstract
Background
The relative accuracy of pulsatile photoplethysmography applications (PPG) or handheld (HH) devices compared with the gold standard 12-lead electrocardiogram (ECG) for the diagnosis of atrial fibrillation is unknown.
Methods
Digital databases were searched to identify relevant articles. Raw data were pooled using a bivariate model to calculate diagnostic accuracy measures and estimate Hierarchical Summary Receiver Operating Characteristic (HSROC).
Results
A total of 10 articles comprising 4296 patients (mean age 68.9 years, with 56% males) were included in the analysis. Compared with EKG, the pooled sensitivity of PPG and HH devices in AF detection was 0.93 (95% CI 0.87–0.96; p < 0.05) and 0.87 (95% CI. 0.74–0.94; p < 0.05), respectively. The pooled specificity of PPG and HH devices in AF detection was 0.91 (95% CI 0.88–0.94; p < 0.05) and 0.96 (95% CI 0.90–0.98; p < 0.05), respectively. The diagnostic odds ratio was 129 and 144 for PPG and HH devices, respectively. Fagan’s nomogram showed the probability of a patient having AF and normal rhythm on PPG or HH devices was 2–3%, while the post-test probability of having AF with an irregular R-R interval on PPG or HH devices was 73% and 82%, respectively. The scatter plot of positive and negative likelihood ratio showed high confirmation of AF and reliability of exclusion of absence of irregular R-R intervals (positive likelihood ratio > 10, and negative likelihood ratio < 0.1) on HH devices while PPG was used as confirmation only.
Conclusions
The PPG or HH devices can serve as a reliable alternative for the detection of AF.
Similar content being viewed by others
References
Fitzmaurice DA, Hobbs FD, Jowett S, et al. Screening versus routine practice in detection of atrial fibrillation in patients aged 65 or over: cluster randomised controlled trial. BMJ. 2007;335(7616):383.
Krijthe BP, Kunst A, Benjamin EJ, et al. Projections on the number of individuals with atrial fibrillation in the European Union, from 2000 to 2060. Eur Heart J. 2013;34(35):2746–51.
Lowres N, Neubeck L, Redfern J, Freedman SB. Screening to identify unknown atrial fibrillation A systematic review. Thromb Haemost. 2013;110(2):213–22.
Wolf PA, Abbott RD, Kannel WB. Atrial fibrillation as an independent risk factor for stroke: the Framingham Study. Stroke. 1991;22(8):983–8.
Camm AJ, Lip GY, De Caterina R et al. (2012) 2012 focused update of the ESC Guidelines for the management of atrial fibrillation: an update of the 2010 ESC Guidelines for the management of atrial fibrillation. Developed with the special contribution of the European Heart Rhythm Association. Eur Heart J, 33(21), 2719–2747.
Wiesel J, Arbesfeld B, Schechter D. Comparison of the Microlife blood pressure monitor with the Omron blood pressure monitor for detecting atrial fibrillation. Am J Cardiol. 2014;114(7):1046–8.
O’Sullivan JW, Grigg S, Crawford W, et al. Accuracy of smartphone camera applications for detecting atrial fibrillation: a systematic review and meta-analysis. JAMA Netw Open. 2020;3(4):e202064–e202064.
Svennberg E, Engdahl J, Al-Khalili F, Friberg L, Frykman V, Rosenqvist M. Mass screening for untreated atrial fibrillation: the STROKESTOP study. Circulation. 2015;131(25):2176–84.
Allen J. Photoplethysmography and its application in clinical physiological measurement. Physiol Meas. 2007;28(3):R1-39.
Kearley K, Selwood M, Van den Bruel A et al. Triage tests for identifying atrial fibrillation in primary care: a diagnostic accuracy study comparing single-lead ECG and modified BP monitors. BMJ Open, 4(5), e004565 (2014).
Brasier N, Raichle CJ, Dörr M, et al. Detection of atrial fibrillation with a smartphone camera: first prospective, international, two-centre, clinical validation study (DETECT AF PRO). Europace. 2019;21(1):41–7.
Rubinstein ML, Kraft CS, Parrott JS. Determining qualitative effect size ratings using a likelihood ratio scatter matrix in diagnostic test accuracy systematic reviews. Diagnosis (Berl). 2018;5(4):205–14.
Higgins JPT, Altman DG, Gøtzsche PC et al. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ, 343, d5928 (2011).
Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. Bmj. 2003;327(7414):557–60.
Galbraith RF. Some applications of radial plots. J Am Stat Assoc. 1994;89(428):1232–42.
Deeks JJ, Macaskill P, Irwig L. The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed. J Clin Epidemiol. 2005;58(9):882–93.
Fagan TJ. Letter: Nomogram for Bayes theorem. N Engl J Med. 1975;293(5):257.
Whiting PF, Rutjes AW, Westwood ME, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011;155(8):529–36.
Desteghe L, Raymaekers Z, Lutin M, et al. Performance of handheld electrocardiogram devices to detect atrial fibrillation in a cardiology and geriatric ward setting. Europace. 2017;19(1):29–39.
Chan PH, Wong CK, Pun L, et al. Head-to-head comparison of the AliveCor heart monitor and microlife WatchBP office AFIB for atrial fibrillation screening in a primary care setting. Circulation. 2017;135(1):110–2.
Mortelmans C, Van Haelst R, Van Der Auwera J, Grieten L, Vandervoort P, Vaes B. 180Validation of a new smartphone application for the diagnosis of atrial fibrillation in primary care. EP Europace, 19(suppl_3), iii16-iii16 (2017).
Tang S-C, Huang P-W, Hung C-S, et al. Identification of atrial fibrillation by quantitative analyses of fingertip photoplethysmogram. Sci Rep. 2017;7:45644–45644.
Giebel GD, Gissel C. Accuracy of mHealth devices for atrial fibrillation screening: systematic review. JMIR Mhealth Uhealth. 2019;7(6):e13641. Published 2019 Jun 16.
Osca Asensi J, Izquierdo de Francisco MT, Cano Pérez Ó et al. The RITHMI study: diagnostic ability of a heart rhythm monitor for automatic detection of atrial fibrillation. Revista espanola de cardiologia (English ed.), (2020).
Tieleman RG, Plantinga Y, Rinkes D, et al. Validation and clinical use of a novel diagnostic device for screening of atrial fibrillation. Europace. 2014;16(9):1291–5.
Haverkamp HT, Fosse SO, Schuster P. Accuracy and usability of single-lead ECG from smartphones - a clinical study. Indian Pacing Electrophysiol J. 2019;19(4):145–9.
Rozen G, Vaid J, Hosseini SM, et al. Diagnostic accuracy of a novel mobile phone application for the detection and monitoring of atrial fibrillation. Am J Cardiol. 2018;121(10):1187–91.
Wegner FK, Kochhäuser S, Ellermann C, et al. Prospective blinded Evaluation of the smartphone-based AliveCor Kardia ECG monitor for Atrial Fibrillation detection: the PEAK-AF study. Eur J Intern Med. 2020;73:72–5.
Glas AS, Lijmer JG, Prins MH, Bonsel GJ, Bossuyt PM. The diagnostic odds ratio: a single indicator of test performance. J Clin Epidemiol. 2003;56(11):1129–35.
Stengel D, Bauwens K, Sehouli J, Ekkernkamp A, Porzsolt F. A likelihood ratio approach to meta-analysis of diagnostic studies. J Med Screen. 2003;10(1):47–51.
Naccarelli GV, Varker H, Lin J, Schulman KL. Increasing prevalence of atrial fibrillation and flutter in the United States. Am J Cardiol. 2009;104(11):1534–9.
Ashburner JM, Atlas SJ, McManus DD, Chang Y, Trisini Lipsanopoulos AT, Borowsky LH, Guan W, He W, Ellinor PT, Singer DE, Lubitz SA. Design and rationale of a pragmatic trial integrating routine screening for atrial fibrillation at primary care visits: the VITAL-AF trial. Am Heart J. 2019;215:147–56. https://doi.org/10.1016/j.ahj.2019.06.011.
O’Sullivan JW, Muntinga T, Grigg S, Ioannidis JPA. Prevalence and outcomes of incidental imaging findings: umbrella review. BMJ, 361, k2387 (2018).
O’Sullivan JW, Heneghan C, Perera R et al. Variation in diagnostic test requests and outcomes: a preliminary metric for OpenPathology.net. In: Sci Rep. (Ed.^(Eds) (2018) 4752.
O’Sullivan JW, Stevens S, Hobbs FDR et al. Temporal trends in use of tests in UK primary care, 2000–15: retrospective analysis of 250 million tests. Bmj, 363, k4666 (2018).
Wong KC, Klimis H, Lowres N, von Huben A, Marschner S, Chow CK. Diagnostic accuracy of handheld electrocardiogram devices in detecting atrial fibrillation in adults in community versus hospital settings: a systematic review and meta-analysis. Heart. 2020;106(16):1211–7.
Chan PH, Wong CK, Poh YC et al. Diagnostic performance of a smartphone-based photoplethysmographic application for atrial fibrillation screening in a primary care setting. J Am Heart Assoc, 5(7) (2016).
Yan BP, Lai WHS, Chan CKY et al. Contact-free screening of atrial fibrillation by a smartphone using facial pulsatile photoplethysmographic signals. J Am Heart Assoc, 7(8) (2018).
Osca Asensi J, Izquierdo de Francisco MT, Cano Pérez Ó et al. The RITHMI study: diagnostic ability of a heart rhythm monitor for automatic detection of atrial fibrillation. Rev Esp Cardiol (Engl Ed), (2020).
Koltowski L, Balsam P, Glłowczynska R, Rokicki JK, Peller M, Maksym J, Blicharz L, Maciejewski K, Niedziela M, Opolski G, Grabowski M. Kardia Mobile applicability in clinical practice: a comparison of Kardia Mobile and standard 12-lead electrocardiogram records in 100 consecutive patients of a tertiary cardiovascular care center. Cardiol J. 2019
Lowres N, Neubeck L, Salkeld G, Krass I, McLachlan AJ, Redfern J, Bennett AA, Briffa T, Bauman A, Martinez C, Wallenhorst C, Lau JK, Brieger DB, Sy RW, Freedman SB. Feasibility and cost-effectiveness of stroke prevention through community screening for atrial fibrillation using iPhone ECG in pharmacies. The SEARCH-AF study. Thromb Haemost. 2014
William AD, Kanbour M, Callahan T, Bhargava M, Varma N, Rickard J, Saliba W, Wolski K, Hussein A, Lindsay BD, Wazni OM, Tarakji KG. Assessing the accuracy of an automated atrial fibrillation detection algorithm using smartphone technology: The iREAD Study. Heart Rhythm. 2018
Lau JK, Lowres N, Neubeck L, et al. iPhone ECG application for community screening to detect silent atrial fibrillation: a novel technology to prevent stroke. Int J Cardiol. 2013;165(1):193–4.
Nathan HL, Duhig K, Vousden N, et al. Evaluation of a novel device for the management of high blood pressure and shock in pregnancy in low-resource settings: study protocol for a stepped-wedge cluster-randomised controlled trial (CRADLE-3 trial). Trials. 2018;19(1):206.
Desteghe L, Heidbuchel H. Performance of handheld electrocardiogram devices to detect atrial fibrillation in a cardiology and geriatric ward setting: authors’ response. Europace. 2017;19(8):1408–9.
Wasserlauf J, You C, Patel R, Valys A, Albert D, Passman R. Smartwatch performance for the detection and quantification of atrial fibrillation. Circulation: Arrhythmia and Electrophysiology, 12(6), e006834 (2019).
Abushouk AI. Evolution of Fagan’s nomogram; a commentary. Emerg (Tehran). 2016;4(3):114–5.
Turakhia MP, Desai M, Hedlin H, et al. Rationale and design of a large-scale, app-based study to identify cardiac arrhythmias using a smartwatch: the Apple Heart study. Am Heart J. 2019;207:66–75.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Highlights
• The present study is the largest evidence on the diagnostic accuracy of the smartphone app-based pulsatile photoplethysmography (PPG) or handheld (HH) devices used in the screening of atrial fibrillation (AF).
• PPG or HH devices have a very high sensitivity and specificity for detecting an irregular R-R interval (AF).
• Smartphone app-based PPG and HH devices have high diagnostic yield with high PLR and NLR.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Sattar, Y., Song, D., Sarvepalli, D. et al. Accuracy of pulsatile photoplethysmography applications or handheld devices vs. 12-lead ECG for atrial fibrillation screening: a systematic review and meta-analysis. J Interv Card Electrophysiol 65, 33–44 (2022). https://doi.org/10.1007/s10840-021-01068-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10840-021-01068-x