Skip to main content
Log in

Pool testing with dilution effects and heterogeneous priors

  • Published:
Health Care Management Science Aims and scope Submit manuscript

Abstract

The Dorfman pooled testing scheme is a process in which individual specimens (e.g., blood, urine, swabs, etc.) are pooled and tested together; if the merged sample tests positive for infection, then each specimen from the pool is tested individually. Through this procedure, laboratories can reduce the expected number of tests required to screen the population, as individual tests are only carried out when the pooled test detects an infection. Several different partitions of the population can be used to form the pools. In this study, we analyze the performance of ordered partitions, those in which subjects with similar probability of infection are pooled together. We derive sufficient conditions under which ordered partitions outperform other types of partitions in terms of minimizing the expected number of tests, the expected number of false negatives, and the expected number of false positive classifications. These sufficient conditions can be easily verified in practical applications once the dilution effect has been estimated. We also propose a measure of equity and present conditions under which this measure is maximized by ordered partitions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Notes

  1. Bateman et al. [9] estimate that the probability of detecting COVID-19 from an infected subject is 6% lower when his sample is diluted with the sample of 4 healthy subjects. The percentage reduction in the precision of the test is 8% when the infected sample is further diluted with 9 non-infected samples, and 18% when the infected sample is diluted with 49 non-infected specimens.

  2. See Section 9 for details.

  3. Details provided in the online Appendix.

  4. Hrayer et al. [5] had previously shown that, when all the pools have the same size \(k\ge 2\), and the following condition holds

    $$\begin{aligned} I\frac{\partial ^2 h(I,k)}{\partial I^2}+2 \frac{\partial h(I,k)}{\partial I}\ge 0\quad \forall I\in [0,k], \end{aligned}$$

    then grouping subjects according to an ordered partition minimizes the expected number of false negatives. In the online Appendix we show that this condition implies that hypothesis 1 holds, but the converse is not necessarily true.

  5. The number of different partitions from a set S of 20 individuals is approximately \(5.17e+13\).

  6. Hrayer et al. [4] shows that the number of different ordered partitions of S is \(2^{|S|-1}\).

  7. Indeed, consider \(u=(u_1,u_2,u_3,u_4)=(1,1,2,4)\) and \(u=(\tilde{u_1},\tilde{u_2},\tilde{u_3},\tilde{u_4})=(36/37,36/37,3,3)\). Then clearly \(\min u_i>\min \tilde{u_i}\) and \(\sum u_i>\sum \tilde{u_i}\). However \(\sum \frac{u_i^{1-\alpha }}{1-\alpha }<\sum \frac{\tilde{u_i}^{1-\alpha }}{1-\alpha }\) for \(\alpha =2\).

  8. For simplification, this measure does not incorporate health-related reduction in quality of life, nor costs associated with transmissions that a true positive would have averted.

  9. https://wonder.cdc.gov/std-race-age.html

  10. In part, many end up not being screened because they exhibit no symptoms: approximately 75% of women and 50% of infected men exhibit no symptoms [14].

  11. Having a large number of subjects being tested helps to smooth out the graphs for instances in which n is not a multiple of k.

  12. For simplification, our approach does not incorporate costs associated with transmissions that a true positive would have averted.

  13. If the dilution effect is too strong, pool testing may be deemed too imprecise to be considered as a good alternative to individual testing.

References

  1. Alcalde R, Melo FL, Nishiya A et al (2009) Distribution of hepatitis B virus genotypes and viral load levels in Brazilian chronically infected patients in São Paulo city. Rev. Inst. Med. trop. S. Paulo 51(5):269–272

    Article  Google Scholar 

  2. Samuel A, Magnus C (2012) Modelling the Course of an HIV Infection: Insights from Ecology and Evolution.. Viruses (1999-4915) 4(10):1984 – 2013 https://search-ebscohost-com.pucdechile.idm.oclc.org/login.aspx?direct=true &db=fsr &AN=82876502 &lang=es &site=ehost-live

  3. Shane A, Bradley F, Long J, Barry J, Thornton L, Parry JV (2000) Prevalence of antibodies to hepatitis B, hepatitis C, and HIV and risk factors in Irish prisoners: results of a national cross sectional survey. BMJ 321(7253):78–82. https://doi.org/10.1136/bmj.321.7253.78

    Article  Google Scholar 

  4. Hrayer A, Bish DR, Bish EK (2019) Optimal Risk-Based Group Testing. Management Science 65(9):4365–4384

    Article  Google Scholar 

  5. Hrayer A, Bish EK, Bish DR (2018) Adaptive risk-based pooling in public health screening. IISE Transactions 50(9):743–766

    Google Scholar 

  6. Hrayer A, Bish EK, Bish DR (2020) Static Risk-Based Group Testing Schemes Under Imperfectly Observable Risk. Stochastic Systems 10(4):361–390

    Article  Google Scholar 

  7. Leonardo JB, Goic M, Olivares M et al (2023) Analytics Saves Lives During the COVID-19 Crisis in Chile. INFORMS J Appl Anal 53(1):9–31. https://doi.org/10.1287/inte.2022.1149

    Article  Google Scholar 

  8. Leonardo B, Salinas V, Sauré D, Thraves C, Yankovic N (2022) The Effect of Correlation and False Negatives in Pool Testing Strategies for COVID-19. Healthcare Management Science 25:146–165

    Article  Google Scholar 

  9. Allen CB, Mueller S, Guenther K, Shult P (2020) Assessing the dilution effect of specimen pooling on the sensitivity of SARS-CoV-2 PCR tests. J Med Virol. https://doi.org/10.1002/jmv.26519

    Article  Google Scholar 

  10. Dimitris B, Farias VF, Trichakis N (2012) On the Efficiency-Fairness Trade-off. Manag Sci 58(12):2234–2250

    Google Scholar 

  11. Birkmeyer JD, Goodnough LT, AuBuchon JP, Noordsij PG, Littenberg B (1993) The cost-effectiveness of preoperative autologous blood donation for total hip and knee replacement. Transfusion 33(7):544–551. https://doi.org/10.1046/j.1537-2995.1993.33793325048.x

    Article  Google Scholar 

  12. Walter B, Kamaga K (2020) An axiomatization of the mixed utilitarian-maximin social welfare orderings. Economic Theory 69(2):451–473 https://EconPapers.repec.org/RePEc:spr:joecth:v:69:y:2020:i:2:d:10.1007_s00199-018-1168-y

  13. Burns KC, Mauro CA (1987) Group testing with test error as a function of concentration. Communications in Statistics-theory and Methods 16:2821–2837

    Article  Google Scholar 

  14. Centers for Disease Control and Prevention. (2000) Tracking the hidden epidemics, trends in STDs in the United States. https://www.cdc.gov/std/trends2000/trends2000.pdf

  15. Centers for Disease Control and Prevention. (2019) Sexually Transmitted Infections Treatment Guidelines, 2021 https://www.cdc.gov/std/treatment-guidelines/chlamydia.htm

  16. Centers for Disease Control and Prevention. (2019) Viral Hepatitis Surveillance Report United States https://www.cdc.gov/hepatitis/statistics/2019surveillance/pdfs/2019HepSurveillanceRpt.pdf

  17. Chahal HS, Peters MG, Harris AM, McCabe D, Volberding P, Kahn JG (2018) Cost-effectiveness of Hepatitis B Virus Infection Screening and Treatment or Vaccination in 6 High-risk Populations in the United States. Open Forum Infectious Diseases 6(1):ofy353 https://doi.org/10.1093/ofid/ofy353

  18. Bogdan C (2001) Randomized Communication in Radio Networks, 401–456. https://doi.org/10.1007/978-1-4615-0013-1_11

  19. Dorfman R (1943) The Detection of Defective Members of Large Populations. The Ann Math Stat 14:436–440

    Article  Google Scholar 

  20. Downs LO, Vawda S, Bester PA et al. (2020) Bimodal distribution and set point HBV DNA viral loads in chronic infection: retrospective analysis of cohorts from the UK and South Africa

  21. El-Amine H, Bish EK, Bish DR (2017) Optimal pooling strategies for nucleic acid testing of donated blood considering viral load growth curves and donor characteristics. IISE Trans Healthc Syst Eng 7(1):15–29. https://doi.org/10.1080/19488300.2016.1255285

    Article  Google Scholar 

  22. Wenxin F (2020) Wuhan Tests Nine Million People for Coronavirus in 10 Days. The Wall Street J, https://www.wsj.com/articles/wuhan-tests-nine-million-people-for-coronavirus-in-10-days-11590408910

  23. Goodrich M, Atallah M, Tamassia R (2005) Indexing Information for Data Forensics. vol 3531 p 206–221 Dec https://doi.org/10.1007/11496137_15

  24. Grobe N, Cherif A, Wang X, Dong Z, Kotanko P (2020) Sample pooling: burden or solution? Clin Microbiol Infect

  25. Harsanyi JC (1955) Cardinal Welfare, Individualistic Ethics, and Interpersonal Comparisons of Utility. J Polit Econ 63(4):309–321 http://www.jstor.org/stable/1827128

  26. Hwang FK (1975) A Generalized Binomial Group Testing Problem. J Am Stat Assoc 70:923–926

    Article  Google Scholar 

  27. Hwang FK (1976) Group Testing with a Dilution Effect. Biometrika 63(3):671–673 http://www.jstor.org/stable/2335750

  28. Jackson BR, Busch MP, Stramer SL, AuBuchon JP (2003) The cost-effectiveness of NAT for HIV, HCV, and HBV in whole-blood donations. Transfusion 43(6):721–729. https://doi.org/10.1046/j.1537-2995.2003.00392.x

    Article  Google Scholar 

  29. Kacena KA, Quinn SB, Hartman SC, Quinn TC, Gaydos CA (1998) Pooling of Urine Samples for Screening for Neisseria gonorrhoeae by Ligase Chain Reaction: Accuracy and Application. J Clin Microbiol 36:3624–3628

    Article  Google Scholar 

  30. Kacena KA, Quinn SB, Howell R, Madico GE, Quin TC, Gaydos CA (1998) Pooling Urine Samples for Ligase Chain Reaction Screening for Genital Chlamydia trachomatis Infection in Asymptomatic Women. J Clin Microbiol 36(2):481–485

    Article  Google Scholar 

  31. Hae-Young K, Hudgens MG, Dreyfuss JM, Westreich DJ, Pilcher CD (2007) Comparison of Group Testing Algorithms for Case Identification in the Presence of Test Error. Biometrics 63(4):1152–1163 http://www.jstor.org/stable/4541470

  32. Tian L, Kao D, Chiang M, Sabharwal A (2010) An Axiomatic Theory of Fairness in Network Resource Allocation. In Proceedings IEEE INFOCOM, p 1–9. https://doi.org/10.1109/INFCOM.2010.5461911

  33. Maartens G, Celum C, Lewin SR (2014) HIV infection: epidemiology, pathogenesis, treatment, and prevention. The Lancet vol 71

  34. McMahan CS, Tebbs JM, Bilder CR (2012) Informative Dorfman Screening. Biometrics 68(1):287–296, http://www.jstor.org/stable/41434069

  35. Mokalled SC, McMahan CS, Tebbs JM, Brown DA, Bilder CR (2021) Incorporating the dilution effect in group testing regression. Stat Med 40(11):2540–2555. https://doi.org/10.1002/sim.8916

    Article  Google Scholar 

  36. Morre SA, Chris J, Meijer LM, Munk C, Kruger-Kjaer S, Winther JF, Jørgensens HO, Adriaan JC, Brule VD (2000) Pooling of Urine Specimens for Detection of Asymptomatic Chlamydia trachomatis Infections by PCR in a Low-Prevalence Population: Cost-Saving Strategy for Epidemiological Studies and Screening Programs. J Clin Microbiol 38:1679–1680

    Article  Google Scholar 

  37. Nemhauser G, Wolsey L (1998) Integer and Combinatorial Optimization. Wiley

    Google Scholar 

  38. Nguyen NT, Aprahamian H, Bish EK, Bish DR (2019) A Methodology for Deriving the Sensitivity of Pooled Testing, Based on Viral Load Progression and Pooling Dilution. J Transl Med 17(1):1152–1163

    Article  Google Scholar 

  39. Owusu-Edusei K Jr, Chesson HW, Gift TL, Brunham RC, Bolan G (2015) Cost-effectiveness of Chlamydia Vaccination Programs for Young Women. Emerging infectious diseases 21(6):960–968. https://doi.org/10.3201/eid2106.141270

    Article  Google Scholar 

  40. Rawls J (1971) A theory of justice. The Belknap Press of Harvard University Press

  41. Schneider M, Byung-Cheol K (2020) The utilitarian-maximin social welfare function and anomalies in social choice. South Econ J 87(2):629–646. https://doi.org/10.1002/soej.12464

    Article  Google Scholar 

  42. Smith JM, Uvin AZ, Macmadu A, Rich JD (2017) Epidemiology and Treatment of Hepatitis B in Prisoners. Current Hepatology Reports 16(1) https://doi.org/10.1007/s11901-017-0364-8

  43. Sobel M, Groll PA (1959) Group testing to eliminate efficiently all defectives in a binomial sample. The Bell Syst Tech J 38(5):1179–1252. https://doi.org/10.1002/j.1538-7305.1959.tb03914.x

    Article  Google Scholar 

  44. Wang D, McMahan CS, Gallagher CM (2015) A general regression framework for group testing data, which incorporates pool dilution effects. Stat Med 34:3606–3621. https://doi.org/10.1002/sim.6578

    Article  Google Scholar 

  45. Warasi MS, McMahan C, Tebbs J, Bilder CR (2017) Group Testing Regression Models with Dilution Submodels. Stat Med 36(30):4860–4872

    Article  Google Scholar 

  46. Wein LM, Zenio SA (1996) Pooled testing for HIV screening: capturing the dilution effect. Oper Res 44(4):543-569

    Article  Google Scholar 

  47. World Health Organization (2017) Global Hepatitis Report , https://www.who.int/publications/i/item/global-hepatitis-report-2017

  48. Yapali S, Talaat N, Lok AS (2014) Management of Hepatitis B: Our Practice and How It Relates to the Guidelines. Clin Gastroenterol Hepatol 12:16–26. https://doi.org/10.1016/j.cgh.2013.04.036

    Article  Google Scholar 

  49. Yelin I, Aharony N, Tamar ES et al (2020) Evaluation of COVID-19 RT-qPCR Test in Multi sample Pools. Clin Infect Dis 71(16):2073–2078. https://doi.org/10.1093/cid/ciaa531

    Article  Google Scholar 

  50. Shimian Z, Stramer SL, Dodd RY (2012) Donor Testing and Risk: Current Prevalence, Incidence, and Residual Risk of Transfusion-Transmissible Agents in US Allogeneic Donations. Transfus Med Rev 26(2):119–128. https://doi.org/10.1016/j.tmrv.2011.07.007

    Article  Google Scholar 

Download references

Acknowledgements

I am grateful to Dr. Shane Allwright for authorizing the usage of her dataset regarding the prevalence of HBV among Irish prisons’ inmates. I would also like to thank all of those who provided invaluable feedback to this research: especial thanks goes to Luis Martins Abreu, Michael Kuhlman, Joshua M. Tebbs, Paulo Saraiva and two anonymous referees.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Gustavo Quinderé Saraiva.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary file 1 (pdf 204 KB)

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Saraiva, G.Q. Pool testing with dilution effects and heterogeneous priors. Health Care Manag Sci 26, 651–672 (2023). https://doi.org/10.1007/s10729-023-09650-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10729-023-09650-7

Keywords

Navigation