Abstract
Purpose
We developed a simple self-checkable screening tool for chronic prostatitis (S-CP) and internally validated it to encourage men (in the general population) with possible chronic prostatitis to consult urologists.
Methods
The expert panel proposed the S-CP, which comprises three domains: Area of pain or discomfort (6 components), accompanying Symptom (6 components), and Trigger for symptom flares (4 components). We employed logistic regression to predict chronic prostatitis prevalence with the S-CP. We evaluated the predictive performance using data from a representative national survey of Japanese men aged 20 to 84. We calculated the optimism-adjusted area under the curve using bootstrapping. We assessed sensitivity/specificity, likelihood ratio, and predictive value for each cutoff of the S-CP.
Results
Data were collected for 5,010 men—71 (1.4%) had a chronic prostatitis diagnosis. The apparent and adjusted area under the curve for the S-CP was 0.765 [95% confidence interval (CI) 0.702, 0.829] and 0.761 (0.696, 0.819), respectively. When the cutoff was two of the three domains being positive, sensitivity and specificity were 62.0% (95% CI 49.7, 73.2) and 85.4% (95% CI 84.4, 86.4), respectively. The positive/negative likelihood ratios were 4.2 (95% CI 3.5, 5.2) and 0.45 (95% CI 0.33, 0.60), respectively. The positive/negative predictive values were 5.7 (95% CI 4.2, 7.6) and 99.4 (95% CI 99.1, 99.6), respectively.
Conclusion
The reasonable predictive performance of the S-CP indicated that patients (in the general population) with chronic prostatitis were screened as a first step. Further research would develop another tool for diagnostic support in actual clinical settings.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Chronic prostatitis/chronic pelvic pain syndrome (CP), grouped as category III in the National Institutes of Health (NIH) classification, is a common disease in men, with an estimated prevalence of 1.8–9.7% of the male population [1, 2]. CP significantly impairs the quality of life (QOL) and is widely distributed among older adults and young people, who play a central role in economic activities [3]. Therefore, CP is a disease that significantly impacts society [4].
Patients with CP present with various symptoms, primarily pelvic pain, discomfort, and dysuria. However, CP diagnosis is complex. No definitive diagnostic method for CP has been established, and no consensus has been reached regarding its diagnosis. The gold standard is a comprehensive diagnosis by an experienced urologist involving the exclusion of other urological disorders [5]. Consequently, physicians in general practice and urology clinics, who are mainly the primary care providers for patients with CP [6], have been facing challenges in diagnosing and managing this condition and reported confusion and frustration [7, 8].
Moreover, there is concern that a significant number of patients with CP may lack proper diagnosis and treatment. In fact, in our previously published work [3], a survey of the general population depicted that the percentage of participants who reported CP-like symptoms without CP diagnosis was more than double the percentage of those who had been diagnosed with CP at medical institutions (3.7% vs. 1.4%, respectively). Notably, both groups had a significantly impaired QOL. Therefore, it is crucial to provide more patients with CP with the opportunity to receive appropriate treatment by developing simple, self-checkable screening tools to encourage individuals (in the general population) affected by CP to consult a urologist.
In the past 20 years, there have been over 2,000 reports on CP. There has been much discussion on the molecular mechanisms of this intractable disease and how to treat it [9]. Nevertheless, reports to improve diagnostic opportunities have been limited. Several studies have been conducted to estimate the prevalence of CP in the general population using the NIH-Chronic Prostatitis Symptom Index (CPSI) [10]. However, the NIH-CPSI is a tool primarily designed to measure symptom severity in patients with CP, not for screening for actual CP [11].
Therefore, we developed and internally validated the screening tool for CP (S-CP), a self-checkable clinical prediction model (CPM) for CP extraction in the general population, to recommend medical consultation to those who may be affected by CP.
Methods
Study design and population
This study used data from a questionnaire survey distributed electronically via the Nippon Research Center, an independent research company, from January 5 through March 4, 2021. The participants were men aged 20 to 84 years at the time of the survey. Those who could not read or write Japanese were excluded from this study. Data from those who answered all the questions were included in the analysis. The survey was designed to represent the general population of Japan based on quota sampling from the national census in 2015 using quota sampling [12] and continued until the target of 5,000 men was reached at each stratum. The survey details and the target population’s characteristics are described elsewhere [3]. This study was conducted in accordance with the World Medical Association’s Declaration of Helsinki [13]. It was approved by the Institutional Review Board of Kagawa University (approval number: 2020-064) and the Institute for Health Outcomes and Process Evaluation Research (approval number: 202001). All participants provided written informed consent. This study followed the Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD) reporting guidelines [14].
Data collection
The target condition for prediction was the prevalence of CP, defined as having a history of CP diagnosis at a medical facility. Participants who answered “yes” to the question, “Have you ever been diagnosed with CP?” were assigned to the CP group. Additionally, we extracted data on the participants’ background characteristics (e.g., age, comorbidity, and lifestyle) and the predictors for CP prevalence that comprised the CPM described below.
Screening tool for CP (S-CP)
We formed an expert panel comprising two urologists working at a university hospital, one urologist working at a general hospital, two urologists working at a clinic, and three epidemiologists to determine the domains and items that constitute a simple CPM for predicting the prevalence of CP, which was named S-CP. Each domain and its items were then extracted with reference to the RAND/UCLA appropriateness method [15]. Multiple panel meetings were held until a consensus was reached. First, we determined the three key domains in the screening for CP. We then discussed the items which comprised each domain and created an item pool consisting of 23 items. Finally, we selected the 16 critical items that comprised the three domains. We agreed to consider a domain as positive if the participants presented at least one of the items of that domain. Besides, we decided to predict CP prevalence using three dichotomous variables representing each domain. Domain 3 was determined if either domain 1 or domain 2 was positive (i.e., if domains 1 and 2 were negative, domain 3 would also be negative). The different domains and their items are listed below.
Domain 1. “Area” of pain or discomfort (6 items): “area between rectum and testicles (perineum), testicles, urethra of the penis, tip of the penis (not related to urination), below the waist in the pubic or bladder area, groin area.”
Domain 2. Accompanying “Symptom” (6 items): “pain or burning during urination, pain or discomfort during or after sexual climax (ejaculation), hematogenous semen or hematuria, discoloration of semen, premature ejaculation, erectile dysfunction.”
Domain 3. “Trigger” for symptom flares (4 items): “cold, sitting or driving, stimulant intake or alcohol consumption, lack of sleep or stress.”
Statistical analyses
The distribution of background characteristics for all participants was first described. Then, participants with CP were compared to those without CP. Continuous variables were summarized using the median and interquartile range. Dichotomous variables were summarized using numbers and percentages. P-values for differences in characteristics were calculated from the Wilcoxon rank sum test for continuous variables and the Fisher’s exact test for dichotomous variables.
Second, a logistic regression analysis was performed to explain the prevalence of CP with the three variables: “Area” of pain or discomfort, accompanying “Symptom,” and “Trigger” for symptom flares. Each variable’s intercept and regression coefficients were calculated to develop a temporal S-CP. We calculated the area under the curve (AUC) and 95% confidence interval (CI) of the temporal S-CP to estimate the ability for apparent discrimination. Optimism-adjusted AUC and bootstrap shrinkage factor were also calculated using bootstrapping (200 times) [16]. The temporal S-CP was then uniformly shrunk using the bootstrap shrinkage factor [17], and the shrinkage model was referred to as the final version of the S-CP. The risk for each stratum of the final S-CP is illustrated as a risk table. In addition, the sensitivity, specificity, positive/negative likelihood ratio, and positive/negative predictive value were calculated when the cutoff was defined as all the three domains of “Area,” “Symptom,” and “Trigger” being positive. The analysis was also performed when the cutoff was defined as positive for two of the three domains. To assess calibration, we compared the estimated risk of CP using the final S-CP with the observed proportion for each stratum. All data were analyzed using Stata version 17.0 (StataCorp LLC, College Station, TX, USA).
Results
The survey request was distributed to 19,450 men, and 6,671 (34.3%) indicated a willingness to participate. Of these, 5,010 (75.1%) provided complete responses, and their data were analyzed. In total, 71 (1.4%) had a history of CP diagnosis. The distribution of background characteristics for all participants and participants grouped with and without CP is shown in Table 1. Substantial differences were observed between the CP and no-CP groups in the distribution of most items except for the “Groin area” and “Erectile dysfunction” that are part of the S-CP. Differences in the distribution of comorbidity (cardiovascular disease, diabetes, depression, male infertility) were also observed, but there was no marked difference in lifestyle.
The screening tool for CP (S-CP)
The intercept for the temporal S-CP generated via logistic regression analysis was − 5.410, and the regression coefficients for the “Area,” “Symptom,” and “Trigger” were 1.470, 0.989, and 0.778, respectively. The apparent AUC for the temporal S-CP was 0.765 (95% CI 0.702–0.829). The optimism-adjusted AUC calculated by applying bootstrapping was 0.761 (95% CI 0.696–0.819), and the bootstrap shrinkage factor was 0.982. The linear predictor for the final S-CP with uniform shrinkage had an intercept of − 5.377 and regression coefficients of 1.444, 0.972, and 0.764 for the “Area,” “Symptom,” and “Trigger,” respectively.
The risk of CP prevalence for each stratum using the final S-CP is shown in Table 2. When the cutoff was defined as all the three domains of “Area,” “Symptom,” and “Trigger” being positive, the sensitivity and the specificity were 35.2% (95% CI 24.2– 47.5) and 96.1% (95% CI 95.5–96.6), respectively. The positive and negative likelihood ratios were 9.0 (95% CI 6.4–12.6) and 0.67 (95% CI 0.57–0.80). The positive and negative predictive values were 11.4 (95% CI 7.5–16.4) and 99.0 (95% CI 98.7–99.3), respectively. When the cutoff was defined as two of these three domains being positive, the sensitivity and the specificity were 62.0% (95% CI 49.7–73.2) and 85.4% (95% CI 84.4–86.4), respectively. The positive and negative likelihood ratios were 4.2 (95% CI 3.5, 5.2) and 0.45 (95% CI 0.33–0.60), respectively. The positive and negative predictive values were 5.7 (95% CI 4.2–7.6) and 99.4 (95% CI 99.1–99.6), respectively. The final version of the S-CP and the risk table is available in the supplementary material.
Figure 1 shows the expected risk of CP prevalence and the observed CP prevalence in each stratum using the final S-CP. Although no CP prevalence was observed in the strata to which only “Area” was applicable, the expected risk and observed prevalence were generally well-calibrated. The number of participants and patients with CP in each stratum are shown in Supplementary Table 1.
Discussion
In the present study, we developed and internally validated the S-CP, a simple screening tool for CP prevalence in the general population. The discrimination power of CP prevalence using the S-CP is relatively high, with an optimism-adjusted AUC of 0.761 (95% CI 0.696–0.819), indicating that this tool is helpful for the initial screening of patients with CP from the general population. Recommendations for urologist evaluation in high-risk populations identified using the S-CP may facilitate appropriate diagnosis and treatment in patients who may have CP.
CP is not a monogenic disease but rather a heterogeneous syndrome with many aspects, including urinary factors, psychosocial factors, organ specificity, infection, neurogenic/neuropathic factors, and tenderness of skeletal muscles [18,19,20]. CP diagnosis requires sufficient clinical experience and is often problematic, resulting in a significant number of undiagnosed patients in the general population [3, 21]. Therefore, there is an urgent need to provide possible patients with CP with the opportunity to receive appropriate diagnosis and treatment. To achieve this goal, we could first develop a CPM that enables easy self-assessment of the risk of CP prevalence in the general population and subsequently recommends those at high risk to undergo medical examinations with a urologist. The S-CP is a simple and self-checkable tool composed solely of information collected via a questionnaire survey. Considering that CP is a highly multifaceted syndrome, the AUC of 0.761 (95% CI 0.696–0.819) seemed to be an adequate discriminative performance. Therefore, the S-CP is expected to significantly contribute to improving CP care.
For the clinical implementation of the S-CP, consideration of how to recommend medical examination with a urologist is essential. Specifically, it is necessary to decide whether the cutoff for the S-CP should be positive in all three domains or two of the three domains. The negative predictive value is clinically essential since the S-CP is used to screen for possible patients with CP in the general population by self-check. The negative predictive values for the cutoffs of “all the three” and “two of the three” were high [99.0 (95% CI 98.7–99.3) and 99.4 (95% CI 99.1–99.6), respectively]. However, when the cutoff was set to “all the three,” the number of false negatives increased, reaching 46/71 patients.
Therefore, we suggest that “two of the three” should be adopted as the cutoff (27/71 false negatives). When the cutoff was set to “two of the three,” the positive predictive value was only 5.7 (95% CI 4.2–7.6), indicating a high frequency of false positives. In this case, people would be burdened with unnecessary anxiety and the cost of visiting a medical facility. However, we expect many false positives to be diagnosed with other urologic conditions that present similar symptoms to CP. Given the benefit of the S-CP in providing possible patients with CP or those with CP-like conditions to see a urologist, the degree of false positives could be acceptable.
There were several limitations to this study. First, there is a possibility of misclassification for CP prevalence. The determination of CP prevalence was based on self-reports of diagnostic history. Thus, patients diagnosed with acute prostatitis or other similar conditions could have responded that they had a diagnosis of CP. There is no certainty as to the accuracy of the CP diagnosis at each clinic. Moreover, possible patients with CP would be misclassified as having no CP within this study population. However, the prevalence of diagnosed CP cases in the study population (1.4%) was generally consistent with those in previous studies of diagnosed CP cases [2, 11]. Second, the sample size was limited. Although the study population was relatively large (over 5,000), only 71 events were available for analysis because of the low prevalence of CP. More precise prediction might be possible if risk estimation could reflect the associations and interactions among the 16 items of the S-CP. However, this would require a considerable number of patients with CP to be sampled from the general population, which is impractical. Third, external validation is yet to be performed. Although internal validation has been performed, this study is a development study of the S-CP, and external validation is desired for its clinical implementation. In addition, the target population of this study was limited to Japanese individuals, and it is desirable to validate the diagnostic performance of the S-CP in other countries. Finally, the S-CP could not be used for diagnostic support in clinical settings as it was developed for use in the general population. The next step in providing possible patients with CP with the opportunity to receive appropriate diagnosis and treatment is to improve the accuracy of CP diagnosis in actual clinical settings, which could be achieved with another CPM to support CP diagnosis. The prevalence of comorbidities differs between the CP and no-CP groups, likewise in the domains of the S-CP (Table 1). Based on the findings of this study and additional clinically available information, such as physical examination of the abdomen, genitalia, perineum, and prostate [22], we believe that it is possible to develop a CPM to support the diagnosis of CP in actual clinical settings.
In conclusion, we developed and internally validated the S-CP, a simple screening tool for CP prevalence in the general population. Recommendations to see a urologist in high-risk populations identified using the S-CP may enable possible patients with CP to receive timely diagnosis and treatment. Further research is warranted to develop another CPM for diagnostic support in clinical settings.
Data availability
The datasets created and analyzed in this study are not publicly available. Requests for data can be addressed to the corresponding author (MS).
References
Nickel JC, Downey J, Hunter D, Clark J (2001) Prevalence of prostatitis-like symptoms in a population-based study using the National Institutes of Health chronic prostatitis symptom index. J Urol 165:842–845. https://doi.org/10.1016/S0022-5347(05)66541-X
Suskind AM, Berry SH, Ewing BA, Elliott MN, Suttorp MJ, Clemens JQ (2013) The prevalence and overlap of interstitial cystitis/bladder pain syndrome and chronic prostatitis/chronic pelvic pain syndrome in men: results of the rand interstitial cystitis Epidemiology male study. J Urol 189:141–145. https://doi.org/10.1016/j.juro.2012.08.088
Sugimoto M, Hijikata Y, Tohi Y, Kuroda H, Takei M, Matsuki T et al (2022) Low quality of life in men with chronic prostatitis-like symptoms. Prostate Cancer Prostatic Dis 25:785–790. https://doi.org/10.1038/s41391-022-00559-w
Duloy AM, Calhoun EA, Clemens JQ (2007) Economic impact of chronic prostatitis. Curr Urol Rep 8:336–339. https://doi.org/10.1007/s11934-007-0081-x
Rees J, Abrahams M, Doble A, Cooper A, Prostatitis Expert Reference Group (PERG) (2015) Diagnosis and treatment of chronic bacterial prostatitis and chronic prostatitis/chronic pelvic pain syndrome: a consensus guideline. BJU Int 116:509–525. https://doi.org/10.1111/bju.13101
Clemens JQ, Meenan RT, O’Keeffe Rosetti MC, Gao SY, Calhoun EA (2005) Incidence and clinical characteristics of National Institutes of Health type III prostatitis in the community. J Urol 174:2319–2322. https://doi.org/10.1097/01.ju.0000182152.28519.e7
Kiyota H, Onodera S, Ohishi Y, Tsukamoto T, Matsumoto T (2003) Questionnaire survey of Japanese urologists concerning the diagnosis and treatment of chronic prostatitis and chronic pelvic pain syndrome. Int J Urol 10:636–642. https://doi.org/10.1046/j.1442-2042.2003.00720.x
Calhoun EA, Clemens JQ, Litwin MS, Walker-Corkery E, Markossian T, Kusek JW, McNaughton-Collins M (2009) Primary care physician practices in the diagnosis, treatment and management of men with chronic prostatitis/chronic pelvic pain syndrome. Prostate Cancer Prostatic Dis 12:288–295. https://doi.org/10.1038/pcan.2009.9
Chen Q, Feng J, Liu Z, An D, Li Y, Zhou S, Weng Z (2021) Research trends of prostatitis over past 20 years: a bibliometric analysis. Andrologia 53:e14206. https://doi.org/10.1111/and.14206
Litwin MS, McNaughton-Collins M, Fowler FJ Jr, Nickel JC, Calhoun EA, Pontari MA et al (1999) The National Institutes of Health chronic prostatitis symptom index: development and validation of a new outcome measure. Chronic prostatitis Collaborative Research network. J Urol 162:369–375. https://doi.org/10.1016/s0022-5347(05)68562-x
Roberts RO, Jacobson DJ, Girman CJ, Rhodes T, Lieber MM, Jacobsen SJ (2004) Low agreement between previous physician diagnosed prostatitis and National Institutes of Health chronic prostatitis symptom index pain measures. J Urol 171:279–283. https://doi.org/10.1097/01.ju.0000100088.70887.29
Ministry of internal affairs and communications (2015). The 2015 population census. https://www.stat.go.jp/data/kokusei/2015/ Accessed Jun 26, 2023. Statistics Bureau of Japan
World Medical Association (2013) World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. JAMA 310:2191–2194. https://doi.org/10.1001/jama.2013.281053
Collins GS, Reitsma JB, Altman DG, Moons KG (2015) Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. Ann Intern Med 162:55–63. https://doi.org/10.7326/M14-0697
Brook RH, Chassin MR, Fink A, Solomon DH, Kosecoff J, Park RE (1986) A method for the detailed assessment of the appropriateness of medical technologies. Int J Technol Assess Health Care 2:53–63. https://doi.org/10.1017/s0266462300002774
Steyerberg EW, Harrell FE Jr, Borsboom GJ, Eijkemans MJ, Vergouwe Y, Habbema JD (2001) Internal validation of predictive models: efficiency of some procedures for logistic regression analysis. J Clin Epidemiol 54:774–781. https://doi.org/10.1016/s0895-4356(01)00341-9
Riley RD, Snell KIE, Martin GP, Whittle R, Archer L, Sperrin M, Collins GS (2021) Penalization and shrinkage methods produced unreliable clinical prediction models especially when sample size was small. J Clin Epidemiol 132:88–96. https://doi.org/10.1016/j.jclinepi.2020.12.005
Shoskes DA, Nickel JC (2013) Classification and treatment of men with chronic prostatitis/chronic pelvic pain syndrome using the UPOINT system. World J Urol 31:755–760. https://doi.org/10.1007/s00345-013-1075-6
Lai HH, Thu JHL, Moh FV, Paradis A, Vetter J (2019) Clustering of patients with interstitial cystitis/bladder pain syndrome and chronic prostatitis/chronic pelvic pain syndrome. J Urol 202:546–551. https://doi.org/10.1097/JU.0000000000000250
Nickel JC (2020) Chronic prostatitis/chronic pelvic pain syndrome: it is time to change our management and research strategy. BJU Int 125:479–480. https://doi.org/10.1111/bju.15036
Liang CZ, Li HJ, Wang ZP, Xing JP, Hu WL, Zhang TF et al (2009) The prevalence of prostatitis-like symptoms in China. J Urol 182:558–563. https://doi.org/10.1016/j.juro.2009.04.011
Magistro G, Wagenlehner FM, Grabe M, Weidner W, Stief CG, Nickel JC (2016) Contemporary management of chronic prostatitis/chronic pelvic pain syndrome. Eur Urol 69:286–297. https://doi.org/10.1016/j.eururo.2015.08.061
Acknowledgements
We would like to thank Dr. Kazuyoshi Izumi, Dr. Tomohiro Mashima, and Dr. Hiroshi Yamasaki, who contributed to the development of the questionnaire. This study was supported by crowdfunding via Otsucle (https://otsucle.jp/). The authors thank those who supported “The Project to Develop a Novel Diagnostic Tool for Chronic Prostatitis.” We would also like to thank Editage (https://editage.com/) for English language editing.
Author information
Authors and Affiliations
Contributions
Conceptualization: MS, YH, YT, HK, MT, TM, YK, YY, SF. Data curation: YH, YY. Formal analysis: YH, YY, SF. Funding acquisition: MS, YT, YK. Investigation: YH, YY, SF. Methodology: YH, YY, SF. Project administration: MS, YK, YY, SF. Resources: MS, YK, YY, SF. Software: YH, YY. Supervision: MS, YK, YY, SF. Validation: TK, YY, SF. Visualization: YT, YH, MS, TK, YY, SF. Writing original draft: YT, YH, YY. Writing review & editing: SM, HK, MT, TM, TK, YK, SF.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no competing financial interests.
Research involving human participants and/or animals
This study involved human participants and was conducted following the ethical standards of the institutional and/or national research committee, in accordance with the World Medical Association’s Declaration of Helsinki. It received approval from the Institutional Review Board of Kagawa University (approval number: 2020–064) and the Institute for Health Outcomes and Process Evaluation Research (approval number: 202001).
Informed consent
All participants provided written informed consent before participating in the study.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Tohi, Y., Hijikata, Y., Sugimoto, M. et al. Development and internal validation of a screening tool for chronic prostatitis (S-CP). World J Urol 41, 2759–2765 (2023). https://doi.org/10.1007/s00345-023-04574-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00345-023-04574-x