Exact Confidence Limits on Some New Measures of Concordance and Discordance in Binary Outcomes

Abstract

Using a measure of agreement that does not distinguish the “positive” outcome from the “negative” outcome can be sometimes misleading in assessing resemblance. To alleviate this concern, some new indices, including the “positive” and “negative” conditional synchrony measures (CSM) (or the conditional discordant measures [CDM]), as well as their related measures, have been recently proposed elsewhere. We show that one can easily derive exact confidence limits for these new indices. Using Monte Carlo simulation, we find that the asymptotic interval estimator derived from the score test and these exact interval estimators can all perform well in a variety of situations, while the asymptotic interval estimator based on Wald’s statistic can lose accuracy. We use the data taken from a cross-sectional validation study assessing the diagnostic performance of the Whooley questions for major depression disorder (MDD) among older adults to illustrate the use of these interval estimators developed here.