Abstract
The incompatible probability represents an important non-classical phenomenon, and it describes conflicting observed marginal probabilities, which cannot be satisfied with a joint probability. First, the incompatibility of random variables was defined and discussed via the non-positive semi-definiteness of their covariance matrixes. Then, a method was proposed to verify the existence of incompatible probability for variables. A hypothesis testing was also applied to reexamine the likelihood of the observed marginal probabilities being integrated into a joint probability space, thus showing the statistical significance of incompatible probability cases. A case study with user click-through data provided the initial evidence of the incompatible probability in information retrieval (IR), particularly in user interaction. The experiments indicate that both incompatible and compatible cases can be found in IR data, and informational queries are more likely to be compatible than navigational queries. The results inspire new theoretical perspectives of modeling the complex interactions and phenomena in IR.
Similar content being viewed by others
References
Singhal Amit. Modern information retrieval: A brief overview [J]. Bulletin of the IEEE Computer Society Technical Committee on Data Engineering, 2001, 24(4): 35–43.
Maron M E, Kuhns J L. On relevance, probabilistic indexing, and information retrieval [J]. JACM, 1960, 7(3): 216–244.
Sparck Jones K, Walker S, Robertson S E. A probabilistic model of information retrieval: Development and comparative experiments. Parts 1 and 2 [J]. IP&M, 2000, 36(6): 779–808, 809–840.
Sheldon M Ross. A First Course in Probability [M]. Pearson Prentice Hall, USA, 2006.
Grinstead Charles M, Laurie Snell J. Introduction to Probability [M]. American Mathematical Society, USA, 1997.
John Rice. Mathematical Statistics and Data Analysis [M]. Duxbury Press, USA, 2006.
Ripley B D. Pattern Recognition and Neural Networks [M]. Cambridge University Press, UK, 1996.
Gudder S P. Quantum Probability [M]. Academic Press, USA, 1988.
Khrennivov A. Classical and quantum mechanics on information spaces with applications to cognitive, psychological, social, and anomalous phenomena [J]. Foundations of Physics, 1999, 29(7): 1065–1098.
Albert Einstein, Podolsky B, Rosen N. Can quantummechanical description of physical reality be considered complete? [J]. Physical Review, 1935, 47(10): 777–780.
Bell J S. On the Einstein-Podolsky-Rosen Paradox [J]. Physics, 1964, 1: 195–200.
Khrennikov A. Can quantum information be processed by macroscopic systems ? [J]. Quantum Information Processing, 2007, 6(6): 401–429.
Khrennikov A Y. Contextual Approach to Quantum Formalism (Fundamental Theories of Physics)[M]. Springer, Heidelberg-Berlin-New York, 2009.
Tsallis C. Possible generalization of Boltzmann-Gibbs statistics [J]. Journal of Statistical Physics, 1988, 52(1/2): 479–487.
Author information
Authors and Affiliations
Corresponding author
Additional information
Supported by National Basic Research Program of China(“973” Program, No.2013cb329304), Natural Science Foundation of China (No. 61105072, No. 61070044 and No. 61111130190) and International Joint Research Project “QONTEXT” of the Council of European Union.
Wang Bo, born in 1979, male, Dr, lecturer.
Rights and permissions
About this article
Cite this article
Wang, B., Hou, Y. Measurement of incompatible probability in information retrieval: A case study with user clicks. Trans. Tianjin Univ. 19, 37–42 (2013). https://doi.org/10.1007/s12209-013-2029-1
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12209-013-2029-1