Skip to main content
Log in

Measurement of incompatible probability in information retrieval: A case study with user clicks

  • Published:
Transactions of Tianjin University Aims and scope Submit manuscript

Abstract

The incompatible probability represents an important non-classical phenomenon, and it describes conflicting observed marginal probabilities, which cannot be satisfied with a joint probability. First, the incompatibility of random variables was defined and discussed via the non-positive semi-definiteness of their covariance matrixes. Then, a method was proposed to verify the existence of incompatible probability for variables. A hypothesis testing was also applied to reexamine the likelihood of the observed marginal probabilities being integrated into a joint probability space, thus showing the statistical significance of incompatible probability cases. A case study with user click-through data provided the initial evidence of the incompatible probability in information retrieval (IR), particularly in user interaction. The experiments indicate that both incompatible and compatible cases can be found in IR data, and informational queries are more likely to be compatible than navigational queries. The results inspire new theoretical perspectives of modeling the complex interactions and phenomena in IR.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Singhal Amit. Modern information retrieval: A brief overview [J]. Bulletin of the IEEE Computer Society Technical Committee on Data Engineering, 2001, 24(4): 35–43.

    Google Scholar 

  2. Maron M E, Kuhns J L. On relevance, probabilistic indexing, and information retrieval [J]. JACM, 1960, 7(3): 216–244.

    Article  Google Scholar 

  3. Sparck Jones K, Walker S, Robertson S E. A probabilistic model of information retrieval: Development and comparative experiments. Parts 1 and 2 [J]. IP&M, 2000, 36(6): 779–808, 809–840.

    Google Scholar 

  4. Sheldon M Ross. A First Course in Probability [M]. Pearson Prentice Hall, USA, 2006.

    Google Scholar 

  5. Grinstead Charles M, Laurie Snell J. Introduction to Probability [M]. American Mathematical Society, USA, 1997.

    Google Scholar 

  6. John Rice. Mathematical Statistics and Data Analysis [M]. Duxbury Press, USA, 2006.

    Google Scholar 

  7. Ripley B D. Pattern Recognition and Neural Networks [M]. Cambridge University Press, UK, 1996.

    Google Scholar 

  8. Gudder S P. Quantum Probability [M]. Academic Press, USA, 1988.

    Google Scholar 

  9. Khrennivov A. Classical and quantum mechanics on information spaces with applications to cognitive, psychological, social, and anomalous phenomena [J]. Foundations of Physics, 1999, 29(7): 1065–1098.

    Article  MathSciNet  Google Scholar 

  10. Albert Einstein, Podolsky B, Rosen N. Can quantummechanical description of physical reality be considered complete? [J]. Physical Review, 1935, 47(10): 777–780.

    Article  Google Scholar 

  11. Bell J S. On the Einstein-Podolsky-Rosen Paradox [J]. Physics, 1964, 1: 195–200.

    Google Scholar 

  12. Khrennikov A. Can quantum information be processed by macroscopic systems ? [J]. Quantum Information Processing, 2007, 6(6): 401–429.

    Article  MathSciNet  MATH  Google Scholar 

  13. Khrennikov A Y. Contextual Approach to Quantum Formalism (Fundamental Theories of Physics)[M]. Springer, Heidelberg-Berlin-New York, 2009.

    Google Scholar 

  14. Tsallis C. Possible generalization of Boltzmann-Gibbs statistics [J]. Journal of Statistical Physics, 1988, 52(1/2): 479–487.

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Bo Wang  (王 博).

Additional information

Supported by National Basic Research Program of China(“973” Program, No.2013cb329304), Natural Science Foundation of China (No. 61105072, No. 61070044 and No. 61111130190) and International Joint Research Project “QONTEXT” of the Council of European Union.

Wang Bo, born in 1979, male, Dr, lecturer.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Wang, B., Hou, Y. Measurement of incompatible probability in information retrieval: A case study with user clicks. Trans. Tianjin Univ. 19, 37–42 (2013). https://doi.org/10.1007/s12209-013-2029-1

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12209-013-2029-1

Keywords

Navigation