Effects of Language and Terminology of Query Suggestions on the Precision of Health Searches
Health information is highly sought on the Web by users that naturally have different levels of expertise in the topics they search for. Assisting users with query formulation is important when users are searching for topics about which they have little knowledge or familiarity. To assist users with health query formulation, we developed a query suggestion system that provides alternative queries combining Portuguese and English language with lay and medico-scientific terminology. Here, we analyze how this system affects the precision of search sessions. Results show that a system providing these suggestions tends to perform better than a system without them. On specific groups of users, clicking on suggestions has positive effects on precision while using them as sources of new terms has the opposite effect. This suggests that a personalized suggestion system might have a good impact on precision.
KeywordsQuery suggestion Health Language Terminology English proficiency Health literacy Topic familiarity
This work was supported by Project “NORTE-01-0145- FEDER-000016” (NanoSTIMA), financed by the North Portugal Regional Operational Programme (NORTE 2020), under the PORTUGAL 2020 Partnership Agreement, and through the European Regional Development Fund (ERDF).
- 1.Borlund, P.: The IIR evaluation model: a framework for evaluation of interactive information retrieval systems. Inf. Res. 8(3) (2003). http://informationr.net/ir/8-3/paper152.html
- 2.Fox, S.: Health topics. Technical report, Pew Internet & American Life Project, Washington, DC (2011)Google Scholar
- 5.Kelly, D., Gyllstrom, K., Bailey, E.W.: A comparison of query and term suggestion features for interactive searching. In: Proceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2009, pp. 371–378. ACM, New York (2009). https://doi.org/10.1145/1571941.1572006
- 6.Kogan, S., Zeng, Q., Ash, N., Greenes, R.A.: Problems and challenges in patient information retrieval: a descriptive study. In: Proceedings AMIA Symposium, pp. 329–333 (2001). http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2243602/
- 9.Lopes, C.T., Ribeiro, C.: Effects of terminology on health queries: an analysis by user’s health literacy and topic familiarity, vol. 39, chap. 10, pp. 145–184. Emerald Group Publishing Limited (2015). https://doi.org/10.1108/S0065-283020150000039013
- 11.Luo, G., Tang, C.: On iterative intelligent medical search. In: Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2008, pp. 3–10. ACM, New York (2008). https://doi.org/10.1145/1390334.1390338
- 12.Luo, G., Tang, C., Yang, H., Wei, X.: MedSearch: a specialized search engine for medical information retrieval. In: Proceeding of the 17th ACM Conference on Information and Knowledge Mining, CIKM 2008, pp. 143–152. ACM, New York (2008). https://doi.org/10.1145/1458082.1458104
- 13.McCray, A.T., Tse, T.: Understanding search failures in consumer health information systems. In: AMIA Annual Symposium Proceedings, pp. 430–434 (2003). http://www.ncbi.nlm.nih.gov/pmc/articles/PMC1479930/
- 14.NLM: 2012AA consumer health vocabulary source information (2012). http://www.nlm.nih.gov/research/umls/sourcereleasedocs/current/CHV/index.html
- 16.Robertson, S.E., Kanoulas, E., Yilmaz, E.: Extending average precision to graded relevance judgments. In: Proceeding of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2010, pp. 603–610. ACM, New York, July 2010. https://doi.org/10.1145/1835449.1835550
- 20.Zarro, M., Lin, X.: Using social tags and controlled vocabularies as filters for searching and browsing: a health science experiment. In: Fifth Workshop on Human-Computer Interaction and Information Retrieval, October 2011Google Scholar
- 22.Zhang, Y.: Contextualizing consumer health information searching: an analysis of questions in a social Q&A community. In: Proceedings of the 1st ACM International Health Informatics Symposium, pp. 210–219 (2010)Google Scholar