ACTraversal: Ranking Crowdsourced Commonsense Assertions and Certifications

  • Tao-Hsuan Chang
  • Yen-Ling Kuo
  • Jane Yung-jen Hsu
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7047)


Building commonsense knowledge bases is a challenging undertaking. While we have witnessed the successful collection of large amounts of commonsense knowledge by either automatic text mining or games with a purpose (GWAP), such data are of limited precision. Verifying data is typically done with repetition, which works better for very large data sets. Our research proposes a novel approach to data verification by coupling multiple data collection methods. This paper presents ACTraversal, a graph traversal algorithm for ranking data collected from GWAP and text mining. Experiments on aggregating data from two GWAPs, i.e. Virtual Pets and Top10, with two text mining tools, i.e. SEAL and Google Distance, showed significant improvements.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    von Ahn, L., Kedia, M., Blum, M.: Verbosity: A game for collecting common-sense knowledge. In: ACM Conference on Human Factors in Computing Systems (CHI Notes), pp. 75–78 (2006)Google Scholar
  2. 2.
    Carlson, A., Betteridge, J., Kisiel, B., Settles, B., Hruschka Jr., E.R., Mitchell, T.M.: Toward an architecture for never-ending language learning. In: Twenty-Fourth Conference on Artificial Intelligence, AAAI 2010 (2010)Google Scholar
  3. 3.
    Chang, T.h., Chan, C.w., Hsu, J.Y.j.: Human computation game for commonsense data verification. In: Proceedings of the 2010 AAAI Fall Symposium Series on Commonsense Knowledge (2010)Google Scholar
  4. 4.
    Etzioni, O., Cafarella, M., Downey, D., Popescu, A.M., Shaked, T., Soderland, S., Weld, D.S., Yates, A.: Methods for domain-independent information extraction from the web: an experimental comparison. In: Proceedings of the 19th National Conference on Artifical Intelligence, AAAI 2004, pp. 391–398 (2004)Google Scholar
  5. 5.
    Kuo, Y.L., Lee, J.C., Chiang, K.Y., Wang, R., Shen, E., Chan, C.W., Hsu, J.Y.j.: Community-based game design: experiments on social games for commonsense data collection. In: Proceedings of the ACM SIGKDD Workshop on Human Computation (2009)Google Scholar
  6. 6.
    Lenat, D.B.: Cyc: A large-scale investment in knowledge infrastructure. Communications of the ACM 38(11), 33–38 (1995)CrossRefGoogle Scholar
  7. 7.
    Schubert, L., Tong, M.: Extracting and evaluating general world knowledge from the brown corpus. In: Proceedings of the HLT-NAACL Workshop on Text Meaning (2003)Google Scholar
  8. 8.
    Singh, P., Lin, T., Mueller, E.T., Lim, G., Perkins, T., Zhu, W.L.: Open mind common sense: Knowledge acquisition from the general public. In: On the Move to Meaningful Internet Systems, 2002 - DOA/Coop IS/ODBASE 2002 Confederated International Conferences DOA, CoopIS and ODBASE 2002 (2002)Google Scholar
  9. 9.
    Speer, R., Havasi, C., Surana, H.: Using verbosity: Common sense data from games with a purpose. In: The Florida AI Research Society Conference (2010)Google Scholar
  10. 10.
    Von Ahn, L.: Games with a purpose. Computer 39(6), 92–94 (2006)CrossRefGoogle Scholar
  11. 11.
    Wang, R., Cohen, W.: Language-independent set expansion of named entities using the web. In: Seventh IEEE International Conference on Data Mining, ICDM 2007, pp. 342–350. IEEE (2008)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Tao-Hsuan Chang
    • 1
  • Yen-Ling Kuo
    • 1
  • Jane Yung-jen Hsu
    • 1
  1. 1.Department of Computer Science and Information EngineeringNational Taiwan UniversityTaiwan

Personalised recommendations