Abstract
A central challenge of semantic ambient media applications is designing smart user interfaces that are able to dynamically deal with an a-priori unknown number of data categories and data instances received live from different Linked Open Data sources while at the same time being intuitive and easy to use. In the mobile world, this challenge is even more difficult as the mobile devices have limited interaction possibilities and smaller display size. In this paper, we tackle this challenge and present the user-centered, iterative design of a mobile application for faceted search and exploration of a large, multi-dimensional data set of open social media on a touchscreen mobile phone. The application is called Mobile Facets and provides live retrieval and interactive search and exploration of resources like places, persons, organizations, and events originating from different, integrated social media sources like DBpedia, Eventful, Upcoming, Flickr, and GeoNames. In contrast to existing work, we do not know in advance the number and type of data categories and data instances that will be received as the data is queried live from the sources. While developing Mobile Facets, we have applied a participatory design with a small group of five users. For the final prototype we have conducted a task-based, formative evaluation with 12 additional subjects to investigate the applicability and usability of our Mobile Facets application.
Similar content being viewed by others
References
Arndt H (2006) Integrierte informationsarchitektur: die erfolgreiche konzeption professioneller websites. Springer, Berlin
Auer S, Bizer C, Kobilarov G, Lehmann J, Cyganiak R, Ives ZG (2007) DBpedia: a nucleus for a web of open data. In: ISWC/ASWC. Springer, Berlin
de Oliveira Neto JaS, Roussel N, Filgueiras LV (2009) User’s issues in crossmedia applications. In: Proceedings of the 27th ACM international conference on design of communication, SIGDOC ’09. ACM, New York, pp 119–126
English J, Hearst M, Sinha R, Swearingen K, Yee K-P (2002) Flexible search and navigation using faceted metadata. Technical report, University of Berkeley
Franz T, Schultz A, Sizov S, Staab S (2009) TripleRank: ranking semantic web data by tensor decomposition. In: ISWC
Gediga G, Hamborg K-C (1999) IsoMetrics: an usability inventory supporting summative and formative evaluation of software systems. In: HCI (1). Lawrence Erlbaum, Hove, pp 1018–1022
Gediga G, Hamborg K-C (2001) Evaluation of software systems. In: Encyclopedia of computer science and technology, vol 45
Hearst MA (2006) Design recommendations for hierarchical faceted search interfaces. In: Workshop on faceted search, pp 26–30
Hearst MA (2008) UIs for faceted navigation: recent advances and remaining open problems. In: Computer interaction and information retrieval
Heath T, Bizer C (2011) Linked data: evolving the web into a global data space. Morgan & Claypool. http://linkeddatabook.com/. Accessed 6 Feb 2013
Hildebrand M, van Ossenbruggen J, Hardman L (2006) /facet: a browser for heterogeneous semantic web repositories. In: ISWC
Jacobson I, Booch G, Rumbaugh J (1999) The unified software development process. Object technology. Addison Wesley Longman, Don Mills
Karlson AK, Robertson GG, Robbins DCC, Czerwinski MP, Smith GR (2006) FaThumb: a facet-based interface for mobile search. In CHI. ACM, New York
Lewis C, Rieman J, Blustein AJ (1994) Task-centered user interface design: a practical introduction. http://hcibib.org/tcuid/. Accessed 6 Feb 2013
Oren E, Delbru R, Decker S (2006) Extending faceted navigation for RDF data. In: International semantic web conference
Pogorelc B, Vatavu R, Lugmayr A, Stockleben B, Risse T, Kaario J, Lomonaco EC, Gams M (2011) Re-thinking the future of semantic ambient media. Multimed Tools Appl. doi:10.1007/s11042-011-0917-8
Sacco G (2009) Dynamic taxonomies and faceted search: theory, practice, and experience. Springer, Berlin
Schmeiß D, Scherp A, Staab S (2010) Integrated mobile visualization and interaction of events and POIs. In: Multimedia, Firenze, Italy. ACM, New York, pp 1567–1570
Schraefel MC, Smith DA, Owens A et al (2005) The evolving mspace platform: leveraging the semantic web on the trail of the memex. In: Hypertext
Segerståhl K (2009) Crossmedia systems constructed around human activities: a field study and implications for design. In: 12th IFIP TC13 international conference on human–computer interaction—INTERACT 2009, Uppsala, Sweden. Lecture notes in computer science, vol 5727. Springer, New York, pp 354–367
Sohn T, Li KA, Griswold WG, Hollan JD (2008) A diary study of mobile information needs. In: CHI. ACM, New York, pp 433–442
Tan S, Ngo C-W, Tan H-K, Pang L (2011) Cross media hyperlinking for search topic browsing. In: Proceedings of the 19th international conference on multimedia 2011, Scottsdale, AZ, USA. ACM, New York, pp 243–252
Trappeniers L, Godon M, Claeys L, Martinot O, Marilly E (2008) Cross-media experiences: ambient community interactions in the city. Bell Labs Tech J 13(2):5–11
van Aart CJ, Wielinga BJ, van Hage WR (2010) Mobile cultural heritage guide: location-aware semantic search. In: EKAW. Springer, New York
Wilson ML, Russell A, Smith DA, Owens A, Schraefel MC (2005) mSpace Mobile: a mobile application for the semantic web. In: End user semantic web workshop
Wilson ML, Smith DA, Russell A, Schraefel MC (2006) mSpace Mobile: a UI Gestalt to support on-the-go info-interaction. In: CHI
Yee K-P, Swearingen K, Li K, Hearst M (2003) Faceted metadata for image search and browsing. In: Human factors in computing systems. ACM, New York
Acknowledgements
We thank all subjects participating in the evaluation. This research has been co-funded by the EU in FP7 in the IP WeKnowIt (215453) and IP SocialSensor (287975).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Kleinen, A., Scherp, A. & Staab, S. Interactive faceted search and exploration of open social media data on a touchscreen mobile phone. Multimed Tools Appl 71, 39–60 (2014). https://doi.org/10.1007/s11042-013-1366-3
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-013-1366-3