Abstract
While various recommender approaches are increasingly considered in e-learning, lack of studies of actual use is hindering the development. For several years, we have used non-algorithmic recommender features on an undergraduate course website to help students find pertinent study materials. As students earn credit from adding and evaluating materials, some have chosen to evaluate materials dishonesty, i.e. without actually reading them. To improve honesty, in 2012 we coupled 5-star ratings with commenting (previously uncoupled) to increase the cost and complexity of evaluating and gave students individual presence with nicknames (previously anonymous) to increase social presence and enable reputation formation. Our results show that high enough cost of evaluating together with high enough social presence can lead to complete honesty in evaluations and enhance both user experience and student involvement. In effect, designing such e-learning systems includes not only designing the features but also their use, as the two are intertwined.
Chapter PDF
Similar content being viewed by others
References
Tang, T., McCalla, G.: Beyond Learners’ Interest: Personalized Paper Recommendation Based on Their Pedagogical Features for an e-Learning System. In: Zhang, C., Guesgen, H.W., Yeap, W.-K. (eds.) PRICAI 2004. LNCS (LNAI), vol. 3157, pp. 301–310. Springer, Heidelberg (2004)
Hage, H., Aïmeur, E.: Harnessing Learner’s Collective Intelligence: A Web 2.0 Approach to E-learning. In: Woolf, B.P., Aïmeur, E., Nkambou, R., Lajoie, S. (eds.) ITS 2008. LNCS, vol. 5091, pp. 438–447. Springer, Heidelberg (2008)
Kiliç-Çakmak, E.: Learning strategies and motivational factors predicting information literacy self-efficacy of e-learners. AJET 26(2), 192–208 (2010)
Schafer, J.B., Konstan, J., Riedl, J.: Recommender Systems in E-commerce. In: Proc. the 1st ACM Conf. on Electronic Commerce, pp. 158–166. ACM, New York (1999)
Rashid, A.M., Ling, K., Tassone, R., Resnick, P., Kraut, R., Riedl, J.: Motivating Participation by Displaying the Value of Contribution. In: Proc. the SIGCHI Conf. on Human Factors in Computing Systems, pp. 955–958. ACM, New York (2006)
Leino, J.: Case Study: Material Additions, Ratings, and Comments in a Course Setting. In: Santos, O.C., Boticario, J.G. (eds.) Educational Recommender Systems and Technologies: Practices and Challenges, pp. 258–280. IGI Global (2011)
Manouselis, N., Drachsler, H., Vuorikari, R., Hummel, H., Koper, R.: Recommender Systems in Technology Enhanced Learning. In: Kantor, P., Ricci, F., Rokach, L., Shapira, B. (eds.) Recommender Systems Handbook, pp. 387–415. Springer, Heidelberg (2011)
Santos, O.C., Boticario, J.G.: Modeling Recommendations for the Educational Domain. Procedia Computer Science 1(2), 2793–2800 (2010)
Ghauth, K.I., Abdullah, N.A.: Learning Materials Recommendation Using Good Learners Ratings and Content-based Filtering. Journal of Educational Technology Research and Development 58(6), 711–727 (2010)
Drachsler, H., Hummel, H.G.K., Koper, R.: Identifying the Goal, User model and Conditions of Recommender Systems for Formal and Informal Learning. Journal of Digital Information 10(2), 4–24 (2009)
Pu, P., Chen, L.: Trust-inspiring Explanation Interfaces for Recommender Systems. Knowledge-Based Systems 20, 542–556 (2007)
Konstan, J., Riedl, J.: Recommender Systems: From Algorithms to User Experience. User Model. User-Adap. Inter. 22, 101–123 (2012)
Talwar, A., Jurca, R., Faltings, B.: Understanding User Behavior in Online Feedback Reporting. In: Proc. the 8th ACM Conf. on Electronic Commerce, pp. 134–142. ACM, New York (2007)
Lam, S.K., Riedl, J.: Shilling Recommender Systems for Fun and Profit. In: Proc. the 13th Int. Conf. on World Wide Web, pp. 393–402. ACM, New York (2004)
Sparling, E.I., Sen, S.: Rating: How Difficult is It? In: Proc. the 5th ACM Conf. on Recommender Systems, pp. 149–156. ACM, New York (2011)
Hu, N., Pavlou, P., Zhang, J.: Can Online Reviews Reveal a Product’s True Quality? In: Proc. the 7th ACM Conf. on Electronic Commerce, pp. 324–330. ACM, New York (2006)
Hennig-Thurau, T., Gwinner, K.P., Walsh, G., Gremler, D.D.: Electronic Word-of-Mouth via Consumer-opinion Platforms: What Motivates Consumers to Articulate Themselves on the Internet? Journal of Interactive Marketing 18(1), 38–52 (2004)
Leino, J., Räihä, K.-J.: User Experiences and Impressions of Recommenders in Complex Information Environments. IEEE Data Engineering Bulletin 31(2), 32–39 (2008)
Nov, O., Ye, C.: Why Do People Tag? Communications of ACM 53(7), 128–131 (2010)
McNee, S.M., Riedl, J., Konstan, J.: Being Accurate Is Not Enough: How Accuracy Metrics Have Hurt Recommender Systems. In: CHI 2006 Extended Abstracts on Human Factors in Computing Systems, pp. 1097–1101. ACM, New York (2006)
McMillan, D.W., Chavis, D.M.: Sense of Community: A Definition and Theory. Journal of Community Psychology 14(1), 6–23 (1986)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 IFIP International Federation for Information Processing
About this paper
Cite this paper
Leino, J., Heimonen, T. (2013). Improving Evaluation Honesty and User Experience in E-learning by Increasing Evaluation Cost and Social Presence. In: Kotzé, P., Marsden, G., Lindgaard, G., Wesson, J., Winckler, M. (eds) Human-Computer Interaction – INTERACT 2013. INTERACT 2013. Lecture Notes in Computer Science, vol 8118. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40480-1_42
Download citation
DOI: https://doi.org/10.1007/978-3-642-40480-1_42
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-40479-5
Online ISBN: 978-3-642-40480-1
eBook Packages: Computer ScienceComputer Science (R0)