Skip to main content

Advertisement

SpringerLink
Log in

A Real-Time Data Mining Approach for Interaction Analytics Assessment: IoT Based Student Interaction Framework

  • Published:
International Journal of Parallel Programming Aims and scope Submit manuscript

Abstract

Students’ interaction and collaboration with the fellows and teachers using the Internet of Things (IoT) based interoperable infrastructure is a convenient way. Measuring student attention is an essential part of the educational assessment for students’ interaction. As new learning styles develop, new tools and assessment methods are also needed. The focus in this paper is to develop IoT based interaction framework and analysis of the student experience in electronic learning (eLearning) so that the students can take full advantage of the modern interaction technology and their learning can increase to a high level. This setup has a data collection module, which is implemented using Visual C# programming language and computer vision library. The number of faces, number of eyes, and status of eyes are extracted from the video stream, which is taken from a video camera. The extracted information is saved in a dataset for further analysis. The analysis of the dataset produces interesting results for student learning assessments. Modern learning management systems can integrate the developed tool to consider student-learning behaviors when assessing electronic learning strategies. The tools are also developed for the data collection on both student and teacher ends. Correlation of data and hidden meaning are extracted to make the learning experience and teaching performance better and adaptable. IoT based infrastructure provides the facilities to fellow students about location awareness, fellows’ accessibility, social behavior and helping hand.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Al-Sakran, H.: An agent-based architecture for developing e-learning system. Inf. Technol. J. 5(1), 121–127 (2006)

    Article  Google Scholar 

  2. Alessi, S.M., Trollip, S.R.: Multimedia for Learning: Methods and Development. Allyn & Bacon, Incorporated, Boston (2001)

    Google Scholar 

  3. Chen, L. et al.: Towards automated assessment of public speaking skills using multimodal cues. In: Proceedings of the 16th International Conference on Multimodal Interaction, ACM (2014)

  4. Jabbar, S., Ullah, F., Khalid, S., Khan, M., Han, K.: Semantic interoperability in heterogeneous IoT infrastructure for healthcare. Wirel. Commun. Mob. Comput. 2017, 9731806 (2017). https://doi.org/10.1155/2017/9731806

    Article  Google Scholar 

  5. Farris, I., et al.: MIFaaS: a mobile-IoT-federation-as-a-service model for dynamic cooperation of IoT cloud providers. Future Gener. Comput. Syst. 70, 126–137 (2017)

    Article  Google Scholar 

  6. Dyckhoff, A.L., et al.: Design and implementation of a learning analytics toolkit for teachers. J. Educ. Technol. Soc. 15(3), 58–76 (2012)

    Google Scholar 

  7. Wiley, E.W., Shavelson, R.J., Kurpius, A.A.: On the factorial structure of the SAT and implications for next-generation college readiness assessments. Educ. Psychol. Meas. 74, 859–874 (2014)

    Article  Google Scholar 

  8. Borkulo, S.P., et al.: What can be learned from computer modeling? Comparing expository and modeling approaches to teaching dynamic systems behavior. J. Sci. Educ. Technol. 21(2), 267–275 (2011)

    Article  Google Scholar 

  9. Gubbi, J., et al.: Internet of things (IoT): a vision, architectural elements, and future directions. Future Gener. Comput. Syst. 29(7), 1645–1660 (2013)

    Article  Google Scholar 

  10. Abualkishik, A., Omar, K.: Framework for translating the Holy Quran and its reciting rules to Braille code. In: International Conference on Research and Innovation in Information Systems (ICRIIS), IEEE (2013)

  11. Truncali, A., et al.: Teaching physicians to address unhealthy alcohol use: a randomized controlled trial assessing the effect of a web-based module on medical student performance. J. Subst. Abuse Treat. 40(2), 203–213 (2011)

    Article  Google Scholar 

  12. Krause, S., et al.: Implicit interpersonal attraction in small groups automatically activated evaluations predict actual behavior toward social partners. Soc. Psychol. Pers. Sci. 5, 671–679 (2014)

    Article  Google Scholar 

  13. Hess, F., Saxberg, B.: Schooling rebooted: turning educators into learning engineers. http://educationnext.org/schooling-rebooted/. Accessed 30 June 2017

  14. Chai, J., et al.: eCROPS-CA: a systematic approach toward effective and sustainable cancer prevention in rural China. BMC Cancer 15(1), 233 (2015)

    Article  Google Scholar 

  15. Malik, K.R., et al.: Multiagent semantical annotation enhancement model for IoT-based energy-aware data. Int. J. Distrib. Sens. Netw. 12, 9103265 (2016)

    Article  Google Scholar 

  16. Abuarqoub, A., Hammoudeh, M., Alsboui, T.: An overview of information extraction from mobile wireless sensor networks. In: Andreev, S., Balandin, S., Koucheryavy, Y. (eds.) Internet of Things, Smart Spaces, and Next Generation Networking: 12th International Conference, NEW2AN 2012, and 5th Conference, ruSMART 2012, St. Petersburg, Russia, 27–29 August 2012. Proceedings, pp. 95–106. Springer, Berlin, Heidelberg (2012)

  17. Deutsch, M., et al.: World professional association for transgender health EMR working group. Electronic medical records and the transgender patient: recommendations from the world professional association for transgender health EMR working group. J. Am. Med. Inform. Assoc. 20(4), 700–703 (2013)

    Article  Google Scholar 

  18. Kienstra, N., et al.: Doing philosophy effectively: student learning in classroom teaching. PLoS ONE 10(9), e0137590 (2015)

    Article  Google Scholar 

  19. Wang, Y.-F., et al.: A new method for computing attention network scores and relationships between attention networks. PLoS ONE 9(3), e89733 (2014)

    Article  Google Scholar 

  20. Plyer, A., Le Besnerais, G., Champagnat, F.: Massively parallel Lucas Kanade optical flow for real-time video processing applications. J. Real Time Image Process. 11(4), 713–730 (2016)

    Article  Google Scholar 

  21. Saponara, S., et al.: Algorithmic and architectural design for real-time and power-efficient Retinex image/video processing. J. Real Time Image Process. 1(4), 267–283 (2007)

    Article  Google Scholar 

  22. Sánchez, S., et al.: Real-time implementation of remotely sensed hyperspectral image unmixing on GPUs. J. Real Time Image Process. 10(3), 469–483 (2015)

    Article  Google Scholar 

  23. Gomes, S.L., et al.: Embedded real-time speed limit sign recognition using image processing and machine learning techniques. Neural Comput. Appl. 28, 1–12 (2016)

    Article  Google Scholar 

  24. Saragi, T., Nation, I.S.P., Meister, G.F.: Vocabulary learning and reading. System 6(2), 72–78 (1978)

    Article  Google Scholar 

  25. Laurillard, D.: Rethinking University Teaching: A Conversational Framework for the Effective Use of Learning Technologies. Routledge, Abingdon (2013)

    Book  Google Scholar 

  26. Renninger, A., Hidi, S., Krapp, A.: The Role of Interest in Learning and Development. Psychology Press, London (2014)

    Google Scholar 

  27. Jeong, Y.-S., et al.: Guest editorial: advanced technologies and services for multimedia big data processing. Multimed. Tools Appl. 74(10), 3413–3418 (2015)

    Article  Google Scholar 

  28. Ali, N.: Students’ perceptions about use of multimedia projectors for information transfer in class room–a single center experience. Adv. Health Prof. Educ. 1(2), 70–73 (2016)

    Google Scholar 

  29. Beeland, W.D.: Student engagement, visual learning and technology: Can interactive whiteboards help. In: Annual Conference of the Association of Information Technology for Teaching Education, Dublin (2002)

  30. Clark, R.C., Mayer, R.E.: E-learning and the Science of Instruction: Proven Guidelines for Consumers and Designers of Multimedia Learning. Wiley, New York (2016)

    Book  Google Scholar 

  31. Yousafzai, A., et al.: Multimedia augmented m-learning: issues, trends and open challenges. Int. J. Inf. Manag. 36(5), 784–792 (2016)

    Article  Google Scholar 

  32. Sharma, P.: Evaluating visual saliency algorithms: past, present and future. J. Imaging Sci. Technol. 59(5), 50501-1–50501-17 (2015)

    Article  Google Scholar 

  33. Zhang, L., et al.: SUN: a Bayesian framework for saliency using natural statistics. J. Vis. 8(7), 32–32 (2008)

    Article  Google Scholar 

  34. Zhang, J., Sclaroff, S.: Saliency detection: a boolean map approach. In: Proceedings of the IEEE International Conference on Computer Vision (2013)

  35. Meng, H., et al.: Real-time human action recognition on an embedded, reconfigurable video processing architecture. J. Real Time Image Process. 3(3), 163–176 (2008)

    Article  Google Scholar 

  36. Kapela, R., McGuinness, K., O’Connor, N.E.: Real-time field sports scene classification using colour and frequency space decompositions. J. Real Time Image Process. 13, 1–13 (2014)

    Google Scholar 

  37. Paul, A., et al.: Video search and indexing with reinforcement agent for interactive multimedia services. ACM Trans. Embed. Comput. Syst. (TECS) 12(2), 25 (2013)

    Google Scholar 

  38. Razzaq Malik, K., et al.: Data security and privacy in cloud computing: threat level indications. Sci. Int. 26(5), 1991–1996 (2014)

    Google Scholar 

  39. Jabbar, S., et al.: Trust model at service layer of cloud computing for educational institutes. J. Supercomput. 72(1), 58–83 (2016)

    Article  Google Scholar 

  40. Naseer, M.K., Jabbar, S., Zafar, I.: A novel trust model for selection of cloud service provider. In: 2014 World Symposium on Computer Applications and Research (WSCAR) (2014)

  41. Malik, K.R., et al.: Big-data: transformation from heterogeneous data to semantically-enriched simplified data. Multimed. Tools Appl. 75, 1–21 (2015)

    Google Scholar 

  42. Khalid, S., et al.: Accurate and efficient shape matching approach using vocabularies of multi-feature space representations. J. Real Time Image Process. 13, 1–17 (2015)

    Google Scholar 

  43. Chen, C., Liu, K., Kehtarnavaz, N.: Real-time human action recognition based on depth motion maps. J. Real Time Image Process. 12(1), 155–163 (2016)

    Article  Google Scholar 

  44. Farhan, M., et al.: Real-time imaging-based assessment model for improving teaching performance and student experience in e-learning. J. Real Time Image Process. 13, 1–14 (2017)

    Article  Google Scholar 

  45. Tallent-Runnels, M.K., et al.: Teaching courses online: a review of the research. Rev. Educ. Res. 76(1), 93–135 (2006)

    Article  Google Scholar 

  46. Enock, P.M., Hofmann, S.G., McNally, R.J.: Attention bias modification training via smartphone to reduce social anxiety: a randomized, controlled multi-session experiment. Cognit. Ther. Res. 38(2), 200–216 (2014)

    Article  Google Scholar 

  47. Mörwald, T., et al.: Advances in real-time object tracking. J. Real Time Image Process. 10(4), 683–697 (2015)

    Article  Google Scholar 

  48. Selvakumar, K., et al.: Real-time vision based driver drowsiness detection using partial least squares analysis. J. Signal Process. Syst. 85, 1–12 (2015)

    Google Scholar 

  49. Salah, A.A., Alpaydin, E., Akarun, L.: A selective attention-based method for visual pattern recognition with application to handwritten digit recognition and face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 24(3), 420–425 (2002)

    Article  Google Scholar 

  50. Li, H., Ngan, K.N.: Saliency model-based face segmentation and tracking in head-and-shoulder video sequences. J. Vis. Commun. Image Represent. 19(5), 320–333 (2008)

    Article  Google Scholar 

  51. Kienzle, W., et al.: Center-surround patterns emerge as optimal predictors for human saccade targets. J. Vis. 9(5), 7–7 (2009)

    Article  Google Scholar 

  52. Macfadyen, L.P., Dawson, S.: Mining LMS data to develop an ”early warning system” for educators: a proof of concept. Comput. Educ. 54(2), 588–599 (2010)

    Article  Google Scholar 

  53. Mathe, S., Sminchisescu, C.: Dynamic eye movement datasets and learnt saliency models for visual action recognition. Computer Vision-ECCV 2012, 842–856 (2012)

    Google Scholar 

  54. Han, J.H., Finkelstein, A.: Understanding the effects of professors’ pedagogical development with Clicker Assessment and feedback technologies and the impact on students’ engagement and learning in higher education. Comput. Educ. 65, 64–76 (2013)

    Article  Google Scholar 

  55. Thoms, B., Eryilmaz, E.: How media choice affects learner interactions in distance learning classes. Comput. Educ. 75, 112–126 (2014)

    Article  Google Scholar 

  56. Ba, J., Mnih, V., Kavukcuoglu, K.: Multiple object recognition with visual attention. arXiv preprint arXiv:1412.7755 (2014)

  57. Gittins, H., Wall, J., Foley, A., Clayden, K., Young, E., Owens, E., et al.: Multilevel engagement: theory and practice integration. In: Kelliher, F., Reinl, L. (eds.) Green Innovation and Future Technology: Engaging Regional SMEs in the Green Economy, pp. 41–56. Palgrave Macmillan, London, UK (2015)

    Google Scholar 

  58. Ohlsson, N., Ståhl, M.: Model-Based Approach to Computer Vision and Automatic Control using Matlab Simulink for an Autonomous Indoor Multirotor System. Department of Signals and Systems, Chalmers University of Technology, Gothenburg, Sweden (2013)

  59. Kaehler, A., Bradski, G.: Learning OpenCV. O’Reilly Media, Inc, Sebastopol (2014)

    Google Scholar 

  60. Anders, J., et al.: A hardware/software prototyping system for driving assistance investigations. J. Real Time Image Process. 11(3), 559–569 (2016)

    Article  Google Scholar 

  61. Li, C., Brost, V., Benezeth, Y., Marzani, F., Yang, F.: Design and evaluation of a parallel and optimized light–tissue interaction-based method for fast skin lesion assessment. J. Real-Time Image Proc. (2015). https://doi.org/10.1007/s11554-015-0494-6.

    Article  Google Scholar 

  62. Shi, S.: Emgu CV Essentials. Packt Publishing Ltd, Birmingham (2013)

    Google Scholar 

  63. Chambers, O., Milenkovic, J., Tasic, J.F.: A pre-processing scheme for real-time registration of dynamic contrast-enhanced magnetic resonance images. J. Real-Time Image Proc. (2014). https://doi.org/10.1007/s11554-014-0468-0

    Article  Google Scholar 

  64. Gómez-Aguilar, D.A., et al.: Tap into visual analysis of customization of grouping of activities in eLearning. Comput. Hum. Behav. 47, 60–67 (2015)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, COMSATS Institute of Information Technology, Sahiwal, Pakistan

    Muhammad Farhan

  2. Department of Computer Science, National Textile University, Faisalabad, Pakistan

    Sohail Jabbar

  3. Department of Computer Science and Engineering, University of Engineering and Technology, Lahore, Pakistan

    Muhammad Aslam

  4. Department of Information and Communication Engineering, Yeungnam University, Gyeongbuk, 280 Daehak-Ro, Gyeongsan, 38541, Republic of Korea

    Awais Ahmad

  5. Department of Computer Science, University of Engineering and Technology, Taxila, Pakistan

    Muhammad Munwar Iqbal

  6. Sarhad University of Information Technology, Peshawar, Pakistan

    Murad Khan

  7. Department of CS, CINVESTAV-IPN, Mexico City, Mexico

    Martinez-Enriquez Ana Maria

Authors
  1. Muhammad Farhan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sohail Jabbar
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Muhammad Aslam
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Awais Ahmad
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Muhammad Munwar Iqbal
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Murad Khan
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Martinez-Enriquez Ana Maria
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sohail Jabbar.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Farhan, M., Jabbar, S., Aslam, M. et al. A Real-Time Data Mining Approach for Interaction Analytics Assessment: IoT Based Student Interaction Framework. Int J Parallel Prog 46, 886–903 (2018). https://doi.org/10.1007/s10766-017-0553-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10766-017-0553-7

Keywords

Search

Navigation