Skip to main content
Log in

Adaptive architecture based on agents for assessing a web application

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The personalization presents a key factor in the majority of web application. It improves the user experience by serving each user according to his desires and intentions. To ensure a good personalization process, the evaluation should be considered. However, in the literature, assessing this process is considered as a secondary purpose and treated as a lowcost test before the final deployment of a web application. Besides, the majority of assessments are domain dependent. They also report performance for a short time period and for specific users. Thus, we propose a solution, called RPMAS, designed with an adaptive architecture, based on agents. It is a reference system that attempts to personalize the same services offered by the assessed web application. Then, a comparison is performed to evaluate the results of the concerned web application. Following this comparison, RPMAS proposes improvements to the evaluated web application, or makes a self-evaluation to treat its proper weaknesses. In this article, we expose the detailed architecture of the proposed solution. Indeed, our solution is composed of three layers: the Observation Layer, the Modeling and Data Processing Layer and the Prediction, Recommendation and Evaluation Layer. Each layer has several intelligent and adaptive agents. We underline the various RPMAS advantages, compared to the state of the art. Then, we provide the proof of the efficiency of our contribution when evaluating different web applications. Finally, we developed a first scenario which illustrates the assessment made by our RPMAS regarding an online library. Also, we deploy a second scenario to assess an intelligent tutoring application. Regarding the accuracy measure, the gap between RPMAS and the first application is 17.316%. For the second scenario, using the AUC measure, the gap indicates 13.09%.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Notes

  1. Please refer on abbreviations to get the meaning of all used acronyms

  2. https://github.com/khalilbenaissa10/WSKWebApp

Abbreviations

O-Layer:

Observation Layer

MDP-Layer:

Modeling and Data Processing Layer

PRE-Layer:

Prediction, Recommendation and Evaluation Layer

RPMAS:

Referential Personalized Multi-Agent System

ConvLSTM:

Convolution Long Short Term Memory

AIDKVMN:

Augmented Input Dynamic Key Value Memory Network

AUC:

Area Under the Curve

References

  1. Ai Q, Wang X, Bruch S, Golbandi N, Bendersky M, Najork M (2019) Learning groupwise multivariate scoring functions using deep neural networks. In: Proceedings of the 2019 ACM SIGIR international conference on theory of information retrieval, pp 85–92

  2. Belarbi N, Chafiq N, Talbi M, Namir A, Benlahmar E (2019) User profiling in a spoc: A method based on user video clickstream analysis. International Journal of Emerging Technologies in Learning 14(1)

  3. Castells P, Fernández M, Vallet D, Mylonas P, Avrithis Y (2005) Self-tuning personalized information retrieval in an ontology-based framework. In: OTM confederated international conferences on the move to meaningful internet systems. Springer, pp 977–986

  4. Chen CM, Lee HM, Chen YH (2005) Personalized e-learning system using item response theory. Comput Educ 44(3):237–255

    Article  Google Scholar 

  5. Chen Y, Subburathinam A, Chen CH, Zaki MJ (2021) Personalized food recommendation as constrained question answering over a large-scale food knowledge graph. arXiv:2101.01775

  6. Diebold FX, Mariano RS (2002) Comparing predictive accuracy. Journal of Business and Economic Statistics 20(1):134–144

    Article  MathSciNet  Google Scholar 

  7. Dou Z, Song R, Wen JR (2007) A large-scale evaluation and analysis of personalized search strategies. In: Proceedings of the 16th international conference on World Wide Web, pp 581–590

  8. Dreyfus HL, Hubert L et al (1992) What computers still can’t do: A critique of artificial reason. MIT Press, Cambridge

    Google Scholar 

  9. EL AISSAOUI O, OUGHDIR L (2020) A learning style-based ontology matching to enhance learning resources recommendation. In: 2020 1st international conference on innovative research in applied science, engineering and technology (IRASET). IEEE, pp 1–7

  10. Garrido A, Morales L (2014) E-learning and intelligent planning: Improving content personalization. IEEE Revista Iberoamericana de Tecnologias del Aprendizaje 9(1):1–7

    Article  Google Scholar 

  11. Gertler PJ, Martinez S, Premand P, Rawlings LB, Vermeersch CM (2011) Impact evaluation in practice. World Bank Publications

  12. Guo Q, Zhang M (2009) Implement web learning environment based on data mining. Knowl-Based Syst 22(6):439–442

    Article  Google Scholar 

  13. Guo W, Liu X, Wang S, Gao H, Sankar A, Yang Z, Guo Q, Zhang L, Long B, Chen BC et al (2020) Detext: A deep text ranking framework with bert. In: Proceedings of the 29th ACM international conference on information & knowledge management, pp 2509–2516

  14. Hussain M, Zhu W, Zhang W, Abidi SMR, Ali S (2019) Using machine learning to predict student difficulties from learning session data. Artif Intell Rev 52(1):381–407

    Article  Google Scholar 

  15. Jannach D, Kamehkhosh I, Lerche L (2017) Leveraging multi-dimensional user models for personalized next-track music recommendation. In: Proceedings of the symposium on applied computing, pp 1635–1642

  16. Jannach D, Kamehkhosh I, Lerche L (2017) Leveraging multi-dimensional user models for personalized next-track music recommendation. In: Proceedings of the symposium on applied computing, pp 1635–1642

  17. Jerez JM, Molina I, García-Laencina PJ, Alba E, Ribelles N, Martín M, Franco L (2010) Missing data imputation using statistical and machine learning methods in a real breast cancer problem. Artificial Intelligence in Medicine 50(2):105–115

    Article  Google Scholar 

  18. Kasiri LA, Cheng KTG, Sambasivan M, Sidin SM (2017) Integration of standardization and customization: Impact on service quality, customer satisfaction, and loyalty. J Retail Consum Serv 35:91–97

    Article  Google Scholar 

  19. Katarya R, Arora Y (2020) Capsmf: a novel product recommender system using deep learning based text analysis model. Multimedia Tools and Applications 79(47):35,927–35,948

    Article  Google Scholar 

  20. Kiseleva J, Williams K, Hassan Awadallah A, Crook AC, Zitouni I, Anastasakos T (2016) Predicting user satisfaction with intelligent assistants. In: Proceedings of the 39th International ACM SIGIR conference on research and development in information retrieval, pp 45–54

  21. Labidi S, Lejouad W (1993) From distributed artificial intelligence to multi-agent systems (french version). Ph.D. thesis, INRIA

  22. Li F, Lau R, Dharmendran P (2009) Advances in web based learning–ICWL 2009, Springer, Berlin

  23. Malik BH, Khalid M, Maryam M, Nauman M, Yousaf S, Mehmood M, Saleem H (2019) Iot testing-as-a-service: A new dimension of automation. International Journal of Advanced Computer Science and Applications 10(5)

  24. Malik ZK, Fyfe C (2012) Review of web personalization. Journal of Emerging Technologies in Web Intelligence 4(3):285–296

    Article  Google Scholar 

  25. Mandryk RL, Atkins MS (2007) A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies. International Journal of Human-Computer Studies 65(4):329–347

    Article  Google Scholar 

  26. Mobasher B (2007) Data mining for web personalization. In: The adaptive web. Springer, pp 90–135

  27. Mobasher B, Cooley R, Srivastava J (2000) Automatic personalization based on web usage mining. Commun ACM 43(8):142–151

    Article  Google Scholar 

  28. Moukas A, Maes P (1998) Amalthaea: An evolving multi-agent information filtering and discovery system for the www. Autonomous Agents and Multi-Agent Systems 1(1):59–88

    Article  Google Scholar 

  29. Rani M, Nayak R, Vyas O (2015) An ontology-based adaptive personalized e-learning system, assisted by software agents on cloud storage. Knowl-Based Syst 90:33–48

    Article  Google Scholar 

  30. Rekik R, Kallel I, Casillas J, Alimi AM (2018) Assessing web sites quality: A systematic literature review by text and association rules mining. International Journal of Information Management 38(1):201–216

    Article  Google Scholar 

  31. Riemer K, Totz C (2003) The many faces of personalization. In: The customer centric enterprise. Springer, pp 35–50

  32. Salonen V, Karjaluoto H (2016) Web personalization: the state of the art and future avenues for research and practice. Telematics Inform 33(4):1088–1104

    Article  Google Scholar 

  33. Shang J, Xiao C, Ma T, Li H, Sun J (2019) Gamenet: Graph augmented memory networks for recommending medication combination. In: proceedings of the AAAI conference on artificial intelligence, vol 33, pp 1126–1133

  34. Shi D, Wang T, Xing H, Xu H (2020) A learning path recommendation model based on a multidimensional knowledge graph framework for e-learning. Knowl-Based Syst 195(105):618

    Google Scholar 

  35. Shin K, Kwak H, Kim KM, Kim M, Park YJ, Jeong J, Jung S (2021) One4all user representation for recommender systems in e-commerce. arXiv:2106.00573

  36. Soui M, Abed M, Ghèdira K et al (2011) Towards a dynamic evaluation of personalized information system based on multi-agents approach: Application in intelligent transport. In: 2011 4th international conference on logistics. IEEE, pp 68–75

  37. Trifa A, Hedhili A, Chaari WL (2019) Knowledge tracing with an intelligent agent, in an e-learning platform. Educ Inf Technol 24(1):711–741

    Article  Google Scholar 

  38. Trifa A, Sbai AH, Chaari WL (2017) Enhancing assessment of personalized multi-agent system through convlstm. Procedia Computer Science 112:249–259

    Article  Google Scholar 

  39. Trifa A, Sbaï AH, Chaari WL (2017) Evaluate a personalized multi agent system through social networks: web scraping. In: 2017 IEEE 26th international conference on enabling technologies: infrastructure for collaborative enterprises (WETICE). IEEE, pp 18–20

  40. Trifa A, Sbaï AH, Chaari WL (2017) Evaluate a personalized multi agent system through social networks: web scraping. In: 2017 IEEE 26th international conference on enabling technologies: infrastructure for collaborative enterprises (WETICE). IEEE, pp 18–20

  41. Wiedemann G, Remus S, Chawla A, Biemann C (2019) Does bert make any sense? interpretable word sense disambiguation with contextualized embeddings. arXiv:1909.10430

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Amal Trifa.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Trifa, A., Hedhili, A. & Chaari, W.L. Adaptive architecture based on agents for assessing a web application. Multimed Tools Appl 81, 40581–40607 (2022). https://doi.org/10.1007/s11042-022-13059-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-13059-9

Keywords

Navigation