Skip to main content
Log in

An affective learning agent with Petri-net-based implementation

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Traditional interactive evolutionary computing approaches are usually susceptible to limited searching ability and human’s strong subjectivity. In response, by extending a traditional Belief-Desire-Intention (BDI) structure, a kind of affective learning agent which can perform affective computing and learning activities in human-computer interaction environment is explicitly introduced. In solving human-computer interactive multi-objective decision-making problems whose objectives are usually far from well structured and quantified, this kind of agent may help reduce human’s subjective fatigue as well as make decisions more objective and scientific. Specifically, a conceptual model of the agent, affective learning-BDI (AL-BDI) agent, is proposed initially, along with corresponding functional modules to learn human’s affective preference. After that, a kind of high level Petri nets, colored Petri nets are employed to realize the components and scheduler of the AL-BDI agents. To exemplify applications of the approaches, test functions are suggested to case studies, giving rise to satisfied results and showing validity of the contribution.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

References

  1. Gnjatović M, Janev M, Delić V (2011) Focus tree: modeling attentional information in task-oriented human-machine interaction. Appl Intell 36 (OL)

  2. Gao J, Lv H (2011) Institution-governed cross-domain agent service cooperation: a model for trusted and autonomic service cooperation. Appl Intell 36 (OL)

  3. Treur J (2011) A virtual human agent model with behaviour based on feeling exhaustion. Appl Intell 35:469–482

    Article  Google Scholar 

  4. Tan A-H, Ong Y-S, Tapanuj A (2011) A hybrid agent architecture integrating desire, intention and reinforcement learning. Expert Syst Appl 38:8477–8487

    Article  Google Scholar 

  5. Casali A, Godo L, Sierra C (2011) A graded BDI agent model to represent and reason about preferences. Artif Intell 175:1468–1478

    Article  MathSciNet  MATH  Google Scholar 

  6. Ferber J (1999) Multi-agent systems. Addison-Wesley Longman, Marlow

    Google Scholar 

  7. Jennings NR (1999) Agent-based computing: promise and perils. In: Proceedings of the 16th international joint conferences on artificial intelligence, Stockholm, Sweeden

    Google Scholar 

  8. Xiao L, Greer D (2009) Adaptive agent model: software adaptivity using an agent-oriented model-driven. Archit Inf Softw Technol 51:109–137

    Article  Google Scholar 

  9. Maes S, Meganck S, Manderick B (2007) Inference in multi-agent causal models. Int J Approx Reason 46:274–299

    Article  MathSciNet  MATH  Google Scholar 

  10. Picard RW (1997) Affective computing. MIT Press, London

    Google Scholar 

  11. Wang Z, Zhao Y (2001) An expert system of commodity choose applied with artifibial psychology. In: IEEE international conference on systems, man and cybernetics, pp 2326–2330

    Google Scholar 

  12. Onony A, Clore GL, Collins A (1988) The cognitive structure of emotions. Cambridge University Press, Cambridge

    Google Scholar 

  13. Fan X, Chen P-C, Yen J (2010) Learning HMM-based cognitive load models for supporting human-agent teamwork. Cogn Syst Res 11:108–119

    Article  Google Scholar 

  14. Rosis FD et al (2003) From Greta’s mind to her face: modelling the dynamics of affective states in a conversational embodied agent. Int J Hum-Agent Stud 59(1–2):81–118

    Article  Google Scholar 

  15. Miranda JM, Aldea A (2005) Emotions in human and artificial intelligence. Agents Hum Behav 21(2):323–341

    Article  Google Scholar 

  16. Ventura R, Ferreir CP (2009) Responding efficiently to relevant stimuli using an affect-based agent architecture. Neurocomputing 72(13–15):2923–2930

    Article  Google Scholar 

  17. van Kesteren A-J, op den Akker R (2000) Simulation of emotions of agents in virtual environments using neural networks. In: Proceedings of the twente workshop on language technology 18, Enschede, pp 137–147

    Google Scholar 

  18. Ishihara H, Fukuda T (2000) Traffic signal networks simulator with learning emotional algorithm. In: IEEE/RSJ international conference on intelligent robots and systems, pp 2274–2279

    Google Scholar 

  19. Kwon (2004) Modeling and generating context-aware agent-based applications with amended colored Petri nets. Expert Syst Appl 27:609–621

    Article  Google Scholar 

  20. Lamih (2008) Use of Petri nets for modeling an agent-based interactive system: basic principles and case study. Petri Net, Theory Appl 131–147

  21. Gao S, Dew R (2007) Enhancing web-based adaptive learning with colored timed Petri net. In: Knowledge science, engineering and management. LNAI, vol 4798, pp 177–185

    Chapter  Google Scholar 

  22. Chang Y-C, Huang Y-C, Chu C-P (2009) B2 model: a browsing behavior model based on high-level Petri nets to generate behavioral patterns for e-learning. Expert Syst Appl 36:12423–12440

    Article  Google Scholar 

  23. Chang Y-C, Chu C-P (2010) Applying learning behavioral petri nets to the analysis of learning behavior in web-based learning environments. Inf Sci 180:995–1009

    Article  MathSciNet  Google Scholar 

  24. Omrani F, Harounabadi A, Rafe V (2011) An adaptive method based on high-level Petri nets for e-learning. Softw Eng Appl 4:559–570

    Article  Google Scholar 

  25. Barzegar S, Davoudpour M, Meybodi MR, Sadeghian A, Tirandazian A (2011) Formalized learning automata with adaptive fuzzy coloured Petri net: an application specific to managing traffic signals. Sci Iran 18(3):554–565

    Article  Google Scholar 

  26. Liu X-Q, Wu M, Chen J-X (2002) Knowledge aggregation and navigation high-level Petri nets-based in e-learning. In: Proceedings of the first international conference on machine learning and cybernetics, Beijing

    Google Scholar 

  27. Zitzler E, Thiele L, Laumanns M et al (2003) Performance assessment of multi-objective optimizers: an analysis and review. IEEE Trans Evol Comput 17(2):117–132

    Article  Google Scholar 

  28. Lai C-C, Chang C-Y (2009) A hierarchical evolutionary algorithm for automatic medical image segmentation. Expert Syst Appl 36(1):248–259

    Article  Google Scholar 

  29. John V, Trucco E, Ivekovic S (2010) Markerless human articulated tracking using hierarchical particle swarm optimization. Image Vis Comput 28(11):1530–1547

    Article  Google Scholar 

  30. Li H-g, Su C (2011) Affective interactive agents with applications in control performance assessment. Comput Integr Manuf Syst 11:2438–2446

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hongguang Li.

Appendix: Complexity analysis of the affective learning algorithms

Appendix: Complexity analysis of the affective learning algorithms

As a technique of computer science, algorithm’s complexity analysis is typically concerned with time and space complexity which is meant to measure the costs of the algorithm in terms of time and space. In this sense, we briefly present the complexity analysis of the affective learning algorithms as follows.

Time complexity analysis

To facilitate the discussion, initially, we specify some related parameters associated with the algorithms as follows. t denotes the number of human-computer affective interactions; p(t) is the population of tth generation; m is the population size; q is the length of chromosome; p c is the crossover rate; p m is the mutation rate; f is the human’s expectation value. Additionally, some parameters are involved in the preferential minimization problem solved by genetic algorithms as well, in which, n is the evolution number; p′(n) is the population of nth generation; k is the population size; l is the length of chromosome; \(p_{c}'\) is the crossover rate; \(p_{m}'\) is the mutation rate; f′ is the human’s expectation values. Thus, The basic statements involved in the algorithms can be summarized as follows.

Initialize (p c ,p m ,t,f);

// initializing parameters of the interactive evolutionary computing algorithm (i.e. crossover rate, mutation rate etc.)

{t=0;

(1) :

initialize p(t); // initiating population randomly;

(2) :

calculate the multi-objective fitness index of the initial chromosome group;

(3) :

for (j=1; j<t+1; j++)

// when the fitness index of the highest chromosome fitness value is less than that of human’s expectations, doing follows;

{

(4) :

select the excellent individuals; //selection operations;

(5) :

crossover of p(t); //crossover operations;

(6) :

mutation of p(t); //mutation operations;

(7) :

achieve chromosome groups, Q (t+1), of the next generation;

// calculating chromosome groups’ multi-objective fitness index of the next generation;

(8) :

according to affective computing metrics, calculate agent’s affective preferences corresponding to each individual;

(9) :

present human’s preferences of each individual by interactions;

//next, solving the minimization problem in terms of the preferential deviation between agents and human:

{

(10) :

initialize (\(p_{c}',p_{m}',n,f'\));

// initializing parameters of the genetic algorithm (i.e. crossover rate, mutation rate etc.)

(11) :

initialize p′(n); // initiating population of A, X randomly;

(12) :

calculate fitness index;

(13) :

for (i=1; i<n+1; i++); // when the highest fitness index is still less than the expected one, doing follows;

{

(14) :

selection of p′(n); // selection operations;

(15) :

crossover of p′(n); // crossover operations;

(16) :

mutation of p′(n); // mutation operations;

(17) :

achieve next generation of chromosome groups, Q (n+1); //calculating the chromosome groups’ fitness index of the next generation;

}

(18) :

update the optimized affective computing model parameters A, X;

}

}

}

(19) :

achieve the average multi-objective fitness of the current chromosome groups.

It is obviously that the basic statement which has the most execution time in the algorithm is usually in the innermost loop of the loop body. Taking account of statements (3)–(12) and (13)–(17) forming nested loops, the time complexity of the algorithms is eventually characterized by: T 1(n)+T 2(n)+T 3(n)∗{T 4(n)+⋯T 12(n)+T 13(n)∗[T 14(n)+T 17(n)]+T 18(n)}+T 19(n)=O[t×((m×q)+n×(k×l))], where, O marks the time performance.

Space complexity analysis

Space complexity is concerned with the required storage space where the algorithms execute in computers. In addition, a general discussion can be conducted on auxiliary storage unit space besides the normal memory overhead. In this sense, the affective learning algorithm’s space complexity could refer to the two nested initial chromosomes’ occupant space. Furthermore, other operations are conducted on the spot. As a result, the affective learning algorithm‘s space complexity is presented as O(m×q+k×l).

Rights and permissions

Reprints and permissions

About this article

Cite this article

Su, C., Li, H. An affective learning agent with Petri-net-based implementation. Appl Intell 37, 569–585 (2012). https://doi.org/10.1007/s10489-012-0350-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-012-0350-3

Keywords

Navigation