Abstract
According to aviation statistics, most of the safety occurrences happen not in the air, but on the ground. Management of airlines and airports often consider failures to comply with safety-related regulations as important contributors to safety occurrences. To address the issue of compliance, approaches based on external regulation of the employees’ behavior were proposed. Unfortunately, an externally imposed control is often not internalized by employees and has a short-term effect on their performance. To achieve a long-term effect, employees need to be internally motivated to adhere to regulations. To understand the role of motivation for compliance in ground service organizations, in this paper a formal agent-based model is proposed based on theories from social science with a wide empirical support. The model incorporates cognitive, social, and organizational aspects. The model was simulated and partially validated by a case study performed at a real airline ground service organization. The model was able to reproduce behavioral patterns related to compliance of the platform employees in this study. Based on the model, global sensitivity analysis was performed. The results of this analysis together with the simulation results were used to generate recommendations to improve compliance.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
1 Introduction
Safety has the highest priority in aviation. Although commercial aviation is one of the safest modes of transportation, the ever increasing amount of traffic requires a substantial effort to decrease levels of risk. According to aviation statistics [6], most of the safety occurrences happen not during the flight, but on the ground, e.g. during aircraft ground handling operations and aircraft maintenance operations. Decreasing the number of ground safety occurrences has a high priority in many airlines in different countries. To achieve this aim some airlines use ramp Line Operations Safety Assessments (LOSA) [6] — a monitoring tool for measuring and identifying the adherence to safety regulations on the platform. Monitoring and recording of violations of safety regulations using ramp LOSA is done on a regular basis by experienced platform employees. It was expected that collecting information about violations and presenting this information to the employees would make them aware of their undesirable behavior. Unfortunately, the introduction of ramp LOSA at the ground service organization under study did not result in a decrease of the number of ground safety occurrences.
To address the issue of compliance of employees with safety regulations, an approach based on the STAMP framework was proposed in [5]. This approach appeals to top-down external control of the employees by management. The approach proceeds by identifying and mitigating deficiencies of an organizational control structure. However, as pointed out by [7], such an externally imposed control is often not internalized by humans and has a short-term effect on the performance of employees. To achieve a long-term effect, employees need to be internally motivated to adhere to regulations [7]. Thus, the main focus of this paper is on modeling and analysis of the motivation of platform employees to comply with safety regulations. Specifically, the following research questions are addressed:
-
Which and how cognitive, social, and organizational factors influence the motivation of an employee to comply with safety regulations?
-
Can a motivation model be developed to predict deviations from safety regulations in a real airline ground service organization?
-
How and what kind of recommendations to improve compliance can be generated based on the analysis?
To answer these questions an agent-based motivation model was developed based on several theories from social science combined in an integrated framework. The model was applied in the context of a specific task of the aircraft arrival procedure - Foreign Object Damage (FOD) check. A foreign object is any object that should not be located near an aircraft, as it can damage aircraft or injure personnel. According to Boeing [4], the improper execution of FOD checks costs airlines and airports millions of dollars every year. Particularly the effects of FOD on maintenance costs, predominantly engine damage repairs, can be significant. Nevertheless, the ramp LOSA statistics showed that FOD checks are often not performed by platform employees.
The proposed model elaborates the motivation and decision making of the platform employees concerning whether or not to perform an FOD check. In this elaboration, individual cognitive, social, and organizational factors are taken into account. Furthermore, the model includes individual and social learning of agents representing the employees, and addresses two modes of reasoning of the agents – explicit rational reasoning and implicit automatic reasoning (habits). To initialize the model, an extensive one year study was performed at a real ground service organization. Data were gathered by observation, questionnaires, and interviews with employees playing different roles in the organization. The collected data were separated into two data sets. The first set contained data on the organizational context (i.e., formal organizational structures and processes, norms, and regulations) and on local processes and characteristics of the organizational agents. This dataset was used to initialize the model. To represent the uncertainty and variability of the components of the model, most of the parameters were specified by intervals with a uniform distribution. The second set contained data describing global organizational or systemic properties (such as ramp LOSA statistics), which were used to validate the model. Some of the model validation results are discussed in the paper. The model was able to capture behavioral patterns of the platform employees and reflect the ramp LOSA statistics concerning FOD check compliance in the real ground service organization.
Based on the model, global sensitivity analysis was performed to identify the parameters with the highest impact on compliance. The information about these parameters, combined with the simulation results, was used to formulate recommendations to improve compliance. These recommendations are summarized in the paper.
The paper is organized as follows. In Section 2, the theoretical basis of the model is described. In Section 3, the proposed agent-based model is provided. The main results from the simulation study are discussed in Section 4. Section 5 presents the results of the sensitivity analysis. Recommendations to improve compliance are discussed in Section 6. The paper ends with conclusions and a discussion of the results.
2 Theoretical background
The theoretical basis of the model comprises several theories from social science, which are summarized below. These theories address universal human needs, the way humans reason about their needs, and how they make choices to act based on this reasoning. All the theories used for the model development have strong empirical support.
Self-determination theory [7] is a theory of human motivation, which addresses people’s universal, innate psychological needs and tendencies for growth and fulfillment. Specifically, the theory postulates three types of basic needs:
-
the need for competenceconcerns the people’s inherent desire to be effective in dealing with the environment;
-
the need for relatedness concerns the universal disposition to interact with, be connected to, and experience caring for other people;
-
the need for autonomy concerns people’s universal urge to be causal agents – to have volition.
Inline with other motivation theories [22], in addition to the needs listed above, the need for safetywas added, which is particularly relevant for the ground service organization, in which physical injuries are not uncommon.
Based on needs, individual goals can be defined. Higher level individual goals may be refined in goal hierarchies as described in [23]. A goal is a state that the individual desires to achieve or maintain. To achieve or maintain his or her goals, an individual considers different behavioral options (actions or plans). One of the theories that explains why individuals choose one option over another is the Expectancy Theory of Motivation by Vroom [22]. Advantages of the Expectancy Theory include: (a) it can be formalized; (b) it allows incorporating the organizational context; (c) it has received good empirical support. According to this theory, when an individual evaluates alternative possibilities to act, he or she explicitly or implicitly makes estimations for the following factors: expectancy, instrumentality, and valence.
Expectancy refers to the individual’s belief about the likelihood that a particular act will be followed by a particular outcome (called a first-level outcome). Its value varies between 0 and 1.
Instrumentality is a belief concerning the likelihood of a first level outcome resulting into a particular second level outcome; its value varies between −1 and + 1. Instrumentality takes negative values when a second-level outcome has a negative correlation with a first-level outcome. A second level outcome represents a desired (or avoided) state of affairs that is reflected in the agent’s goals.
Valence refers to the strength of the individual’s desire for an outcome or state of affairs; it is also an indication of the priority of goals.
Values of expectancies, instrumentalities and valences may change over time, in particular due to individual and social learning. The motivational force of an individual i to choose option to act k is calculated as:
Here E k l, i (t) is the strength of the expectancy that option i will be followed by outcome j; V h, i (t) is the valence of the second level outcome (a goal) h; and I k l h, i (t) is the perceived instrumentality of outcome l for the attainment of outcome h for option k.
The Vroom’s theory describes the process of rational decision making. However, repetitive actions such as those that occur during aircraft handling may over time become automatic, i.e., a habit. The dual process theory [16] distinguishes System 1 and System 2 thinking. While System 2 is used for rational, rule-based, and analytic thinking, System 1 is associated with unconscious, implicit, and automatic reasoning. Depending on the dynamics of environmental changes, an individual switches between the systems. Both systems are used in the model and the case study considered in the paper.
In the following section, we demonstrate how the theories from this section were formalized and integrated into an agent-based model.
3 The agent-based model
To develop the model, the steps of a generic methodology for modeling agent organizations from [26] were used. In what follows, these steps are elaborated.
3.1 Identification of organizational roles
The following roles were identified (Fig. 1): Platform Employee, Team Leader, and Sector Manager. The Platform Employee and Team Leader roles form a composite Team. For each Team, four Platform Employee role instances and one Team Leader role instance are specified. There is one Sector Manager role instance in the model.
3.2 Identification of interactions among roles and with the environment
All roles are able to interact with each other (Fig. 1). The Platform Employee role and Team Leader role are able to observe the tasks to be accomplished in the environment (i.e., aircraft to be handled), outcomes of their own actions (task is finished successfully, task duration, a safety occurrence happened during the task), and task execution by the other Platform Employee agents. Furthermore, the Team Leader and Sector Manager roles are able to observe violations of the procedures and to provide reprimands to the Platform Employee roles. The reprimands can be observed by all roles.
3.3 Identification of tasks and workflows
Each Team role handles one aircraft at a time. Aircraft to be handled are organized in a FIFO queue. The specific focus of this study is on the FOD check task in the aircraft handling procedure. There are several reasons why this task was chosen. First, the FOD check task is an essential part of the aircraft arrival procedure, which is performed many times during a day by different platform employees. Second, the improper execution of FOD checks costs airlines and airports millions of dollars every year. Third, aviation statistics show that among all the tasks of the arrival procedure, FOD checks are most often not performed by platform employees. Fourth, this task involves individual decision making of platform employees, social processes, and formal organizational aspects, such as formal authority and formal procedures. Therefore, this task is well suited to answer the research questions of the paper. Furthermore, this task is performed separately from other tasks of the arrival procedure, and differs from these tasks substantially. Thus, to analyze the execution of FOD checks, other tasks can be modeled at a higher level, represented by time intervals based on the operational statistics from the organization under study. The sensitive raw data cannot be presented in the paper for confidentiality reasons. Note that individual decision making and the social mechanisms modeled in this paper are based on general psychological and social theories and are not restricted to the FOD check task only.
Specific agents are allocated to the role instances, which in contrast to roles and role instances may have internal cognitive states and dynamics, which are described in the following steps.
3.4 Identification of characteristics of agents
Platform Employee agents have three characteristics: risk aversion (reflected in parameters of the expectancy theory model E13, E14, E15, E16, I131, I141, I152, I162, in Fig. 2, openness to new experiences, and expressiveness in communication. All of these characteristics are assigned values in the interval [0,1].
3.5 Identification of goals and needs of agents
In accordance with self-determination theory and the field study, a number of goals and subgoals were identified in Table 1). The types of needs identified in Section 2 were used by ethnographers to elicit the goals of the platform employees, who participated in the study. The goals were elicited by interviews with the platform employees and their managers, and based on observation of their daily practices. For each type of need, questions were prepared to refine goals based on the need in the specific context of the case study. Furthermore, the priorities of the goals were established. A detailed description of the procedure, as well as of the obtained outcomes, is provided in [3, 10, 14]. For more details on the identified goals, please refer to Appendix A.
3.6 Identification of beliefs of agents
All the expectancies, instrumentalities, and valences of the Platform Employee agents are represented by their beliefs. Thus, a numerical value is associated with every agent’s beliefs.
3.7 Specification of decision making of agents
Decision making by the Platform Employee agents about whether or not to perform an FOD check was modeled by using the Vroom’s expectancy theory (Fig. 2). To initialize the expectancies, instrumentalities, and valences of the model for each agent, three classes of values were introduced: Low, Medium, and High. This was done to address the issue of uncertainty in these parameters, and individual variations of the platform employees. Most of the numerical scales of these parameters were divided equally among the classes: Low for [0, 0.33), Medium for [0.33, 0.67), and High for [0.67, 1]. For a few scales, the division among the classes was adjusted depending on the interpretation of the corresponding parameters in the context of the case study. To determine the values (i.e., specific classes) of the parameters, an ethnographic study was performed in the real ground service organization by observation of organizational practices, interviews, and questionnaires with employees. Furthermore, secondary sources were used, such as safety reports, safety statistics, and reports on previous operational studies at the organization. The complete list of the parameter values of the model, and justifiations for the choices of their values, are provided in Appendix B.
The expectancy theory model was used for System 2 reasoning. When the same operations were routinely executed by a Platform Employee agent, the agent’s System 2 reasoning was gradually shifting to System 1 reasoning – a habit had been formed. This shift was modeled by the dynamics of agent i’s openness parameter α i :
where \(\alpha _{i}^{\min }\) is the minimum perceptive openness of agent i (set to 0.1 in the simulation), and ζis the rate of transition from System 2 to System 1. It depends on the execution frequency of the operation by the agent, as well as on the agent’s personal characteristics. In the simulation ζ = 0.015, meaning that it takes around two months to form a new habit.
When procedural rules change, an agent needs to adapt to a new situation and reconsider options by switching from System 1 to System 2: the agent i’s openness is set to its initial value α i (0), and the process of the new habit formation starts again.
A similar expectancy theory model was created for option 2 – ‘Not to perform FOD check’. It has the same types of parameters, but their values are different (see Appendix B).
In the simulation, every time an agent i considers explicitly (System 2) or implicitly (System 1) whether or not to perform an FOD check, motivation forces F 1, i and F 2, i for both options are calculated by (1). Then, the agent performs the FOD check with probability (F m a x + F 1, i )/(2F m a x + F 1, i + F 2, i ). The normalization with F m a x is used to compensate for the negative values of the instrumentalities.
3.8 Specification of agent learning and social interaction
Two types of learning were modeled: individual and social learning of agents.
An agent learns individually by observing a feedback from the environment on its action. In the decision making model from Fig. 1, the individual learning was realized by updating values of expectancies (E) based on the following observations:
-
An agent observes whether or not a reprimand from other agents is provided, when the agent does not comply with regulations (update of E111, E112, E113).
-
After the successful execution of a task, an agent observes how much time it took and how it influenced the total execution time of the operation (update of E11, E12). The task durations were determined based on operational data from the organization under investigation.
-
When an agent does not perform a FOD check, a safety occurrence could occur. The agent is able to observe such occurrences (update of E13, E14). For this also the organizational statistics was used.
Furthermore, the Platform Employee agents are able to observe the execution of operations by other agents in their teams, and to learn from these agents by verbal communication. Social learning is modeled as the process of social contagion [13]. By this process, expectancies E k l, i (t) were updated as:
Here
is the amount of change of the agent i’s state; T is the set of the agents in the team. A weight γ j, i ∈ [0, 1] is the degree of influence of agent j on agent i defined as:
α i (t) and ε j (t) are the agent characteristics – the openness of information recipient agent i and the expressiveness of information provider agent j,and β ∈ [0, 1] is the strength of the information channel between the two agents.
The communication style in the teams of platform employees is direct, informal, and of a high frequency. For direct communication between agents β j i = 1.
Sector Managers communicate with the Platform Employees directly during observation tours and dedicated meetings. Indirect communication with the management occurs by messages on information screens, posters, memos etc. (β j i = 0.3). The expectancy values of the agents are updated once per simulated day.
3.9 Identification of shared beliefs, norms and values of (groups of) agents
By field observations and interviews, a team norm was identified. The norm applies to situations in which a team arrives too late at an aircraft stand while the aircraft is waiting for the docking process. To save time, the FOD check is omitted and the arrival procedure starts directly. Field data revealed that employees who execute the check in the described situation get a social reprehension from other team members. This influences the achievement of goal G3.1, which is driven by the alignment of the decision option with the team norms and team leader norms.
Expectancy of agent i E 17, i (t) that decision option 1 is in alignment with the team norms depends on the degree of similarity between decision option 1 and the most relevant team norm (if one exists, otherwise E 17, i (t) = 0) and the likelihood that agent i is familiar with this norm. The value of corresponding I 173 is determined as the product of the perceived importance of the norm in the team and the degree of connectedness of agent i in the team: \(\underset {j\in T,\,i\ne j}{\sum } (\gamma _{ij} +\gamma _{ji} )/2(\vert T\vert -1)\), where T is the set of agents in the team. Intuitively, to have a large positive contribution to team relatedness goal G3.1, the agent i’s decision option should be in line with an important team norm, and agent i should be well-connected in the team, i.e. be its prototypical member. This way of reasoning is inspired by prototypicality theories [21].
The Team Leader agent’s norms and Sector Manager agent’s norms are in line with the organizational regulations.
3.10 Specification of the environmental dynamics
The number of aircraft to be handled by the teams of platform employees was modeled according to the actual operational statistics. A day was divided into three shifts (morning, afternoon/evening, and night). During normal operations, on average, the arrival procedure is executed three times each shift.
4 Simulation study
In this section, first a simulation setup is described (Section 4.1), then simulation results are discussed (Section 4.2)
4.1 Simulation setup
Here we discuss a scenario that occurred in reality and that could be validated by empirical data from ramp LOSA. In this scenario, three periods of the organizational operation are considered:
-
the first period, with limited managerial control over the execution of the platform operations and limited safety information provision;
-
the second period (8 weeks), with high managerial control after many safety occurrences happened in the first period;
-
the third period, in which the release of managerial control occurs over time (a linear transition from High control to Low control mode, Table 2).
The parameters for these periods, which were determined by using the field study data, are provided in Table 2. The organization under study does not collect data about reprimands; the probabilities in Table 2 were derived from interviews. In general, the platform employees knew that the reprimands were not likely to be provided, which was in line with the culture of the organization. Therefore, even in the High control mode, the probabilities of reprimands were not high. In the Low control mode, the activities of the platform employees were rarely observed by the management, and violations of procedures were often tolerated. Furthermore, weak social control with respect to safety was realized within the teams. The coercive power of both the sector manager and the team leaders was low. In the High control mode, the team leaders were largely held responsible for observing compliance of the platform employees with regulations and procedures. The sector manager could observe on average three times less operations than the team leaders in the High control mode.
In the Low control mode, very little communication of safety-related information occurred in the organization, which is reflected in the parameter settings in Table 2. In the High control mode, communication has significantly improved. The safety manager organized intensive communication sessions, as well as communicated with platform employees on the workfloor. Furthermore, diverse indirect communication means were employed, such as posters, newsletters, and memos, to remind and inform the platform employees about safety regulations. However, the expressiveness of such information sources was perceived by the platform employees as lower than the expressiveness of management in direct communication.
A team consists of 5 agents: a Team Leader and 4 Platform Employees. In the simulation, the agents in the teams communicated with each other in a random order.
According to interviews at the organization under study, two types of agents in the teams were identified: more expressive agents with ε i ∈ [0.5, 0.9], and less expressive agents with ε i ∈ [0.1, 0.5]. Each agent can be of either type with an equal probability. The openness of an agent α i was assigned a wide range [0.1, 0.9], to represent the diversity of agents. In each simulation run, the agents’ parameters were randomly generated using the uniformly distributed intervals introduced above and in Appendix B.
In the simulation, every time step corresponds to a decision moment for executing or not executing the FOD check. One simulation day is divided into three shifts (morning, afternoon/evening, and night). During normal operations, on average, the arrival procedure is executed three times each shift. The simulated time period was 200 working days; Δt = 1/3, indicating that on average 3 decisions are made by each Platform Employee agent per day.
4.2 Simulation results
In this section, the main simulation results obtained for the scenario under consideration are described.
Due to frequent observation and communication of the agents in a team, their expectancies related to the exchanged information tend to converge over time (Fig. 3). This is a well-known effect in the literature on social contagion [1, 13].
Simulation experiments with a varying composition of teams indicated that the individual characteristics of the Team Leader agent play a crucial role in the dynamics of social contagion, and largely determine expectancies in a team.
Specifically, consider simulation results for two particular teams (Table 3), which exemplify desired and undesired effects of social learning (Fig. 3). In both teams information concerning parameter E22 (belief about the likelihood that performing FOD check would prevent aircraft damage) is being exchanged between the agents.
High values of parameter E22 are desired, since it indicates the degree of safety awareness of a Platform Employee agent. In Team 1 the team leader has a high value for parameter E22 and a high expressiveness. The team members have a high openness. In such a team, the E22 values of the agents change in a desired way, i.e., converge to a high value, close to the initial value of the team leader.
Social contagion can also result in undesired dynamics of expectancy values, as in the case with Team 2 (Table 2). In this example, Platform Employee agents 7 and 8 have a high expressiveness and risk-taking attitude, which in combination influence negatively the expectancies of Platform Employee agents 5 and 6. The team leader has a limited influence on the team members to prevent this undesired process (Fig. 4).
Both desired and undesired dynamics, as was studied by the simulation, were recognized by sector managers in the organization under study. They observed that the compliance with regulations and overall performance vary much over the teams. Furthermore, it was confirmed that negative social influence is not limited to single teams but spreads over the whole organization. According to the sector managers, the findings are not limited to safety-related attitudes, but also concerns operational performance of employees.
In the following we discuss simulation results for the scenario described in Section 4.1.
In the first period of the simulated scenario, after the initialization phase, most of the agents have a relatively constant motivational force for both decision options (Fig. 5). The motivational forces to perform FOD checks are low, as the organization neither sufficiently controls the execution of operations nor creates a sufficient awareness about the importance of FOD checks. Some agents in the team even prefer not to perform the check. By the end of this phase, the agents function in System 1 mode of reasoning.
In the beginning of the second period (indicated by the dotted vertical line in Fig. 5) the organization introduces more frequent managerial control and reprimands. To adapt to the new circumstances, the agents switch to a System 2 mode of reasoning. Such a change results in an increased motivation to perform FOD checks and a decreased motivation not to do so of all agents in all teams. The differences in motivation are explained by differences in the individual characteristics of the agents. However, when after 8 weeks the control and information provision was gradually removed, the agents start gradually returning to their previous state. This form of motivated behavior is known in the literature as ‘externally regulated behavior’ [7]. Such a form of motivation is sustained by the continuous presence of reprimands and rewards. These behavioral patterns were also observed in the ground service organization under study.
Model variants with larger shifts of 7 and 10 agents were also simulated. The patterns in Fig. 5 were also observed in these cases (Appendix D). However, the more agents that participated in a shift, the higher were the motivational forces both to report and not to report. This can be partially explained by more intense social interaction and influence processes in a shift. Furthermore, clusters of agents demonstrating similar behavior emerged in larger shifts, which were particularly well distinguishable in shifts with 10 agents. In the teams, in which all members are expected to interact intensively with each other, it might be an undesirable property.
The model simulation outcomes were also compared to the ramp LOSA statistics of the FOD checks execution in the ground service organization (Fig. 6). The model was able to capture the trends in real ramp LOSA data. Specifically, in Q2, characterized by limited managerial control and limited information provision, both the simulated outcomes and real data indicate a low percentage of the executed FOD checks. In Q3, characterized by a substantial increase of managerial control, a rapid increase in the percentage of executed FOD checks is observed, both in the simulated outcomes and real data. In Q4, a high percentage of the executed FOD checks persists. Starting from Q4, strict managerial control is gradually released. This results in a decrease of the percentage of the executed FOD checks, as can be seen in both simulated and real data for Q1.
The simulation outcomes presented in Fig. 6 fit a normal distribution. Since trace empirical data for the whole simulation were not available in this study, the validation of the model outcomes was done using Student’s two-sample t-test, as also recommended in [17]. Student’s two-sample t-test performed on real and simulated data supported the null-hypothesis at the significance level 5 %.
5 Sensitivity analysis
In this section, a sensitivity analysis approach is described in Section 5.1. Then, the sensitivity analysis results are presented in Section 5.2.
5.1 Sensitivity analysis approach
Based on the model, sensitivity analysis was performed by using the Monte Carlo filtering method [25]. This is a global sensitivity analysis method, which has the advantage over local methods that the analysis is not limited to changing one parameter at a time while keeping the other parameters fixed. The aim of Monte Carlo filtering is to identify model parameters variation of which according to associated credibility intervals leads to significant differences in the model output. It consists of two steps, which are presented next.
-
Step 1:
MC simulations For the complete set of model parameters, lower and upper bounds of credibility intervals of their values were determined based on data gathered at the organization under investigation and on our knowledge about the uncertainty in modeled aspects (Appendix B). Next, 3000 Monte Carlo simulation trials were performed where in each simulation the parameters were chosen uniformly within their credibility interval bounds. For each input factor x i two sets of values were determined: x i |F, containing all values of x i from the simulations that produced the acceptable motivation force levels, and x i |F, containing all x i values that produced unacceptable (low) motivation force levels The threshold that separated the acceptable values from the unacceptable ones was set as the 0.3-percentile of the empirical probability distribution of the motivational force to perform FOD check obtained by the Monte Carlo simulations.
-
Step 2:
Smirnov test A Smirnov two sample test was performed for each input factor independently. The applied test statistics are
$$d(x_{i}) = sup\| P_{F}(x_{i}|F) - P_{F}(x_{i}|\underline{F})\| , $$where P F and P F are marginal cumulative probability distribution functions calculated for the sets x i |F and \(x_{i}|\underline {F}\), respectively. A low level of d(x i ) supports the null-hypothesis \(H_{0}: P_{F}(x_{i}|F= P_{F}(x_{i}|\underline {F})\), meaning that the parameter x i is not important, whereas a high level of d(x i ) implies the rejection of H 0, meaning that x i is a key factor.
To investigate the effects of the credibility intervals on the sensitivity analysis results, the sensitivity analysis procedure was also performed with wider ranges of the parameters of the decision making model reflecting a larger diversity of the Platform Employee agents and their attitudes than was identified in the organization under study. Specifically, the expectancies, instrumentalities, and valences varied in the whole range (0, 1).
5.2 Sensitivity analysis results
In the following sections, the main findings concerning different types of parameters of the model are discussed. The sensitivity analysis findings obtained by the MC simulation with the parameter ranges defined in Appendix B mostly agreed with the findings obtained by the MC simulation with wider ranges as defined in Section 5.1. The only difference is that in the case with the wide parameter ranges, the parameters related to the reprimands from the team and the team leader were identified as important. This is because the simulation settings allowed formation of diverse attitudes towards reprimands, which had a significant impact on whether or not to perform the FOD check task. A complete overview of the sensitivity analysis results is provided in Appendix C.
Instrumentalities
The importance of instrumentalities in the model is considerably larger than the importance of expectancies, weights, and valences. The instrumentalities answer the question why a decision option considered by an agent is important for the achievement of its goals. Also, according to other studies (e.g., in incident management and emergency [20]), explaining why an action needs to be performed has a higher motivational effect on the agent than simply providing information or instructions.
Time perceptions
Analysis revealed that the parameters related to the perception of time efficiency (E 12, I 121) have a large impact on the model outcomes. This was also recognized by the domain experts.
Risk perceptions
In the model, the perceived effectiveness of the FOD check for preventing (engine) damage (E 22 and I 22) was important.
Connectedness and influence relations
Social relations within teams and with the management (I411b and I431b) have a major contribution to individual decision making and significantly impact the model outcomes. This was also recognized by the domain experts.
Norms
The parameters related to the team norms (E411a and I411b) have a high influence on the model outcomes.
The importance of the autonomy-related variables IF 1 (Amount of monitoring and control) and IF 2 (Level of rule details) is comparable with the importance of the expectancies.
Valences
As expected, the importance of the competence valence (V 1) was considerably larger than of the other valences.
Management reprimands
In contrast with what was expected, the importance of managerial reprimands (E53 and I53) is relatively low compared with other parameters. This is primarily because of the low probabilities of reprimand provision by the Sector Manager agent (Just culture). Together with a relatively low reprimand severity, the effect of management influence through control is low.
6 Recommendations
Based on the sensitivity analysis results discussed in Section 5, a number of recommendations for improvement of compliance were formulated, which were divided into four areas: information provision, managerial control and influence social interaction in teams, and autonomy.
6.1 Information provision
Provision of information (through formal and informal communication channels) is performed by the management to change safety-related beliefs and attitudes of the employees. Simulations revealed that information provision positively affects time and risk perceptions (expectancies) of the Platform Employee agents which contributes significantly to the desired motivational forces. The effectiveness of information provision depends on the strength of information channels Interviews with managers and platform staff revealed that the information screens in the canteen and direct communication (e.g. information sessions) are effective channels. The effectiveness of sending emails and workplace instructions is limited. The impact of magazines like Ground Safety is questioned. Direct communication between sector managers and platform staff seems to be the most adequate way of influencing employees. It is recommended that higher management should facilitate sector managers in organizing measures to inform and influence platform staff.
Further analysis by simulation revealed that the effect of information provision reduces over time. Increasing the information provision period does not significantly affect time and risk perceptions Thus, information provision periods should be short and intensive. Furthermore, explaining why behavior/routines should change is more important than simply providing information. Experiences with dedicated intensive information sessions for introducing a new arrival procedure were positive.
6.2 Managerial control and influence
Reprimands by sector management can be an effective method to influence behavior of employees. Field study data however show that the probability for a team member to receive a reprimand from a sector manager for a specific action is low (Just culture [8]) The sensitivity analysis results also indicated a low importance of the reprimand-related parameters. However, if the credibility intervals of the reprimand probability and severity include high values, their effect on motivation would increase considerably. Nevertheless, even in this case reprimands would impact extrinsically motivated behavior and would have only a short-term effect on motivation.
Since the probability for receiving reprimands from sector managers is low, other control options need to be explored. More frequent use of observers to check rule compliance on the platform could be considered. The experience with employees performing time measurements and monitoring the correct execution of the arrival procedure was positive. The benefit of using operational personal for these measurements and observations is twofold. First, important safety statistics for the management and safety departments can be collected. In the second place, the safety awareness of the observers and other employees can be improved.
6.3 Social interaction in teams
Team composition has a strong influence on the formation of desired and undesired norms and routines in teams. Expressive persons with a negative attitude towards safety can influence other team members in an undesirable manner. The negative effects are amplified throughout the whole department due to varying team compositions. Sector managers are considering the introduction of a registration system for management and team leaders to record undesired behaviour of employees. Such a system might help in identifying expressive employees with negative attitudes. Such identification would make it possible to rearrange teams to limit social contagion of undesired attitudes and behavior.
The results suggest enhancing the leadership capabilities of team leaders. Personal training of team leaders could improve their influence on team members.
6.4 Autonomy
Theory [7] suggests that autonomy is an important need influencing human motivation. Our sensitivity analysis revealed that the level of rule details has a significant influence on motivation. Employees argue that the operational performance goals cannot be met if all rules are followed, and argue for more freedom in the execution of their tasks. Furthermore, field study data indicated that the participation of employees in the rule formation process was limited. The results suggest that facilitating and stimulating feedback from the platform to the rule formation process by management would contribute positively to the autonomy need. Some researchers consider this process as a bottom-up formation of rule ownership by employees [11, 12]
7 Discussion and Conclusions
In this paper, a formal agent-based motivation model was presented, based on an integrated theoretical basis from social science. All the theories used for the model development were extensively validated by experiments with human subjects and received wide support. The validity of the expectancy theory has been extensively tested by empirical studies [15, 22]. These studies have consistently found that expectancy type attitude measures are significantly correlated with measures of individual motivation and task performance. Self-determination theory, which is the basis of the model, is well accepted in social science. Its psychometric instruments are well validated [7]. A recent study described in [24] provides evidence that the psychometric properties of measures of motivation are aligned with self-determination theory. Self-determination theory has similarities with other influential theories of human motivation. In particular, [19] identifies four universal human motives: achievement, affiliation, power, and avoidance. Achievement is related to the competence need. Affiliation is similar to the relatedness need. The power motive is interpreted in [19] as having an impact on the world and reaching the sense of control. Furthermore, the power motive is to a degree reflected in the social contagion process, by which agents influence each other. In particular, the degree of influence might incorporate power aspects (e.g., based on the French & Raven’s framework [9]). The avoidance motive is not directly included in self-determination theory. However, in our model it may be related to the safety need. Furthermore, this motive is also reflected in social contagion between agents, as it determines the intensity and frequency of interaction through social contagion parameters.
In the study presented in the paper, a good agreement is demonstrated between the simulated results obtained using the proposed model and real data from the ground service organization under study. However, to gain more confidence in the model, more validation studies need to be performed. Data gathering for such studies is a time-consuming and difficult task, which on the one hand requires support of the organization, and on the other hand expertise in social science and ethnography. In our project, data were gathered by professional ethnographers.
A number of important individual, social, and organizational factors were identified by sensitivity analysis based on the model, which influence the motivation of the platform employees to comply with safety regulations. It is suggested that to achieve long lasting compliance, these factors need to be addressed by management. The sensitivity analysis identified the importance of social relations and norms for motivation and compliance. Other important findings concerned information provision by management to the employees. In particular, it is important not only to provide information, but also to explain the reasons for, and consequences of, rules and regulations.
In the paper, the compliance of employees to a specific task – FOD check – was investigated. However, the same modeling approach could also be used to study other tasks. Moreover, in a discussion with another ground service organization from a different national culture, findings from this study were recognized as relevant for their organization too. However, to determine the generality of the model-driven approach, more detailed studies at other organizations are required.
To the best knowledge of the authors, this is the first attempt to approach the problem of compliance in airline ground service organizations by a model-driven simulation study of the employees’ motivation. Previous studies on safety occurrences at airline ground service organizations (e.g., [2]) mainly used statistical data analysis and informal identification of possible causes of these occurrences.
The formal agent-based modeling and simulation approach used here has a potential to become a useful decision support tool for managers at airline ground service organizations.
References
Axelrod R (1997) The dissemination of culture a model with local convergence and global polarization. J Confl Resolut 41:2023–226
Balk A (2008) Safety of ground handling (Research Report No. NLR-CR-2007-961). Retrieved from EASA website: http://easa.europa.eu/essi/ecast/wpcontent/uploads/2011/08/NLR-CR-2007-961.pdf:NationalAerospaceLaboratory
Bakker J (2014) Making sense of safety at KLM Ground Services. Master Thesis, VU University Amsterdam
Boeing (1998) Foreign object debris and damage prevention. Retrieved from http://www.boeing.com/commercial/aeromagazine/aero01/textonly/s01txt.html
de Boer RJ, de Jong S (2014) Application of STAMP to Facilitate Interventions to Improve Platform Safety. In: Proceedings of the 3rd STAMP workshop, boston
de Boer RJ, Koncak B, Habekotté R, Van Hilten GJ (2011) Introduction of ramp-LOSA at KLM Ground Services. In: Human factors of systems and technology, human factors and ergonomics society annual meeting. Shaker publishing, Maastricht
Deci EL, Vansteenkiste M (2004) Self-determination theory and basic need satisfaction: Understanding human development in positive psychology. Ricerche di Psichologia, 27, pp 17–34
Dekker S (2008) Just culture Balancing safety and accountability. Ashgate Publishing, Burlington
French J, Raven B (1959) The bases of social power. In: Cartwright D (ed) Studies in social power. Institute for Social Research, Ann Arbor, pp 150–167
Haest R (2014) Modeling and Analysis of Rule and Procedure Compliance in Airline Ground Operations: A multidisciplinary safety study at KLM Ground Services Master Thesis Delft University of Technology. (available from TU Delft repository)
Hale A (2013a)Working to rule, or working safely? Part 1: A state of the art review. Saf Sci 55:207–221
Hale A (2013b) Working to rule or working safely? Part 2: The management of safety rules and procedures. Saf Sci 55:222–231
Hegselmann R, Krause U (2002) Opinion dynamics and bounded confidence: models, analysis and simulation. J of Artificial Societies and Social Simulation 5:3
Heimering R (2014) Understanding the organizational routines of the KLM Ground Services handling staff regarding to personal safety rules/procedures Master Thesis. VU University, Amsterdam
Heneman HG, Schwab DP (1972) Evaluation of research on expectancy theory predictions of employee performance. Psychol Bull 78(1):1
Kahneman D (2011) Thinking, fast and slow New York Farrar Straus and Giroux
Kleijen JPC (1999) Validation of models: statistical techniques and data availability. Simulation Conference Proceedings, 1999 Winter. Vol 1. IEEE
Mackie G, Moneti F, Denny E, Shakya H (2012) What are Social Norms? How are They Measured?. In: Working paper UNICEF / UCSD center on global justice poject cooperation agreement
McClelland DC (1987) Human motivation. CUP Archive
Mitleton-Kelly E (2013) Co-evolution of Intelligent Socio-technical Systems Modelling and Applications in Large Scale Emergency and Transport Domains. Springer
Monti A, Soda G (2014) Perceived Organizational Identification and Prototypicality as Origins of Knowledge Exchange Networks. In: Brass DJ, Labianca G (JOE), Mehra A, Halgin DS, Borgatti SP (eds) Contemporary Perspectives on Organizational Social Networks (Research in the Sociology of Organizations Volume 40). Emerald Group Publishing Limited, pp 357–379
Pinder CC (1998) Work motivation in organizational behavior. Prentice-hall, NJ
Popova V, Sharpanskykh A (2011) Formal modelling of organisational goals based on performance indicators. Data Knowl Eng 70(4):335–364
Sebire SJ, Jago R, Fox KR, Edwards MJ, Thompson JL (2013) Testing a self-determination theory model of children’s physical activity motivation: a cross-sectional study. Int J Behav Nutr Phys Act 10(1):111
Saltelli A, Tarantola S, Campolongo F, Ratto M (2004) Sensitivity Analysis In Practice: A Guide to Assessing Scientific Models. Wiley, West Sussex
Sharpanskykh A, Stroeve S (2011) An Agent-based Approach for Structured Modeling, Analysis and Improvement of Safety Culture. Computational and Mathematical Organization Theory 17:77–117
Acknowledgments
We are grateful to Gert Jan van Hilten and Patrick Pronk for practical support of this research. Furthermore, we would like to thank David Passenier, dr. Robert Jan de Boer, and dr. Nicoletta Dimitrova for stimulating discussions in the course of this research. We thank prof.dr. Warren Walker for his valuable comments on the paper.
Author information
Authors and Affiliations
Corresponding author
Appendices
Appendix A: The goals of a platform employee agent
1.1 G1.1 Achieve the highest time efficiency
Handling all assigned aircraft on-time during the turnaround process can be seen as the main goal for platform staff during their normal daily operations. This deeply rooted goal can be clearly observed and was highlighted during the interviews with employees. Management targets support the performance driven mentality of platform staff.
Most employees have a long employment history and a high commitment and solidarity towards the company and their passengers. Satisfying passengers by avoiding delays in the turnaround process is deeply rooted in the minds of the operational staff. Competence goals are therefore strongly related to working as efficient as possible with respect to time. For years management have been giving time efficiency the highest priority. More recently the management priority has shifted towards safety as the main priority after a series of serious accidents and incidents. This priority shift is not entirely adapted by the operational personnel yet. A frequently heard comment to this is the following: ”if we will comply with all (safety) rules, most aircraft would no longer depart on time ”.
1.2 G1.2 Prevent aircraft, equipment and/or infrastructural damage
The platform environment can be hectic and busy during an aircraft turnaround process. Different companies and departments carry out their work within a short time period. Causing aircraft, equipment or infrastructural damage has a high impact on the organization, customers and employees. The consequences of aircraft damage in particular in terms of delay costs and maintenance costs can be high. Platform staff is well aware of the impact of incidents and avoiding damage has a high priority.
In the culture which is present at the workplace, involvement in incidents strongly affects the feeling of competence of platform staff. In most cases the involved ones need to report the damage to the management. The consequences are however limited for the employee since the management claims there is a just cultureat the organization. In a just culture employees are not punished for actions, omissions or decisions, but gross negligence, willful violations and destructive acts are not tolerated.
1.3 G2.1 Prevent personal injury
Personal injury during operations is mainly caused by falling from height, moving equipment (collision) and exposure to environmental conditions (noise). These types of incidents can mostly be prevented by following rules and procedures, using physical safety barriers and wearing personal protective equipment (PPT). Occupational safety has a high management priority. Personnel indicated that returning home safely after work is a top priority. Based on low compliance levels to applicable rules and procedures a discrepancy between preventing personal injury and following rules seems to exist.
1.4 G3.1 Achieve high team acceptance
The team acceptance goal is driven by the need of an individual to feel a sense of belonging to a group. The goal is satisfied when people feel appreciated and/or accepted by their colleagues. Following the team norms is a condition for acceptance. A social norm is based on reciprocal expectations of the people within the group. It is what people in some group believe to be normal, that is, believed to be a typical action, an appropriate action, or both [18]. Social norms can be stiffly resistant to change. The working paper by Unicef [18] provides some other ways of measuring social norms and was used as a guidance for the identification of the norms considered in this thesis.
The mutual relationships and dependencies between team members can be very strong. The field study revealed that maintaining good relationships with colleagues is an important job satisfaction requirement. In this respect, the team leader has a special role. The team leader is a member of a team, but has different responsibilities than the other team members. The team leader is a link between sector management and the workfloor. Sector management considers team leaders as the ambassadors of management norms at the workfloor. Team leaders struggle with the conflicting interests of management and workfloor. The result is the emergence of team leader norms, which are partly fulfilling the management norms and partly team norms.
1.5 G3.2 Achieve high management acceptance
Following rules and procedures, the management norms, are the condition for management acceptance. In general, the priority for management acceptance is much lower than the team acceptance priority for most team members. A relatively strong management aversion and incomprehension were identified during the data gathering phase. Complaints vary from inadequate working equipment to problems with holiday requests. This incomprehension strongly affects the influence relations between sector management and platform staff.
1.6 G4.1 Achieve a high level of freedom in the execution of tasks
The autonomy need in relation to platform operations is characterized by freedom in execution of tasks. Following rules and procedures restricts the freedom in execution of tasks. The number of rules and level of detail by which the process is described influence largely the flexibility in the operation execution. Also the amount of control is an important factor which can restrict the perceived freedom.
1.7 G4.2 Achieve high psychological ownership of rules
Ownership of rules is related to commitment and plays an important role in compliance with those rules, even in situations where no control exists. It is important to ensure that rules and procedures match the conditions at the workfloor. Team members and team leaders are the experts in carrying out the work and the rules and procedures should be in alignment with their (safety-related) beliefs. Autonomy is strongly affected by (new) rules which are not supported by platform staff. This frustration increases the incomprehension between management and operational personnel and affects negatively the feeling of autonomy.
Appendix B: Model parameters
In the table below Low (L) corresponds to [0, 0.33), Medium (M) corresponds to [0.33, 0.67), and High (H) corresponds to [0.67, 1]. For negative values of instrumentalities \(\underline {\text {L}}\) stands for [0, −0.33), \(\underline {\text {M}}\) stands for [ −0.33, −0.67), \(\underline {\text {H}}\) stands for [ −0.67, −1]. Other intervals are specified by numbers.
Appendix C: Sensitivity analysis results
The following table provides a list with the most important model parameters in the order of decreasing importance obtained by the sensitivity analysis with the parameter ranges as defined in Appendix B.
The next table provides a list with the most important model parameters obtained by the sensitivity analysis with the decision making parameters (expectancies, instrumentalities, and valences) ranging in (0, 1).
Appendix D: What-if simulation outcomes for larger teams
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Sharpanskykh, A., Haest, R. An agent-based model to study compliance with safety regulations at an airline ground service organization. Appl Intell 45, 881–903 (2016). https://doi.org/10.1007/s10489-016-0795-x
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10489-016-0795-x