Collaboration effectiveness-based complex operations allocation strategy towards to human–robot interaction

Under the background of the fourth industrial revolution driven by the new generation information technology and artificial intelligence, human–robot collaboration has become an important part of smart manufacturing. The new “human–robot–environment” relationship conducts industrial robots to collaborate with workers to adapt to environmental changes harmoniously. How to determine a reasonable human–robot interaction operations allocation strategy is the primary problem, by comprehensively considering the workers’ flexibility and industrial robots’ automation. In this paper, a human–robot collaborative operation framework based on CNC (Computer Number Control) machine tool was proposed, which divided into three stages: pre-machining, machining and post-machining. Then, an action-based granularity decomposition method was used to construct the human–robot interaction hierarchical model. Further, a collaboration effectiveness-based operations allocation function was established through normalizing the time, cost, efficiency, accuracy and complexity of human–robot interaction. Finally, a simulated annealing algorithm was adopted to solve preferable collaboration scheme; a case was used to verify the feasibility and effectiveness of the proposed method. It is expected that this study can provide useful guidance for human–robot interaction operations allocation on CNC machine tools.


Introduction
The new generation information technology and advanced manufacturing technology have become the core driving force of the fourth industrial revolution. At present, artificial intelligence (AI) based models, such as computing vision, deep learning, and knowledge graph, have significantly shown advances in smart product design, production optimization and maintenance management [1,2]. With the continuous shortening of product life cycle, the manufacturing paradigm has gradually shifted from large-in which workers and industrial robots can work together autonomously through multi-directional, multi-level and multi-scale operations. At present, there are bottlenecks in human-robot collaboration on CNC (Computer Number Control) machine tools: 1 The adaptability of complex operations. Traditional CNC machine tools are committed to high precision as the goal to complete fixed and heavy operations; while the new generation CNC machine tools focus more on deep human-robot collaboration, and the operations are flexible. 2 The friendliness of humanrobot interaction. Traditional CNC machine tools have low friendliness and intelligence; while the new generation CNC machine tools can provide a variety of interaction modes such as voice and gesture to actively recognize workers' behavior intention [7].
In the context of human-robot interaction, workers and industrial robots have their own significant advantages. The advantage of workers lies in their strong cognitive ability especially when dealing with complex operation tasks; the advantage of industrial robots lies in high strength, fast speed and high accuracy. In the industrial scenario of human-robot interaction, the primary problem to be solved is the rational operations allocation between workers and industrial robots. Therefore, this paper takes the human-robot collaboration for CNC machine tools as the research object, and investigates the allocation strategy of complex operations. By measuring the complexity of workers and industrial robots' operations, an optimization function based on multi-attribute evaluation was proposed. The main contributions of this paper are outlined as follows: 1) A human-robot collaborative operations framework on CNC machine tool was proposed. According to the characteristics of the collaborative operations, it was divided into three stages: pre-machining, machining and post-machining. 2) A three-layer hierarchical model of "production line-operations-actions" was established. A human-robot operation allocation model was built and solved by simulated annealing algorithm. The rest of this paper is organized as follows. Section 2 presents literature review of human-robot collaboration. A human-robot collaborative operation framework on CNC machine tool is proposed in Sect. 3. Section 4 shows the actions analysis in the context of human-robot interaction. In Sect. 5, a collaboration operations allocation model is established. Section 6 uses a simulated annealing algorithm to solve above model. Section 7 is a case study. Conclusions and future work are shown in Sect. 8.

Literature review
As an emerging mode, human-robot collaboration has attracted increasing attentions in recent years, both in academia and in industry [8]. At present, it has been widely studied in construction, assembly, disassembly and other scenarios [9][10][11]. Focusing on the allocation strategy of collaboration operations, typical study was outlined as follows: Gervasi et al. proposed a general framework to evaluate the collaboration between humans and robots considering different configuration profiles [12]. Malik and Brem explored the feasibility of using a digital twin to address the complexity of collaborative production systems through an industrial case and a demonstrator [13]. Roveda et al. proposed a Model-Based Reinforcement Learning (MBRL) variable impedance controller to assist human operators in collaborative tasks [14]. Parsa and Saadat proposed a disassembly planning method based on human-robot collaboration. Based on cleanability, reparability and economy of remanufacturing components, genetic algorithm was used to find a nearoptimal collaborative disassembly process [15]. Then Tram and Raweewan studied human-robot task allocation when designing for semi-automation considering total operating cost, cycle time, and ergonomic difficulty through building a multiobjective linear programming model [16]. Baenziger et al. established the production time and ergonomics during a production cycle as a function of the human-robot task allocation, and used genetic algorithm to optimize the task allocation in human-robot teams for a given workplace [17]. Also, Zhang et al. adopted a human-robot collaborative reinforcement learning algorithm to optimize the task sequence allocation scheme in assembly processes [18]. To sum up, most of the current literature is about the task allocation of product disassembly and assembly line. There is a lack of research on human-robot operations allocation in production line, especially CNC machine tools.
In terms of human-robot collaborative operations allocation of the production line, different workpieces processes and different types of CNC machine tools can lead to more complex collaborative schemes between workers and industrial robots. Therefore, human-robot collaborative operations allocation is a complex nonlinear combination problem. Many studies have shown that intelligent optimization algorithms have outstanding advantages in solving the above NP-hard problems [19]. For example, Ren et al. summarized the research on the smart management of intelligent optimization algorithms in manufacturing equipment from the four aspects: task analysis and management of intelligent manufacturing equipment in big data environment, task decomposition and resource allocation, task network analysis and evaluation, and task integration analysis and verification evaluation progress [20]. Qawqzeh et al. investigated the recent publications of swarm intelligence algorithms (particle swarm optimization (PSO), ant colony optimization (ACO), artificial bee colony (ABC), and the firefly algorithm (FA)) in scheduling and optimization problems [21]. It must be noted that as an intelligent algorithm for solving large-scale combinatorial optimization problems based on Monte Carlo iterative flow measurement, simulated annealing algorithm has been widely studied [22]. Compared with the traditional iterative algorithms, simulated annealing algorithm has some significant advantages: 1 It cannot fall into a local minimum. Because it is always possible to deviate from the local minimum when the system operates at a non-zero temperature. 2 Simulated annealing algorithm is adaptive. The general outline of the system can be seen in the high temperature process, and its specific details can be seen in the low temperature. Due to its above unique optimization mechanism and less dependence on problem information, versatility and flexibility, SA has been widely used in the field of optimization, such as production scheduling, control engineering, machine learning, neural networks, and signal processing [23][24][25]. Therefore, simulated annealing algorithm was adopted to solve the operations allocation model of human-robot interaction.

Human-robot collaborative operation framework on CNC machine tool
In production line, the related physical elements include the CNC machine tools, AGVs (Automatic Guided Vehicle), RFID (Radio Frequency Identification), industrial robots, workers, and various sensing devices, which are connected through industrial Internet. As shown in Fig. 1, the machining process of workpieces involve the premachining, machining, and post-machining. The corresponding human-robot collaboration services on CNC machine tool can be divided into three stages: 1) Pre-machining stage When the production line receives the machining tasks, it must determine the process planning and fixture arrangement. In this pre-machining stage, the collaborative content of human-robot interaction includes the grasping, placement, positioning of workpieces, installation and setting of cutting tools.
2) Machining stage In the machining stage, it is essential to realize the real-time collection of machining process information Figure 1 Human-robot collaboration operations and smart decision-making. If the abnormal state of the machining process was identified, the data-driven and knowledge-guided decision-making mechanism was triggered. The collaborative content of human-robot interaction includes the real-time monitoring based on machine vision, the optimization strategy based on knowledge and machine learning, etc.
3) Post-machining stage In the post-machining stage, it is essential to inspect and test the finished workpieces. After passing the inspection, the workplaces were moved to the next process through AGV, workers or forklifts. The collaborative content of human-robot interaction includes cleaning, deburring, inspection, condition test and other inspection operations, as well as the packaging, transportation.
The goal of human-robot interaction is to ensure the stability of machining accuracy and improve production efficiency. Due to the diversity and complexity of collaboration operations in workpieces machining, it needs to consider the flexibility of workers and the repeatability of industrial robots. Through normalizing the time, cost, efficiency, accuracy and complexity of human-robot interaction, collaboration effectiveness was proposed to evaluate the operations allocation strategy.

Action analysis in the context of human-robot interaction
When machining complex workpieces, detailed process design was needed. The process on the production line can be subdivided into several steps. For each step, there are different combinations of human-robot interaction, such as fully automated machining, independent worker machining, collaborative machining of workers and industrial robots. The reasonable arrangement of these humanrobot interaction combinations can not only improve the machining efficiency and accuracy, but also reduce the working difficulty of workers. This paper mainly focuses on the operations allocation in pre-machining stage.

Description of actions
In the production line, different operations are composed of basic actions. Workers can finish complex operations by using different actions and varying their sequence. According to the characteristics of industrial robots, some actions were described as shown in Table 1 [26,27].

Hierarchical model of operations
The operation model was divided into three layers: production line layer, operation layer, and action layer. As shown in Fig. 2, in the human-robot collaboration, the action layer represents the specific actions that industrial robots or workers can perform; the operation layer represents the sum of a series of actions based on a machine tool; the production line layer represents the sum of multiple machine tools that can complete the production of different batches of workpieces. Figure 3 shows an example about "workpieces loading". According to the hierarchical rules of operation model, its action layer included four specific actions: obtain the spatial position of the workpieces; grab the workpieces from the current position; move to the next position; place the workpieces.

Complexity evaluation of operations
An operation consists of multiple actions. In the process of actions execution, the action can be completed not only by workers, but also by industrial robots. In a smart production line, industrial robots have been able to replace most workers. For example, using industrial robots instead of workers to deal with workpieces can greatly reduce the labor intensity and repeatability of workers. However, industrial robots cannot replace workers in some complex or important operations based on the operation accuracy and professional experience. Even in some operations, workers and industrial robots need to collaborate with each other. For the above reasons, we need to consider the complexity evaluation of the different operations based on human- where H i is the scale of ith operation; C i is the number of ith operation's actions.
2) Difficulty K Difficulty refers to the difficulty of finishing the operations. Here, the difficulty is evaluated by analyzing the actions. The difficulty of operation depends on the respective difficulty and the total number of all actions. Therefore, the relative operation difficulty can be denoted as: where B i denotes the sum of relative difficulty in ith operation's actions. The factors affecting the action difficulty K have coupling characteristics with each other. Neural network can be adopted to evaluate the difficulty of each action [29]. Table 2 is the description of the action difficulties related to several key steps.
Then, the complexity measurement model of operations can be denoted as: where L i is the complexity of the ith operation; H i is scale of the ith operation; K i is difficulty of the ith operation.

Relevant assumptions
Considering that the complex actions in operations involve professional experience and knowledge, it is defined as that the accuracy completed by workers is greater than that completed by industrial robots. Therefore, the order of completion accuracy is as follows: human-robot collaboration > workers > industrial robots. The following conditions are assumed: 1 Each action does not affect each other, but needs to meet the sequence requirements; 2 The completion of each operation needs different industrial robots and different workers; 3 The completion of the operation can meet the requirements. Given the above assumptions, find an optimization scheme to minimize the human-robot collaboration effectiveness under certain conditions, such as certain total machining time, total machining cost, worker labor complexity, machining accuracy, machining efficiency and so on.

Variable definition
In human-robot interaction, it is assumed that there are M operations, and each operation has N actions. Humanrobot collaboration allocation is conducted on each operation. Suppose each operation has N actions, which are The way of completing actions by industrial robots or workers, and the corresponding key values are 0 and 1 respectively. A I Accuracy that the Ith action can achieve in the process of completing the operation.

C I
Cost of the Ith action in completing the operation. C I0 is the cost of industrial robots to complete the Ith action, and C I1 is the cost of the workers to complete the Ith action. T I Time in completing the Ith action. T I0 is the time spent by the industrial robots to complete the Ith action, and T I1 is the time spent by the workers to complete the Ith action. E I Efficiency coefficient to complete the Ith action. P I0 is the efficiency coefficient of the industrial robots to complete the Ith action; P I1 is the efficiency coefficient of the workers to complete the Ith action. L I Labor complexity of workers who adopt different ways to complete the Ith action. A I0 is the labor complexity of the industrial robots to complete the Ith action; A I1 is the labor complexity of the workers to complete the Ith action. Y I Weight coefficient of the Ith action, which is related to all actions involved in the operation, and the weight coefficient corresponding to each action is different; the weight coefficient between each action is measured by the operation accuracy. The higher the accuracy is, the greater the weight coefficient is. The corresponding variable descriptions are shown in Table 3.

Objective function
Collaboration effectiveness refers to the evaluation of the cost, time, complexity, and other factors involved in the collaborative interaction between workers and industrial robots in completing complex actions. It is a comprehensive evaluation index of the collaborative interaction effectiveness. In this paper, the factors are normalized as the optimization goal of collaborative operations allocation [30]. Collaboration effectiveness (Q) is defined as: where |T| is the normalized time; |C| is the normalized cost; |A| is the normalized accuracy; |E| is the normalized efficiency; |L| is the normalized labor complexity; w n is the weight determined by linear weighting method, n 1 w n = 1.

Constraints
Constraints are divided into cost constraints, time constraints, adjacency matrix constraints and equilibrium degree. The calculation method is as follows: 1 Cost constraint where c ij denotes the cost to complete the jth action in the ith operation. w 1 • , w 2 • is the weight, w 1 • + w 2 • = 1, i = 1, 2, . . . , N ; j = 0, 1, 2.
where t ij denotes the time to complete the jth action in the ith operation. w 3 It is the ratio of the number of workers' continuous actions to the sum of all actions in an operation.
where F 1 denotes the degree of equilibrium; N A denotes the maximum number of actions continuously completed by workers, and N denotes the sum of all actions in an operation. 4 Adjacency matrix constraint Each operation is completed by multiple actions, and each action in the operation has coupling relationships. That is, different actions under the same operation can lead to mutual influence. An adjacency matrix is established to represent the relationship between their actions, which is shown as follows: where M is the number of operations; N is the number of actions.
6 Operations allocation optimization based on simulated annealing algorithm 6.1 Parameter setting 1) Initial temperature T 0 and temperature decay function There are many forms of attenuation function. The common attenuation function is where α is a constant, generally 0.95.
2) The selected parameters are as follows: Initial temperature T 0 = 100. Cooling function T t+1 = αT t . Then the temperature at time t: Time function:

Optimization process of simulated annealing algorithm
As shown in Fig. 4, the basic flow of the algorithm is described.
Step 1: Input the initial data, constraint function and its weight, collaboration efficiency weight, and input the number of iterations and initial temperature; Step 2: Initialize the temperature T 0 , cooling function T t+1 , time function C t and initialization solution, and calculate the human-robot collaboration effectiveness Q; Step 3: Generate new solutions; Step 4: Bring the new solution into the constraint function (C • , T • ), if the conditions are not met, go to Step 3 again; Step 5: Calculate human-robot collaboration effectiveness Q_1; Step 6: Q_1 < Q, accept the new solution; Q_1 > Q, accept the new solution according to a certain probability p t ; Step 7: Judge whether the number of iterations has been reached. If not, go to Step 3; Step 8: If the algorithm fails to meet the exit conditions, reduce T 0 , iterate again, and go to Step 3.

Scenario description
Taking the positioning and drilling of a workpiece as an example to verify the feasibility of the proposed simulated annealing algorithm to solve the human-robot collaboration operations allocation model. The specific scenario description was shown in Fig. 5.
During this period, works and industrial robots need to constantly interact, collaborate with each other and help complete the operation. Taking the workpieces placement as an example, it can be assumed that industrial robot grasped the workpieces, and the worker assisted in positioning and placing the workpieces. The interaction scene between worker and industrial robot was shown in Fig. 6. Figure 7 shows the actions obtained after further decomposition of the above scene operations.

Actions analysis
In the machining process of workpieces, positioning plays an important role. Accurate positioning is a key prerequisite for ensuring the machining accuracy. The positioning methods mainly include double pin positioning, long side guiding positioning, surface combination positioning and so on. In the positioning of workpiece installation, it can be divided into multiple actions to complete the combination. The main actions analysis was shown in Table 4.  Through the actions analysis, the partial process of workpieces installation and positioning was shown in Fig. 8.

Result analysis
Set the algorithm's iterations number to 300, and its convergence curve was shown in Fig. 9. The calculated minimum human-robot collaboration effectiveness was 34.2163.
In order to prove the effectiveness of the algorithm, we compared the solving performance of SA, (Genetic Algorithm) GA and PSO. Set the number of iterations to 300, and the results were shown in Fig. 10. SA has better optimization ability than the other two algorithms. In terms of optimal solution, SA was 34.2163, which was 7.5% less than GA (36.782); in terms of running time, SA was 6.5 s, which was 12.3% less than PSO (7.3 s).
Based on the simulated annealing algorithm, the human-robot collaboration scheme for workpieces was shown in Fig. 11. The equilibrium degree F 1 = 5 23 ≈ 0.2174. It meets the requirements.

Conclusions
Human-robot interaction has a broad application prospect in smart manufacturing. By deploying industrial robots, we can make full use of the advantages of workers  Convergence curve and industrial robots to improve machining efficiency and reduce production costs. This paper studies the humancomputer interaction on CNC machine tools, and the conclusions are as follows: 1) A three-layers hierarchical model "production line-operations-actions" was used to describe the human-computer collaboration. The complexity measurement of human-computer operations was given, which provided an important foundation for the operations allocation. 2) A collaboration effectiveness-based operations allocation model was established through normalizing the time, cost, efficiency, accuracy and complexity of human-robot interaction. 3) A simulated annealing algorithm was used to solve preferable interaction scheme. Compared with GA and PSO, SA has better solving performance in optimal solution and running time. The optimal collaboration effectiveness was 34.2163 and equilibrium degree was 0.2174, which met the expected collaboration requirements. This paper focuses on the human-robot collaborative operations allocation in pre-machining stage. The future work is to investigate the collaborative operations allocation in machining stage, as well as the operations allocation of the whole production line.