Abstract
Out-of-the-box swarm solutions powering industrial logistics will need to adapt to the tasks at hand, coordinating in a distributed manner to transport objects of different sizes. This work designs and evaluates a collective transport strategy to move large and arbitrarily shaped objects in warehouse environments. The strategy uses a decentralized recruitment and decision-making process, ensuring that sufficient robots are in place for a coordinated, safe lift and transport of the object. Results show robots having no prior knowledge about the object’s size and shape were successfully able to transport them in simulation.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
1 Introduction
A recent study found that potential users of storage and retrieval systems perceive swarm robots to be useful when they facilitate efficient storage, automatic inventory check, and sorting abilities [1]. Despite the generally positive reaction to robot swarms, the interviewees expressed several concerns related to safety, predictability, and the system’s trustworthiness. This study explores how warehouse swarm robots can safely transport large and arbitrarily shaped objects towards a target direction without any prior knowledge of the object and the number of agents required. A large and arbitrarily shaped object in this context refers to a closed 2-dimensional shape representing the payload’s base area. This area is larger than the unit size a single robot can carry. This paper presents a collective transport strategy that consists of a coordinated lift of the object once sufficient agents are recruited.
Nature provides a useful paradigm for collective transport strategies in swarm robotics. Ant colonies are a prominent source of inspiration due to their ability to collectively transport large prey to their nest. This task exceeds the capabilities of a single ant and can be achieved only through reactive actions. Such collective behaviors in nature have attracted researchers’ attention for several decades [2, 3]. Research has shown that there is no centralized control. Such biological systems are robust, flexible, and scalable [4, 5]. Discovered characteristics and models enable engineers to replicate such complex emergent behaviors artificially. Besides using swarm robots to retrieve large and arbitrarily shaped objects in warehouses, a robotic swarm system performing collective transport could also be used in other industries ranging from logistics, agriculture, and mining to disaster support [6]. Examples of such applications are moving oversized goods such as massive airplane parts, prefabricated construction items, heavy mining machinery, or rescue equipment.
In warehouses and distribution centers, centralized multi-robot systems have proven effective in performing stock storage and retrieval in highly controlled environments [7]. As online purchases increase and include larger and bulkier items like appliances, furniture or gym equipment, orders often exceed the standard size and weight a single mobile robot can carry. Nevertheless, customers expect delivery times similar to those of smaller items such as books and electronic products [8]. Another challenge is handling oversized objects often requires some form of manual labor. Despite existing health and safety regulations, warehouse workers are at high risk of accidents [9]. Large and heavy object transport is, therefore, well suited for automation. For instance, in [10], mobile robots are proposed that use handcarts and outriggers. However, solutions adaptable for various large object sizes and shapes are rare. We propose that robot swarms could be a safe and adaptable load handling solution for warehouses. In addition, unlike existing centralized warehouse systems, a swarm system only requires minimal infrastructure and setup time. Such a system could be a scalable out-of-the-box solution, especially for small and medium-sized enterprises (SMEs), which often cannot invest in a sophisticated centralized system [1, 11].
This article is organized as follows: Sect. 2 discusses the background and places the study in context. Section 3 describes the methods and outlines the proposed collective transport strategy. In Sect. 4, the simulation results and performance analysis are presented and discussed. Finally, in Sect. 5, conclusions are drawn, and future work is outlined.
2 Background and previous research
In swarm robotics, many robots are used to collectively perform a relatively complex task. Swarm robots are designed to be simple and inexpensive, having only limited sensors and communication ranges [12]. The collective behavior at the group level emerges from individual actions robots take based purely on local information from other robots and the environment [13, 14]. One of the most challenging questions in swarm robotics is how to choose the behavior of individual agents that results in the desired emergent group behavior [15]. Swarm robotics research in warehouses and storage environments has been primarily focused on collective retrieval of unit sized objects, each carried by a single robot [16].
The task of retrieving large and arbitrarily shaped objects can be divided into three subtasks. First, the object to be transported must be found. Second, sufficient numbers of agents must be recruited for a safe lift and transport. Third, the object must be moved towards a target direction.
2.1 Object search
Random walks are fundamental search strategies to find an object, particularly when there are no environmental indications, and where walkers lack localization and mapping capabilities [17]. There are many variants of random walks. In two recent independent studies, the ballistic motion variant was reported to result in the broadest area coverage of closed environments [18, 19].
2.2 Collective transport
In many ant species, workers cooperate to retrieve large prey that a single ant cannot retrieve. Typically, the ant that finds a prey object first tries to move it. If it remains unsuccessful, it recruits nestmates [12] [p. 256–259]. Like the ants, robotic swarms could work together to retrieve large objects, recruiting sufficient robots. In decentralized collective transport, coordination can be achieved without direct communication, instead relying on coordination through the object being transported [12] [p. 260]. The effect of one agent engaged in collective transport modifies the stimuli perceived by other agents and in turn, produces a change by these agents. This mechanism is known as stigmergy [20].
Other approaches are based on leader–follower principles [21,22,23]. In those studies, a leader plans the trajectory and controls the motion, while the remaining robots support the leader’s motion in a coordinated manner. In other approaches, an external supervisor observes the collective motion and sends suitable control actions to the robots to lead the object towards some goal direction [24]. However, these strategies have not been evaluated and generalized to arbitrarily shaped objects. More analytical strategies have also been proposed, but they rely on sophisticated robots that know the object’s shape and position to be transported [25,26,27]. As opposed to centralized control approaches, decentralized control approaches are likely to result in suboptimal system performance. However, decentralized strategies have the advantage of being scalable and can be implemented on robots with limited onboard capabilities. The agents only require local information, which they acquire through sensing their environment [28]. Some studies aim to solve the problem of transporting larger objects using robots that can self-assemble into a stronger unit to pull or push an object. Suitable controllers can be synthesized using an evolutionary algorithm [29, 30]. In the work of [6], it was shown that if a number of individual agents apply forces towards the target direction, the object’s center of mass will move in a straight line to the direction of the goal. The versatility of this simple strategy was experimentally demonstrated with up to 100 Kilobot robots [31] collectively transporting numerous complex object shapes. Further, it was noted that the object’s rotational velocity is insignificant compared to its translational velocity. This study provides a valuable example of independently acting robots transporting objects. In this work, we consider distributed robot systems that need to actively lift an object, rather than push it. Unlike with pushing, the risk of instability makes it necessary to reach consensus about when to lift, before attempting a lift. We address this by combining a passive recruitment strategy with a decentralized decision-making process to ensure a coordinated, safe lift and transport.
3 Methods
A lift and transport of payload in a warehouse environment must be executed in a safe and coordinated fashion for users to accept and trust the swarm robotic solution [1, 32]. We present a strategy that recruits robots under an object upheld on stilts, then coordinates the lift of the object once sufficient numbers of robots are distributed underneath the object. Here, we outline the simulated scenario and control algorithm.
3.1 Simulated scenario
Experiments were performed in a custom-built agent-based simulator in Python. Robots modeled are omnidirectional, capable of movement in any direction at a speed of 0.2 m/s. The random walk behavior and obstacle avoidance was implemented using a subsumption architecture as introduced by Brooks in [33, 34]. Robots can detect they are under an object and their distance to nearby robots. Further, it is assumed that the robots are equipped with wireless mesh communication technology to communicate with each other.
The swarm’s task is to transport an object to the retrieval area \((2\,\hbox {m} \times 5\,\hbox {m})\) on the side of the area \((7\,\hbox {m} \times 5\,\hbox {m})\), as illustrated in Fig. 1 with an arbitrarily shaped object of size 2 \(\mathrm {m^2}\).
. The robots are initialized with random orientations and at random positions within the warehouse environment, excluding the object’s area. The performance of the collective transport strategy is measured in terms of retrieval time, and number of robots used to transport an arbitrarily shaped object. The retrieval time is defined as the time taken until the robots move the center of the object beyond the vertical dashed line at \(x = 500\, \hbox {cm}\) and into the retrieval area. The maximum time given for the swarm to complete the task is 20 min. The independent variables of the outlined scenario are the swarm size (i.e., the number of deployed robots) and the object’s size. Table 1 shows the simulated parameters for the experimental warehouse setup. These parameters were chosen based on the design of our new swarm for logistics.
3.2 Collective transport strategy
As illustrated in Fig. 2, a finite-state machine (FSM) is implemented on the robots to select which behavior(s) to utilize for any given situation.
Figure 3 shows an example simulation of a swarm consisting of 30 agents that collectively retrieve an arrow-shaped object with an area of \(1.26\,\hbox {m}^2\). Important steps are annotated, explaining the collective transport strategy. The three main phases are object search (1a–c), recruitment of sufficient agents for safe lift and transport (2a–c), and collective transport (3a–b).
3.3 Criteria for a safe lift and transport
Positioned agents monitor the state of nearby agents. As the recruitment of agents underneath the object progresses, agents start to fulfill one of the two criteria defined below. The two criteria provide a metric to assess the local arrangement of agents. With this local metric, the aim is to allow the swarm to make a collective decision as to whether there are sufficient agents in place and whether the positioned agents are well-distributed throughout the object. Once all positioned agents have fulfilled either one of the criteria, the swarm collectively decides that it is now safe to lift and transport the object.
-
1.
Agent positioned near the border of the object: Every positioned agent records the number of visits from randomly walking agents. These are agents that bump into the positioned agent (\(\le\)min. distance to other agents, specified in Table 1). Once the number of visited agents exceeds the defined threshold (i.e., min. number of visited randomly walking agents), the agent knows that it must be positioned close to the object’s border. An agent situated close to the border of the object relies on this metric to assess its local readiness to contribute to a safe lift and transport.
-
2.
Agent positioned within the object: To judge whether agents positioned within the object (i.e., not close to the border) are well-distributed, every positioned agent observes its local neighborhood. If there are more than a predefined min. number of positioned neighbor agents within a particular radius (i.e., radius to other positioned agents), the agent evaluates itself to be part of a locally well-distributed group of agents that is ready to lift and transport the object safely.
Table 2 shows the chosen parameters. Note that a smaller number of visited, randomly walking agents would lead to a lift and transport sooner. However, there is a trade-off between ensuring safety and lifting the object in a timely fashion. Choosing the parameters depends on the priority given to safety. Through numerous simulation runs, the parameters were chosen to support a safe lift and transport while also considering the agents’ time to fulfill the criteria.
3.4 Collective decision making
Once a positioned agent fulfills either of the previously outlined criteria, it changes into the locally safe to lift state, in which the robot initiates a collective lift request. An agent in the locally safe to lift state is ready to lift the object and checks whether all other agents underneath the object are also ready to lift. Each agent that switches into the locally safe to lift state sends out a lift request to all agents underneath this specific object. All agents situated underneath the object respond to the request with either a negative (i.e., locally not ready for a safe lift) or positive (i.e., locally ready for a safe lift) feedback message. This lift request–response communication model is illustrated in Fig. 4.
. If the requesting agent receives one or more negative feedback messages, no lift is initiated. Note that the communication cost increases the larger the object because the lift requesting robot has to communicate with all other robots positioned underneath the object to check their statuses. Finally, once the last agent underneath the object has changed to the locally safe to lift state and has not received any negative feedback, the lift is initiated by a lift command message sent to all involved agents. As a result, all involved agents lift the object in a coordinated fashion and transport it towards the goal direction.
4 Results and discussion
Simulations are conducted to assess and validate the proposed collective transport strategy’s performance for various configurations of the swarm and object size. The simulated object sizes range from 1.5 to 3.5 m\(^2\) in 0.5 m\(^2\) steps. These are typical object sizes of home appliances, gym equipment, and furniture. The swarm sizes range from 20 to 40 robots in 5 robot intervals. The simulations were run 10 times for each configuration of an object and swarm size. In each simulation run, the object was placed at \(x = 200\, \hbox {cm}\) and \(y = 250\,\hbox {cm}\) with a randomly selected orientation. New large and arbitrarily shaped objects were generated for each configuration. The object generation algorithm is based on a region growing procedure that adds pixels to the existing cluster in a random fashion until the object reaches the desired area.
4.1 Reliability
To assess whether sufficient agents lift and transport the object, the number of agents transporting the object was analyzed for each simulation run and summarized for all configurations in Fig. 5.
The horizontal red lines show the minimum number of agents required to feasibly lift and transport an object of a given size. As specified in Table 1 on page 3, every robot can lift a maximum load of 2 kg, and the object is defined to have an equally distributed mass of 8 kg/m\(^2\). Therefore, for example, for a 1.5 m\(^2\) sized object, at least six agents are required for a feasible lift and transport. All simulation runs above those red horizontal lines, also highlighted in green, show scenarios where the object was successfully retrieved with sufficient agents. In the simulation runs highlighted in blue, the object was not lifted and transported because the safe lift and transport criteria were not fulfilled. Respectively, the number of agents transporting the object in these cases was zero.
The safe lift and transport criteria are less likely to be met by all involved agents attempting to safely transport the larger objects because more agents are to be recruited and have to fulfil the criteria within the given time constraint. Also, the number of remaining available robots that assist in fulfilling the object border agents’ safe lift and transport criteria (i.e., Criteria 1) decreases as more robots are positioned underneath the object. To improve the number of cases that result in a successful lift and transport of the larger objects, the proposed method may be enhanced by an active recruitment strategy where already positioned agents actively attract available agents towards the object. Moreover, robots may be equipped with more sophisticated sensing capabilities (e.g., vision system) to identify the object and estimate the number of required agents before moving underneath the object.
Overall, the linear relationship between the object size and the number of agents that decided to lift and transport the object shows the proposed collective transport strategy’s adaptability, reliability and scalability. Given that sufficient agents are deployed and each object has a unique identifier, multiple objects could potentially be transported simultaneously in a fully decentralized fashion.
4.2 Average retrieval time
Figure 6 shows a heatmap of the average time taken for swarms of different sizes to retrieve different sized arbitrarily shaped objects. For the calculation of the average retrieval time, only simulation runs in which the object was retrieved are considered. The grey heatmap entries show swarm and object size pairs that did not result in any completed retrievals within the given 20 min.
Larger swarms generally retrieve objects faster because the object is more likely to be encountered by randomly walking agents. In addition, more agents in the environment help to fulfil the positioned border agents’ safety criteria, leading to an earlier lift and transport of the object. Note that the number of randomly walking agents assisting in fulfilling the positioned border agents’ safety criteria decreases as more agents find and enter underneath the object. Thus, especially for larger objects, swarm size should be increased initially or dynamically on demand.
Altogether, the results show that large and arbitrarily shaped objects can be retrieved both reliably and in a timely fashion, given a large enough swarm size.
5 Conclusions and future work
This study designed a decentralized collective transport strategy that allows a swarm of relatively simple warehouse robots to retrieve large and arbitrarily shaped objects without any prior knowledge of the object’s size, shape and location. The introduced approach to recruiting sufficient agents to the object, and the collective decision-making process, allows for a safe lift and transport. Thereby, we present a system that adapts to the task at hand and has the potential to become a scalable out-of-the-box swarm robotic solution requiring minimal infrastructure and setup time. The proposed collective transport strategy, verified successfully in simulations, can now be tested experimentally on real warehouse robots present in our laboratory.
References
Carrillo-Zapata D, Milner E, Hird J, Tzoumas G, Vardanega PJ, Sooriyabandara M, Giuliani M, Winfield AF, Hauert S (2020) Mutual shaping in swarm robotics: user studies in fire and rescue, storage organization, and bridge inspection. Front Robot AI 7:53
Vicsek T, Zafeiris A (2012) Collective motion. Phys Rep 517(3–4):71–140
Feinerman O, Pinkoviezky I, Gelblum A, Fonio E, Gov NS (2018) The physics of cooperative transport in groups of ants. Nat Phys 14(7):683–693
Brambilla M, Ferrante E, Birattari M, Dorigo M (2013) Swarm robotics: a review from the swarm engineering perspective. Swarm Intell 7(1):1–41
Camazine S, Deneubourg JL, Franks NR, Sneyd J, Theraula G, Bonabeau E (2020) Self-organization in biological systems. Princeton University Press, Princeton
Rubenstein M, Cabrera A, Werfel J, Habibi G, McLurkin J, Nagpal R (2013) Collective transport of complex objects by simple robots: theory and experiments. In: Proceedings of International Conference on Autonomous Agents and Multi-agent Systems, pp 47–54
Roodbergen KJ, Vis IF (2009) A survey of literature on automated storage and retrieval systems. Eur J Oper Res 194(2):343–362
Scott H, Lasher C (2018) E-commerce warehouses adapt for large and bulky item handling. Supply and Demand Chain Executive. https://www.sdcexec.com/warehousing/article/21002159/wynright-corporation-ecommerce-warehouses-adapt-for-large-and-bulky-item-handling. Accessed 24 June 2021
HSE: Health and Safety Executive (2010) Accidents in storage and warehousing. Health and Safety Executive. https://www.hse.gov.uk/logistics/warehousing.htm. Accessed 24 June 2021
Ohashi F, Kaminishi K, Heredia JDF, Kato H, Ogata T, Hara T, Ota J (2016) Realization of heavy object transportation by mobile robots using handcarts and outrigger. Robomech J 3(1):1–12
Jones S, Milner E, Sooriyabandara M, Hauert S (2020) Distributed situational awareness in robot swarms. Adv Intell Syst. https://doi.org/10.1002/aisy.202000110
Bonabeau E, Marco D, Theraulaz G (1999) Swarm intelligence: from natural to artificial systems (no. 1). Oxford University Press, Oxford
Bonabeau E, Dorigo M, Theraulaz G (2000) Inspiration for optimization from social insect behaviour. Nature 406(6791):39–42
Beni G, Wang J (1993) Swarm intelligence in cellular robotic systems. Robots and biological systems: towards a new bionics? Springer, Berlin, pp 703–712
Jones S, Winfield AF, Hauert S, Studley M (2019) Onboard evolution of understandable swarm behaviors. Adv Intell Syst. https://doi.org/10.1002/aisy.201900031
Milner E, Sooriyabandara M, Hauert S (2021) Stochastic behaviours for retrieval of storage items using simulated robot swarms. In: Proceedings of the SWARM2021: The 4th International Symposium on Swarm Behavior and Bio-Inspired Robotics, Proceedings of the SWARM2019: The 3rd International Symposium on Swarm Behavior and Bio-Inspired Robotics, pp 297–308
Dimidov C, Oriolo G, Trianni V (2016) Random walks in swarm robotics: an experiment with kilobots. International conference on swarm intelligence. Springer, Cham, pp 185–196
Kegeleirs M, Ramos DG, Birattari M (2019) Random walk exploration for swarm mapping. Annual conference towards autonomous robotic systems. Springer, Cham, pp 211–222
Spaey G, Kegeleirs M, Ramos DG, Birattari M (2019) Comparison of different exploration schemes in the automatic modular design of robot swarms. In BNAIC/BeneLearn
Dorigo M, Bonabeau E, Theraulaz G (2000) Ant algorithms and stigmergy. Futur Gener Comput Syst 16(8):851–871
Wang Z, Schwager M (2016) Force-amplifying n-robot transport system (force-ants) for cooperative planar manipulation without communication. Int J Robot Res 35(13):1564–1586
Wang Z, Schwager M (2016) Kinematic multi-robot manipulation with no communication using force feedback. IEEE International Conference on Robotics and Automation (ICRA), pp 427-432
Teh XX, Aijaz A, Portelli A, Jones S (2020) Communications-based formation control of mobile robots: modeling, analysis and performance evaluation. In: Proceedings of 23rd International ACM Conference on Modeling, Analysis and Simulation of Wireless and Mobile Systems, pp 149–153
Shahrokhi S, Becker AT (2016) Object manipulation and position control using a swarm with global inputs. In: IEEE International Conference on Automation Science and Engineering (CASE), pp 561–566
Montemayor G, Wen JT (2005) Decentralized collaborative load transport by multiple robots. In: Proceedings of IEEE International Conference on Robotics and Automation, pp 372–377
Lindsey QJ, Shomin M, Kumar V (2010) Cooperative quasi-static planar manipulation with multiple robots. Int Des Eng Tech Conf Comput Inf Eng Conf 44106:1351–1360
Su H, Krovi V (2008) Decentralized dynamic control of a nonholonomic mobile manipulator collective: a simulation study. Dyn Syst Control Conf 43352:661–668
Berman S, Lindsey Q, Sakar MS, Kumar V, Pratt SC (2011) Experimental study and modeling of group retrieval in ants as an approach to collective transport in swarm robotic systems. Proc IEEE 99(9):1470–1481
Gross R, Tuci E, Dorigo M, Bonani M, Mondada F (2006) Object transport by modular robots that self-assemble. In: Proceedings of IEEE International Conference on Robotics and Automation (ICRA), pp 2558–2564
Gross R, Dorigo M (2009) Towards group transport by swarms of robots. Int J Bio-Inspir Comput 1(1–2):1–13
Rubenstein M, Ahler C, Nagpal R (2012) Kilobot: A low cost scalable robot system for collective behaviors. In: IEEE International Conference on Robotics and Automation, pp 3293–3298
Kruijff GJM, Janíček M, Keshavdas S et al (2014) Experience in system design for human-robot teaming in urban search and rescue. Field and service robotics. Springer, Berlin, pp 111–125
Brooks R (1986) A robust layered control system for a mobile robot. IEEE J Robot Autom 2(1):14–23
Brooks R (1991) Intelligence without representation. Artif Intell 47(1–3):139–159
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This work was presented in part at the joint symposium with the 15th International Symposium on Distributed Autonomous Robotic Systems 2021 and the 4th International Symposium on Swarm Behavior and Bio-Inspired Robotics 2021 (Online, June1–4, 2021).
Rights and permissions
This article is published under an open access license. Please check the 'Copyright Information' section either on this page or in the PDF for details of this license and what re-use is permitted. If your intended use exceeds what is permitted by the license or if you are unable to locate the licence and re-use information, please contact the Rights and Permissions team.
About this article
Cite this article
Jurt, M., Milner, E., Sooriyabandara, M. et al. Collective transport of arbitrarily shaped objects using robot swarms. Artif Life Robotics 27, 365–372 (2022). https://doi.org/10.1007/s10015-022-00730-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10015-022-00730-5