Use of Graphic Imagery as a Mean of Communication Between Operators and Unmanned Systems in C3Fire Tasks
Digitization in the battle field enables the creation of new communication means among distributed elements. We aim to examine how the use of graphic imagery and means of graphic communication facilitate performance, shorten the OODA loop (Observe–Orient–Decide–Act), and enhance operators’ situation awareness. Previous research (Oron-Gilad and Oppenheim 2015) looked at bi-directional graphic communication on video feed derived from an unmanned aerial system (UAS), allowing a dismounted commander and the operator of the UAS to view and communicate on the video imagery. It was concluded that the commanders favored the ability to use non-stationary markings on the video feed relative to no markings at all or anchored-fixed markings. Furthermore, the verbal communication between the team mates changed as the team gained experience over consecutive trials, and with the use of graphic communication.
In the current study, we examined the added value of using still images, one-way, graphic communication from an operator, represented by Coral, tablet or UAS observers to a ground fighter, represented by either Tank (mounted) or Spike-MR (dismounted) attackers, while collaborating to acquire stationary targets in a rural built area. The abilities to communicate by using still images with or without additional markings (annotations) were aimed to be compared to a basic communication form based on ‘coordinates’ and to a future solution of augmentation of the target’s location on reality. Difficulties in accurately implementing the augmentation have severely hindered the accuracy of performance in this communication mean. Therefore, comparisons were made relative to ‘coordinates’ as a baseline and to the use of still images (with annotations or without). Verbal communication within the teams (two-way) was available at all times. Eight teams of three; ‘attacker’, ‘observer’, and ‘controller’ (as the higher echelon commander) participated in the experiment. Participant soldiers were assigned to a simulated work station according to their expertise. The dependent variables were (1) objective measures - execution, response time and accuracy, and (2) subjective evaluation of – usability, stress, and the quality of communication, and (3) verbal communication.
The results show that in the Ground-Ground teams, operators benefited from the use of still images especially in the time to acquire a target and the accuracy distance from target. In contrary, still images from the UAS were less beneficial to the ground operators relative to ‘coordinates’ in terms of time to acquire a target and executions. Overall, observer-type participants favored the use of still images. When they had free choice, they chose the still image configurations almost in all cases (98%). Yet, there were differences in the way the observers and the attackers perceived the quality of the graphic communication, and there were differences, between the mounted and the dismounted attackers as well. All in all, it seems that the addition of graphic communication increased the number of ping-pong chats between the team members, but, on average, shortened the duration of each chat. From the perspective of the controllers, who were supervising the teams, they noted that the Ground-Ground teams used less verbal communication compared to the Ground-Aerial teams. Furthermore, less verbal communication was required when using the still images interface (with or without markings) compared to ‘coordinates’.
We conclude that; (1) Still images may improve the communication between Ground-Ground teams; (2) In some cases, adding the ability to graphically mark elements on the still image (i.e., annotations) improved the communication in terms of self-evaluation of team cooperation and performance, even more than still images alone; (3) In presence of graphic communication, the verbal communication patterns have changed with more ‘ping-pong’ transmissions among team members although shorter ones; and (4) When participants had free choice of communication means they preferred the still images with graphic markings over the other alternatives of ‘coordinates’ and still images without markings).
Further investigation is needed to test the added value of using bi-directional graphic communication (either on still images or by temporary markings on dynamic video scenes).
KeywordsClose Target Reconnaissance (CTR) OODA loop Graphic communication Ground and aerial views Mounted and dismounted attackers Observer-Attacker teams OODA loop Short cycle
This work was supported by the US Army Research Laboratory through the DCS subcontract no: APX03-S010 (B.G. Negev Technologies and Applications Ltd) under Prime Contract no W911NF-10-D-0002, Michael Barnes, Technical Monitor. This work was done in collaboration with the IDF Battle lab, Lt. Col Yaniv Minkov, Major Yisachar Shapira and Major Yoav Yulis. The work is unclassified, Approved for public release.
- Artman, H., Granlund, R.: Team situation awareness using graphical or textual databases in dynamic decision making. In: Proceedings of the 9th Conference on Cognitive Ergonomics, pp. 149–155, August 1998Google Scholar
- Brehmer, B.: The dynamic OODA loop: amalgamating Boyd’s OODA loop and the cybernetic approach to command and control. In Proceedings of the 10th International Command and Control Research Technology Symposium (2005)Google Scholar
- Brooke, J.: System Usability Scale (SUS). Usability Evaluation in Industry. Taylor and Francis, London (1996)Google Scholar
- Cumming, M., Akar, E.: The representation of common ground and its role in P2P-supported design team processes. Embracing Complex. Des. 23 (2005)Google Scholar
- Fussell, S.R., Setlock, L.D., Kraut, R.E.: Effects of head-mounted and scene-oriented video systems on remote collaboration on physical tasks. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 513–520. ACM (2003)Google Scholar
- Granlund, R., Smith, K., Granlund, H.: C3Conflict a simulation environment for studying teamwork in command and control. Naval Postgraduate School, Monterey, CA, Dept. of Operations Research (2011)Google Scholar
- Hew, P.: Structured, Graphical Analysis of C2 Teams and their Technologies. Defence Science and Technology Organisation Canberra (Australia) (2011)Google Scholar
- Klein, G.A., Crandall, B.W.: The role of mental simulation in naturalistic decision making. In: Hancock, P.A., Flach, J., Caird, J., Vicente, K. (eds.) Local Applications of the Ecological Approach to Human-Machine Systems, vol. 2, pp. 324–358. Lawrence Erlbaum, Hillsdale (1995)Google Scholar
- Kraut, R.E., Fussell, S.R., Brennan, S.E., Siegel, J.: Understanding effects of proximity on collaboration: implications for technologies to support remote collaborative work. In: Distributed Work, pp. 137–162 (2002)Google Scholar
- Matthews, G., Joyner, L., Gilliland, K., Campbell, S.E., Falconer, S., Huggins, J.: Validation of a comprehensive stress state questionnaire: towards a state big three. Pers. Psychol. Europe 7, 335–350 (1999)Google Scholar
- Obradovich, J.H., Smith, P.J.: Design concepts for virtual work systems. In: The Handbook of High Performance Virtual Teams, pp. 294–328 (2008)Google Scholar
- Oron-Gilad, T., Oppenheim I.: Final Research Report - Task (5) Bi-directional graphic communication between a dismounted commander and the operators of a remotely operated vehicle, Technical report via DCS, Michael Barnes technical monitor, US Army Research Laboratory, December 2015Google Scholar
- Oron-Gilad, T., Parmet, Y.: Close target reconnaissance: a field evaluation of dismounted soldiers utilizing video feed from an unmanned ground vehicle in patrol missions. J. Cogn. Ergon. Decis. Making (2016). Available online 1st November 2016Google Scholar