Introduction

The convergence of nano-, bio-, information, and cognitive sciences and technologies (NBIC) is continuously advancing in a wide range of work and social spheres. These technological advances have constantly changed the interrelation between “natural” and “artificial” material and have led to a blurring of the boundaries between humans and machines. The debate about the boundaries between humans and technology has been intense for decades [1, 2] and still seems an important topos today. This is also true for current NBIC developments, which probably will lead to a profound change in “our sense of being human — concerning its nature, capabilities, and limits” [3]. Transformation processes triggered by technologies such as molecular manipulation or the development of artifacts that can intervene in organic structures will thus result in radical changes in the meaning of life itself [4, 5]. In this development towards a “manufacturing of life”, the informatization of processes, new forms of standardization, and order-oriented production become essential conditions for socio-technological innovation [3, 6, 7].

Interestingly, the blurring of boundaries can also be identified in classic environments of standardization and order-oriented production: in real manufacturing processes. Here, technical advances in micro- and nanomanufacturing environments with robots were accompanied by new industrial concepts in the last decade. At these size levels, products manufactured by such novel machines (nanorobots) are mostly found in the field of health devices such as tissues, nanoelectronics biosensors, molecular devices, and drug components. According to Nelson, Dong, and Arai, “nanorobotics is the study of robotics at the nanometer scale, and includes robots that are nanoscale in size, i.e., nanorobots, and large robots capable of manipulating objects that have nanometer dimensions with nanometer resolution, i.e., nano robotic manipulators” [8]. But molecular manipulation is also used in the field of additive manufacturing, especially for microelectronic products and specialized machines. In this way, converging NBIC technologies move from the laboratory to the shop floor. Microelectronics is important in the field of computer components such as microchips, wafers, devices for the Internet of Things (IoT), and sensors. Both products types cover a variety of industries and specific applications. At the same time, our daily life is filling up with new objects and devices with ever smaller components, such as laptops, smartphones, printers, watches, etc., manufactured by these industries. Especially in these contexts, a blurring of boundaries can be observed, both at the macrolevel (manufacturing of micro- and nanoproducts) and at the micro- and nano levels (application of the products manufactured). At both levels, human–machine interaction (HMI) involves new interfaces which are not yet clearly defined in all sectors of the process industry [9].

Today, HMI in the process industry is characterized by the use of sensors that control the increased accuracy of production flow, product components, and product quality. These sensors provide huge amounts of data and information about the manufacturing status, which are evaluated in control and management processes. The operators involved usually control production processes using this indirect information, but they also use data collected through direct information. Due to the high division of labor in production, their expertise, work experience, and feeling for the processes are only partially used and differ according to their tasks in the work processes [10,11,12].

HMI in micro- and nanomanufacturing seems even more indirect, as machine operators observe the manufacturing processes directly, but only through specialized microscopes and computers. The technologies “mediate” the work processes. Therefore, working on both scales requires, on the one hand, increased abstraction and simulation skills of the workers. On the other hand, the application of this type of technical tools and artifacts is associated with increased standardization of work processes [13].

Starting from these observations, this article focuses on the overall question: How do issues of manufacturing life influence real working models in manufacturing? Actually, socio-technical environments such as industrial robotics have a long tradition in the manufacturing sector. They are still organized by highly rationalistic work structures that are based on strict boundaries between humans and machines [14,15,16], even if such boundaries metaphorically take the form of fences in robotics cells.Footnote 1 Robotic cells consider the integration of one, or more than one, robot and other machinery, buffers, local warehouses, conveyors, sensors, etc., and when they are operating in automatic modes at shop floors, it is needed to apply stationary fences for safety reasons. Recent developments make possible the use of virtual fences, maintaining the strict boundaries between machines and humans. Against this background, the article focuses on the question whether working with robotics on the micro- and nanoscale will push the boundaries of HMI in manufacturing.

Although the application of micro- and nanorobotics in manufacturing environments still seems rare, trends already show that nanomaterials or microelectronics will probably be part of numerous products in a few decades: the miniaturization of components of many everyday products, from sensors and smartphones to clothing or other textiles, will continue to progress. One important example is the electronics sector, where technical environments require detailed and accurate production processes and the use of micro robotic machines to assemble or produce ever smaller components. The number of industries that make use of micro- and nanorobotic systems however is slowly increasing, e.g., in the energy storage sector and the chemical sector [17]. With regard to the manufacturing life, the challenges and implications of human-centered manufacturing systems should be intensively observed with regard to (possible) increased blurring of boundaries of HMI. These might have a significant impact on the quality of work in manufacturing which seems still underestimated.

The first chapter of this article outlines the institutional relationship between technological innovation and work organization in manufacturing as discussed in recent decades. The second chapter approaches the analysis of technological developments with the extensive introduction of robotics and automation processes and the changes taking place in HMI in the manufacturing sector. In the third chapter, we briefly analyze robot applications in different sectors and related developments in work organizations. Here, we will focus on the application of emergent micro- and nanolevel robotics and discuss its impact on HMI. Our conclusions revisit and summarize the previous questions and outline further research needs.

Robots and Organization of Work in Production Systems

Early industrial robots, built back in the 1960s, emerged from the combination of two technologies: numerical control machine tools for precise manufacturing and teleoperators for remote handling of radioactive materials. In addition, the rapid development of integrated circuits, digital computers, and miniaturized components enabled the design and programming of computer-controlled robots by humans [18,19,20,21,22,23]. Whether the design and programming was done by engineers and technicians only, or also by machine operators, depended very much on the model of work organization.

The following decades were characterized by increasing automation in almost all sectors of the manufacturing industry [24]. Progress in automation became the technical and organizational basis for successful economic growth in many branches, such as the automotive and chemical industries. The introduction of robots into these production processes in the 1970s played a crucial role in the automation of work and the profound transformation of HMI. Since the late 1990s, robot applications have also been used outside of factories, mainly in sectors such as agriculture, services, and mobility. Here, huge potential of these applications has been identified. However, the introduction and application of robots in the health care sector has been (controversially) discussed [2528].

Today, the use of robots in various fields is steadily increasing worldwide, which has triggered an intensive public and scientific debate about living and working “in the robot society” [29]. In these debates, robotics is portrayed as a technology that represents technological progress not only in production but also in its application in daily life [17, 30, 31]. Although empirical data show that innovations in robotics are basically related to applications in the manufacturing industry [32], robots seem to be the metaphor par excellence for describing the technical and social dimensions of future societies. At the same time, the concept of “robot societies” [31] raises doubts and concerns about human–robot interaction (HRI) and its impact on societal evolution. Public and scientific debates show that ethical reflection on HRI goes hand in hand with these concerns [27, 33, 34]. This seems especially true for NBIC technologies, which pose risks and hazards, in particular, in the field of organic material manipulation. De Jong and Borm conclude that “the scientific paradigm for the possible (adverse) reactivity of nanoparticles is lacking and we have little understanding of the basics of the interaction of nanoparticles with living cells, organs and organisms. A conceptual understanding of biological responses to nanomaterials is needed to develop and apply safe nanomaterials in drug delivery in the future” [35: 145]. The high degree of specialization in this field hampers the public and scientific debate.

As described above, robot applications have been successfully introduced in the manufacturing industry. Especially in recent decades, the technology density at workplace level has increased significantly through robotics [36]. Robot-based work environments, where one operator takes control of several machines and several work processes, have become much more complex. This technical complexity has led to significant changes, both at the workplace level and at the organizational level, which are being intensively discussed in many disciplines [37,38,39,40,41].

When introducing NBIC technologies, emphasis is usually placed on new forms of business models, new organizational patterns, and the use of technological platforms (networks) to support and promote competitive company strategies [42, 43]. However, socio-technological concepts addressing issues such as quality of work, HMI, or the formation of work teams to promote worker autonomy seem to be rather neglected, especially in the field of robotics [44, 45]. There appears to be a significant knowledge gap about the relationship between increasing automation, complexity of work contents, and changes in work quality [46,47,48]. This lack of knowledge becomes even more apparent with innovative applications of robotics on the micro- and nanoscale, e.g., in the manufacturing industry or in medicine [49, 50]. To date, there are no studies analyzing the implications of robotics in terms of working conditions and forms of work organization of these sub-millimeter manufacturing systems. Technological innovations in this area are usually presented as “purely” technological development processes by engineering sciences that do not affect social and organizational conditions.

In the development toward the manufacturing of life, the informatization of production processes has played and still will play a central role from the very beginning [51]. Here, the introduction of robotics on micro and sub-millimeter scale will probably be accompanied by new standardization measures and order-oriented production. These issues of standardization are being integrated into the “rational” modes of production by NBIC technologies. It should be further explored whether working at the sub-mm scale entails (or not) is generating new modes of work in manufacturing. Thus, the deep analysis of HMI can make an important contribution to integrating cognitive, physical, and mental aspects of humans more strongly into work processes. Furthermore, this analysis may figure out whether manufacturing life is integrated into manufacturing processes.

The Shift from the Macro- to Micro- and to Nano level of HMI in Manufacturing Processes

As described above, robotic applications in manufacturing are usually embedded in complex socio-technical organizational structures. However, experience shows that robotic applications do not necessarily replace operational tasks and thus human work [52, 53]. They enable changes in the division of labor between machines and working groups/workers which bring physical relief and thus help improve working conditions. Furthermore, they can contribute to increasing human competence and autonomy, especially in highly skilled jobs at shop floor level [54,55,56]. But can we conclude that these phenomena will also occur at the micro- and nanolevels of robotics? Will increasing competence requirements and autonomy shape HMI with this type of robots? There is still little empirical research on these questions.

The importance of socio-technical concepts for work environments in micro- and nanomanufacturing still seem to be underestimated. The impact of these technologies on new job profiles, new qualification requirements, or new task contents is still an open research field from the economic perspective [5254]. On the other hand, research on new developments in robotics, especially in the engineering sciences, is strongly supported by public and private funding worldwide. The outcomes of that technical research can serve as tools for designing new work environments. In particular, technological developments in the fields of haptics, vision and control systems, and mobile capacity are leading to new forms of human–machine interaction (HMI) in the manufacturing industry. Social sciences could analyze the implications of those new technical concepts and contribute to the design of new work environments [57, 58].

At the microlevel, technical developments in the area of vision and control systems are becoming increasingly relevant in manufacturing processes. Haptics and mobile capacity, however, are less relevant for micro- and nanorobots than for industrial or service robots. Innovations in these fields mainly concern collaborative robotics, assistive bionics, exoskeletons, autonomous systems (ground, water, or air vehicles), and micro robotics. In these areas, the complexity of HMI at the working level is increasing significantly due to the use of various technologies, such as computerized numerical control (CNC) machine tools, automated guided vehicles (AGVs), and cyber-physical devices. For example, in many manufacturing companies, operators of flexible automation systems have to interact with CNC machine tools, collaborative robots, assistive mobile robots (AGVs or ground autonomous systems), and intermediate buffers with smart sensors.

Furthermore, the use of electronic processors and computer-controlled devices has increased significantly. This means that the technology density at these workplaces is much higher than at comparable workplaces in industry [36]. Due to the acceleration of processes, the complexity of tasks, and the required level of attention, HMI becomes much more intensive. The increasing complexity affects qualification requirements and work performance: the higher the complexity, the higher the competences required to perform the tasks. In companies that use NBIC technologies, this can lead to significant changes in the manufacturing workforce. Usually, a highly skilled worker, but without experience or special training, is not able to interact with this variety of devices. This is especially true in so-called “industry 4.0” environments, which require a higher level of skills and competences [56, 59].

Visions of production at the micro- and nanoscale are reflected in a prominent European report which focuses on aspects of working conditions, specifically the possibility of employee involvement [60]. The authors of the report assume that there are two dimensions of HMI and its integration in these new technical environments: (a) task discretion or the influence that employees can exercise on their immediate work tasks, (b) organizational participation or the influence that employees have on decisions in their work organization. Following these considerations, work in technically complex work environments (CWEs), such as micro- and nanomanufacturing, can enable a higher degree of operator control over their own task design and performance [37, 61, 62]. Problems that can arise in such work environments by quasi-accidents, failures, and other unexpected events. These can occur especially in the lower mm dimensions. The more complex the technical system is (equipment, communication system, accuracy requirements, systems architecture), the greater is the need to design the work environment appropriately (tasks, job allocation). At the same time, the greater the work autonomy and the qualification requirements, the clearer the work content and the decentralized decision-making processes must be. Experience shows that both dimensions, the social and the technical, must be designed together to prevent divergence in management strategies for the two dimensions and to integrate the technological complexity in the work environment. This seems to be especially true for the lower mm dimensions.

According to the US National Robotics Initiative’s Roadmap for U.S. Robotics — From Internet to Robotics [63, 64] on nanomanufacturing, the classic complementary metal-oxide semiconductor (CMOS)-based integrated circuits and computing paradigms are to be supplemented by new nanofabricated computing substrates. As stated in the report, advances in microelectromechanical systems (MEMS), low-power very large-scale integration (VLSI), and nanotechnology already enable the use of sub-mm self-powered robots (or nanorobots) in the healthcare, energy, and manufacturing sectors. New parallel, and even stochastic, assembly technologies for low-cost production are likely to emerge. Many conventional paradigms for manufacturing will, according to this technical vision [65], be replaced by new, yet-to-be-imagined approaches to nanomanufacturing. Accordingly, the roadmap for nanomanufacturing and nanorobotics recommends basic research and development focusing on [63, 64]:

  • 5 years: technologies for massively parallel assembly via self-assembly and harnessing biology to develop novel approaches for manufacturing with organic materials

  • 10 years: manufacturing for the post-CMOS revolution enabling the next generation of molecular electronics and organic computers

  • 15 years: nano-manufacturing for nano-robots for drug delivery, therapeutics, and diagnostics

The agenda of the US Roadmap is to regulate the development of nanorobots for medical applications until the early-2030s. Important steps toward achieving the goals are measures to promote technologies in the field of micro processing. In particular, a rapid development of technologies based on CMOS, VLSI, and MEMS is planned for the next years. The knowledge gained should be applied not only in industry but also in new systems for the medical (surgery robots) and healthcare sectors (assistive systems).

According to Nelson et al., new industrial areas for micro robotics include assembly, inspection and maintenance, micro optics (positioning of micro optical chips, micro lenses, and prisms), and micro factories. Many of these applications require automated handling and assembly of small parts with sub-mm accuracy [8]. Some suppliers and manufacturers of micro optics need to configure automated micro electro-mechanical systems (MEMS) assembly machines for their devices. Other companies need to develop automated lens (for video camera production) and endoscope inspection systems (endoscopes at the point of use by medical professionals). Based on practical experience, this knowledge should also contribute to the development of new types of microelectronic products in the long run. Work structures in which such systems are used must differ from those where the components to be integrated or transformed can be visualized directly.

At nano level, the control in manufacturing process is also performed by highly specialized and precise machines, such as atomic force microscopes (AFMs) and scanning probe microscopes (SPMs), which do not allow the human operator to intervene directly. AFM is a very high-resolution type of SPM and produces images of surfaces using a physical probe that scans the specimen (organic or non-organic). In this way, the AFM provides a three-dimensional surface profile which allows the operator to work in ambient air or even in a liquid environment, as the following scheme and photo shows (Fig. 1).Footnote 2

Fig. 1
figure 1

Process and work environment with scanning probe microscope (SPM). SPM from Karlsruhe University of Applied Sciences (Germany)

There is a significant shift in the work environment, which is due to the dimensional features of the nanoscale components: materials at this level behave differently than on a conventional scale. There is a higher chemical reactivity, while the object’s surface area in relation to its volume is very small. At the microlevel, the volume of components cannot be monitored directly by operators, but through information with computerized parameters. However, at the nanoscale, special devices are needed to intervene in the process, which means the operator visualizes and works through microscope the manufacturing process. The point is that at both dimensional levels — micro and nano — HMI takes place through indirect information about the production status, and augmented reality devices may be used to control the processes. At microlevel, the worker uses imaging sensors to access information on the process control, but at nano level, the use of special microscopes is required to collect information that will be provided through augmented reality (as shown in the above scheme of Fig. 1).

The use of 3D images becomes important and standard in micro- and nano production with robots, in particular in electronics or precision metal engineering. According to De Santis et al., the “dependability of complex robot systems in anthropic domains during normal operations is threatened by different kinds of potential failures or un-modelled aspects of sensors, control/actuation systems, and software architecture, which may result in undesirable behaviours” [66]. Some of the undesirable events in work environments with NBIC technologies, sensors, control systems, software, and manipulation at sub-mm levels can have safety implications. In the context of medical robotics, Fei et al. stress that “safety is not only an engineering issue but also a management project” [25]. The same assumption can be applied to any other type of robot used in manufacturing, as for EN ISO 10218:2011 [67,68,69] standards about safety requirements for industrial robots. However, while HMI analyses usually consider various aspects, such as autonomy, level of shared interaction, handling of sensors and sensor fusion, task content, and ratio between robots and workers, safety conditions in non-physical interaction are rarely considered.

As described above, system integration is one of the major challenges for robotics in CWE in manufacturing. Micro- and nanorobots will be used in the near future and will constitute a limiting factor in the integration of production cycles. Because “nano-objects do not exist without technological mediation: they require the use of SPM or AFM connected to powerful computers and software. In this respect they instantiate Bachelard’s notion of ‘phenomenotechnics’: they are constructed by technological means and require a convergence of research efforts and a multidisciplinary community. Nanoscale objects only came into being via a technological macrosystem, a network of information technologies” [70]. As Bensaúde-Vincent points out, these types of technologies will play a central role in the redesign of work practices. Nanotechnology in particular will establish a new quality of HMI, which is characterized by the complexity, the degree of abstraction of the content, and the relationship of the technical intermediary to its “working object.” This means that image mediation will become the standard in work environments that offer a new quality of HMI: simulation-based interaction, where the object to be assembled or manufactured only becomes visible through novel microscopes.

The following pictures show the work with an AFM in a manufacturing environment (Fig. 2).

Fig. 2
figure 2

Operation with atomic force microscopy (From https://www.youtube.com/watch?v=GybH5DfWG9w (Park Atomic Force Microscopy))

As shown in the pictures above, several devices are connected to the workplace interacting with the AFM, and “each AFM instrument should be miniaturized as much as possible to maximize the number of instruments that can be operated in parallel”, as referred by Sadeghian et al. [69] about these machines (atomic microscopes).

The SPM, a special type of AFM, has the disadvantage of producing images in black and white or greyscale, which can lead to distortion of the shape or size of a specimen or sub-mm object. Computers are used to compensate for these distortions and generate real-time color images that provide the operators with real-time information, e.g., on interactions within cellular structures, harmonic responses, and magnetic energy (see pictures below in Figs. 3 and 4).

Fig. 3
figure 3

Operation of an SPM (https://www.youtube.com/watch?v=GY9lfO-tVfE

With a scanning tunneling microscopeFootnote 3 (see pictures above), the human operator installs the cantilever with the specimen to be manufactured or assembled and then controls the process via a computer terminal that receives data from several sensors. The feeding of the specimen chamber can also be automated when connected to an industrial robot (not shown in the above photo). The following image shows how an STM manipulates atoms to assemble a new object or even a nanorobot.

Khare et al. explain in their article on sub-mm additive manufacturing: “SPM methods allow direct-write patterning and in situ imaging by contact or near-contact interactions of a substrate with a nanoscale probe, typically at the end of an atomic force microscope (AFM) cantilever” [71]. Therefore, this method, as seen in Fig. 4 from the Laboratory of Solid-State Physics (LPS) form the CNRS and University of Paris-Saclay, can be applied to low batch production industry or for prototyping (medical products or electronics).

Fig. 4
figure 4

Example of manufacturing process using a STM (Physics Reimagined group (LPS, CNRS Université Paris-Sud) with funding of Labex PAL. https://www.youtube.com/watch?v=HE2yE8SvHmA)

At these scales, simulation, anticipation, and production instances are defined by machines, while at the same time the technical competences of humans to work with such objects must increase. Such competences are related to the task contents, such as nano handling and manipulation needs, and the scope of the overall processes. Here, it seems that the boundaries of HMI with respect to machine autonomy processes may become blurred. The high complexity of the technological systems in which humans are involved probably leads to a loss of control rather than an increase in autonomy. In other words, since the complexity of the systems requires higher skill levels to interpret the computed visual information, these machines can lead to a higher degree of automation of the manufacturing processes (additive or not) on an industrial level. It can be assumed that, under these circumstances, the human operator will lose control of the work process, while keeping his or her autonomy. This autonomy can be at the decision level or at the process level. The operator can be entitled to such autonomy because of the competences required to perform the necessary tasks.

There are several authors that demonstrate different application experiences with these levels of micro- and nanomanufacturing possibilities. For instance, Bogue states on micro- and nanorobotics: “As yet, the technology is in its infancy, but a growing number of academic groups are studying nanorobotic concepts” [72]. Fabrication by deposition, etching, and lithography (additive manufacturing), reliable electronic interconnect processes, energy storage and conversion (e.g., batteries, fuel cells), and production of photovoltaic nanomaterials are recent examples of industrial applications. The range of products focuses on applications that will play a major role in the near future. However, according to Khare et al., “methods such as electron-beam lithography and focused-ion beam printing work in a serial writing mode are expensive. In addition, these top-down nanomanufacturing methods are intrinsically planar, requiring multiple postprocessing steps which limit patterning flexibility and result in a large excess of material waste during manufacturing. Additive nanomanufacturing provides design flexibility and allows direct write patterning of metallic, ceramic and insulating nanostructures, which are typically precluded with photolithography” [71]. This lithography method uses both micro- and nanomanufacturing approaches in additive processes. HMI in such systems is similar to that of special microscopes used in sub-mm manufacturing.

Ru et al. demonstrated automated nanomanipulation inside a scanning electron microscope (SEM) for a well-structured nanomanipulation task via visual servo control. Here, four-point probe measurement of individual nanowires was achieved automatically by controlling four nanomanipulators with SEM visual feedback [73]. In contrast, Yang et al. point out the challenges of coordinating such complex nanomanipulation processes: “high efficiency nanomanipulation requires multiple degrees of freedom, including rotation, for orientation control of nanotubes and automated nano-handling control. Besides, a single nanomanipulator itself has limited capabilities, but the coordinated effort of a multitude will produce the desired system-level results. Coordination is needed across the board – for communication, sensing, and acting – which poses a major research challenge. The scale and dynamics of nanorobotics systems precludes centralized coordination and global sharing of states” [74]. The following pictures show examples of human interaction with SEMs (Fig. 5).

Fig. 5
figure 5

Work operation examples with an SEM. a Pomona College Physics and Astronomy Department (USA) (Source: https://www.pomona.edu/academics/departments/physics-and-astronomy/facilities/scanning-electron-microscope). b Laboratory Testing Inc. (USA). (Source: https://www.labtesting.com/services/materials-testing/metallurgical-testing/sem-analysis/). c Zeiss Auriga SEM–FIB Workstation installed at CENIMAT|i3N (Portugal)

The pictures above show laboratories that operate and test SEM systems. In most cases, they also provide services for companies (prototyping, testing, quality control). The examples vary from Germany to USA and to Portugal. The working processes in those labs are very similar and are being applied elsewhere as we understood from the interviews made. However, there are also companies that provide such component manufacturing services, and some larger industrial companies are equipped with their own SEM systems. The cases at service and industry sectors are not so frequent. However, it is clear that the number of cases will increase quickly in the next years in a correlated fashion as product and component miniaturization is also growing in different sectors. The economy sectors that potentially will increase the use of miniaturized products and components can vary from electronics and optics, to automotive, to pharmaceutics, or even to medical devices. Many others will follow.

Overall, the field of sub-mm robotics covers the manipulation of objects at the micro- and nanoscale (manipulators) as well as the design and fabrication of autonomous robotic agents, as referred by Nelson et al. [8] and Requicha [75]. The procedures required for molecule manipulation or the development of artifacts that can intervene in organic structures are likely to transform production processes and HMI in these work environments. Changes in HMI result from the separation between the operator and the object of transformation. Usually, the operator controls the process via computer terminals (see pictures above). The object of transformation is located in the specimen chamber, which is closed by means of a high-vacuum pump. At the micro- and nano levels, sensors and data processing play a central role in the work performance as soon as direct manipulation is no longer possible. Work tasks are mediated through ICT, and the work contents must follow standardized procedures. At the sub-mm scale, humans have to interact with specialized machines with a high degree of ICT integration on an extremely abstract level. They work in a much more complex work environment, with different types of machines and a variety of devices.

Looking at the empirical experience with NBIC technologies in industry, it is striking that knowledge about the interrelation between micro- and nanorobotics and the design of task organization for machine operation seems to be proportional to the dimensional level: there is very little knowledge on the socio-organizational implications of microrobots and almost no knowledge at the nanorobotics level. Therefore, a closer look at the shift from the macro- to micro- to nano level in future systems of manufacturing seems worthwhile.

Human–Machine Interfaces at the Micro- and Nano levels

Whereas socio-technical concepts in manufacturing have been evaluated with regard to (economic) efficiency as well as with regard to working conditions, empirical information about the impact of manufacturing on a sub-mm scale is still missing. In scientific debates, another aspect focuses also on the new quality of human–machine interface, where robotics becomes a mediated function between the operator and the product or component to be assembled or manufactured. These changes are based on the structure of manufacturing applications which should be developed in the long run on a specific socio-technical concept in this field.

The technical precision increases when the manufacturing process is driven into the microlevel, and even clearer, into the nano level. The management becomes also more central in the field of emerging technologies applied in these last dimensions. Here, it seems important to analyze in depth which normative perspective is leading robotic applications. Whereas in production sector the socio-technical concept of robotics has led to processes of increased codification, commodification, standardization, and fragmentation, according to Schmiede [51], similar developments at micro- and nano levels are still under observation.

As well for the nano assembly, it is necessary to use SPM. Although microscopes are normally used for imaging, it was recognized soon after their invention that they can also modify the samples, as Requicha et al. point out in their paper [75]. AFM can be used for nano assemblies, but only in ambient conditions. Thus, the standard use of the AFM is as an imaging instrument. This research team concludes that AFMs provide effective means for fabricating nanodevices and nano system prototypes and products in small quantities [75].

Another element that will have implication on the modes of HMI with micro- and nanomachinery is that complex communication and information management is controlling the functioning of the system. The decision process has several levels of determination, and unexpected events can have higher risk effects for the process performance and task completion. Studies from Dalgaard [23] or Bernstein, Crowley, and Nourbakhsh [76] already indicate this. In conventional industrial manufacturing, the robot operators (from the traditional industrial robots to the most advanced collaborative robots) are using their individual senses like their vision, their senses of touching, their senses of smelling and hearing to understand and interact with the work environment. In manufacturing, an increase of integration of service robotic technology is widely expected and through the deployment of robots into novel areas of manufacturing, as Hirsch-Kreinsen and Karacic [9] or Moldaschl [77] already concluded.

However, new problems are occurring with the manufacturing at nanoscale. It needs unusual equipment (like the above-mentioned SPM and AFM) and it can be applied for small quantities of products. Besides this, the operator should be at distance from the manufacturing objects. There are existing two basic principles for the fabrication of micro- and nanorobot devices: the bottom-up and top-down approach. Assembling smaller components to the final product is called bottom-up approach, whereas reducing a big to a small piece is called top-down approach. Since fabrication methods determine the design of a robot, the required robot performance in a specific application field is indirectly linked to these fabrication methods. Micro- and nanofabrication methods are of major relevance for successful implementing micro- and nanorobots [22, 78]. Thus, microrobots with the application of in-pipe inspections, operation in microenvironment and microsurgery of blood vessels will be very useful to industrial and medical fields, as Guo et al. conclude [26].

Some robot manufacturers are developing new cell production assembly system, in which physical and information supports are provided to the human operators, reinforcing the safe cooperation with the robot while providing instructions on the operations to be performed [79,80,81].

Interestingly, the European Multi-Annual Roadmap describes “in the context of manufacturing, the greatest potential is for functions which contribute to a reduction of programming and configuration requirements in deployed systems. There are formulated clear benefits for small lot size systems in reducing the time and skill needed to reconfigure an adapt systems to new processes” [82]. Examples, hereby, can be used from “man-robot interaction with open-end learning process, robot apprentice learning from experience, from various workers, abstraction, etc.” that will be found in several case studies. The ability levels for human interaction that are relevant will be from the level 5 (Social interaction), but a special focus will be found for levels 6 (Complex social interaction) and 7 (Intuitive Interaction). From a technical side these descriptions seem already comprehensible, from a social and organizational side, however, these descriptions seem open in its applications. For the purpose of understanding the HMI levels, it seems important to include the human dimension.

This means that the new forms of interaction with micro- and nano level machinery will need much higher Technology Readiness Levels (TRL). As known, TRL is a type of measurement system used to assess the maturity level of a particular technology, developed by NASA.Footnote 4 Later it was adapted and adopted by the European Commission (EC) from 2014 at the Framework Programme Horizon 2020. Whenever the TRL, the more critical becomes the technology readiness, the more important is the definition of the limits and capacities of the human agent.

In the Multi-Annual Roadmap on Robotics, established by the EC for the above-mentioned Framework Programme of Research and Development, the “Human–Robot Interaction Levels” under chapter “Interaction Ability” is described in detail. It applies to all types of robots, and not specifically to nanorobotics. There [83] “the following set of levels relate to the interaction between users and the robot system. This set of ability levels are distinct from the cognitive human–robot interaction levels as they define the method of interaction independently of the cognitive context”. The level 0,Footnote 5 1,Footnote 6 2,Footnote 7 and 3Footnote 8 reveal the basic levels of interaction ability in the HMI, and they are mostly applicable to most applications of industrial robots. The next levels (TRL 4 to 6) can be more suitable to micro- and nano-manufacturing.

  • Level 4—This kind of interaction is mostly common to industry companies that use welding or gluing robots, with no sequential operations. These applications can be as well used for nano levels. There the system can operate autonomously during some parts of a task or in some tasks. This can be also the case for some operations with micro-assembly. Once this task or sub-task is complete the human operator will either select the subsequent task or intervene to control the system by direct interaction to carry out a task, as in the application examples mentioned. This results in alternating sequences of autonomous and direct control of the system by the robot operator.

  • Level 5—The interaction level of task sequence control is not so common, as the robot system should be able to execute sub-tasks autonomously which involve a higher level of decisional autonomy than the pre-defined tasks in Level 3. The human operator is required to select the next sub-task resulting in a sequence of actions that make up a completed task, even for micro- and nano robots.

  • Level 6—The system is able to recognize when it is unable to proceed or when it requires user input to select alternative strategies or courses of action. These alternatives may involve periods of direct control. This is the case when robots are integrated in more complex systems with interaction with other machines or robots. As usually there are no applications in micro- or nanomanufacturing requiring this level of operation, the examples of this level of interaction are not applied, or at least there are also no literature references of any example, although conceptually they may be possible.

For the Level 7 (Task selection) and Level 8 (Mission Goal setting), we also do not have any reference for micro- and nanorobotics, as verified by the literature review, as well by the expert interviews. Even for “conventional” industry robotics, the cases are less common. These levels of interaction imply that the robotic systems are able to autonomously execute tasks but requires the human operator to select between strategic task alternatives in order to execute a mission (TRL7), or the system will be able to execute tasks to achieve a mission where the human is able to interact with the system to direct the overall objectives of the mission. The levels of autonomy are dependent on technology development, but mostly dependent on social determinants: the operator skills and competences, and the work organization models [84]. In this roadmap, the “Human–robot interaction feedback” is defined as an “ability to command a robot depends on the user’s perception of the state of the robot” [83]. Here are also different levels of robot feedback. It starts on level 0 where there is no feedback,Footnote 9 and continues on 1.Footnote 10 The following levels are applied to micro- and nanorobotics:

  • Level 2 — Robots operating with micro components in the electronics sector provide vision data feedback. The human operator must interpret this visual imagery to assess the state of the robot or its environment.

  • Level 3 — A simple haptic feedback is delivered to the user via a single point of contact, for example a joystick. Some industrial cases of robots applied to additive manufacturing methods with micro process using robots to handle specimen chambers at SPM provide this level of feedback.

  • Level 4 — More recent system of robots operating with micromanufacturing or even microrobots are able to feedback to the operator signals and forces that augment the force information (augmented haptic feedback). The augmentation enhances the interaction between the user and the robot. In the future, it is also to be applied to nanorobots in the electronics sector.

These feedback levels nicely show the (new) quality of HMI in these complex systems like the image interpretation and new types of haptic feedback. The next levelsFootnote 11 are presently objectives for more advanced robotics in some manufacturing industries, but not at micro- or sub-mm levels. The last feedback level (TRL 8), for example, would require that the robotic system is able to augment the experience of tele-presence with additional information that enhances the interaction between the user and the robot. Some changes can be expected at the level of communication between these dimensional robots and other robots or humans. Presently, just level 4 feedback is known in few cases, as was reported to us in interviews with field experts.

The boundaries of HMI at micro- and nano levels imply enhanced interaction augmentation, with additional information, with additional sensing or additional interpretation. It seems that these effects may provide new modes of HMI in manufacturing with robots at micro and nano scale. However, standardization and linearity of processes and order-oriented production will be established also at micro and nano scale [66, 74, 76, 85]. With regard to the enhanced interaction augmentation in the HMI, Adam Greenfield points out that these new systems “confronts us with an interlocking series of concerns, ranging from the immediately practical to the existential. The initial reservations center on the technical difficulties that are involved in articulating an acceptably high-quality experience” [86].

Boundaries Between Manufacturing Life and Work — Conclusions

The Intel co-founder, Gordon Moore, mentioned that the number of transistors incorporated in a chip will approximately double every 24 months. As a result, the transistor scale gets smaller and smaller according to the famous Moore’s Law. However, the global semiconductor silicon wafer market is expected to reach US$13.64 billion by 2025 (being 9.85 billion in 2019). Semiconductors have emerged as the building blocks of all modern technologies, and wafers remain the core component of many microelectronic devices and the cornerstone of the electronics industry. The engineering behind an integrated circuit goes far beyond the simple assembly of individual components. In fact, microscopic circuit patterns are built on multiple layers of different materials. These steps are repeated several hundred times until the chip is finally finished.Footnote 12 The above descriptions impressively demonstrate the market dimension of products manufactured with robotics at the sub-mm scale. However, due to the high level of technical specialization, the public has little knowledge about the manufacturing processes of products such as smartphones, tablets, and other digital devices.

Given the ongoing innovation process of micro- and nanoscale robotics in manufacturing, the overarching question is how deep and how complex the impact on HMI is. What are the side effects of new technical features, especially if they are developed at the micro- and nano levels? How does HMI change at this scale? Will the boundaries in HMI change? How will this affect the quality and organization of work?

The article confirms the hypothesis that working with robotics at the sub-mm scale will probably blur the boundaries of HMI in manufacturing and bring new challenges. Although there is little empirical evidence, it seems that HMI will become more involved in the physical interface, but the boundaries of HMI will become blurred by more intense interaction via information collection and control.

As described above, the shift from macroscale robotics (industrial and collaborative robots) to micro- and nanoscale robotics is characterized by an increase in the technical complexity of HMI at the shop floor level. This is similar to experiences in the manufacturing industry with new forms of interaction between operators and CNC machine tools or collaborative robots. The interaction with machines at the sub-mm scale and the large number of electronic processors, vision systems, and computerized devices used in these new processes place new demands on operators, while at the same time, the possibilities for human manipulation of the work processes are decreasing. Control is achieved through automotive procedures and feedback, which increases the autonomy of the manufacturing process. Due to the increasing autonomy of the processes, the boundaries of HMI become blurred. Interestingly, this has not been the case with automotive production in the process industry, as Kidd [46] and Brödner [62] have already demonstrated. But will the broadened parameters of the “Industry 4.0” concept with the dissemination of cyber-physical systems and industrial IoT robots (macroscale) bring similar developments? Previous works from Pfeiffer [59] or from us [87] has focused on that and the answer probably is, yes. It seems that HMI at the sub-mm scale is characterized by a new quality of interaction with more complex devices in the interaction process, but less work autonomy of humans. As the article showed, working at the micro- and nanoscale is technically and organizationally complex. The assumptions about the impact of HMI in these areas are preliminary, and further research is needed, which will be outlined in the following steps:

In a first step, problems, limits, and potentials of micro- and nanoscale robotics should be identified and analyzed for different models of organization in complex work environments. In addition, the side effects of technical applications should be explored comprehensively in terms of both HMI and organizational structures, also taking into account the human dimension in terms of “improved” working conditions, as Bethel and Murphy [88] already demonstrated some years ago.

In a second step, further research should identify — mainly based on scenarios — new developments where technical achievements (3D operation, augmented reality, haptics, micro- and nanomanipulation) can be applied in more sectors of the manufacturing industry [74, 89, 90]. The new dimensions of micro- and nanorobotics in several sectors (metal industry, microelectronics, textiles, medical devices) give rise to new forms of HMI. The strong development toward miniaturization of electronic devices and components in manufacturing is accompanied by an increasing need for simulation tools for the assembly of sub-mm components and control of the novel robots [8, 78, 91]. Without doubt, in the long run, interaction will be mediated through computer imaging and will take new directions, where direct process control by humans is probably no longer possible.

As mentioned in the beginning of this article, at both dimensional levels — micro and nano — HMI takes place through indirect information about the production status, and augmented reality devices may be used to control the processes. That being said, we can conclude that working on these scales requires, on the one hand, increased abstraction and simulation skills of the workers. On the other hand, the application of this type of technical tools and artifacts is associated with increased standardization of work processes. These changes in HMI and thus at workplace level require critical analysis of their impact in terms of safety standards, new forms of control, and workers’ autonomy in work environments at the micro- and nanoscale.