A wearable triboelectric nanogenerator (denoted as CSF-TENG) is designed using biodegradable and carboxymethyl chitosan-silk fibroin (CSF) film.
In vitro biodegradation of CSF film is performed through trypsin and lysozyme. 63.1% of CSF film is removed by trypsin and lysozyme after degrading for 11 days.
An intuitive writing system is designed by CSF-TENGs-based human-machine interface to promptly track writing steps, highlight the stroke in advance, and access the accuracy of letters.
Letter handwriting, especially stroke correction, is of great importance for recording languages and expressing and exchanging ideas for individual behavior and the public. In this study, a biodegradable and conductive carboxymethyl chitosan-silk fibroin (CSF) film is prepared to design wearable triboelectric nanogenerator (denoted as CSF-TENG), which outputs of Voc ≈ 165 V, Isc ≈ 1.4 μA, and Qsc ≈ 72 mW cm−2. Further, in vitro biodegradation of CSF film is performed through trypsin and lysozyme. The results show that trypsin and lysozyme have stable and favorable biodegradation properties, removing 63.1% of CSF film after degrading for 11 days. Further, the CSF-TENG-based human–machine interface (HMI) is designed to promptly track writing steps and access the accuracy of letters, resulting in a straightforward communication media of human and machine. The CSF-TENG-based HMI can automatically recognize and correct three representative letters (F, H, and K), which is benefited by HMI system for data processing and analysis. The CSF-TENG-based HMI can make decisions for the next stroke, highlighting the stroke in advance by replacing it with red, which can be a candidate for calligraphy practice and correction. Finally, various demonstrations are done in real-time to achieve virtual and real-world controls including writing, vehicle movements, and healthcare.
Wearable electronics have experienced development and progress in the past decades because of their significant contributions to various fields [1,2,3,4,5,6]. Wearable electronics components can be coated on the human body or skin to monitor human healthcare such as respiration monitor , body temperature , and safety protection [9, 10]. Furthermore, it has emerged recently toward flexible and portable devices for motion monitoring, healthcare, and human–machine interfaces (HMIs) [11,12,13,14,15]. Thus, the recent advancement of wearable electronics based on HMIs has sparked the digitalization of human activity through analyzing data generated by tiny movements and endowing it with wide application such as accurate recognition, gestures , and communication [17, 18].
Internet of things (IoT) consists of a series of devices that are interconnected over the internet or other communication networks. It has shown significant potential in activity recognition, intelligent monitoring, and real-time response systems [19,20,21,22]. Ultrafast expansion and deployment of semiconductor technology enable cost-effective means for wireless network interconnectivity between countless sensors and processors, stimulating visible development in the HMIs [23,24,25]. Accordingly, the burgeoning HMI fosters an imperative demand for intelligent sensors that provide a key connection between humans and machines, allowing for more effective but simpler routes to realized more required works [26,27,28,29]. Under this circumstance, huge and widely dispersed electronic devices such as wearable electronics/photonics devices are expected to be interconnected wirelessly with IoT, providing comprehensive real-time surveillance on our destinations and actions [30,31,32,33]. Hence, wearable electronics are undergoing an explosive development for human–machine interaction in IoT applications [34,35,36].
However, the remarkable advancement of wearable electronics necessitates the widespread use of mobile power sources, which in many situations are still traditional devices with limited lifetimes [37,38,39,40]. Thus, significant effort has been devoted to the exploration of wearable devices that can convert wasted mechanical energy to electrical signals [41,42,43,44]. Triboelectric nanogenerator (TENG) was established in response to this requirement. TENG acts as an innovation of energy collection technology that noticeably stands out from its virtues and unique traits because of enormous breakthroughs in energy-harvesting nanotechnology [45,46,47,48]. TENG-based HMIs are experiencing extensive and flourishing development, and they are used in almost all aspects of our lives for wearable sensor, medical monitoring, and energy conversion [49,50,51,52]. Thus, TENG-based HMIs exhibit many of the numerous merits (for example, low-cost, self-powered, and easy electric circuits etc.) and have continued to emerge in various fields, such as tracking identification, error information amendment, and human–computer interaction [43, 53,54,55,56]. For instance, it is reported a wearable triboelectric sensor for gait analysis and motion harvest to improve the intelligence of the robot-aided lower-limb and waist rehabilitation . M. Zhu et al. intergated triboelectric sensors with an exoskeleton system to capture and project various motions of human and robotic arm . C. Li et al. described a badge-reel-like stretch sensor based on TENG to monitor the change of spinal shape, illustrating application in daily spinal monitoring and physical rehabilitation training .
In past few years, TENG-based HMIs have been developed to track a trajectory pattern or identify letters leading to a real-time response and sustainable monitoring [60,61,62,63]. For example, W. Zhang et al. displayed a triboelectric sensor for handwriting signature identification . X. Ji et al. constructed a triboelectric electronics based HMI for analyzing writing signal pattern and letters fingerprint. Further, by combining machine learning, the recognition accuracy of letters fingerprint is calculated . Although the interactive communication between human and machines is achieved through the fundamental letter identification in the above-mentioned works, complex writing process hasn’t been realized by only depending on output signal or pattern identification. Particularly, calligraphy is of great importance in personal development because it is intimately associated with personal behavioral features, and is an essential part of civilian applications. Besides, traditional calligraphy boards, which are used to writing letter daily only provide writing rather than detailed monitoring, and do not meet the requirements of letters practice and correction. Thus, the real-time and sustainable monitoring of writing steps is crucial feature for practicing or correcting the aesthetic of letters and even its accuracy. Additionally, traditional wearable electronics posses low biodegradability and impermeability, even harmful materials to environment. Hence these factors restrict their applications. Notably, wearable TENG with biodegradability for letter handwriting has not yet been reported.
Here, HMI-enabled wearable electronics based on a triboelectric mechanism are constructed to achieve an intelligent, highly accurate, and real-time response writing system and carboxymethyl chitosan-silk fibroin-TENG (CSF-TENG) with a contact-separation mode fabricating the portable electronics, which uses carboxymethyl chitosan-silk fibroin (CSF) film as friction electrification material. CSF film is prepared by crosslinking carboxymethyl chitosan and silk, resulting in biodegradability, flexibility, and softness. Weight loss and UV–visible absorption change are used to investigate the biodegradation behavior of CFS film by trypsin and lysozyme. The impact of silk content on the electrical properties of CSF-TENG and the high electrical output performance of the optimal device is evaluated. Most importantly, the CSF-TENG-based HMI is successfully demonstrated in practicing letters and correcting the writing steps. Finally, 3D virtual reality (VR) applications including letters writing and healthcare based on the CSF-TENG-based HMI are achieved.
2 Materials and Methods
Sodium Carbonate, lithium bromide, and phosphate buffer (PBS, pH = 7.4) were purchased from Sinopharm Chemical Reagent Co., Ltd., China; EDC hydrochloride was obtained from BOSF Biotechnology Co., Ltd; trypsin (EC 22.214.171.124) and lysozyme (EC 126.96.36.199) were supplied by Shanghai Macklin Biochemical Co., Ltd; deionized water was obtained from a ULUPURE water system; carboxymethyl chitosan was purchased from Aladdin Reagent Company, and raw silks were obtained from the laboratory.
2.2 Preparation of Silk Fibroin (SF)
Raw silk was boiled in a 0.02 M Na2CO3 solution at 98 °C for 30 min and washed thoroughly with deionized (DI) water to remove impurities and wax; the purified products were submerged in a 9.3 M LiBr solution with a mass ratio of 1:20 at 60 °C. Further, the solution was collected and dialyzed (Mw = 3500) to eliminate residues, and a silk fibroin solution was obtained and denoted as SF.
2.3 Preparation of CSF Film
To achieve a uniform solution, 1 g of carboxymethyl chitosan was dissolved in 25 mL of DI water through stirring. After stirring, the obtained SF was added to the as-formed solution, and 1 mL of EDC hydrochloride (concentration: 30% of the amount of carboxymethyl chitosan) was subsequently added to the solution dropwise after stirring. Further, the mixture was dried in an oven at 60 °C, and the final (CSF) film was obtained. Following the same process, CSF films prepared with a different mass ratio of SF were abbreviated as CSF 0:1, CSF 1:1, and CSF 2:1.
2.4 Fabrication of CSF-TENG
The as-prepared CSF film with a size of 5 × 5 cm2 was selected as one electrode, and the PTFE film of the same size was attached to the CSF film. Further, the conductive sponge was chosen as another electrode to cover the PTFE film; a dielectric layer of PTFE film (5 × 5 cm2) was attached to the surface between the CSF film and conductive sponge.
2.5 Construction of CSF-TENG Writing System
The CSF-TENG writing system was designed as a woven structure to sensitively respond to mechanical inputs during the handwriting process. The writing system was consist of an 8 × 8 pixel overlapping region on the weft and warp side.
2.6 In Vitro Degradation of CSF Film
CSF film was incubated in a 30 mL solution of trypsin and lysozyme in PBS at 38 °C for 11 days. To obtain a uniform solution, 15 mg each of trypsin and lysozyme was dissolved in 30 mL of PBS, and 100 mg of CSF film was added to the resultant solution. The solution was placed on a shaking table, degraded at 38 °C, and shook at 100 r min−1. At fixed intervals, 2 mL of the reaction solution was sampled and measured using UV–vis spectrophotometry. The reaction solution was manually changed daily throughout the degradation process to enhance the degradation efficiency.
The microstructures and morphologies of the samples were obtained using scanning electron microscopy (SEM) and a su1510 microscope. Fourier-transform infrared (FTIR) spectra were obtained on a Nicolet iS10 spectrometer (Thermo Fisher). The chemical states of the samples were scanned by x-ray diffraction (XRD, Bruker AXS) under Cu Kα radiation from 10 to 90 °C. UV–vis spectra of the solution were performed by UV-3600 (Agilent, Cary300). An electrometer was used to measure the TENG’s output voltage and current (Keithley 6514).
3 Structure and Output Performance
3.1 Fabrication and Characterization of CSF Film
Figure 1a illustrates the fabrication process of CSF film by crosslinking carboxymethyl chitosan with SF solution. Carboxymethyl chitosan is dissolved in DI water under moderate conditions to form a solution. After adding SF into the resultant solution, EDS hydrochloride is swiftly added while stirring. The formed CSF film is replaced with absolute ethanol and dried at 60 °C after crosslinking. Complex mechanical deformations are measured to intuitively evaluate the physical properties of CSF films. The prepared CSF film can tolerate multidimensional strains under mechanical deformations such as torsional twisting, curl state, and linear stretching, illustrating great potential in wearable sensor, body monitoring and human–machine interaction (Fig. 1b–e).
The SEM images in Fig. 2a–c shows the morphological features of SF, carboxymethyl chitosan, and CSF marfilm. Pure SF only has a smooth and dense membrane structure on its surface, and microporous cannot be captured (Fig. 2a). For carboxymethyl chitosan film, the porous structure with open macropores formed by stacking and irregular terraced layered is visible (Fig. 2b). Additionally, the surface of carboxymethyl chitosan displays hills and valleys because of the irregular arrangement of the inner structure. The CSF surface has numerous lacunae within the network and the pore size increases, indicating that the crosslinking SF with carboxymethyl chitosan affects the morphology structure (Fig. 2c).
The crystal phases of all samples were measured using XRD. The XRD pattern of carboxymethyl chitosan shows a broad peak at 20.5° (Fig. 2d), which is consistent with the previous study . A diffraction peak located at 20° is attributed to the amorphous structure of SF . The XRD curve of CSF film retains the diffraction peak of SF and carboxymethyl chitosan after crosslinking but is noticeably different from the two. However, the peak of CSF film weakens and broadens dramatically. This abnormal phenomenon is because of the presence of a high amount of amorphous SF in the CSF film and crosslinking interactions between SF and carboxymethyl chitosan.
FTIR measurements were also performed to adequately account for the interaction structure of SF and carboxymethyl chitosan. Figure 2e shows that the strong peaks located at 1616, 1518, and 1234 cm−1 are attributed to the C = O (amide I), N–H (amide II), and C–N&N–H (amide III), respectively. The character peak at 3279 cm−1 is assigned to the hydrogen-bonded N–H and O–H stretching vibration. The spectrum of carboxymethyl chitosan shows absorption peaks at 1050 and 1130 cm−1, which are typical peaks of the saccharide structure. The amide I and amide II absorption peaks at 1652 and 1573 cm−1, respectively, indicate that chitosan has a significant deacetylation degree. Further, the CSF 1:1 film exhibits all the characteristic peaks mentioned earlier, indicating that the SF and carboxymethyl chitosan are effectively crosslinked.
Chemical reagents (NaOH, acid, and H2O2, etc.) can cause diverse diseases in living things and pose severe threats to ecosystems. Biodegradation is an effective degrading process in which microorganisms or their active by-products (bacteria, fungi, yeast, and polysaccharide) decompose waste in the natural environment [67, 68]. Further, the microorganisms involved in the biodegradation processes generate various enzymes such as protease, hydrolases, and lipases, which directly enhances biodegradation via catalysis. Thus, the biodegradability of CSF was carried out in the mixture of trypsin and lysozyme, which can effectively degrade protein and polysaccharides. The weight loss was measured to determine the periodic decomposition rate of CSF by replacing the enzyme fluid daily. A UV–vis spectrophotometer was used to determine the optical absorption behaviors of silk, carboxymethyl chitosan, trypsin-lysozyme, and CSF degraded for 18 h (CSF-18 h). Figure 2f illustrates that all samples exhibit fundamental absorption in the UV region. The UV spectra of trypsin-lysozyme and carboxymethyl chitosan show a characteristic peak from 250 to 325 nm, corresponding to the formation of π conjugated structure. In comparison with trypsin-lysozyme and carboxymethyl chitosan, CSF’ peak at 250–325 nm disappears after 18 h of degradation, suggesting a catalytic reaction between trypsin-lysozyme solution and CSF. Further, the UV region shows a slight decrease in the CSF absorption intensity, which can be attributed to the hydrolysis of CSF film. However, the inset picture of residual CSF solution confirms that the mixture is increasingly becoming nontransparent because of degradation. Figure 2g shows the degradation rate of DI water and trypsin-lysozyme solution for CSF film. When incubated at 38 °C with constant shaking for 11 days, DI water shows no CSF degradation capacity, whereas, the trypsin-lysozyme solution shows a higher CSF biodegradation ability. The biodegradation rate of CSF film treated by trypsin-lysozyme solution is about 36.53% after 24 h. The degradation rates increase from 36.53% to 63.07% as the reaction time increases, indicating that trypsin-lysozyme plays a positive role in CSF film biodegradation. Figure 2h(i–iv) shows the weight loss of CSF film degraded by the trypsin-lysozyme solution to further validate the biodegradability and environmental friendliness of CSF film; the weight of CSF film noticeably decreases from 100 to 37.37 mg (Fig. 2h(iii–iv)). The result proves that CSF film possesses great biodegradability, and can be ultimately hydrolyzed to tiny molecules.
3.2 Structure and Output Performance of CSF-TENG
However, the CSF film is also a high-performance conductive material. A flexible contact-separation mode CSF-TENG is designed after the CSF film is used as an upper electrode (Fig. 3a). Figure 3b shows the electricity-generation principle of CSF-TENG, which uses a typical contact-separation mode. PTFE is selected as a reference material throughout the experiments to determine the electric output performance of CSF film since it is one of the most available negatively charged materials. A piece of conductive sponge attached to PTFE and CSF film is used as back electrodes, which are connected to the external circuit for evaluating the electric output. When the PTFE is touched the CSF film in the original mode, charges are generated from the triboelectrification between the PTFE and CSF film with equally opposite polarities distributed on their surface (Fig. 3b(i)). A potential difference between the conductive sponge and CSF film is formed after the CSF and the PTFE film are separated. Electrons travel from the top of the CSF film to the bottom of the conductive sponge through the external circuit, resulting in an instantaneous current flow (Fig. 3b(ii)). When the PTFE and CSF films are completely separated, an electrostatic equilibrium is achieved between them and the electrons stop transferring (Fig. 3b(iii)). When the CSF film begins making contact again, electrons flow back from the bottom conductive sponge to the CSF film to balance the electrical potential differences (Fig. 3b(iv)). There are no remaining electrons on the electrode when the two charged surfaces fully overlap again, and the CSF-TENG reverts to the original state (Fig. 3b(i)). The electrostatic potential difference of CSF-TENG in the contacting and separating states is further illustrated by numerical calculations (Fig. S1).
A series of CSF films with different amounts of SF (2, 1, and 0.5 g) were fabricated to obtain a high triboelectric patch. The effect of the amount of SF on the electrical output performance of CSF-TNEG was evaluated under mass ratio (CC: SF) ranging from 0:1, 1:1, 1:2, and 1:0 (Fig. 3c). The results show that the CSF 1:1 has the highest electrical output performance (140 V, 1.32 μA, and 64 nC), whereas the output performance of CSF 1:2 and CSF 0:1 gradually deteriorates. Further, the electrical output of the optimized CSF-TENG was accessed by pressing and releasing cycles under various frequencies (0.5–2 Hz), resulting in a maximum Voc, Qsc, and Isc, for 165 V, 77 nC, and 2 μA, respectively (Fig. 3d–f). Further, we will like to investigate how different pressures affect electrical output performance. The Voc, Isc, and Qsc of CSF-TENG are measured under various pressures (0.65–12.67 N) for verification. Figure S2 shows that the entire electrical outputs are increased linearly as the pressure increases from 0.65 to 12.67 N. This phenomenon is attributed to the increased pressure, which can enlarge the contact-separation area, resulting in higher electrical outputs. The peak voltage was measured as different external resistances to obtain additional details on the behavior of the electrical energy output under external load (Fig. 3g). At a resistance of 1 GΩ, the voltage was at about 165 V, whereas the output power density peaks was at 72 mW cm−2. However, the CSF-TENG was successfully used to charge different capacitors at a frequency of 1 Hz. The charging rate increases with decreasing capacitances (Fig. 3h). By manually patting the CSF-TENG, 100 commercial LEDs can be easily illuminated (Fig. S3). For a systematic investigation, an additional test was performed to evaluate the stability of CSF-TENG. Figure 3i shows that the Qsc does not deteriorate after 30 min, demonstrating the strong stability of CSF-TENG. However, pressure is a crucial role in measuring the accuracy of the CSF-TENG in the sensor system.
4 CSF-TENG-Based HMI for Letters Practice and Correction
The CSF-TENG-based HMI, which has real-time response capability can be used as an intelligent writing pad to practice and correct letters. It must include a single isolated friction electrode uniformly distributed onto the PTFE to sensitively respond to mechanical inputs during the handwriting process. Thus, CSF mesh fabricated by CSF strips (width: 2 mm) acts as the upper triboelectric layer because of its woven structure. Each point’s output signal is recorded with 2 channels, and varying contact points are connected to 16 channels (Figure S4, supporting information). Figure 4a(i–iii) shows the real-time output signals of the letter writing for different strokes (“–,” “/,” and “|”) obtained by the acquisition card. For the stroke “–,” the user briefly touches the first point of the stroke array, and proceeds from electrode 2 to 6, where an output voltage pulse with the regular magnitude is first produced on electrode 2, and then the output voltage of various magnitudes are rapidly generated on electrodes 3, 4, 5, and 6 until the user completes the strokes array without discovering an output voltage (Fig. S5). Because of the real-time response-ability, it is obvious that no matter what kind of strokes the user writes, the handwriting signals and tracks exhibit instant response in the time domain. We selected three letters that are composed of strokes “–,” “/,” and “|” in all letters as an exhibition (“F,” “H,” and “K”). Leveraging the various output information from CSF-TENG, labview is utilized to analyze the signals to identify and correct letters. Figure 4b is the identification and correction images of letter F. The accurate writing standard is given before writing in the case of letter F (Fig. 4c), and it is divided into “|,” “–,” and “–.” The correlation judgment of the letter F is performed based on the standard. A real-time trend can be observed in the voltage on F writing from the output signals (Fig. 4d–h). During the whole process, visible signals are generated as the pressure is applied, and steps corresponding to the motions are performed promptly (Fig. 4d, f and Movie S1), followed by identifying the completed step and making the precise judgment based on the information of letters collected from the CSF-TENG. However, the writing results can be sent back to the user in real-time, allowing them to rewrite the selected letter in the CSF-TENG for validation and amendment. Thus, the corresponding results above the related strokes can be instantly recognized by labview for revision purposes. Although the user’s stroke sequence differs from the given standard, the alert system shows an error warning (Fig. 4b(i)). However, the finished stroke trend is unsatisfactory, deviating significantly from the standard version. For example, when the first writing stroke is “|,” the system switches on the green light (Fig. 4b(ii)), whereas an error alert is displayed when the stroke “–” is written first. However, when the next red stroke appears, the user should follow the hint to describe it, which will be replaced by a white stroke that is synchronized with the screen’s actual movement. Figure 4c illustrates that the letter F is correctly revised and identified.
Apart from letter F, letters H and K are also explored as representative letters by CSF-TENG-based HMI to make our writing applicable to the normal letters. Figure 4h(i) and Movies S2 and S3 show the images and signals of the last two letters. Figure S5 shows the writing steps of letters H and K that serve as the standards of the two letters. Similarly, when a user writes on the first step of the pad, the stroke gradually generates a distinguishable electrical signal. The images show a distinct sharpness and pattern. As we can see, it is not easy to write letter K smoothly because of the stroke “ < ”. However, the results verify that no matter how difficult the stroke “ < ” it is, CSF-TENG-based HMI can write perfectly and respond immediately. For the two letters, the same conclusion can be drawn: CSF-TENG-based HMI exhibites high rearrangement and correction accuracies. The compelling results also suggest that CSF-TENG-based HMI illustrates perspectives about the future development trends of the portable electronics and workbook practice board, such as letter identification, intelligent revision, and magic calligraphy practice board in the AI/IoT era.
5 CSF-TENG-Based HMI for Different Applications
The flourish advancement of VR and AR technologies provide a creative way for the potential application in social media and personal engagement. Thus, we designed a training program in Unity 3D to verify a VR writing control (Movies S4-S6). Each sensor channel is connected to Arduino for data acquisition. Python processes recieved data in real-time manner and then sends motion command to Unity 3D. Unity 3D receives the command of the predicted steps and then convert it into the movements of virtual pen, as shown in Fig. 5a. In our demonstration, three letters are available for recognition to control the virtual pen, including the letter N, U, and S. When the user writes letters, the steps will be simultaneously synchronized onto the virtual space. Next, the virtual pen in Unity 3D responds to the corresponding order in the virtual board. The triboelectric outputs and VR demonstrations of the three letters are shown in Fig. 5b and Movie S4. Further, the CSF-TENG is also implemented to follow a set of movement routes to prove the HMI for vehicle control, where the arrows represent forward movement, backward movement, leftward-movement and rightward-movement, respectively. The schematic illustration for the vehicle manipulation is shown in Fig. 5c. Simply, the output signals are captured and process by MCU. After, the signals are transffered into digital signals and then detected by the second MCU, which transmit commands to realize vehicle control. In a typical interactive process, the CSF-TENG outputs are employed to control the direction of vehicle movement by tracking the sliding trace of finger. For example, when the finger slides from the bottom to the top, the CSF-TENG from vertical channel 5 to horizontal channel 7 generate electrical signals, thus operating the vehicle to move forwards, backwards, and leftwards as well as rightwards. Figure 5d(i–iv) summarize the output details in responses to the corresponding traces. And the real-time control for vehicle movement commanded by CSF-TENG is intuitively illustrated in Movie S7. Afterward, to provide a simple and intuitive communication command for the special population include the patients and the elderly, the five pixels labeled as drink, lying down, sitting up, emergency contact, and rehabilitation training are presented. Figure 5e illustrates the circuit connection for the communication board. Firstly, the output signals collected from the CSF-TENG convert into digital signals to be transferred out through wireless module. Then the acquired signals are processed and sent to computer based on the MCU. As illustrated in Fig. 5f, a corresponding requirement is displayed on the screen of computer as pressing the emergency contact. Similarly, as the finger touches to the second pixel, the related icon appears verifying real-time and accurate communication (Movie S8). Each simple touching can generate a peak voltage (Fig. 5g). These demonstrations verify the potential of wearable electronics for the realization of the advanced multifunctional HMIs.
In conclusion, a wearable electronic for letters exercise and automatic correction is developed by CSF-TENG-based HMI. It is implemented by combining TENG and advanced HMI-based real-time data processing. A flexible and wearable CSF-TENG with biodegradable CSF triboelectric film is proposed using the simple assembly method. Contrasting experiments to optimize the output capacity of CSF-TENG are performed, followed by a series of performance measurements. A maximum voltage of 165 V and output power density of 72 mW cm−2 at a resistance of 1 GΩ is produced. Further, by using CSF-TENG-based HMI for real-time feature response, the writing process and sequence for the three letters can be tracked and reminded in a timely manner, demonstrating the identification and revision abilities of the proposed system for letters with different shapes. The error warning of the writing result can be generated by writing the same letters with different strokes. It only needs to be lightly touched once in the testing experiment because of its numerous advantages like portability, sensitivity, and rapid response properties. Finally, 3D VR controls including writing, healthcare and vehicle monitoring are successfully displayed using the constructed CSF-TENG-based HMI. Looking forward, an intelligent lifestyle can be established via wearable electronics, automatic identification, correction, and VR applications as a prospect under the HMI and AI infrastructure by employing sensory interactive system.
J. Zhu, X. Liu, Q. Shi, T. Zhongda, S. Xinge et al., Development trends and perspectives of future sensors and MEMS/NEMS. Micromachines 11(1), 7 (2019). https://doi.org/10.3390/mi11010007
Y. Ra, M. La, S. Cho, S.J. Park, D. Choi, Scalable batch fabrication of flexible, transparent and self-triggered tactile sensor array based on triboelectric effect. Int. J. Precis. Eng. Manuf. Green Tech. 8, 519–531 (2020). https://doi.org/10.1007/s40684-020-00267-7
D. Doganay, M.O. Cicek, M.B. Durukan, B. Altuntas, E. Agbahca et al., Fabric based wearable triboelectric nanogenerators for human machine interface. Nano Energy 89, 106412 (2021). https://doi.org/10.1016/j.nanoen.2021.106412
Q. Shi, B. Dong, T. He, Z. Sun, J. Zhu et al., Progress in wearable electronics/photonics—moving toward the era of artificial intelligence and internet of things. InfoMat 2(6), 1131–1162 (2020). https://doi.org/10.1002/inf2.12122
S. Lee, Q. Shi, C. Lee, From flexible electronics technology in the era of IoT and artificial intelligence toward future implanted body sensor networks. APL Mater. 7(3), 031302 (2019). https://doi.org/10.1063/1.5063498
R. Wu, L. Ma, S. Liu, A. Patil, C. Hou et al., Fibrous inductance strain sensors for passive inductance textile sensing. Mater. Today Phys. 15, 100243 (2020). https://doi.org/10.1063/1.5063498
C. Ning, R. Cheng, Y. Jiang, F. Sheng, J. Yi et al., Helical fiber strain sensors based on triboelectric nanogenerators for self-powered human respiratory monitoring. ACS Nano 16(2), 2811–2821 (2022). https://doi.org/10.1021/acsnano.1c09792
S. Han, J. Kim, S.M. Won, Y. Ma, D. Kang et al., Battery-free, wireless sensors for full-body pressure and temperature mapping. Sci. Trans. Med. 10(435), eaan4950 (2018). https://doi.org/10.1126/scitranslmed.aan4950
L. Zu, D. Liu, J. Shao, Y. Liu, S. Shu et al., A self-powered early warning glove with integrated elastic-arched triboelectric nanogenerator and flexible printed circuit for real-time safety protection. Adv. Mater. Technol. 5(7), 2100787 (2022). https://doi.org/10.1002/admt.202100787
L. Ma, R. Wu, H. Miao, X. Fan, L. Kong et al., All-in-one fibrous capacitive humidity sensor for human breath monitoring. Text. Res. J. 91(3–4), 398–405 (2021). https://doi.org/10.1177/0040517520944495
R. Yin, D. Wang, S. Zhao, Z. Lou, G. Shen, Wearable sensors-enabled human–machine interaction systems: from design to application. Adv. Funct. Mater. 31(11), 2008936 (2021). https://doi.org/10.1002/adfm.202008936
T. He, H. Wang, J. Wang, X. Tian, F. We et al., Self-sustainable wearable textile nano-energy nano-system (NENS) for next-generation healthcare applications. Adv. Sci. 6(24), 1901437 (2019). https://doi.org/10.1002/advs.201901437
M. Zhu, T. He, C. Lee, Technologies toward next generation human machine interfaces: from machine learning enhanced tactile sensing to neuromorphic sensory systems. Appl. Phys. Rev. 7(3), 031305 (2020). https://doi.org/10.1063/5.0016485
M. Zhu, Z. Yi, B. Yang, C. Lee, Making use of nanoenergy from human–nanogenerator and self-powered sensor enabled sustainable wireless IoT sensory systems. Nano Today 36, 101016 (2021). https://doi.org/10.1016/j.nantod.2020.101016
K. Qin, C. Chen, X. Pu, Q. Tang, W. He et al., Magnetic array assisted triboelectric nanogenerator sensor for real-time gesture interaction. Nano-Micro Lett. 13, 51 (2021). https://doi.org/10.1007/s40820-020-00575-2
F. Wen, Z. Zhang, T. He, C. Lee, AI enabled sign language recognition and VR space bidirectional communication using triboelectric smart glove. Nat. Commun. 12, 5378 (2021). https://doi.org/10.1038/s41467-021-25637-w
Y. Lu, H. Tian, J. Cheng, F. Zhu, B. Liu et al., Decoding lip language using triboelectric sensors with deep learning. Nat. Commun. 13, 1401 (2022). https://doi.org/10.1038/s41467-022-29083-0
X. Qu, X. Ma, B. Shi, H. Li, L. Zheng et al., Refreshable braille display system based on triboelectric nanogenerator and dielectric elastomer. Adv. Funct. Mater. 31(5), 2006612 (2020). https://doi.org/10.1002/adfm.202006612
Z. Zhang, T. He, M. Zhu, Z. Sun, Q. Shi et al., Deep learning-enabled triboelectric smart socks for IoT-based gait analysis and VR applications. NPJ Flex. Electron. 4, 29 (2020). https://doi.org/10.1038/s41528-020-00092-7
Q.F. Shi, Z.D. Sun, Z.X. Zhang, C. Lee, Triboelectric nanogenerators and hybridized systems for enabling next-generation IoT applications. Research 2021, 6849171 (2021). https://doi.org/10.34133/2021/6849171
T. Jin, Z. Sun, L. Li, Q. Zhang, M. Zhu et al., Triboelectric nanogenerator sensors for soft robotics aiming at digital twin applications. Nat. Commun. 11, 5381 (2020). https://doi.org/10.1038/s41467-020-19059-3
Q. Shi, Z. Zhang, T. He, Z. Sun, B. Wang et al., Deep learning enabled smart mats as a scalable floor monitoring system. Nat. Commun. 11, 4609 (2020). https://doi.org/10.1038/s41467-020-18471-z
X. Guo, T. He, Z. Zhang, A. Luo, C. Lee, Artificial intelligence-enabled caregiving walking stick powered by ultra-low-frequency human motion. ACS Nano 15(12), 19054–19069 (2021). https://doi.org/10.1021/acsnano.1c04464
J. Meng, Z.H. Guo, C.X. Pan, L.Y. Wang, C.Y. Chang et al., Flexible textile direct-current generator based on the tribovoltaic effect at dynamic metal-semiconducting polymer interfaces. ACS Energy Lett. 6(7), 2442–2450 (2021). https://doi.org/10.1021/acsenergylett.1c00288
B. Chen, W. Tang, Z.L. Wang, Advanced 3D printing-based triboelectric nanogenerator for mechanical energy harvesting and self-powered sensing. Mater. Today 1(50), 224–238 (2021). https://doi.org/10.1016/j.mattod.2021.05.017
S.S. Rautaray, A. Agrawal, Vision based hand gesture recognition for human computer interaction: a survey. Artif. Intel. Rev. 43, 1–54 (2015). https://doi.org/10.1007/s10462-012-9356-9
H. Wang, X. Ma, Y. Hao, Electronic devices for human-machine interfaces. Adv. Mater. Interfaces 4(4), 1600709 (2017). https://doi.org/10.1002/admi.201600709
F.A. Hassani, Q. Shi, F. Wen, T. He, A. Haroun et al., Smart materials for smart healthcare–moving from sensors and actuators to self-sustained nanoenergy nanosystems. Smart Mater. Med. 1, 92–124 (2020). https://doi.org/10.1016/j.smaim.2020.07.005
Y. Chen, Z. Gao, F. Zhang, Z. Wen, X. Sun, Recent progress in self-powered multifunctional e-skin for advanced applications. Exploration 2(1), 20210112 (2022). https://doi.org/10.1002/exp.20210112
M. Zhu, Z. Yi, B. Yang, C. Lee, Making use of nanoenergy from human - nanogenerator and self-powered sensor enabled sustainable wireless IoT sensory systems. Nano Today 36, 101016 (2021). https://doi.org/10.1016/j.nantod.2020.101016
A. Haroun, X.H. Le, S. Gao, B.W. Dong, T.Y.Y. He et al., Progress in micro/nano sensors and nanoenergy for future aiot-based smart home applications. Nano Express 2(2), 33 (2021). https://doi.org/10.1088/2632-959X/abf3d4
Z. Sun, M. Zhu, C. Lee, Progress in the triboelectric human–machine interfaces (HMIs)-moving from smart gloves to AI/haptic enabled HMI in the 5G/IoT era. Nanoenergy Adv. 1(1), 81–120 (2021). https://doi.org/10.3390/nanoenergyadv1010005
Z. Sun, M. Zhu, Z. Zhang, Z. Chen, Q. Shi et al., Artificial intelligence of things (AIoT) enabled virtual shop applications using self-powered sensor enhanced soft robotic manipulator. Adv. Sci. 8(14), 2100230 (2021). https://doi.org/10.1002/advs.202100230
F. Wen, Z. Sun, T. He, Q. Shi, M. Zhu et al., Machine learning glove using self-powered conductive superhydrophobic triboelectric textile for gesture recognition in VR/AR applications. Adv. Sci. 7(14), 2000261 (2020). https://doi.org/10.1002/advs.202000261
Z. Bai, Y. Xu, C. Lee, J. Guo, Autonomously adhesive, stretchable, and transparent solid-state polyionic triboelectric patch for wearable power source and tactile sensor. Adv. Funct. Mater. 31(37), 2104365 (2021). https://doi.org/10.1002/adfm.202104365
Y. Zhang, X. Gao, Y. Wu, J. Gui, S. Guo et al., Self-powered technology based on nanogenerators for biomedical applications. Exploration 1(1), 90–114 (2021). https://doi.org/10.1002/EXP.20210152
Y. Lai, H. Wu, H. Lin, C. Chang, H. Chou et al., Entirely, intrinsically, and autonomously self-healable, highly transparent, and superstretchable triboelectric nanogenerator for personal power sources and self-powered electronic skins. Adv. Funct. Mater. (2019). https://doi.org/10.1002/adfm.201904626
X. Hou, J. Zhu, J. Qian, X. Niu, J. He et al., Stretchable triboelectric textile composed of wavy conductive-cloth-pet and patterned stretchable electrode for harvesting multi-variant human motion energy. ACS Appl. Mater. Interfaces 10(50), 43661–43668 (2018). https://doi.org/10.1021/acsami.8b16267
P. Xiong, M. Liu, X. Chen, J. Sun, L.W. Zhong, Ultrastretchable, transparent triboelectric nanogenerator as electronic skin for biomechanical energy harvesting and tactile sensing. Sci. Adv. 3(5), e1700015 (2017). https://doi.org/10.1126/sciadv.1700015
Z. Hui, M. Xiao, D. Shen, J. Feng, P. Peng et al., A self-powered nanogenerator for the electrical protection of integrated circuits from trace amounts of liquid. Nano-Micro Lett. 12, 5 (2020). https://doi.org/10.1007/s40820-019-0338-1
F. Xu, S. Dong, G. Liu, C. Pan, Z.L. Wang, Scalable fabrication of stretchable and washable textile triboelectric nanogenerators as constant power sources for wearable electronics. Nano Energy 88, 106247 (2021). https://doi.org/10.1016/j.nanoen.2021.106247
Y. Zhu, S. Lin, W. Gao, M. Zhang, Z.L. Wang, Effects of oxygen vacancies and cation valence states on the triboelectric property of substoichiometric oxide films. ACS Appl. Mater. Interfaces 13(30), 35795–35803 (2021). https://doi.org/10.1021/acsami.1c09248
T. He, X. Guo, C. Lee, Flourishing energy harvesters for future body sensor network: from single to multiple energy sources. IScience 24(1), 101934 (2021). https://doi.org/10.1016/j.isci.2020.101934
X. Guo, L. Liu, Z. Zhang, S. Gao, T. He et al., Technology evolution from micro-scale energy harvesters to nanogenerators. J. Micromech. Microeng. 31(9), 093002 (2021). https://doi.org/10.1088/1361-6439/ac168e
X.S. Zhang, M. Han, B. Kim, J.F. Bao, J. Brugger et al., All-in-one self-powered flexible microsystems based on triboelectric nanogenerators. Nano Energy 47, 410–426 (2018). https://doi.org/10.1016/j.nanoen.2018.02.046
F. He, X. You, H. Gong, Y. Yang, M. Ye, Stretchable, biocompatible, and multifunctional silk fibroin-based hydrogels toward wearable strain/pressure sensors and triboelectric nanogenerators. ACS Appl. Mater. Interfaces 12(5), 6442–6450 (2020). https://doi.org/10.1021/acsami.9b19721
Y. Ra, J. Choi, M. La, Development of a highly transparent and flexible touch sensor based on triboelectric effect. Funct. Compos. Struct. 1(4), 045001 (2019). https://doi.org/10.1088/2631-6331/ab47ba
S. Fu, W. He, H. Wu, C. Shan, Y. Du et al., High output performance and ultra-durable dc output for triboelectric nanogenerator inspired by primary cell. Nano-Micro Lett. 14, 155 (2022). https://doi.org/10.1007/s40820-022-00898-2
S. Shen, J. Yi, R. Cheng, L. Ma, F. Sheng et al., Electromagnetic shielding triboelectric yarns for human–machine interacting. Adv. Electron. Mater. 8(2), 2101130 (2022). https://doi.org/10.1002/aelm.202101130
S. Shen, J. Fu, J. Yi, L. Ma, F. Sheng et al., High-efficiency wastewater purification system based on coupled photoelectric–catalytic action provided by triboelectric nanogenerator. Nano-Micro Lett. 13, 194 (2021). https://doi.org/10.1007/s40820-021-00695-3
Z.H. Guo, Y.C. Jiao, H.L. Wang, C. Zhang, F. Liang et al., Self-powered electrowetting valve for instantaneous and simultaneous actuation of paper-based microfluidic assays. Adv. Funct. Mater. 29(15), 1808974 (2019). https://doi.org/10.1002/adfm.201808974
V. Slabov, S. Kopyl, M.P.S. Santos, A.L. Kholkin, Natural and eco-friendly materials for triboelectric energy harvesting. Nano-Micro Lett. 12, 42 (2020). https://doi.org/10.1007/s40820-020-0373-y
Q.J. Sun, Y. Lei, X.H. Zhao, J. Han, V. Roy, Scalable fabrication of hierarchically structured graphite/polydimethylsiloxane composite films for large-area triboelectric nanogenerators and self-powered tactile sensing. Nano Energy 80, 105521 (2021). https://doi.org/10.1016/j.nanoen.2020.105521
Y.W. Cai, X.N. Zhang, G.G. Wang, G.Z. Li, Y. Yang, A flexible ultra-sensitive triboelectric tactile sensor of wrinkled pdms/mxene composite films for e-skin. Nano Energy 81, 105663 (2021). https://doi.org/10.1016/j.nanoen.2020.105663
K. Parida, G. Thangavel, G. Cai, X. Zhou, S. Park et al., Extremely stretchable and self-healing conductor based on thermoplastic elastomer for all-three-dimensional printed triboelectric nanogenerator. Nat. Commun. 10, 2158 (2019). https://doi.org/10.1038/s-41467-019-10061-y
Y. Yang, S.Z. Yu, H. Zhang, L. Ying, S. Lee et al., A single-electrode based triboelectric nanogenerator as self-powered tracking system. Adv. Mater. 25(45), 6594–6601 (2013). https://doi.org/10.1002/adma.201302453
Q. Zhang, T. Jin, G. Cai, L. Xu, T. He et al., Wearable triboelectric sensors enabled gait analysis and waist motion capture for iot-based smart healthcare applications. Adv. Sci. 9(4), 2103694 (2021). https://doi.org/10.1002/advs.202103694
M. Zhu, Z. Sun, T. Chen, C. Lee, Low cost exoskeleton manipulator using bidirectional triboelectric sensors enhanced multiple degree of freedom sensory system. Nat. Commun. 12, 2692 (2021). https://doi.org/10.1038/s41467-021-23020-3
C. Li, D. Liu, C. Xu, Z. Wang, Z.L. Wang, Sensing of joint and spinal bending or stretching via a retractable and wearable badge reel. Nat. Commun. 12, 2950 (2021). https://doi.org/10.1038/s41467-021-23207-8
M. Zhang, J. Li, L. Kang, N. Zhang, C. Huang et al., Machine learning-guided design and development of multifunctional flexible Ag/poly (amic acid) composites using the differential evolution algorithm. Nanoscale 12(6), 3988–3996 (2020). https://doi.org/10.1039/C9NR09146G
L. Ji, K. Zhao, X. Zhao, F. Lu, T. Li, Triboelectric nanogenerator based smart electronics via machine learning. Adv. Mater. Technol. 5(2), 1900921 (2020). https://doi.org/10.1002/admt.201900921
R. Cao, X. Pu, X. Du, W. Yang, J. Wang et al., Screen-printed washable electronic textiles as self-powered touch/gesture tribo-sensors for intelligent human-machine interaction. ACS Nano 12(6), 5190–5196 (2018). https://doi.org/10.1021/acsnano.8b0247
Y. Tong, Z. Feng, J. Kim, J.L. Robertson, B.N. Johnson, 3D printed stretchable triboelectric nanogenerator fibers and devices. Nano Energy 75, 104973 (2020). https://doi.org/10.1016/j.nanoen.2020.104973
W. Zhang, L. Deng, L. Yang, P. Yang, D. Diao et al., Multilanguage-handwriting self-powered recognition based on triboelectric nanogenerator enabled machine learning. Nano Energy 77, 105174 (2020). https://doi.org/10.1016/j.nanoen.2020.105174
Q. Lian, X.F. Zheng, T.F. Hu, Preparation and adsorption properties of magnetic CoFe2O4–chitosan composite microspheres. Russ. J. Phys. Chem. 89(11), 2132–2136 (2015). https://doi.org/10.1134/s0036024415110096
N. Stefan, F.M. Miroiu, G. Socol, Degradable silk fibroin—poly (sebacic acid) diacetoxy terminated, (SF-PSADT) polymeric composite coatings for biodegradable medical applications deposited by laser technology—sciencedirect. Prog. Org. Coat. 134, 11–21 (2019). https://doi.org/10.1016/j.porgcoat.2019.04.075
A. As, C. Pskb, D. Dvnv, A. Sj, A. Sk et al., A review on catalytic-enzyme degradation of toxic environmental pollutants: microbial enzymes. J. Hazard. Mater. 419, 126451 (2021). https://doi.org/10.1016/j.jhazmat.2021.126451
Q. Cai, G. Shi, J. Bei, S. Wang, Enzymatic degradation behavior and mechanism of poly(lactide-co-glycolide) foams by trypsin. Biomaterials 24(4), 629–638 (2003). https://doi.org/10.1016/S0142-9612(02)00377-0
This study was financially supported by National Natural Science Foundation of China (NO. 31470509); China Postdoctoral Science Foundation (No. 2019T120390), China Scholarship Council (NO. 202006790091), the Opening Project of China National Textile and Apparel Council Key Laboratory of Natural Dyes, Soochow University (No. SDHY2122). The authors would also like to thank Shiyanjia laboratory (www.shiyanjia.com) for their professional tests support.
Open access funding provided by Shanghai Jiao Tong University.
Below is the link to the electronic supplementary material.
About this article
Cite this article
Shen, S., Yi, J., Sun, Z. et al. Human Machine Interface with Wearable Electronics Using Biodegradable Triboelectric Films for Calligraphy Practice and Correction. Nano-Micro Lett. 14, 225 (2022). https://doi.org/10.1007/s40820-022-00965-8
- Letter handwriting
- Triboelectric nanogenerator
- Human–machine interface
- Calligraphy practice