Skip to main content
Log in

Improved Four-channel PBTDPA Control Strategy Using Force Feedback Bilateral Teleoperation System

  • Regular Papers
  • Robot and Applications
  • Published:
International Journal of Control, Automation and Systems Aims and scope Submit manuscript

Abstract

Bilateral teleoperation robots with force feedback enable humans to accomplish these tasks without exposing them to these hazardous environments. Its stability and transparency describe the performance of bilateral teleoperation systems with force feedback. Bilateral teleoperation with force feedback enables humans to combine tactics with optesthesia. However, the force feedback may lead to bilateral teleoperation instability if the communication channels’ time delay exists. The instability of bilateral teleoperation with force feedback, which is brought in by the time delay, has become one of the complicated problems researchers need to solve. Transparency is one of the leading design objectives of the teleoperation system. There are two evaluation criteria for transparency: the accuracy of the position followed by the master mechanical arm and the accuracy of the feedback received by the slave arm from the master arm. The main content of this paper is as follows: 1) This paper researches and summarizes the control structures and control algorithms of several well-developed force-feedback bilateral teleoperation systems and decides to improve the PBTDPA algorithm, which aligns with practical application requirements. 2) The four-channel structure makes the transparency of force-feedback bilateral teleoperation systems perfect in theory. This paper uses the four-channel structure combined with the PBTDPA algorithm to improve the transparency of the approach. 3) Moreover, the delay predictor is used to improve the four-channel power-based time domain passivity approach (PBTDPA) control strategy. The delay differential predictor is added to the communication channel. The delay change rate differential predictor can estimate the communication channel’s delay change rate instead of the maximum delay change rate to improve transparency. The simulation experiment of the improved control strategy was carried out. The results show the excellent performance of our design.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. W.-K. Yoon, T. Goshozono, H. Kawabe, M. Kinami, Y. Tsumaki, M. Uchiyama, M. Oda, and T. Doi, “Model-based space robot teleoperation of ETS-VII manipulator,” IEEE Transactions on Robotics and Automation, vol. 20, no. 3, pp. 602–612, 2004.

    Article  Google Scholar 

  2. J. J. Craig, Introduction to Robotics, 2005.

  3. Y. Ding, X. Tian, L. Yin, X. Chen, S. Liu, B. Yang, and W. Zheng, “Multi-scale relation network for few-shot learning based on meta-learning,” Proc. of International Conference on Computer Vision Systems, Springer, pp. 343–352, 2019.

  4. S. Liu, W. Zheng, and B. Yang, “Adaptive terminal sliding mode control for time-delay teleoperation with uncertainties,” Proc. of 2018 IEEE International Conference on Mechatronics and Automation (ICMA), IEEE, pp. 1883–1888, 2018.

  5. B. Yang, T. Cao, W. Zheng, and S. Liu, “Motion Tracking for Beating Heart Based on Sparse Statistic Pose Modeling,” Proc. of 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), IEEE, pp. 1106–1110, 2018.

  6. Y. Tang, S. Liu, Y. Deng, Y. Zhang, L. Yin, and W. Zheng, “An improved method for soft tissue modeling,” Biomedical Signal Processing and Control, vol. 65, p. 102367, 2021.

    Article  Google Scholar 

  7. Y. Tang, S. Liu, Y. Deng, Y. Zhang, L. Yin, and W. Zheng, “Construction of force haptic reappearance system based on Geomagic Touch haptic device,” Computer methods and programs in biomedicine, vol. 190, p. 105344, 2020.

    Article  Google Scholar 

  8. X. Li, W. Zheng, D. Wang, L. Yin, and Y. Wang, “Predicting seismicity trend in southwest of China based on wavelet analysis,” International Journal of Wavelets, Multiresolution and Information Processing, vol. 13, no. 02, p. 1550011, 2015.

    Article  Google Scholar 

  9. W. Zheng, X. Li, L. Yin, Z. Yin, B. Yang, S. Liu, L. Song, Y. Zhou, and Y. Li, “Wavelet analysis of the temporal-spatial distribution in the Eurasia seismic belt,” International Journal of Wavelets, Multiresolution and Information Processing, vol. 15, no. 3, p. 1750018, 2017.

    Article  MathSciNet  Google Scholar 

  10. X. Chen, L. Yin, Y. Fan, L. Song, T. Ji, Y. Liu, J. Tian, and W. Zheng, “Temporal evolution characteristics of PM2.5 concentration based on continuous wavelet transform,” Science of The Total Environment, vol. 699, p. 134244, 2020.

    Article  Google Scholar 

  11. B. Yang, C. Liu, and W. Zheng, “PCA-based 3D pose modeling for beating heart tracking,” Proc. of 2017 13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD), IEEE, pp. 586–590, 2017.

  12. S. Ganjefar, M. Afshar, M. H. Sarajchi, and Z. Shao, “Controller design based on wavelet neural adaptive proportional plus conventional integral-derivative for bilateral teleoperation systems with time-varying parameters,” International Journal of Control, Automation and Systems, vol. 16, no. 5, pp. 2405–2420, 2018.

    Article  Google Scholar 

  13. S. Ganjefar, M. H. Sarajchi, S. M. Hoseini, and Z. Shao, “Lambert W Function Controller Design for Teleoperation Systems,” International Journal of Precision Engineering and Manufacturing, vol. 20, no. 1, pp. 101–110, 2019.

    Article  Google Scholar 

  14. W. Zheng, X. Liu, and L. Yin, “Sentence representation method based on multi-layer semantic network,” Applied Sciences, vol. 11, no. 3, p. 1316, 2021.

    Article  Google Scholar 

  15. L. Yin, X. Li, W. Zheng, Z. Yin, L. Song, L. Ge, and Q. Zeng, “Fractal dimension analysis for seismicity spatial and temporal distribution in the circum-Pacific seismic belt,” Journal of Earth System Science, vol. 128, no. 1, p. 22, 2019.

    Article  Google Scholar 

  16. Y. Tang, S. Liu, and X. Li, “Earthquakes spatio-temporal distribution and fractal analysis in the Eurasian seismic belt,” Rendiconti Lincei. Scienze Fisiche e Naturali, vol. 31, no. 1, pp. 203–209, 2020.

    Article  Google Scholar 

  17. S. Liu, X. Zhang, W. Zheng, and B. Yang, “Adaptive neural network control for time-delay teleoperation with uncertainties,” Proc. of 2017 11th Asian Control Conference (ASCC), IEEE, pp. 1270–1275, 2017.

  18. M. hadi Sarajchi, S. Ganjefar, S. M. Hoseini, and Z. Shao, “Adaptive controller design based on predicted time-delay for teleoperation systems using Lambert W function,” International Journal of Control, Automation, and Systems, vol. 17, no. 6, pp. 1445–1453, 2019.

    Article  Google Scholar 

  19. X. Li, W. Zheng, L. Yin, Z. Yin, L. Song, and X. Tian, “Influence of social-economic activities on air pollutants in Beijing, China,” Open Geosciences, vol. 9, no. 1, pp. 314–321, 2017.

    Article  Google Scholar 

  20. D. Wang and M. Vidyasagar, “Passive control of a stiff flexible link: Communication,” The International Journal of Robotics Research, vol. 11, no. 6, pp. 572–578, 1992.

    Article  Google Scholar 

  21. T. B. Sheridan, “Space teleoperation through time delay: Review and prognosis,” IEEE Transactions on Robotics and Automation, vol. 9, no. 5, pp. 592–606, 1993.

    Article  Google Scholar 

  22. W. Zheng, X. Li, L. Yin, and Y. Wang, “The retrieved urban LST in Beijing based on TM, HJ-1B and MODIS,” Arabian Journal for Science and Engineering, vol. 41, no. 6, pp. 2325–2332, 2016.

    Article  Google Scholar 

  23. W. Zheng, X. Li, J. Xie, L. Yin, and Y. Wang, “Impact of human activities on haze in Beijing based on grey relational analysis,” Rendiconti Lincei, vol. 26, no. 2, pp. 187–192, 2015.

    Article  Google Scholar 

  24. S. Liu, Y. Zhang, W. Zheng, and B. Yang, “Real-time simulation of virtual palpation system,” Proc. of IOP Conference Series: Earth and Environmental Science, vol. 234, no. 1, IOP Publishing, p. 012070, 2019.

    Google Scholar 

  25. S. Ganjefar, M. H. Sarajchi, and M. H. Beheshti, “Adaptive sliding mode controller design for nonlinear teleoperation systems using singular perturbation method,” Nonlinear Dynamics, vol. 81, no. 3, pp. 1435–1452, 2015.

    Article  MathSciNet  Google Scholar 

  26. W. Zheng, X. Li, L. Yin, and Y. Wang, “Spatiotemporal heterogeneity of urban air pollution in China based on spatial analysis,” Rendiconti Lincei, vol. 27, no. 2, pp. 351–356, 2016.

    Article  Google Scholar 

  27. S. Ganjefar, M. H. Sarajchi, and S. Mahmoud Hoseini, “Teleoperation systems design using singular perturbation method and sliding mode controllers,” Journal of Dynamic Systems, Measurement, and Control, vol. 136, no. 5, p. 051005, 2014.

    Article  Google Scholar 

  28. A. Liegeois, “Automatic supervisory control of the configuration and behavior of multibody mechanisms,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 7, no. 12, pp. 868–871, 1977.

    Article  Google Scholar 

  29. X. Liu and M. Tavakoli, “Adaptive inverse dynamics four-channel control of uncertain nonlinear teleoperation systems,” Advanced Robotics, vol. 25, no. 13–14, pp. 1729–1750, 2011.

    Article  Google Scholar 

  30. C. Xu, B. Yang, F. Guo, W. Zheng, and P. Poignet, “Sparse-view CBCT reconstruction via weighted Schatten p-norm minimization,” Optics Express, vol. 28, no. 24, pp. 35469–35482, 2020.

    Article  Google Scholar 

  31. M. Reed and B. Simon, Methods of Modern Mathematical Physics, 1978.

  32. X. Ni, L. Yin, X. Chen, S. Liu, B. Yang, and W. Zheng, “Semantic representation for visual reasoning,” Proc. of MATEC Web of Conferences, vol. 277, EDP Sciences, p. 02006, 2019.

  33. V. G. Cerf and R. E. Icahn, “A protocol for packet network intercommunication,” ACM SIGCOMM Computer Communication Review, vol. 35, no. 2, pp. 71–82, 2005.

    Article  Google Scholar 

  34. J. Lim, J. Ko, and J. Lee, “Internet-based teleoperation of a mobile robot with force-reflection,” Proc. of 2003 IEEE Conference on Control Applications (CCA 2003), vol. 1, IEEE, pp. 680–685, 2003.

  35. O. J. Rösch, K. Schilling, and H. Roth, “Haptic interfaces for the remote control of mobile robots,” Control Engineering Practice, vol. 10, no. 11, pp. 1309–1313, 2002.

    Article  Google Scholar 

  36. N. Chopra, M. W. Spong, S. Hirche, and M. Buss, “Bilateral teleoperation over the internet: The time varying delay,” Proc. of the American Control Conference (ACC), 2003.

  37. I. G. Polushin, P. X. Liu, C.-H. Lung, and G. D. On, “Position-error based schemes for bilateral teleoperation with time delay: Theory and experiments,” Journal of Dynamic Systems, Measurement, and Control, vol. 132, no. 3, p. 031008, 2010.

    Article  Google Scholar 

  38. G. S. Gupta, S. C. Mukhopadhyay, C. H. Messom, and S. N. Demidenko, “Master-slave control of a teleoperated anthropomorphic robotic arm with gripping force sensing,” IEEE Transactions on Instrumentation and Measurement, vol. 55, no. 6, pp. 2136–2145, 2006.

    Article  Google Scholar 

  39. G. de Gersem, Kinaesthetic Feedback and Enhanced Sensitivity in Robotic Endoscopic Telesurgery, Catholic University of Leuven, p. 7, 2005.

  40. A. Haddadi, Stability, Performance, and Implementation Issues in Bilateral Teleoperation Control and Haptic Simulation Systems, Queen’s University (Canada), 2012.

  41. A. Bemporad, “Predictive control of teleoperated constrained systems with unbounded communication delays,” Proc. of the 37th IEEE Conference on Decision and Control (Cat. No. 98CH36171), vol. 2, IEEE, pp. 2133–2138, 1998.

    Article  Google Scholar 

  42. Y. Ye, Y.-J. Pan, and Y. Gupta, “A power based time domain passivity control for haptic interfaces,” Proc. of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference, IEEE, pp. 7521–7526, 2009.

  43. D. Lee and D. Xu, “Feedback r-passivity of lagrangian systems for mobile robot teleoperation,” Proc. of 2011 IEEE International Conference on Robotics and Automation, IEEE, pp. 2118–2123, 2011.

  44. P. F. Hokayem and M. W. Spong, “Bilateral teleoperation: An historical survey,” Automatica, vol. 42, no. 12, pp. 2035–2057, 2006.

    Article  MathSciNet  Google Scholar 

  45. K. Kosuge and H. Murayama, “Bilateral feedback control of telemanipulator via computer network in discrete time domain,” Proc. of International Conference on Robotics and Automation, vol. 3: IEEE, pp. 2219–2224, 1997.

    Chapter  Google Scholar 

  46. Y. Ye, Y.-J. Pan, and T. Hilliard, “Bilateral teleoperation with time-varying delay: A communication channel passification approach,” IEEE/ASME Transactions on Mechatronics, vol. 18, no. 4, pp. 1431–1434, 2013.

    Article  Google Scholar 

  47. D. Ahn, J.-S. Park, C.-S. Kim, J. Kim, Y. Qian, and T. Itoh, “A design of the low-pass filter using the novel microstrip defected ground structure,” IEEE Transactions on Microwave Theory and Techniques, vol. 49, no. 1, pp. 86–93, 2001.

    Article  Google Scholar 

  48. V. Chawda and M. K. O’Malley, “Position synchronization in bilateral teleoperation under time-varying communication delays,” IEEE/ASME Transactions on Mechatronics, vol. 20, no. 1, pp. 245–253, 2014.

    Article  Google Scholar 

  49. J. Artigas, J.-H. Ryu, and C. Preusche, “Time domain passivity control for position-position teleoperation architectures,” Presence: Teleoperators and Virtual Environments, vol. 19, no. 5, pp. 482–497, 2010.

    Article  Google Scholar 

Download references

Funding

This work was jointly supported by the Sichuan Science and Technology Program (2021YFQ0003, 2019YJ0189) and the Fundamental Research Funds for the Central Universities (ZYGX2019J059).

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Wenfeng Zheng or Lirong Yin.

Additional information

Conflicts of Interest

The authors declare no conflict of interest.

Xin Gong is an undergraduate student at the Xi’an Fanyi University who has participated as a research assistant in the collaborative research with the Research Center of Machine Perception and Intelligent Systems of the University of Electronic Science and Technology of China.

Lixiao Wang is a Professor and an Assistant to the President and Chief of the Science and Technology Division of Xi’an Fanyi University. She has a Ph.D. degree in economics from Northwest University and a Postdoctoral in Business Administration. She has published more than 30 papers.

Yuanyuan Mou is an undergraduate student at the Xi’an Fanyi university. She participates in the collaborative research between Xi’an Fanyi University and the University of Electronic Science and Technology of China as a research assistant at the Research Center of Machine Perception and Intelligent Systems.

Haili Wang is an undergraduate student at the Xi’an Fanyi university. She participates as a research assistant in the collaborative research between Xi’an Fanyi University and the Research Center of Machine Perception and Intelligent Systems of the University of Electronic Science and Technology of China.

Xiaoqian Wei obtained a bachelor’s degree and master’s degree in Automatic Control at the University of Electronic Science and Technology of China. Her research interest is in the area of analysis and modeling of time-delay systems and bilateral teleoperation systems.

Wenfeng Zheng is an associate professor at the School of Automation Engineering of the University of Electronic Science and Technology of China since 2008. He received his Ph.D. degree in earth exploration and information technology from the Chengdu University of Technology in 2008. The focused research interests involve environmental science, information technology, and artificial intelligent. He has published more than 100 papers, and authorized more than 30 Chinese national invention patents. He is a member of Association for Computing Machinery, IEEE, America Association Geographer, American Geophysical Union, and a membership of China Association of Inventions.

Lirong Yin is a Ph.D. student in the Department of Geography and Anthropology at Louisiana State University with a study interest in remote sensing, server weather and climate change, Coastal environment, natural hazard, and coupled human and natural dynamic system. Acquired the Master of Science in Geography from Louisiana State University and the Bachelor of Science in Geography Information Science from the University of Iowa, she has experienced the artificial intelligence studies and machine learning techniques, geo-data processing and information analysis skills. She is well experienced in programming and database design as a geo-analyst. She has published more than 30 papers.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gong, X., Wang, L., Mou, Y. et al. Improved Four-channel PBTDPA Control Strategy Using Force Feedback Bilateral Teleoperation System. Int. J. Control Autom. Syst. 20, 1002–1017 (2022). https://doi.org/10.1007/s12555-021-0096-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12555-021-0096-y

Keywords

Navigation