Skip to main content

From Raw Signals to Human Skills Level in Physical Human-Robot Collaboration for Advanced-Manufacturing Applications

  • Conference paper
  • First Online:
Neural Information Processing (ICONIP 2019)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 11954))

Included in the following conference series:

Abstract

Providing individualized assistance to a human when she/he is physically interacting with a robot is a challenge that necessarily entails user profiling. The identification of the human profile in advanced-manufacturing is only partially addressed in the literature, through either intrusive, or not fully transparent approaches. As on-the-job training has a negative impact on operators’ working conditions, we specifically focus on their skills, and show that they can be observed in a non-intrusive way, through a data-driven approach to extract knowledge from the internal data of the robot. To this end, we have defined useful characteristics derived from raw data, called in this paper Key Skill Indicators (KSI), and have devised a user’s skills model based on expert knowledge. Experiments from real cases show promising results, especially that our approach is able to distinguish more finely a skilled human from a novice, and that the latter would benefit from assistance regarding specific skills.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    In the Interactive Robotics Laboratory of CEA, LIST premises.

  2. 2.

    https://www.isybot.com/en/events/syb3/.

  3. 3.

    Video available: https://youtu.be/sDP0sdgW9J0.

  4. 4.

    The authors thank Clément Dugué for setting up the experiment.

References

  1. Chmarra, M.K., Klein, S., de Winter, J.C., Jansen, F.W., Dankelman, J.: Objective classification of residents based on their psychomotor laparoscopic skills. Surg. Endosc. 24(5), 1031–1039 (2010)

    Article  Google Scholar 

  2. Cotin, S., Stylopoulos, N., Ottensmeyer, M., Neumann, P., Rattner, D., Dawson, S.: Metrics for laparoscopic skills trainers: the weakest link!. In: Dohi, T., Kikinis, R. (eds.) MICCAI 2002. LNCS, vol. 2488, pp. 35–43. Springer, Heidelberg (2002). https://doi.org/10.1007/3-540-45786-0_5

    Chapter  Google Scholar 

  3. Enayati, N., Ferrigno, G., De Momi, E.: Skill-based human-robot cooperation in tele-operated path tracking. Auton. Robot. 42, 1–13 (2018)

    Article  Google Scholar 

  4. Erden, M.S., Jonkman, J.A.: Physical human-robot interaction by observing actuator currents. Int. J. Robot. Autom. 27(3), 233 (2012)

    Google Scholar 

  5. Erden, M.S., Billard, A.: End-point impedance measurements at human hand during interactive manual welding with robot. In: 2014 IEEE International Conference on Robotics and Automation (ICRA), pp. 126–133. IEEE (2014)

    Google Scholar 

  6. Gribovskaya, E., Kheddar, A., Billard, A.: Motion learning and adaptive impedance for robot control during physical interaction with humans. In: 2011 IEEE International Conference on Robotics and Automation (ICRA), pp. 4326–4332. IEEE (2011)

    Google Scholar 

  7. Hogan, N., Flash, T.: Moving gracefully: quantitative theories of motor coordination. Trends Neurosci. 10(4), 170–174 (1987)

    Article  Google Scholar 

  8. Kim, K.S., Sentis, L.: Human body part multicontact recognition and detection methodology. In: 2017 IEEE International Conference on Robotics and Automation (ICRA), pp. 1908–1915. IEEE (2017)

    Google Scholar 

  9. Kim, W., Lee, J., Peternel, L., Tsagarakis, N., Ajoudani, A.: Anticipatory robot assistance for the prevention of human static joint overloading in human-robot collaboration. IEEE Robot. Autom. Lett. 3(1), 68–75 (2018)

    Article  Google Scholar 

  10. Martinez, C.M., Heucke, M., Wang, F.Y., Gao, B., Cao, D.: Driving style recognition for intelligent vehicle control and advanced driver assistance: a survey. IEEE Trans. Intell. Transp. Syst. 19(3), 666–676 (2018)

    Article  Google Scholar 

  11. Milliken, L., Hollinger, G.A.: Modeling user expertise for choosing levels of shared autonomy. In: Robotics and Automation (ICRA), pp. 2285–2291. IEEE (2017)

    Google Scholar 

  12. Nikolaidis, S., Ramakrishnan, R., Gu, K., Shah, J.: Efficient model learning from joint-action demonstrations for human-robot collaborative tasks. In: Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction, pp. 189–196. ACM (2015)

    Google Scholar 

  13. Normadhi, N.B.A., Shuib, L., Nasir, H.N.M., Bimba, A., Idris, N., Balakrishnan, V.: Identification of personal traits in adaptive learning environment: systematic literature review. Comput. Educ. 130, 168–190 (2019)

    Article  Google Scholar 

  14. Peternel, L., Tsagarakis, N., Caldwell, D., Ajoudani, A.: Adaptation of robot physical behaviour to human fatigue in human-robot co-manipulation. In: 2016 IEEE-RAS 16th International Conference on Humanoid Robots, pp. 489–494 (2016)

    Google Scholar 

  15. Mahesa, R.R., Vinodkumar, M., Neethu, V.: Modeling the influence of individual and employment factors on musculoskeletal disorders in fabrication industry. Hum. Factors Ergon. Manuf. Serv. Ind. 27(2), 116–125 (2017)

    Article  Google Scholar 

  16. Rossi, S., Ferland, F., Tapus, A.: User profiling and behavioral adaptation for HRI: a survey. Pattern Recognit. Lett. 99, 3–12 (2017)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Katleen Blanchet .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Blanchet, K., Kchir, S., Bouzeghoub, A., Lebec, O., Hède, P. (2019). From Raw Signals to Human Skills Level in Physical Human-Robot Collaboration for Advanced-Manufacturing Applications. In: Gedeon, T., Wong, K., Lee, M. (eds) Neural Information Processing. ICONIP 2019. Lecture Notes in Computer Science(), vol 11954. Springer, Cham. https://doi.org/10.1007/978-3-030-36711-4_47

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-36711-4_47

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-36710-7

  • Online ISBN: 978-3-030-36711-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics