Skip to main content
Book cover

International Conference on Social Robotics

ICSR 2020: Social Robotics pp 220–231Cite as

What Am I Allowed to Do Here?: Online Learning of Context-Specific Norms by Pepper

Part of the Lecture Notes in Computer Science book series (LNAI,volume 12483)

Abstract

Social norms support coordination and cooperation in society. With social robots becoming increasingly involved in our society, they also need to follow the social norms of the society. This paper presents a computational framework for learning contexts and the social norms present in a context in an online manner on a robot. The paper utilizes a recent state-of-the-art approach for incremental learning and adapts it for online learning of scenes (contexts). The paper further utilizes Dempster-Schafer theory to model context-specific norms. After learning the scenes (contexts), we use active learning to learn related norms. We test our approach on the Pepper robot by taking it through different scene locations. Our results show that Pepper can learn different scenes and related norms simply by communicating with a human partner in an online manner.

Keywords

  • Online learning
  • Indoor scene classification
  • Norm learning
  • Active learning
  • Human-robot interaction

This is a preview of subscription content, access via your institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-030-62056-1_19
  • Chapter length: 12 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   109.00
Price excludes VAT (USA)
  • ISBN: 978-3-030-62056-1
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   139.99
Price excludes VAT (USA)
Learn about institutional subscriptions
Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.

References

  1. Ayub, A., Fendley, C., Wagner, A.R.: Boundaryless online learning of indoor scenes by a robot, in Review, CoRL (2020)

    Google Scholar 

  2. Ayub, A., Wagner, A.R.: Centroid based concept learning for RGB-D indoor scene classification. arXiv:1911.00155 (2020)

  3. Ayub, A., Wagner, A.R.: Cognitively-inspired model for incremental category learning using only a few examples in Review, Pattern Recognition (2020)

    Google Scholar 

  4. Ayub, A., Wagner, A.R.: Cognitively-inspired model for incremental learning using a few examples. In: The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, June 2020

    Google Scholar 

  5. Ayub, A., Wagner, A.R.: Online learning of objects through curiosity-driven active learning. In: IEEE RoMan Workshop on Lifelong Learning for Long-term Human-Robot Interaction (2020)

    Google Scholar 

  6. Ayub, A., Wagner, A.R.: Storing encoded episodes as concepts for continual learning. arXiv:2007.06637 (2020)

  7. Ayub, A., Wagner, A.R.: Tell me what this is: few-shot incremental object learning by a robot. arXiv:2008.00819 (2020)

  8. Kawewong, A., Pimup, R., Hasegawa, O.: Incremental learning framework for indoor scene recognition. In: AAAI (2013)

    Google Scholar 

  9. Krishnamoorthy, V., Luo, W., Lewis, M., Sycara, K.: A computational framework for integrating task planning and norm aware reasoning for social robots. In: 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), pp. 282–287 (2018)

    Google Scholar 

  10. Paul, S., Bappy, J.H., Roy-Chowdhury, A.K.: Non-uniform subset selection for active learning in structured data. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 2017

    Google Scholar 

  11. Quattoni, A., Torralba, A.: Recognizing indoor scenes. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 413–420, June 2009

    Google Scholar 

  12. Rebuffi, S.A., Kolesnikov, A., Sperl, G., Lampert, C.H.: iCaRL: incremental classifier and representation learning. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 2017

    Google Scholar 

  13. Sarathy, V., Scheutz, M., Malle, B.F.: Learning behavioral norms in uncertain and changing contexts. In: 2017 8th IEEE International Conference on Cognitive Infocommunications (CogInfoCom), pp. 000301–000306 (2017)

    Google Scholar 

  14. Sarathy, V., Scheutz, M., Kenett, Y., Allaham, M., Austerweil, J., Malle, B.: Mental representations and computational modeling of context-specific human norm systems. In: 39th Annual Meeting of the Cognitive Science Society (CogSci) (2017)

    Google Scholar 

  15. Shafer, G.: A Mathematical Theory of Evidence. Princeton University Press, Princeton (1976)

    MATH  Google Scholar 

  16. Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556, September 2014

  17. Tan, Z.X., Brawer, J., Scassellati, B.: That’s mine! Learning ownership relations and norms for robots. In: AAAI (2019)

    Google Scholar 

  18. Ullmann-Margalit, E.: The Emergence of Norms. Clarendon Press, Oxford (1976)

    Google Scholar 

  19. Wang, Z., Wang, L., Wang, Y., Zhang, B., Qiao, Y.: Weakly supervised patchnets: describing and aggregating local patches for scene recognition. IEEE Trans. Image Process. 26(4), 2028–2041 (2017)

    MathSciNet  CrossRef  Google Scholar 

  20. Wu, Y., et al.: Large scale incremental learning. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2019

    Google Scholar 

  21. Zhou, B., Lapedriza, A., Khosla, A., Oliva, A., Torralba, A.: Places: a 10 million image database for scene recognition. IEEE Trans. Pattern Anal. Mach. Intell. 40(6), 1452–1464 (2017)

    CrossRef  Google Scholar 

Download references

Acknowledgements

This work was partially supported by the Air Force Office of Sponsored Research contract FA9550-17-1-0017 and National Science Foundation grant CNS-1830390. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.

Author information

Authors and Affiliations

  1. The Pennsylvania State University, State College, PA, 16802, USA

    Ali Ayub & Alan R. Wagner

Authors
  1. Ali Ayub
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Alan R. Wagner
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ali Ayub .

Editor information

Editors and Affiliations

  1. Pennsylvania State University, University Park, PA, USA

    Alan R. Wagner

  2. University of Nevada Reno, Reno, NV, USA

    Ph.D. David Feil-Seifer

  3. University of Denver, Denver, CO, USA

    Kerstin S. Haring

  4. University of Naples Federico II, Naples, Italy

    Prof. Silvia Rossi

  5. Colorado School of Mines, Golden, CO, USA

    Thomas Williams

  6. Wichita State University, Wichita, KS, USA

    Hongsheng He

  7. National University of Singapore, Singapore, Singapore

    Prof. Dr. Shuzhi Sam Ge

Rights and permissions

Reprints and Permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Verify currency and authenticity via CrossMark

Cite this paper

Ayub, A., Wagner, A.R. (2020). What Am I Allowed to Do Here?: Online Learning of Context-Specific Norms by Pepper. In: , et al. Social Robotics. ICSR 2020. Lecture Notes in Computer Science(), vol 12483. Springer, Cham. https://doi.org/10.1007/978-3-030-62056-1_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-62056-1_19

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-62055-4

  • Online ISBN: 978-3-030-62056-1

  • eBook Packages: Computer ScienceComputer Science (R0)