Skip to main content

Towards creating a reference based self-learning model for improving human machine interaction


Machine learning is a field of computer science where a computer is provided a capability to learn rather being programmed every time. Machine learning is considered to be the next generation human machine interaction technology, where a machine will independently learn from users previous data and provide solution and better suggestions to the user. In this work a reference based self-learning model is proposed, which can learn classification on new data from its previous trained models. Here a classification problem is considered to have a series of events related to every class. For classification, all the events related feature vector of a class is fed to the model. Now instead of learning the classification for each event based feature separately, reference based learning is adopted, where the model is trained for only one event based feature and then it learns the classification for other event features by itself. A simulation is performed on three feature vectors as a process of events and the results are presented. The model achieves an accuracy of around 90% using reference based learning. The achieved result of reference based learning is encouraging as it is very close to separately trained model with increase in number of samples per class. This method of live training and classification reduces time required for database preparation and model training separately for each event based features.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8


  1. Tadeusiewicz, R (2010) Speech in human system interaction, 3rd international conference on human system interaction, IEEE

  2. Aron J (2011) How innovative is Apple’s new voice assistant, Siri? New Sci 212(2836):24

    Article  Google Scholar 

  3. Mistry P, Maes, P (2009) SixthSense: a wearable gestural interface. In: Proceedings of ACM SIGGRAPH ASIA 2009 Sketches, Yokohama, Japan, 16–19 Dec 2009. ACM New York, NY, USA. doi:10.1145/1667146.1667160

  4. Zhang Z (2012) Microsoft kinect sensor and its effect. IEEE Multimed 19(2):4–10

    Article  Google Scholar 

  5. Tiwari V, Keskar A (2015) Implementation of low cost iot based smart home using open source platform 18th international symposium on wireless personal multimedia communications, 13–16 Dec

  6. Yu R et al (2013) Toward cloud-based vehicular networks with efficient resource management. IEEE Netw 27(5):48–55

    Article  Google Scholar 

  7. Chen M et al (2015) AIWAC: affective interaction through wearable computing and cloud technology. IEEE Wirel Commun 22(1):20–27

    Article  Google Scholar 

  8. Murphy KP (2012) Machine learning: a probabilistic perspective. MIT Press, Cambridge

    MATH  Google Scholar 

  9. Ding J, Shi J-Y (2016) Kinect microphone array-based speech and speaker recognition for the exhibition control of humanoid robots. Comput Electr Eng. doi:10.1016/j.compeleceng.2015.12.010

    Google Scholar 

  10. Gupta HP et al (2016) A continuous hand gestures recognition technique for human-machine interaction using accelerometer and gyroscope sensors. IEEE Sens J 16(16):6425–6432

    Article  Google Scholar 

  11. Plouffe G, Cretu A-M (2016) Static and dynamic hand gesture recognition in depth data using dynamic time warping. IEEE Trans Instrum Meas 65(2):305–316

    Article  Google Scholar 

  12. Klboz N, Gdkbay U (2015) A hand gesture recognition technique for humancomputer interaction. J Vis Commun Image Represent 28:97–104

    Article  Google Scholar 

  13. Park SU et al (2016) A depth camera-based human activity recognition via deep learning recurrent neural network for health and social care services. Procedia Comput Sci 100:78–84

    Article  Google Scholar 

  14. Perez-Gaspar L-A, Santiago-Omar C-M, Trujillo-Romero F (2016) Multimodal emotion recognition with evolutionary computation for human-robot interaction. Exp Syst Appl 66:42–61

    Article  Google Scholar 

  15. Li H, Suen CY (2016) Robust face recognition based on dynamic rank representation. Pattern Recognit 60:13–24

    Article  Google Scholar 

  16. Ouyang, S, et al (2014) A survey on heterogeneous face recognition: Sketch, infra-red, 3D and low-resolution. arXiv preprint arXiv:1409.5114

  17. Sahidullah M, Saha G (2012) Design, analysis and experimental evaluation of block based transformation in MFCC computation for speaker recognition. Speech Commun 54(4):543–565

    Article  Google Scholar 

  18. Faundez-Zanuy M, Pascual-Gaspar JM (2011) Efficient on-line signature recognition based on multi-section vector quantization. Pattern Anal Appl 14(1):37–45

    MathSciNet  Article  Google Scholar 

Download references


The work was financially supported by Department of Electronics and Information Technology under Ministry of communications and IT, Government of India and Center of Excellence on Combedded systems, Visvesvaraya National Institute of Technology, Nagpur, India.

Author information

Authors and Affiliations


Corresponding author

Correspondence to Varun Tiwari.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Tiwari, V., Keskar, A. & Shivaprakash, N.C. Towards creating a reference based self-learning model for improving human machine interaction. CSIT 5, 201–208 (2017).

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI:


  • Machine learning
  • Human machine interaction
  • Classification
  • Reference based learning