Skip to main content
SpringerLink
Log in

Human–machine computing

  • Regular Paper
  • Published:
CCF Transactions on Pervasive Computing and Interaction Aims and scope Submit manuscript

A Correction to this article was published on 23 February 2021

This article has been updated

Abstract

Nowadays, machines like computers and mobile devices are developing towards having human-like behaviors and thoughts. However, they are unable to completely replace humans because of the high levels of uncertainty and vulnerability. It is expedient to combine humans and machines to complement disadvantages of each other. The previous computing methods are lack of a general definition and framework for combining humans and machines in a dynamic environment. This paper proposes a new concept on cooperation between humans and machines that can give more meaningful inspiration for future development of the filed; we call the proposed computing paradigm human–machine computing (HMC). HMC aims to provide a general framework for machines and humans working on a task interactively in an evolving environment, such that machines achieve optimized performance under human guidance during the computing procedure. In this paper, we describe HMC from six perspectives: definition, framework, challenges, technologies, comparisons, and case studies.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Change history

Notes

  1. Note that users and humans are two different concepts in the proposed framework. The user is who proposes the task and uses HMC to attain the final results of the task. The human is an element of HMC and he/she executes parts of the task.

References

  • Adam, A., Rivlin, E., Shimshoni, I., et al.: Robust real-time unusual event detection using multiple fixed-location monitors. IEEE Trans. Pattern Anal. Mach. Intell. 30(3), 555–560 (2008)

    Article  Google Scholar 

  • Bouindour, S., Snoussi, H., Hittawe, M.M., et al.: An on-line and adaptive method for detecting abnormal events in videos using spatio-temporal ConvNet. Appl. Sci. 9(4), 757 (2019)

    Article  Google Scholar 

  • Candra, M.Z.C.: Hybrid Human–Machine Computing Systems. Doctoral dissertation, Technische Universitt Wien (2016)

  • Cheng, J., Bernstein, M.S.: Flock: hybrid crowd-machine learning classifiers. In: Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work and Social Computing, p. 600611 (2015)

  • Chong, Y.S., Tay, Y.H.: Abnormal event detection in videos using spatiotemporal autoencoder. In: International Symposium on Neural Networks, pp. 189–196 (2017)

  • Daugherty, P.R., Wilson, H.J.: Human + Machine: Reimagining Work in the Age of AI. Harvard Business Press, Brighton (2018)

    Google Scholar 

  • Fails, J.A., Olsen, Jr D.R.: Interactive machine learning. In: Proceedings of the 8th International Conference on Intelligent User Interfaces, pp. 39–45 (2003)

  • Filippov, A.I., Iuzbashev, A.V., Kurnev, A.S.: User authentication via touch pattern recognition based on isolation forest. In: 2018 IEEE Conference of Russian Young Researchers in Electrical and Electronic Engineering (EIConRus), pp. 1485–1489 (2018)

  • Foster, I., Kesselman, C.: The Grid 2: Blueprint for a New Computing Infrastructure. Elsevier, Amsterdam (2003)

    Google Scholar 

  • Guo, B., Chen, C., Zhang, D., et al.: Mobile crowd sensing and computing: when participatory sensing meets participatory social media. IEEE Commun. Mag. 54(2), 131137 (2016)

    Article  Google Scholar 

  • Hasan, M., Choi, J., Neumann, J., et al.: Learning temporal regularity in video sequences. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 733–742 (2016)

  • Hejazi, M., Al-Haddad, S.A.R., Hashim, S.J., et al.: Non-fiducial based ECG biometric authentication using one-class support vector machine. In: 2017 Signal Processing: Algorithms, Architectures, Arrangements, and Applications, pp. 190–194 (2017)

  • Hoc, J.: Towards a cognitive approach to human–machine cooperation in dynamic situations. Int. J. Hum. Comput. Stud. 54(4), 509540 (2001)

    Article  Google Scholar 

  • Jaimes, A., Sebe, N., Gatica-Perez, D.: Human-centered computing: a multimedia perspective. In: Proceedings of the 14th ACM international conference on Multimedia, pp. 855–864 (2006)

  • Lu, C., Shi, J., Jia, J.: Abnormal event detection at 150 fps in matlab. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2720–2727 (2013)

  • Mahadevan, V., Li, W., Bhalodia, V., et al.: Anomaly detection in crowded scenes. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1975–1981 (2010)

  • Malone, T.W., Laubacher, R., Dellarocas, C.: Harnessing crowds: Mapping the genome of collective intelligence. MIT Sloan Research (2009)

  • Mehran, R., Oyama, A., Shah, M.: Abnormal crowd behavior detection using social force model. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 935–942 (2009)

  • Mell, P., Grance, T., et al.: The nist definition of cloud computing. National Institute of Standards and Technology (2011)

  • Peleg, D.: Distributed computing. SIAM Monogr. Discrete Math. Appl. 5, 11 (2000)

    MathSciNet  Google Scholar 

  • Preece, J., Rogers, Y., Sharp, H., et al.: Human–Computer Interaction. Addison-Wesley Longman Ltd., Boston (1994)

    Google Scholar 

  • Ren, X., Silpasuwanchai, C., Cahill, J.: Human-engaged computing: the future of human–computer interaction. CCF Trans. Pervas. Comput. Interact. 1(2), 47–68 (2019)

    Article  Google Scholar 

  • Schirner, G., Erdogmus, D., Chowdhury, K., et al.: The future of human-in-the-loop cyber-physical systems. Computer 1, 3645 (2013)

    Google Scholar 

  • Shi, W., Cao, J., Zhang, Q., et al.: Edge computing: vision and challenges. IEEE Int. Things J. 3(5), 637646 (2016)

    Google Scholar 

  • Toshev, A., Szegedy, C.: Deeppose: Human pose estimation via deep neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1653–1660 (2014)

  • Wang, S., Zhang, W.W., Wang, Y.S.: Fingerprint classification by directional fields. In: Proceedings of Fourth IEEE International Conference on Multimodal Interfaces, pp. 395–399 (2002)

  • Wang, X., Yu, T., Zeng, M., et al.: XRec: behavior-based user recognition across mobile devices. In: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, pp. 1–26 (2017)

  • Wei, J., Snider, J.M., Kim, J., et al.: Towards a viable autonomous driving research platform. In: 2013 IEEE Intelligent Vehicles Symposium (IV), p. 763770 (2013)

  • Weiser, M.: Some computer science issues in ubiquitous computing. Commun. ACM 36(7), 7584 (1993)

    Article  Google Scholar 

  • Xin, T., Guo, B., Wang, Z., et al.: Freesense: indoor human identification with Wi-Fi signals. In: 2016 IEEE Global Communications Conference (GLOBECOM), pp. 1–7 (2016)

  • Xin, T., Guo, B., Wang, Z., et al.: Freesense: a robust approach for indoor human detection using Wi-Fi signals. In: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, p. 143 (2018)

  • Xu, W., Yu, Z., Wang, Z., et al.: Acousticid: gait-based human identification using acoustic signal. In: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, pp. 1–25 (2019)

  • Yuen, M.C., Chen, L.J., King, I.: A survey of human computation systems. In: 2009 International Conference on Computational Science and Engineering, pp. 723–728 (2009)

  • Zhang, Q., Zhou, D., Zeng, X.: Heartid: a multiresolution convolutional neural network for ECG-based biometric human identification in smart health applications. IEEE Access 5, 1180511816 (2017)

    Google Scholar 

  • Zhang, X., Yao, L., Kanhere, S.S., et al.: Mindid: person identification from brain waves through attention-based recurrent neural network. In: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, p. 149 (2018)

  • Zhao, Y., Deng, B., Shen, C., et al.: Spatio-temporal autoencoder for video anomaly detection. In: Proceedings of the 25th ACM International Conference on Multimedia, pp. 1933–1941 (2017)

  • Zheng, N., Liu, Z., Ren, P., et al.: Hybrid-augmented intelligence: collaboration and cognition. Front. Inf. Technol. Electron. Eng. 18(2), 153179 (2017)

    Article  Google Scholar 

  • Zieba, S., Polet, P., Vanderhaegen, F., et al.: Principles of adjustable autonomy: a framework for resilient human–machine cooperation. Cognit. Technol. Work 12(3), 193203 (2010)

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported in part by the National Science Fund for Distinguished Young Scholars (No. 61725205), and the National Natural Science Foundation of China (No. 61960206008, No. 61772428, No. 61972319, No. 61902320).

Author information

Authors and Affiliations

  1. Northwestern Polytechnical University, Xian, 710129, People’s Republic of China

    Zhiwen Yu, Qingyang Li, Fan Yang & Bin Guo

Authors
  1. Zhiwen Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Qingyang Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Fan Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Bin Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhiwen Yu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yu, Z., Li, Q., Yang, F. et al. Human–machine computing. CCF Trans. Pervasive Comp. Interact. 3, 1–12 (2021). https://doi.org/10.1007/s42486-020-00051-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s42486-020-00051-1

Keywords

Search

Navigation