Skip to main content
SpringerLink
Log in

Exploring Application Opportunities for Smart Vehicles in the Continuous Interaction Space Inside and Outside the Vehicle

  • Conference paper
  • First Online:
Human-Computer Interaction – INTERACT 2021 (INTERACT 2021)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12933))

Included in the following conference series:

Abstract

We describe applications that implement interactions between the driver and their smart vehicle in a continuous interaction space characterized by the physical distance to the vehicle and by the smart devices that implement those interactions. Specifically, we demonstrate the principles of smart vehicle proxemics with smart rings, smartwatches, smartphones, and other devices employed to interact with the in-vehicle infotainment system while the driver traverses five distinctly identifiable zones, from inside the vehicle to the personal, proximal, distant, and covert zone outside the vehicle. We present engineering details of our applications that capitalize on standardized web technology (HTML, CSS, JavaScript), communication protocols (WebSocket), and data formats (JSON) and, thus, enable straightforward extension to accommodate other smart devices for new interactions with smart vehicles. We also point to future opportunities for designing interactions from a distance and function of the distance between the driver and their vehicle.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://store.nfcring.com/products/omni?variant=30878229987373.

  2. 2.

    https://www.samsung.com/au/support/model/SM-T555NZWAXSA.

  3. 3.

    Typical range of operation of 10m; see a Bluetooth rang estimator here: https://www.bluetooth.com/learn-about-bluetooth/key-attributes/range.

  4. 4.

    https://www.samsung.com/us/mobile/wearables/smartwatches/galaxy-watch3-45mm-mystic-silver-bluetooth-sm-r840nzsaxar/.

  5. 5.

    The fast remote desktop application - AnyDesk, https://anydesk.com/en.

  6. 6.

    https://www.hidglobal.com/sites/default/files/resource_files/hid-nfc-tags-and-solutions-wp-en.pdf.

References

  1. Aiordăchioae, A., Vatavu, R.D., Popovici, D..M.: A design space for vehicular lifelogging to support creation of digital content in connected cars. In: Proceedings of the ACM Symposium on Engineering Interactive Computing Systems, EICS 2019, ACM, New York (2019). https://doi.org/10.1145/3319499.3328234

  2. Alvarez, I., Martin, A., Dunbar, J., Taiber, J., Wilson, D.M., Gilbert, J.E.: Voice interfaced vehicle user help. In: Proceedings of the 2nd International Conference on Automotive User Interfaces and Interactive Vehicular Applications, pp. 42–49. Automotive, UI 2010, ACM, New York (2010). https://doi.org/10.1145/1969773.1969782

  3. Ballendat, T., Marquardt, N., Greenberg, S.: Proxemic interaction: designing for a proximity and orientation-aware environment. In: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces, ITS 2010, pp. 121–130 (2010). https://doi.org/10.1145/1936652.1936676

  4. Bilius, L.B., Vatavu, R.D.: A synopsis of input modalities for in-vehicle infotainment and consumption of interactive media. In: Proceedings of the ACM International Conference on Interactive Media Experiences, IMX 2020, pp. 195–199. ACM, New York (2020). https://doi.org/10.1145/3391614.3399400

  5. Bilius, L.B., Vatavu, R.D.: A multistudy investigation of drivers and passengers’ gesture and voice input preferences for in-vehicle interactions. J. Intell. Transp. Syst. (2020). https://doi.org/10.1080/15472450.2020.1846127

    Article  Google Scholar 

  6. Bilius, L.B., Vatavu, R.D., Marquardt, N.: Smart vehicle proxemics: a conceptual framework operationalizing proxemics in the context of outside-the-vehicle interactions. In: Proceedings of the 18th International Conference on Human-Computer Interaction, Interact 2021 (2021). 22 pages

    Google Scholar 

  7. Claudine, B., et al.: Self-driving cars: a survey. Expert Syst. Appl. 165, 113816 (2021). https://doi.org/10.1016/j.eswa.2020.113816

    Article  Google Scholar 

  8. Detjen, H., Faltaous, S., Geisler, S., Schneegass, S.: User-defined voice and mid-air gesture commands for maneuver-based interventions in automated vehicles. In: Proceedings of Mensch Und Computer 2019, MuC 2019, pp. 341–348 (2019). https://doi.org/10.1145/3340764.3340798

  9. Fariman, H.J., Alyamani, H.J., Kavakli, M., Hamey, L.: Designing a user-defined gesture vocabulary for an in-vehicle climate control system. In: Proceedings of the 28th Australian Conference on Computer-Human Interaction, OzCHI 2016, pp. 391–395. ACM (2016). https://doi.org/10.1145/3010915.3010955

  10. Gheran, B.F., Vatavu, R.D.: From controls on the steering wheel to controls on the finger: using smart rings for in-vehicle interactions. In: Companion Publication of the 2020 ACM Designing Interactive Systems Conference, DIS 2020 (2020). https://doi.org/10.1145/3393914.3395851

  11. Greenberg, S., Kuzuoka, H.: Using digital but physical surrogates to mediate awareness, communication and privacy in media spaces. Pers. Technol. 3, 182–198 (1999). https://doi.org/10.1007/BF01540552

    Article  Google Scholar 

  12. Greenberg, S., Marquardt, N., Ballendat, T., Diaz-Marino, R., Wang, M.: Proxemic interactions: the new ubicomp? Interactions 18(1), 42–50 (2011). https://doi.org/10.1145/1897239.1897250

    Article  Google Scholar 

  13. Grønbæk, J.E., Knudsen, M.S., O’Hara, K., Krogh, P.G., Vermeulen, J., Petersen, M.G.: Proxemics beyond proximity: designing for flexible social interaction through cross-device interaction. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, CHI 2020, pp. 1–14 2020). https://doi.org/10.1145/3313831.3376379

  14. Hall, E.T.: The Hidden Dimension. Doubleday, Garden City (1966)

    Google Scholar 

  15. Kao, C.H.L., Johns, P., Roseway, A., Czerwinski, M.: Tattio: fabrication of aesthetic and functional temporary tattoos. In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, CHI EA 2016, pp. 3699–3702 (2016). https://doi.org/10.1145/2851581.2890269

  16. Khan, A., Qadeer, M., Ansari, J., Waheed, S.: 4g as a next generation wireless network. In: ICFCC, pp. 334–338 (2009). https://doi.org/10.1109/ICFCC.2009.108

  17. Ledo, D., Greenberg, S., Marquardt, N., Boring, S.: Proxemic-aware controls: designing remote controls for ubiquitous computing ecologies. In: Proceedings of MobileHCI 2015, pp. 187–198. ACM (2015). https://doi.org/10.1145/2785830.2785871

  18. Marquardt, N., Diaz-Marino, R., Boring, S., Greenberg, S.: The proximity toolkit: prototyping proxemic interactions in ubiquitous computing ecologies. In: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, UIST 2011, pp. 315–326 (2011). https://doi.org/10.1145/2047196.2047238

  19. McCarthy, J.: Computer controlled cars (1968). http://jmc.stanford.edu/commentary/progress/cars.pdf

  20. Mumm, J., Mutlu, B.: Human-robot proxemics: physical and psychological distancing in human-robot interaction. In: Proceedings of the 6th International Conference on Human-Robot Interaction, HRI 2011, pp. 331–338. ACM, New York (2011). https://doi.org/10.1145/1957656.1957786

  21. Previc, F.: The neuropsychology of 3-D space. Psychol. Bull. 124, 2 (1998)

    Article  Google Scholar 

  22. Raza, N., Jabbar, S., Han, J., Han, K.: Social vehicle-to-everything (V2X) communication model for intelligent transportation systems based on 5G scenario. In: Proceedings of ICFNDS 2018, ACM (2018). https://doi.org/10.1145/3231053.3231120

  23. Roider, F., Rümelin, S., Pfleging, B., Gross, T.: The effects of situational demands on gaze, speech and gesture input in the vehicle. In: Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Automotive, UI 2017, pp. 94–102. ACM (2017). https://doi.org/10.1145/3122986.3122999

  24. Salmela, E., Vimm, I.: Digital Smart Jewelry: Next Revolution of Jewelry Industry?. Digital Transformation in Smart Manufacturing, IntechOpen (2018). https://doi.org/10.5772/intechopen.71705

  25. Schipor, O.A., Vatavu, R.D.: Empirical results for high-definition video and augmented reality content delivery in hyper-connected cars. Interact. Comput. 33, 3–16 (2021). https://doi.org/10.1093/iwcomp/iwaa025

    Article  Google Scholar 

  26. Schipor, O.A., Vatavu, R.D., Vanderdonckt, J.: Euphoria: a scalable, event-driven architecture for designing interactions across heterogeneous devices in smart environments. Inf. Softw. Technol. 109, 43–59 (2019). https://doi.org/10.1016/j.infsof.2019.01.006

    Article  Google Scholar 

  27. Tanase, C., Vatavu, R.D., Pentiuc, S., Graur, A.: Detecting and tracking multiple users in the proximity of interactive tabletops. Adv. Electr. Comput. Eng. 8, 61–64 (2008). https://doi.org/10.4316/aece.2008.02011

  28. Vogel, D., Balakrishnan, R.: Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users. In: Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology, UIST 2004 (2004). https://doi.org/10.1145/1029632.1029656

  29. Wolf, K., Abdelrahman, Y., Kubitza, T., Schmidt, A.: Proxemic zones of exhibits and their manipulation using floor projection. In: Proceedings of the 5th ACM International Symposium on Pervasive Displays, PerDis 2016, pp. 33–37. ACM (2016). https://doi.org/10.1145/2914920.2915012

  30. Yeh, A., et al.: Exploring proxemics for human-drone interaction. In: Proceedings of the 5th International Conference on Human Agent Interaction, HAI 2017, pp. 81–88 (2017). https://doi.org/10.1145/3125739.3125773

Download references

Acknowledgments

This work was supported by a grant of the Romanian Ministry of Research and Innovation, CCCDI-UEFISCDI, project PN-III-P1-1.2-PCCDI-2017-0917 (21PCCDI/2018), within PNCDI III.

Author information

Authors and Affiliations

  1. MintViz Lab | MANSiD Research Center, Ştefan cel Mare University of Suceava, 720229, Suceava, Romania

    Laura-Bianca Bilius & Radu-Daniel Vatavu

  2. University College London, London, UK

    Nicolai Marquardt

Authors
  1. Laura-Bianca Bilius
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Radu-Daniel Vatavu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Nicolai Marquardt
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Radu-Daniel Vatavu .

Editor information

Editors and Affiliations

  1. Department of Electrical and Information Engineering, Polytechnic University of Bari, Bari, Italy

    Carmelo Ardito

  2. Computer Science Department, University of Bari Aldo Moro, Bari, Italy

    Rosa Lanzilotti

  3. Computer Science Department, University of Pisa, Pisa, Italy

    Alessio Malizia

  4. Department of Computer Science, University of York, York, UK

    Helen Petrie

  5. Computer Science Department, University of Bari Aldo Moro, Bari, Italy

    Antonio Piccinno

  6. Computer Science Department, University of Bari Aldo Moro, Bari, Italy

    Giuseppe Desolda

  7. Microsoft Research, Redmond, WA, USA

    Kori Inkpen

Rights and permissions

Reprints and permissions

Copyright information

© 2021 IFIP International Federation for Information Processing

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Bilius, LB., Vatavu, RD., Marquardt, N. (2021). Exploring Application Opportunities for Smart Vehicles in the Continuous Interaction Space Inside and Outside the Vehicle. In: Ardito, C., et al. Human-Computer Interaction – INTERACT 2021. INTERACT 2021. Lecture Notes in Computer Science(), vol 12933. Springer, Cham. https://doi.org/10.1007/978-3-030-85616-8_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-85616-8_10

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-85615-1

  • Online ISBN: 978-3-030-85616-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Societies and partnerships

Search

Navigation