Augmented Sensors

Part of the Cognitive Science and Technology book series (CSAT)


Key elements of the emerging field of Assistive Augmentation are both the substitution and enhancement of senses–means towards “augmented sensors”. We use the term “augmented sensors” to introduce the following subsections of this part of the volume that focus on enhancing a particular sensory channel, remapping information from one sensory modality to another and creating new sensing modalities. We do so by describing our joint vision of such technology developed at the Augmented Human Lab (Singapore University of Technology and Design). We sketch out research thrusts and enablers, highlight application domains and speculate about the future of augmented sensors.


  1. 1.
    Withana A, Ransiri S, Kaluarachchi T, Singhabahu C, Shi Y, Elvitigala S, Nanayakkara SC. waveSense: ultra low power gesture sensing based on selective volumetric illumination. In: Proceedings of the 29th annual symposium on user interface software and technologyGoogle Scholar
  2. 2.
    Fan K, Huber J, Nanayakkara S, Inami M (2014) SpiderVision: extending the human field of view for augmented awareness. In: Proceedings of the 5th augmented human international conference. ACM, p 49Google Scholar
  3. 3.
    Nanayakkara SC, Wyse L, Ong SH, Taylor E (2013) Enhancing musical experience for the hearing-impaired using visual and haptic inputs. Hum Comput Interact 28(2):115–160Google Scholar
  4. 4.
    Petry B, Illandara T, Nanayakkara SC (2016) MuSS-Bits: sensor-display blocks for deaf people to explore musical sounds. In: Proceedings of the annual meeting of the australian special interest group for computer human interaction, OzCHI ‘16. ACM, New YorkGoogle Scholar
  5. 5.
    Ranasinghe N, Cheok A, Nakatsu R (2014) Taste+: digitally enhancing taste sensations of food and beverages. In: Proceedings of the ACM international conference on multimedia. ACM, pp 737–738Google Scholar
  6. 6.
    Clark RC, Nguyen F, Sweller J (2011) Efficiency in learning: evidence-based guidelines to manage cognitive load. WileyGoogle Scholar
  7. 7.
    Eisma R, Dickinson A, Goodman J, Syme A, Tiwari L, Newell AF (2004) Early user involvement in the development of information technology-related products for older people. Univ Access Inf Soc 3(2):131–140CrossRefGoogle Scholar
  8. 8.
    Shilkrot R, Huber J, Wong ME, Maes P, Nanayakkara SC (2015) FingerReader: a wearable device to explore printed text on the go. In: Proceedings of the 33rd annual SIGCHI conference on human factors in computing systems, Seoul, Korea, April 18–23, 2015. CHI’15. ACM, New York, NY, pp 2363–2372Google Scholar
  9. 9.
    Cortes JPF, Ching TH, Wu C, Chionh CY, Nanayakkara SC, Foong S (2015) BWard: an optical approach for reliable in-situ early blood leakage detection at catheter extraction points. In: Proceedings of the 7th IEEE international conference on automation and mechatronics (RAM), Angkor Wat, Cambodia, July 15–17, 2015, CIS-RAM 2015. IEEE, Piscataway, NJGoogle Scholar
  10. 10.
    Sato M, Poupyrev I, Harrison C (2012) Touche ́: enhancing touch interaction on humans, screens, liquids, and everyday objects. In: Proceedings of CHI 2012. ACM Press, pp 483–492.
  11. 11.
    Yeo KP, Nanayakkara SC, Ransiri S (2013) StickEar: making everyday objects respond to sound. In: Proceedings of the ACM symposium on user interface software and technology, StAndrews, UK, October 8–11, 2013. UIST’13. ACM, New York, NY, pp 221–226Google Scholar
  12. 12.
    Ransiri S, Nanayakkara SC (2012) WatchMe: wrist-worn interface that makes remote monitoring seamless, ASSETSGoogle Scholar
  13. 13.
    Zhang M, Sawchuk AA (2009) A customizable framework of body area sensor network for rehabilitation. Applied sciences in biomedical and communication technologies, 2009. IsabelGoogle Scholar
  14. 14.
    Hiroki S, Takashi W, Achmad A (2009) Ankle and knee joint angle measurements during gait with wearable sensor system for rehabilitation. In: World congress on medical physics and biomedical engineeringGoogle Scholar
  15. 15.
    Peiris R, Janaka N, De Silva DR, Nanayakkara SC (2014) SHRUG: stroke haptic rehabilitation using gaming interfaces. In: Proceedings of the 25th annual CHISGI Australian computer-human interaction conference, Sydney, Australia, December 2–5, 2014. OZCHI’14. ACM, New York, NY, pp 380–383Google Scholar
  16. 16.
    Picard RW, Papert S, Bender W, Blumberg B, Breazeal C, Cavallo D, Strohecker C et al (2004) Affective learning—a manifesto. BT Technol J 22(4):253–269Google Scholar
  17. 17.
    Ortega-Avila S, Huber J, Nanayakkarawasam J, Withana A, Fernando P, Nanayakkara SC (2014) SparKubes: exploring the interplay between digital and physical spaces with minimalistic interfaces. In: OzCHI ’14: Proceedings of the 26th Australian computer-human interaction conference. ACMGoogle Scholar
  18. 18.
    Sridhar PK, Nanayakkara SC, Huber J (2017) Towards understanding of play with augmented toys. In: Proceedings of the 8th augmented human international conference, AH ‘17. ACM, New York, NY, USA. Article 22Google Scholar
  19. 19.
    Nanayakkara SC, Schroepfer T, Wortmann T, Yeo KP, Khew YN, Lian A, Cornelius A (2014) iSwarm: an iterative light installation on the water. In: i Light Marina Bay 2014, Marina Bay, Singapore, 7–30 March, 2014Google Scholar
  20. 20.
    Nanayakkara SC, Schroepfer T, Withana A, Wortmann T, Pablo J (2014) nZwarm: a swarm of luminous sea creatures that interact with passers-by. In: Wellington LUX 2014, Wellington Waterfront, New Zealand, 22–31 August, 2014Google Scholar
  21. 21.
    Nanayakkara SC, Schroepfer T, Withana A, Lian A, Boldu R, Muthukumarana S (2015) The RIBbon @ read bridge: interactive installation that movements and sounds into beautiful light. In: Christmas by the River, Read Bridge, Clarke Quay, Singapore, 4 December 2015–4 January 2016)Google Scholar
  22. 22.
    Nanayakkara SC, Schroepfer T, Withana A, Lian A (2015) SonicSG: interactive mobile- based light installation that tinkles in symphony with the nation’s well wishes. In: SG50 celebrations, Boat Quay, Singapore, 4 December 2015–4 January 2016Google Scholar
  23. 23.
    Bishop C (2012) Artificial hells: participatory art and the [6] politics of spectatorship. Verso BooksGoogle Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2018

Authors and Affiliations

  1. 1.Singapore University of Technology and DesignChangiSingapore
  2. 2.SynapticsZugSwitzerland

Personalised recommendations