Flower Sermon: An Interactive Visual Design Using IoTtalk

  • Chung-Yun Hsiao
  • Chih-Chieh Huang
  • Yi-Bing Lin
  • Yun-Wei Lin


IoTtalk is a platform for IoT device interaction, which has been used to develop many IoT applications such as home automation. This paper uses Flower Sermon artwork as an example to show how interactive visual design can be conveniently implemented in IoTtalk. The Flower Sermon artwork conducts cyber physical interaction, which animates a dandelion in a mirror when a person smiles at that mirror. The dandelion grows larger as the person smiles bigger. The flower also vibrates following the heartbeat rate of the person. In our approach, the camera detecting the face expression and the heartbeat rate is considered as an input IoT device, and the mirror display for dandelion animation is considered as an output IoT device. In IoTtalk, the features of the dandelion animation are considered as the actuators that can be independently controlled. IoTtalk nicely connects these IoT devices, where various features can be created for interactive visual design with little or without any programming effort. We also measure the time complexity for data delivery among the input and the output IoT devices. Our study indicates that the time delays are less than 0.07 s on the average even if the IoTtalk server is located in a cloud.


IoTtalk Interactive visual design IoT platform Cyber physical interaction 



The first version of Dandelion1 is implemented by Qing Liu. This work was supported in part by the Ministry of Science and Technology under Grant 106-2221-E-009 -006 and Grant 106-2221- E-009 -049 -MY2, in part by the Ministry of Education through the SPROUT Project-Center for Open Intelligent Connectivity, National Chiao Tung University, Taiwan, in part by Academia Sinica under Grant AS-105-TP-A07, and in part by the Ministry of Economic Affairs under Grant 106-EC-17-A-24-0619.


  1. 1.
    Crawford C (2003) The art of interactive design. William Pollock, San FranciscoGoogle Scholar
  2. 2.
    Kolko J (2011) Thoughts on interaction design. Morgan Kaufmann, San FranciscoGoogle Scholar
  3. 3.
    Saffer D (2010) Designing for interaction. Berkeley, CaliforniaGoogle Scholar
  4. 4.
    Mendelowitz E, Seeley D, Glicksman D (2016) Whorl: an immersive dive into a world of flowers, color, and play. In: ACM CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp 3871–3874Google Scholar
  5. 5.
    Xiao X, Puentes P, Ackermann E, Ishii H (2016) Andantino: teaching children piano with projected animated characters. In: ACM Proceedings of the 15th International Conference on Interaction Design and Children, pp 37–45Google Scholar
  6. 6.
    AllSeen Alliance (2016) Accessed 13 July 2017
  7. 7.
    oneM2M (2016) Standards for M2M and the Internet of Things. Accessed 13 July 2017
  8. 8.
    OpenMTC (2016) The open machine type communications platform. Accessed 13 July 2017
  9. 9.
    Lin YB, Lin YW, Chih CY, Li TY, Tai CC, Wang YC, Lin FJ, Kuo HC, Huang CC, Hsu SC (2015) Easy connect: a management system for IoT devices and its applications for interactive design and art. IEEE Internet Things J 2(6):551–561CrossRefGoogle Scholar
  10. 10.
    Lin YB, Lin YW, Huang CM, Chih CY, Lin P (2017) IoTtalk: a management platform for reconfigurable sensor devices. IEEE Internet Things J.
  11. 11.
    Lin YW, Lin YB, Hsiao CY, Wang YY (2017) IoTtalk-RC: sensors as universal remote control for aftermarket home appliances. IEEE Internet Things J 4(4):1104–1112CrossRefGoogle Scholar
  12. 12.
    Lin YW, Lin YB, Yang MT, Lin JH (2017) ArduTalk: an arduino network application development platform based on IoTtalk. IEEE Syst J 99:1–9Google Scholar
  13. 13.
    Intel (2016) Intel RealSense SDK Developer Reference. Accessed 13 July 2017
  14. 14.
    Huang SC (2009) MSOrgm (motivational sensitive organism). Leonardo 42(4):374–375CrossRefGoogle Scholar
  15. 15.
    Open CV Open Source Computer Vision (2017) Accessed 13 July 2017
  16. 16.
    Processing (2016) Accessed 13 July 2017
  17. 17.
  18. 18.
    Acer (2017) Acer aBeing One, Accessed 13 July 2017

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018
corrected publication August/2018

Authors and Affiliations

  1. 1.Department of Computer ScienceNational Chiao Tung UniversityHsinchuTaiwan
  2. 2.Center of General Education and College of ArtsNational Tsing Hua UniversityHsinchuTaiwan

Personalised recommendations