Skip to main content

Advertisement

SpringerLink
Log in

Implementation and evaluation of a scene search method for multimedia content using subtitles

  • Original Article
  • Published:
Artificial Life and Robotics Aims and scope Submit manuscript

Abstract

In Japan, information technology is an important issue in educational fields. Many students can come to study using multimedia contents anywhere and anytime. However, Japanese students spend short time on self-learning compared with other countries. Considering this fact, we propose a multimedia switching system to improve their learning time and understanding. In the system, multimedia contents are provided to reflect both knowledge and skills for keeping a self-learning time, motivation and understanding. The system is an educational content to switch their operation, media, quality reflected as a learning support functions. However, we have not focused on the usability of educational contents. In this paper, we discuss implementation and evaluation of scene search using subtitles appended to lecture video implemented as a Web application for supporting self-learning.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

References

  1. Latchman HA, Salzmann C, Gillet D, Bouzekri H (1999) Information technology enhanced learning in distance and conventional education. IEEE Trans Educ 42(4):247–254

    Article  Google Scholar 

  2. Sakamura K, Koshizuka N (2005) Ubiquitous computing technologies for ubiquitous learning. In: Proc. of the IEEE international workshop on wireless and mobile technologies in education, pp. 11–20

  3. Dagger D, Connor AO, Lawless S, Walsh E, Wade VP (2007), Service-oriented E-learning platforms. In: Proc. of the IEEE internet computing, pp. 28–35

  4. Khribi MK, Jemni M (2008), Automatic recommendations for E-learning personalization based on web usage mining techniques and information retrieval. In; Proc. of the eighth IEEE international conference on advanced learning technologies, pp. 241–245

  5. Rapuano S, Zoino F (2006) A learning management system including laboratory experiments on measurement instrumentation. IEEE Trans Instrum Meas 55(5):1757–1776

    Article  Google Scholar 

  6. Graf S, Kinshunk Liu TC (2008), Identifying learning styles in learning management systems by using indications from students’ behaviour. In: Proc. of the eighth IEEE international conference on advanced learning technologies, pp. 482–486

  7. Stickic M, Laerhoven K, V, Schiele B (2008), Exploring semi-supervised and active learning for activity recognition. In: Proc. of the 12th IEEE international symposium on wearable computers, pp. 81–88

  8. Striegel A, Rover DT (2002) Problem-based learning in an introductory computer engineering course. Proc Front Educ 2:7–12

    Google Scholar 

  9. Avery Z, Castillo M, Guo H, Guo J, Warter-Perez N, Won DS, Dong J (2010), Implementing Collaborative Project-Based Learning using the Tablet PC to enhance student learning in engineering and computer science courses. In: Proc. of the IEEE frontiers in education conference, pp. 1–7

  10. Mason GS, Shuman TR, Cool KE (2013) Comparing the effectiveness of an inverted classroom to a traditional classroom in an upper-division engineering course. IEEE Trans Educ 56(4):430–435

    Article  Google Scholar 

  11. Deniz DZ, Karaca C (2004), Pedagogically enhanced video-on-demand based learning system. In: Proc. of the fifth international conference on information technology based higher education and training, pp. 415–420

  12. Subbian V (2013), Role of MOOCs in integrated STEM education: a learning perspective. In: Proc. of the IEEE integrated STEM education conference, pp. 1–4

  13. Maeda Y, Sugita K, Oka T, Yokota M (2008), Proposal of a new concept of universal multimedia access, In: Proc. of 13th international symposium on artificial life and robotics (AROB-2008), OS7-6

  14. Sugita K, Yokota M (2013), Implementation of sightseeing information contents for universal multimedia access, In: Proc. the eighth international conference on P2P, parallel, grid, cloud and internet computing (3PGCIC-2013), pp. 569–573

  15. Sugita K, Nishimura K, Yokota M (2015) Implementation of sightseeing contents considering difference in computer skills and devices. Artif Life Robot 20(1):19–27

    Article  Google Scholar 

  16. Sugita K (2018), A scene search method using subtitles appended to lecture video for supporting self-learning, Artificial life and robotics (AROB-2018), OS7-7: 601–605

  17. Abe S, Tamura T, Kasahara H (1989), Scene retrieval method for video database applications using temporal condition changes. In: Proc. of the international workshop on industrial application of machine intelligence and vision, IEEE Computer Society Press: 355–359

  18. Chu WT, Li CJ, Lin TC (2010), Travel video scene detection by search. In: Proc. of the Fourth pacific-rim symposium on image and video technology, IEEE Computer Society Press: 181–185

  19. Nakamura N, Takano S, Okada Y (2008), A stochastic ARG matching based video scene search system with a sketch query interface. In: Proc. of the fifth international conference on computer graphics, imaging and visualisation, IEEE Computer Society Press: 55–60

  20. Tonomura Y, Abe S (1989), Content oriented visual interface using icons for visual database system. In: Proc. of the IEEE workshop on visual languages, IEEE Computer Society Press: 68–73

  21. Ardizzone E, Cascia ML, Avanzato A, Bruna A (1999), Video Indexing Using MPEG Motion Compensation Vectors. In: Proceedings the IEEE international conference on multimedia computing and systems, IEEE computer society press: 725–729

  22. Ji Z, Wang J, Su YT (2009), Text detection in video frames using hybrid features. In: Proc. of the international conference on machine learning and cybernetics, IEEE Computer Society Press: 318–322

  23. Getahun F, Birara M (2015), Towards a scene-based video annotation framework. In: Proc. of the 11th international conference on signal-image technology & internet-based systems, IEEE Computer Society Press: 306–313

Download references

Author information

Authors and Affiliations

  1. Fukuoka Institute of Technology, Graduate School of Fukuoka Institute of Technology, 3-30-1, Wajiro-Higashi, Higashi-ku, Fukuoka, 811-0295, Japan

    Kaoru Sugita

  2. Graduate School of Fukuoka Institute of Technology, 3-30-1, Wajiro-Higashi, Higashi-ku, Fukuoka, 811-0295, Japan

    Ko Takayama

Authors
  1. Kaoru Sugita
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ko Takayama
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kaoru Sugita.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This work was presented in part at the 23rd International Symposium on Artificial Life and Robotics, Beppu, Oita, January 18–20, 2018.

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sugita, K., Takayama, K. Implementation and evaluation of a scene search method for multimedia content using subtitles. Artif Life Robotics 24, 404–414 (2019). https://doi.org/10.1007/s10015-019-00538-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10015-019-00538-w

Keywords

Search

Navigation