Summary
The paper considers automatic visual recognition of signed expressions. The proposed method is based on modeling gestures with subunits, which is similar to modeling speech by means of phonemes. To define the subunits a data-driven procedure is applied. The procedure consists in partitioning time series, extracted from video, into subsequences which form homogeneous groups. The cut points are determined by an evolutionary optimization procedure based on multicriteria quality assessment of the resulting clusters. In the paper the problem is formulated, its solution method is proposed and experimentally verified on a database of 100 Polish words.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Kraiss, K.F.: Advanced man-machine interaction. Springer, Berlin (2006)
Ong, S.C.W., Ranganath, S.: Automatic sign language analysis: a survey and the future beyond lexical meaning. IEEE Trans. PAMI 27, 873–891 (2005)
Vogler, C., Metaxas, D.A.: Framework for recognizing the simultaneous aspects of american sign language. Computer Vision and Image Understanding 81, 358–384 (2001)
Han, J., Awad, G., Sutherland, A.: Modelling and segmenting subunits for sign language recognition based on hand motion analysis. Pattern Recognition Letters 30, 623–633 (2009)
Li, H., Zhangm, K., Jiangm, T.: Minimum entropy clustering and applications to gene expression analysis. In: 3rd IEEE Computational Systems Bioinformatics Conference, pp. 142–151 (2004)
Xu, R., Wunsch, D.C.: Clustering. J. Wiley and Sons, Inc., Hoboken (2009)
Maulik, U., Bandyopadhyay, S.: Performance evaluation of some clustering algorithms and validity indices. IEEE Trans. PAMI 24, 1650–1654 (2002)
Miettinen, K.M.: Nonlinear multiobjective optimization. Kluwer Acad. Publ., Dordrecht (1998)
De Castro, L.N., Von Zuben, F.J.: Learning and optimization using the clonal selection principle. IEEE Trans. on Evolutionary Computation 6, 239–251 (2002)
Trojanowski, K., Wierzchon, S.: Immune-based algorithms for dynamic optimization. Information Sciences 179, 1495–1515 (2009)
Bicego, M., Murino, V., Figueiredo, M.A.T.: Similarity-based classification of sequences using hidden markov models. Pattern Recognition 37, 2281–2291 (2004)
Liao, T.W.: Clustering of time series data – a survey. Pattern Recognition 38, 1857–1874 (2005)
Handl, J., Knowles, J.: An evolutionary approach to multiobjective clustering. IEEE Trans. on Evolutionary Computation 11, 56–76 (2007)
Saha, S., Bandyopadhyay, S.: A symmetry-based multiobjective clustering technique for automatic evolution of clusters. Pattern Recognition 43, 738–751 (2010)
Tseng, V.S., Chen, C.H., Huang, P.C., Hong, T.P.: Cluster-based genetic segmentation of time series with DWT. Pattern Recognition Letters 30, 1190–1197 (2009)
Ratanamahatana, C.A., Keogh, E.: Three myths about dynamic time warping data mining. In: SIAM Int. Conf. on Data Mining, pp. 506–510 (2005)
Minimum Entropy Clustering Java package, http://www.cs.ucr.edu/~hli/mec/
Kapuscinski, T., Wysocki, M.: Recognition of signed Polish words using visually oriented subunits. In: 3rd Language and Technology Conference: Human Language Technologies as a Challenge for Computer Science and Linguistics, Poznan, pp. 202–206 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Oszust, M., Wysocki, M. (2010). Recognition of Signed Expressions Using Cluster-Based Segmentation of Time Series. In: Choraś, R.S. (eds) Image Processing and Communications Challenges 2. Advances in Intelligent and Soft Computing, vol 84. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-16295-4_19
Download citation
DOI: https://doi.org/10.1007/978-3-642-16295-4_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-16294-7
Online ISBN: 978-3-642-16295-4
eBook Packages: EngineeringEngineering (R0)