Please use this identifier to cite or link to this item: https://doi.org/10.1007/s11265-008-0292-5
Title: Sign language phoneme transcription with rule-based hand trajectory segmentation
Authors: Kong, W.W.
Ranganath, S. 
Keywords: American sign language (ASL)
Hidden Markov models (HMM)
Phoneme transcription
Principal component analysis (PCA)
Trajectory segmentation
Issue Date: May-2010
Source: Kong, W.W., Ranganath, S. (2010-05). Sign language phoneme transcription with rule-based hand trajectory segmentation. Journal of Signal Processing Systems 59 (2) : 211-222. ScholarBank@NUS Repository. https://doi.org/10.1007/s11265-008-0292-5
Abstract: A common approach to extract phonemes of sign language is to use an unsupervised clustering algorithm to group the sign segments. However, simple clustering algorithms based on distance measures usually do not work well on temporal data and require complex algorithms. In this paper, we present a simple and effective approach to extract phonemes from American sign language sentences. We first apply a rule-based segmentation algorithm to segment the hand motion trajectories of signed sentences. We then extract feature descriptors based on principal component analysis to represent the segments efficiently. The segments are clustered by k-means using these high level features to derive phonemes. 25 different continuously signed sentences from a deaf signer were used to perform the analysis. After phoneme transcription, we trained Hidden Markov Models to recognize the sequence of phonemes in the sentences. Overall, our automatic approach yielded 165 segments, and 58 phonemes were obtained based on these segments. The average number of recognition errors was 18.8 (11.4%). In comparison, completely manual trajectory segmentation and phoneme transcription, involving considerable labor yielded 173 segments, 57 phonemes, and the average number of recognition errors was 33.8 (19.5%). © 2008 Springer Science+Business Media, LLC.
Source Title: Journal of Signal Processing Systems
URI: http://scholarbank.nus.edu.sg/handle/10635/57392
ISSN: 19398018
DOI: 10.1007/s11265-008-0292-5
Appears in Collections:Staff Publications

Show full item record
Files in This Item:
There are no files associated with this item.

SCOPUSTM   
Citations

8
checked on Dec 14, 2017

WEB OF SCIENCETM
Citations

9
checked on Nov 17, 2017

Page view(s)

25
checked on Dec 10, 2017

Google ScholarTM

Check

Altmetric


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.