Please use this identifier to cite or link to this item:
Title: Sign language phoneme transcription with rule-based hand trajectory segmentation
Authors: Kong, W.W.
Ranganath, S. 
Keywords: American sign language (ASL)
Hidden Markov models (HMM)
Phoneme transcription
Principal component analysis (PCA)
Trajectory segmentation
Issue Date: May-2010
Citation: Kong, W.W., Ranganath, S. (2010-05). Sign language phoneme transcription with rule-based hand trajectory segmentation. Journal of Signal Processing Systems 59 (2) : 211-222. ScholarBank@NUS Repository.
Abstract: A common approach to extract phonemes of sign language is to use an unsupervised clustering algorithm to group the sign segments. However, simple clustering algorithms based on distance measures usually do not work well on temporal data and require complex algorithms. In this paper, we present a simple and effective approach to extract phonemes from American sign language sentences. We first apply a rule-based segmentation algorithm to segment the hand motion trajectories of signed sentences. We then extract feature descriptors based on principal component analysis to represent the segments efficiently. The segments are clustered by k-means using these high level features to derive phonemes. 25 different continuously signed sentences from a deaf signer were used to perform the analysis. After phoneme transcription, we trained Hidden Markov Models to recognize the sequence of phonemes in the sentences. Overall, our automatic approach yielded 165 segments, and 58 phonemes were obtained based on these segments. The average number of recognition errors was 18.8 (11.4%). In comparison, completely manual trajectory segmentation and phoneme transcription, involving considerable labor yielded 173 segments, 57 phonemes, and the average number of recognition errors was 33.8 (19.5%). © 2008 Springer Science+Business Media, LLC.
Source Title: Journal of Signal Processing Systems
ISSN: 19398018
DOI: 10.1007/s11265-008-0292-5
Appears in Collections:Staff Publications

Show full item record
Files in This Item:
There are no files associated with this item.


checked on Jun 16, 2021


checked on Jun 16, 2021

Page view(s)

checked on Jun 10, 2021

Google ScholarTM



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.