Please use this identifier to cite or link to this item:
Title: Beyong lexical meaning : probabilistic models for sign language recognition
Keywords: gestures, dynamic Bayesian network, multiple data streams, hierarchical structure
Issue Date: 3-Dec-2007
Citation: ONG CHIH WEI, SYLVIE (2007-12-03). Beyong lexical meaning : probabilistic models for sign language recognition. ScholarBank@NUS Repository.
Abstract: This thesis presents a probabilistic framework for recognizing multiple simultaneously expressed concepts in sign language gestures. These gestures communicate not just the lexical meaning but also grammatical information, i.e. inflections that are expressed through systematic spatial and temporal variations in sign appearance. In this thesis we present a new approach to analyse these inflections by modelling the systematic variations as parallel information streams with independent feature sets.We learn from data, the probabilistic relationship between lexical meaning and inflections, and the information streams; and then use the trained model to infer the sign meaning conveyed through observing features in multiple data streams. We propose a novel dynamic Bayesian network structure -- the Multichannel Hierarchical Hidden Markov Model which models the hierarchical, sequential and parallel organization in signing while requiring synchronization between parallel data streams at sign boundaries.
Appears in Collections:Ph.D Theses (Open)

Show full item record
Files in This Item:
File Description SizeFormatAccess SettingsVersion 
OngChihWeiSylvie_PhDThesis2.pdf1.14 MBAdobe PDF



Page view(s)

checked on Dec 30, 2018


checked on Dec 30, 2018

Google ScholarTM


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.