Please use this identifier to cite or link to this item: http://scholarbank.nus.edu.sg/handle/10635/23212
Title: Beyong lexical meaning : probabilistic models for sign language recognition
Authors: ONG CHIH WEI, SYLVIE
Keywords: gestures, dynamic Bayesian network, multiple data streams, hierarchical structure
Issue Date: 3-Dec-2007
Source: ONG CHIH WEI, SYLVIE (2007-12-03). Beyong lexical meaning : probabilistic models for sign language recognition. ScholarBank@NUS Repository.
Abstract: This thesis presents a probabilistic framework for recognizing multiple simultaneously expressed concepts in sign language gestures. These gestures communicate not just the lexical meaning but also grammatical information, i.e. inflections that are expressed through systematic spatial and temporal variations in sign appearance. In this thesis we present a new approach to analyse these inflections by modelling the systematic variations as parallel information streams with independent feature sets.We learn from data, the probabilistic relationship between lexical meaning and inflections, and the information streams; and then use the trained model to infer the sign meaning conveyed through observing features in multiple data streams. We propose a novel dynamic Bayesian network structure -- the Multichannel Hierarchical Hidden Markov Model which models the hierarchical, sequential and parallel organization in signing while requiring synchronization between parallel data streams at sign boundaries.
URI: http://scholarbank.nus.edu.sg/handle/10635/23212
Appears in Collections:Ph.D Theses (Open)

Show full item record
Files in This Item:
File Description SizeFormatAccess SettingsVersion 
OngChihWeiSylvie_PhDThesis2.pdf1.14 MBAdobe PDF

OPEN

NoneView/Download

Page view(s)

207
checked on Dec 18, 2017

Download(s)

154
checked on Dec 18, 2017

Google ScholarTM

Check


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.