Please use this identifier to cite or link to this item: https://scholarbank.nus.edu.sg/handle/10635/40673
Title: An analytic characterization of model minimization in Factored Markov Decision Processes
Authors: Guo, W. 
Leong, T.-Y. 
Issue Date: 2010
Citation: Guo, W.,Leong, T.-Y. (2010). An analytic characterization of model minimization in Factored Markov Decision Processes. Proceedings of the National Conference on Artificial Intelligence 2 : 1077-1082. ScholarBank@NUS Repository.
Abstract: Model minimization in Factored Markov Decision Processes (FMDPs) is concerned with finding the most compact partition of the state space such that all states in the same block are action-equivalent. This is an important problem because it can potentially transform a large FMDP into an equivalent but much smaller one, whose solution can be readily used to solve the original model. Previous model minimization algorithms are iterative in nature, making opaque the relationship between the input model and the output partition. We demonstrate that given a set of well-defined concepts and operations on partitions, we can express the model minimization problem in an analytic fashion. The theoretical results developed can be readily applied to solving problems such as estimating the size of the minimum partition, refining existing algorithms, and so on. Copyright © 2010, Association for the Advancement of Artificial Intelligence (www.aaai.org). All rights reserved.
Source Title: Proceedings of the National Conference on Artificial Intelligence
URI: http://scholarbank.nus.edu.sg/handle/10635/40673
ISBN: 9781577354659
Appears in Collections:Staff Publications

Show full item record
Files in This Item:
There are no files associated with this item.

Google ScholarTM

Check

Altmetric


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.