Sorted by Date Sorted by Publication Type Sorted by Topic
Trey Smith and Reid G. Simmons. In Proc. Nat. Conf. on Artificial Intelligence (AAAI), 2006.
Real-time dynamic programming (RTDP) is a heuristic search algorithm for solving MDPs. We present a modified algorithm called Focused RTDP with several improvements. While RTDP maintains only an upper bound on the long-term reward function, FRTDP maintains two-sided bounds and bases the output policy on the lower bound. FRTDP guides search with a new rule for outcome selection, focusing on parts of the search graph that contribute most to uncertainty about the values of good policies. FRTDP has modified trial termination criteria that should allow it to solve some problems (within $\epsilon$) that RTDP cannot. Experiments show that for all the problems we studied, FRTDP significantly outperforms RTDP and LRTDP, and converges with up to six times fewer backups than the state-of-the-art HDP algorithm.
@InProceedings{smith06:frtdp,
author = {Trey Smith and Reid G. Simmons},
title = {Focused Real-Time Dynamic Programming for {MDPs}: Squeezing More Out of a Heuristic},
booktitle = {Proc. Nat. Conf. on Artificial Intelligence (AAAI)},
year = 2006,
}
Generated by bib2html.pl (written by Patrick Riley ). About this theme. Last modified: Fri Nov 03, 2023 16:16:31