ZMDP Software for POMDP and MDP Planning

The ZMDP software package implements several heuristic search algorithms for POMDPs and MDPs, including some algorithms I developed (FRTDP, HSVI2) and some earlier algorithms that work on the same problems (RTDP, LRTDP, HDP). It also incorporates considerable work in speeding up the usual PWLC value function representation for POMDPs. You're welcome to try it out; please let me know if you have any questions.

ZMDP is now hosted on GitHub

Related Publications

Benchmark Problems

I have introduced a few benchmark problems in my papers. If you want to use these problems yourself, here is information on how to get them.

Links to Other POMDP Software

Trey Smith, <> [ Last modified: Sun Mar 3 19:51:52 2013 ]