h2r/pomdp-py

Can this solve Dec MDPs?

Opened this issue · 1 comments

Hi,

I'm looking for a Dec-MDP solver that I can easily integrate with my existing python code. Could this package be used for the same? If not, do you have any suggestions/directions I can look at? Any help is much appreciated. Thanks.

Best,
Prasanth

There isn’t a “plug-and-play” for DecMDP yet. In principle it is possible (I think even straightforward) to use the existing interfaces to define a Dec-MDP, and then code up a variant based on the existing POUCT or POMCP implementation for planning. I know there is effort in trying pomdp_py for I-POMDP and DecPOMDP (#14). If I get a chance I would improve the multi-agent potential of this library as well. Maybe the next milestone.

If you make an attempt feel free to send a pull request!