MDPtoolbox: a multi-platform toolbox to solve stochastic dynamic programming problems

Abstract

Stochastic dynamic programming (SDP) or Markov decision processes (MDP) are increasingly being used in ecology to find the best decisions over time and under uncertainty so that the chance of achieving an objective is maximised. To date, few programs are available to solve SDP/MDP. We present MDPtoolbox, a multi-platform set of functions to solve Markov decision problems (MATLAB, GNU Octave, Scilab and R). MDPtoolbox provides state-of-the-art and ready to use algorithms to solve a wide range of MDPs. MDPtoolbox is easy to use, freely available and has been continuously improved since 2004. We illustrate how to use MDPtoolbox on a dynamic reserve design problem.

Published in

Ecography
2014, volume: 37, number: 9, pages: 916-920
Publisher: WILEY-BLACKWELL

SLU Authors

• Chapron, Guillaume

  • Department of Ecology, Swedish University of Agricultural Sciences
    

UKÄ Subject classification

Ecology

Publication identifier

• DOI: https://doi.org/10.1111/ecog.00888

Permanent link to this page (URI)

https://res.slu.se/id/publ/64039