Skip to main content
SLU publication database (SLUpub)

Research article2014Peer reviewedOpen access

MDPtoolbox: a multi-platform toolbox to solve stochastic dynamic programming problems

Chades, Iadine; Chapron, Guillaume; Cros, Marie-Josée; Garcia, Frédérick; Sabbadin, Régis

Abstract

Stochastic dynamic programming (SDP) or Markov decision processes (MDP) are increasingly being used in ecology to find the best decisions over time and under uncertainty so that the chance of achieving an objective is maximised. To date, few programs are available to solve SDP/MDP. We present MDPtoolbox, a multi-platform set of functions to solve Markov decision problems (MATLAB, GNU Octave, Scilab and R). MDPtoolbox provides state-of-the-art and ready to use algorithms to solve a wide range of MDPs. MDPtoolbox is easy to use, freely available and has been continuously improved since 2004. We illustrate how to use MDPtoolbox on a dynamic reserve design problem.

Published in

Ecography
2014, Volume: 37, number: 9, pages: 916-920
Publisher: WILEY-BLACKWELL

    UKÄ Subject classification

    Ecology

    Publication identifier

    DOI: https://doi.org/10.1111/ecog.00888

    Permanent link to this page (URI)

    https://res.slu.se/id/publ/64039