Be the first to rate this file! 42 downloads (last 30 days) File Size: 231.41 KB File ID: #25786

Markov Decision Processes (MDP) Toolbox

09 Nov 2009 (Updated 09 Nov 2009)

Code covered by the BSD License

Functions related to the resolution of discrete-time Markov Decision Processes.

File Information
Description	The MDP toolbox proposes functions related to the resolution of discrete-time Markov Decision Processes: backwards induction, value iteration, policy iteration, linear programming algorithms with some variants. The functions were developped with MATLAB (note that one of the functions requires the Mathworks Optimization Toolbox) by Iadine Chadès, Marie-Josée Cros, Frédérick Garcia, Régis Sabbadin of the Biometry and Artificial Intelligence Unit of INRA Toulouse (France). The version 3.0 (September 2009) adds several functions related to Reinforcement Learning and improves the handling of sparse matrices. For more detail see the README file. Toolbox page: http://www.inra.fr/mia/T/MDPtoolbox
MATLAB release	MATLAB 7.9 (2009b)
Zip File Content
HTML Files	MDP toolbox functions, MDP toolbox functions , mdp_bellman_operator description , mdp_check description , mdp_check_square_stochastic description , mdp_computePpolicyPRpolicy description , mdp_computePR description , mdp_eval_policy_iterative description , mdp_eval_policy_matrix description , mdp_eval_policy_optimality, mdp_eval_policy_TD_0 description , mdp_example_forest description , mdp_example_rand description , mdp_finite_horizon description , mdp_LP description , mdp_policy_iteration description , mdp_policy_iteration_modified description , mdp_Q_learning description , mdp_relative_value_iteration description , mdp_span description , mdp_value_iteration description , mdp_value_iteration_bound_iter description , mdp_value_iterationGS description , mdp_verbose and mdp_silent description , Presentation of MDP toolbox documentation
Other Files	license.txt, MDPtoolbox/AUTHORS, MDPtoolbox/COPYING, MDPtoolbox/documentation/arrow.gif, MDPtoolbox/documentation/BIA.png, MDPtoolbox/documentation/INRA.png, MDPtoolbox/documentation/meandiscrepancy.jpg, MDPtoolbox/mdp_bellman_operator.m, MDPtoolbox/mdp_check.m, MDPtoolbox/mdp_check_square_stochastic.m, MDPtoolbox/mdp_computePpolicyPRpolicy.m, MDPtoolbox/mdp_computePR.m, MDPtoolbox/mdp_eval_policy_iterative.m, MDPtoolbox/mdp_eval_policy_matrix.m, MDPtoolbox/mdp_eval_policy_optimality.m, MDPtoolbox/mdp_eval_policy_TD_0.m, MDPtoolbox/mdp_example_forest.m, MDPtoolbox/mdp_example_rand.m, MDPtoolbox/mdp_finite_horizon.m, MDPtoolbox/mdp_LP.m, MDPtoolbox/mdp_policy_iteration.m, MDPtoolbox/mdp_policy_iteration_modified.m, MDPtoolbox/mdp_Q_learning.m, MDPtoolbox/mdp_relative_value_iteration.m, MDPtoolbox/mdp_silent.m, MDPtoolbox/mdp_span.m, MDPtoolbox/mdp_value_iteration.m, MDPtoolbox/mdp_value_iteration_bound_iter.m, MDPtoolbox/mdp_value_iterationGS.m, MDPtoolbox/mdp_verbose.m, MDPtoolbox/README

Tags for This File
Everyone's Tags	control design, dynamic programming, markov decision process, optimization
Tags I've Applied
Add New Tags	Please login to tag files.

Please login to add a comment or rating.

Updates
09 Nov 2009	Add all authors names

Tag Activity for this File
Tag	Applied By	Date/Time
markov decision process	Marie-Josee Cros	09 Nov 2009 12:24:55
optimization	Marie-Josee Cros	09 Nov 2009 12:24:55
control design	Marie-Josee Cros	09 Nov 2009 12:24:55
dynamic programming	Marie-Josee Cros	09 Nov 2009 12:24:55

MATLAB Central Terms of Use

NOTICE: Any content you submit to MATLAB Central, including personal information, is not subject to the protections which may be afforded information collected under other sections of The MathWorks, Inc. Web site. You are entirely responsible for all content that you upload, post, e-mail, transmit or otherwise make available via MATLAB Central. The MathWorks does not control the content posted by visitors to MATLAB Central and, does not guarantee the accuracy, integrity, or quality of such content. Under no circumstances will The MathWorks be liable in any way for any content not authored by The MathWorks, or any loss or damage of any kind incurred as a result of the use of any content posted, e-mailed, transmitted or otherwise made available via MATLAB Central. Read the complete Terms prior to use.