Publication
Zeitschrift für Operations Research
Paper

Generalized Markovian decision processes

View publication

Abstract

A general discrete decision process is formulated which includes both undiscounted and discounted semi-Markovian decision processes as special cases. A policy-iteration algorithm is presented and shown to converge to an optimal policy. Properties of the coupled functional equations are derived. Primal and dual linear programming formulations of the optimization problem are also given. An application is given to Markov ratio decision process. © 1977 Physica-Verlag.

Date

Publication

Zeitschrift für Operations Research

Authors

Share