rcss - R Package

R package for approximating the value functions in Markov decision processes (under linear state dynamics, convex reward and convex scrap functions) using convex piecewise linear functions.