Temporal difference learning with kernels for pricing american-style options

Abstract : We propose in this paper to study the problem of estimating the cost-to-go function for an infinite-horizon discounted Markov chain with possibly continuous state space. For implementation purposes, the state space is typically discretized. As soon as the dimension of the state space becomes large, the computation is no more practicable, a phenomenon referred to as the curse of dimensionality. The approximation of dynamic programming problems is therefore of major importance. A powerful method for dynamic programming, often referred to as neuro-dynamic programming, consists in representing the Bellman function as a linear combination of a priori defined functions, called neurons. In this article, we propose an alternative approach very similar to temporal differences, based on functional gradient descent and using an infinite kernel basis.Furthermore, our algorithm, though aimed at infinite dimensional problems, is implementable in practice. We prove the convergence of this algorithm, and show applications on e.g. bermudan option pricing.
Type de document :
Article dans une revue
Optimization Online, 2005
Liste complète des métadonnées

Contributeur : Aurélien Arnoux <>
Soumis le : vendredi 25 avril 2014 - 10:37:16
Dernière modification le : mercredi 6 décembre 2017 - 16:46:01


  • HAL Id : hal-00983326, version 1



Kengy Barty, Jean-Sébastien Roy, Cyrille Strugarek. Temporal difference learning with kernels for pricing american-style options. Optimization Online, 2005. 〈hal-00983326〉



Consultations de la notice