Rollout, Policy Iteration, and Distributed Reinforcement Learning

Released on by Dimitri Bertsekas
preview-18

  • Rollout, Policy Iteration, and Distributed Reinforcement Learning Book Detail

  • Author : Dimitri Bertsekas
  • Release Date : 2021-08-20
  • Publisher : Athena Scientific
  • Genre : Computers
  • Pages : 498
  • ISBN 13 : 1886529078
  • File Size : 7,7 MB
DOWNLOAD BOOK

Rollout, Policy Iteration, and Distributed Reinforcement Learning by Dimitri Bertsekas PDF Summary

Book Description: The purpose of this book is to develop in greater depth some of the methods from the author's Reinforcement Learning and Optimal Control recently published textbook (Athena Scientific, 2019). In particular, we present new research, relating to systems involving multiple agents, partitioned architectures, and distributed asynchronous computation. We pay special attention to the contexts of dynamic programming/policy iteration and control theory/model predictive control. We also discuss in some detail the application of the methodology to challenging discrete/combinatorial optimization problems, such as routing, scheduling, assignment, and mixed integer programming, including the use of neural network approximations within these contexts. The book focuses on the fundamental idea of policy iteration, i.e., start from some policy, and successively generate one or more improved policies. If just one improved policy is generated, this is called rollout, which, based on broad and consistent computational experience, appears to be one of the most versatile and reliable of all reinforcement learning methods. In this book, rollout algorithms are developed for both discrete deterministic and stochastic DP problems, and the development of distributed implementations in both multiagent and multiprocessor settings, aiming to take advantage of parallelism. Approximate policy iteration is more ambitious than rollout, but it is a strictly off-line method, and it is generally far more computationally intensive. This motivates the use of parallel and distributed computation. One of the purposes of the monograph is to discuss distributed (possibly asynchronous) methods that relate to rollout and policy iteration, both in the context of an exact and an approximate implementation involving neural networks or other approximation architectures. Much of the new research is inspired by the remarkable AlphaZero chess program, where policy iteration, value and policy networks, approximate lookahead minimization, and parallel computation all play an important role.

Disclaimer: www.yourbookbest.com does not own Rollout, Policy Iteration, and Distributed Reinforcement Learning books pdf, neither created or scanned. We just provide the link that is already available on the internet, public domain and in Google Drive. If any way it violates the law or has any issues, then kindly mail us via contact us page to request the removal of the link.

Reinforcement Learning, second edition

Reinforcement Learning, second edition

File Size : 67,67 MB
Total View : 7082 Views
DOWNLOAD

The significantly expanded and updated new edition of a widely used text on reinforcement learning, one of the most active research areas in artificial intellig

Reinforcement Learning and Optimal Control

Reinforcement Learning and Optimal Control

File Size : 19,19 MB
Total View : 7804 Views
DOWNLOAD

This book considers large and challenging multistage decision problems, which can be solved in principle by dynamic programming (DP), but their exact solution i