{"id":1207,"date":"2022-04-05T16:39:08","date_gmt":"2022-04-05T16:39:08","guid":{"rendered":"https:\/\/meyn.ece.ufl.edu\/?page_id=1207"},"modified":"2022-04-05T16:39:08","modified_gmt":"2022-04-05T16:39:08","slug":"control-systems-and-reinforcement-learning","status":"publish","type":"page","link":"https:\/\/faculty.eng.ufl.edu\/meyn\/control-systems-and-reinforcement-learning\/","title":{"rendered":"Control Systems  and Reinforcement Learning"},"content":{"rendered":"<blockquote><p>Published by Cambridge University Press\u00a0 <a href=\"http:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/2021\/08\/SunsetCoverNoBird.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignright wp-image-971 size-medium\" src=\"http:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/2021\/08\/SunsetCoverNoBird-207x300.png\" alt=\"CS&amp;RL\" width=\"207\" height=\"300\" srcset=\"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/2021\/08\/SunsetCoverNoBird-207x300.png 207w, https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/2021\/08\/SunsetCoverNoBird-707x1024.png 707w, https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/2021\/08\/SunsetCoverNoBird-768x1113.png 768w, https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/2021\/08\/SunsetCoverNoBird-1060x1536.png 1060w, https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/2021\/08\/SunsetCoverNoBird-1413x2048.png 1413w, https:\/\/faculty.eng.ufl.edu\/meyn\/wp-content\/uploads\/sites\/671\/2021\/08\/SunsetCoverNoBird-scaled.png 1767w\" sizes=\"auto, (max-width: 207px) 100vw, 207px\" \/><\/a><\/p><\/blockquote>\n<p>They have kindly allowed me to provide free of charge a <a href=\"https:\/\/www.dropbox.com\/s\/2yi42rjj0bboijl\/CSRLonline.pdf?dl=0\">pre-publication draft<\/a>.<\/p>\n<p>I will maintain here a list of <a href=\"https:\/\/meyn.ece.ufl.edu\/csrl-resources\/\">resources<\/a>, links to <a href=\"https:\/\/meyn.ece.ufl.edu\/control-systems-and-reinforcement-learning\/discoveries\/\">discoveries<\/a>, and <a href=\"https:\/\/meyn.ece.ufl.edu\/csrl-errata\/\">errata<\/a> as I find them.<\/p>\n<p>&nbsp;<\/p>\n<p>The organization is unique:<\/p>\n<ul>\n<li class=\"p1\">Part I: Fundamentals Without Noise<\/li>\n<li class=\"p1\">Part II: Reinforcement Learning and Stochastic Control<\/li>\n<\/ul>\n<p>The first half of the book is accessible to a reader without any background in probabilistic methods.\u00a0 Undergraduate probability is desirable, but far more important is calculus and linear algebra (the same background required for a first course covering state space models and control).<\/p>\n<p>A <a href=\"https:\/\/meyn.ece.ufl.edu\/courses\/control-systems-reinforcement-learning\/\">new course<\/a> based on Part I of the book was introduced at UF in the spring of 2021.\u00a0 The course is unique in part because no probability theory is required.<\/p>\n<p>Elements of Part II are included in my <a href=\"https:\/\/meyn.ece.ufl.edu\/courses\/stochastic-control\/\">stochastic control<\/a> course, and in <a href=\"https:\/\/meyn.ece.ufl.edu\/courses\/stochastic-processes\/\">stochastic methods 2<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Published by Cambridge University Press\u00a0 They have kindly allowed me to provide free of charge a pre-publication draft. I will maintain here a list of resources, links to discoveries, and errata as I find them. &nbsp; The organization is unique: Part I: Fundamentals Without Noise Part II: Reinforcement Learning and Stochastic Control The first half [&hellip;]<\/p>\n","protected":false},"author":1347,"featured_media":971,"parent":0,"menu_order":5,"comment_status":"closed","ping_status":"closed","template":"page-templates\/page-section-nav.php","meta":{"_acf_changed":false,"inline_featured_image":false,"featured_post":"","footnotes":"","_links_to":"","_links_to_target":""},"class_list":["post-1207","page","type-page","status-publish","has-post-thumbnail","hentry"],"acf":[],"_links":{"self":[{"href":"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-json\/wp\/v2\/pages\/1207","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-json\/wp\/v2\/users\/1347"}],"replies":[{"embeddable":true,"href":"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-json\/wp\/v2\/comments?post=1207"}],"version-history":[{"count":0,"href":"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-json\/wp\/v2\/pages\/1207\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-json\/wp\/v2\/media\/971"}],"wp:attachment":[{"href":"https:\/\/faculty.eng.ufl.edu\/meyn\/wp-json\/wp\/v2\/media?parent=1207"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}