一、iDLab实验室

实验室主页： http://www.idlab-tsinghua.com...

The Intelligent Driving Laboratory (iDLAB) is a part of the School of Vehicle and Mobility (SVM) at Tsinghua University. This lab focuses on advanced automatic control and machine learning algorithms, and their applications on autonomous driving, connected vehicles, driver assistance and driver behavior analysis, etc. Our research interests are loosely divided into four categories: (1) Perception, decision and control for autonomous vehicles and driver assistance systems; (2) Reinforcement learning and optimal control; (3) Distributed estimation, learning and control; and (4) Large-scale optimization and control of eco-automation and electrified powertrain. We have achieved a series of important research results and peer-reviewed publications publicly available through this website.

二、书籍简介

《Reinforcementlearning and control》撰写从2018年启动，至今已历三年，目的是为清华大学开设的同名研究生课程“强化学习与控制”，准备英文授课讲义。最新版本的前5章已上传iDLab课题组网站，欢迎大家下载分享。

下载地址： http://www.idlab-tsinghua.com...\_types=

一、内容简介

汽车的智能化变革促使整个行业发生了翻天覆地的变化，自动驾驶、云控协同、驾驶辅助等一系列新技术如雨后春笋般涌现，它们在提升地面车辆行驶性能的同时，也为解决交通事故、排放污染、城市拥堵等问题提供了一条可行的途径。近年随着机器学习和自动控制的融合发展，以模仿人类大脑学习机制为原理的强化学习（RL，Reinforcement Learning）技术迅速进入人们的视野，它为大规模复杂系统的学习及动态系统的高实时在线控制提供了一套极具前景的解决方案。

图2 强化学习型自动驾驶框架

但是该方法的工程应用尚属于起步阶段。一个重要的原因是该方法既具有理论学习的复杂度，又具有工程实践的挑战性。理论上，它隶属于统计学习和最优控制领域的交叉结合部，涉及的数理基础较深，涵盖面较广，难以学习本质机理。实践上，入门者不易短期内熟练掌握关联的编程工具，而且若对算法原理不熟悉，难以对代码进行工程化调整，不能发挥算法的应有性能。为应对上述挑战，《Reinforcement Learning and Control》一书面向工程应用领域的科研人员和技术开发者，按照原理剖析、主流算法、典型示例三位一体的原则，逐一介绍该方法在动态系统的学习和控制领域的理论和应用，涉及马尔科夫决策、蒙特卡洛学习、时序差分学习、函数近似、策略梯度学习、近似动态规划、深度强化学习等知识点。

二、内容提要

全书总共包括11章。依次介绍RL概况及基础知识，免模型学习的蒙特卡洛法及时序差分法，带模型学习的动态规划法，间接型及直接型RL，无穷时域及有限时域的近似动态规划，深度强化学习和RL的各类拾遗。

样稿展示

[url]http://groups.tianya.cn/post-235369-d8a8454e7e0c49fd978c604ed6ec3aa5-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-d8a8454e7e0c49fd978c604ed6ec3aa5-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-771da083c76541e69d37cb5cacd6c641-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-771da083c76541e69d37cb5cacd6c641-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-920f6fe09b244ac486ab29ea6118a056-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-920f6fe09b244ac486ab29ea6118a056-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-1bce927dd98c400e87a001ed274d79ac-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-1bce927dd98c400e87a001ed274d79ac-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-b06636f8068d4785a6fb73630e9828a1-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-b06636f8068d4785a6fb73630e9828a1-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-19c1d1928794465282b1e87d85f4ef52-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-19c1d1928794465282b1e87d85f4ef52-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-c79b1281841c465ea21db826ca5e13b4-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-c79b1281841c465ea21db826ca5e13b4-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-5a7c5fa2f9644a10b3de3e6d1f6f67cc-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-5a7c5fa2f9644a10b3de3e6d1f6f67cc-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-5e6702fff6144760ac63b4126963435d-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-5e6702fff6144760ac63b4126963435d-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-00e22f4963bf4ed9b3b7866db5268ca3-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-00e22f4963bf4ed9b3b7866db5268ca3-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-55c405ba02604c45aef4d12065b19db3-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-55c405ba02604c45aef4d12065b19db3-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-a1862c84d2f24c78b0f619ae8f215ae5-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-a1862c84d2f24c78b0f619ae8f215ae5-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-16c83e8fc3714d0eb16eed1579f34e91-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-16c83e8fc3714d0eb16eed1579f34e91-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-370551f2976c4970a69e438b04eb506c-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-370551f2976c4970a69e438b04eb506c-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-938fe1f9e36e4937a7970f02d07ac9a5-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-938fe1f9e36e4937a7970f02d07ac9a5-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-7cd42c7502f54ee48913413a9a4a1146-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-7cd42c7502f54ee48913413a9a4a1146-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-b453e08ce68f4912a0ed50e73f246cf7-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-b453e08ce68f4912a0ed50e73f246cf7-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-7c24f3941bd649658d7234f00a353cf4-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-7c24f3941bd649658d7234f00a353cf4-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-c0bd4abda49c4671b56b8768110a0466-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-c0bd4abda49c4671b56b8768110a0466-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-50afed4b888a4060860cf565a84d2b08-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-50afed4b888a4060860cf565a84d2b08-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-25ba5426bb8a4bf38e49bc2ca6e2bfb9-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-25ba5426bb8a4bf38e49bc2ca6e2bfb9-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-e3a49a84440e448daf610d41aaf93050-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-e3a49a84440e448daf610d41aaf93050-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-bd9fbd246867450a904d09fb5b21023a-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-bd9fbd246867450a904d09fb5b21023a-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-460dad54e12c4c09831f6ea117f8a278-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-460dad54e12c4c09831f6ea117f8a278-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-390167ce2cad40018468763334dd2900-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-390167ce2cad40018468763334dd2900-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-6357d998b4574c72b7d27c350096f6ef-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-6357d998b4574c72b7d27c350096f6ef-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-76af189920d94d0598ec6a779e25d4e3-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-76af189920d94d0598ec6a779e25d4e3-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-387784e12978462cbcb55d62878d95b8-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-387784e12978462cbcb55d62878d95b8-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-d0cef055d8c0401c849d8c50db8470d1-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-d0cef055d8c0401c849d8c50db8470d1-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-31b7475b5da54e5c875aac30fb02e188-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-31b7475b5da54e5c875aac30fb02e188-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-86e35615430048e8b4d8e34538b9cd5c-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-86e35615430048e8b4d8e34538b9cd5c-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-3d2ae9efe3ce40599076439aac15d96a-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-3d2ae9efe3ce40599076439aac15d96a-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-3a07d7dab33f45c8b268db2725caf755-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-3a07d7dab33f45c8b268db2725caf755-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-02402c4d3fc84fcba48084ea9b0b025f-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-02402c4d3fc84fcba48084ea9b0b025f-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-8e45bb5e34b34dba96e1873014d178df-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-8e45bb5e34b34dba96e1873014d178df-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-5a4c6c3510184057afb6ea982ec44b0d-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-5a4c6c3510184057afb6ea982ec44b0d-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-d8d6ecbe2e4d456c858b51560a4614b8-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-d8d6ecbe2e4d456c858b51560a4614b8-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-494be08bf8544daa8dc0d572589b4974-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-494be08bf8544daa8dc0d572589b4974-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-a3817d9d60314d2eb0528e3c01229ed6-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-a3817d9d60314d2eb0528e3c01229ed6-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-4d23058b2993415896c6543248dc234b-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-4d23058b2993415896c6543248dc234b-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-d691955b8975437681fdc77dd2e62848-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-d691955b8975437681fdc77dd2e62848-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-5acc8626acbe4cb9a8e2f9447fd0f78f-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-5acc8626acbe4cb9a8e2f9447fd0f78f-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-1a483803fa5d4337b042ddc58360d7a7-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-1a483803fa5d4337b042ddc58360d7a7-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-4995fb07403f48069631dd874ad0a5a3-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-4995fb07403f48069631dd874ad0a5a3-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-5c4cf8e4a3b0401cafb251337a1e3504-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-5c4cf8e4a3b0401cafb251337a1e3504-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-a82dbbf5bf554a24b2740efe7d9c4c78-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-a82dbbf5bf554a24b2740efe7d9c4c78-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-0364b1df9c77417491fdbe3decf7c978-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-0364b1df9c77417491fdbe3decf7c978-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-e9b04a71181a41cf97a7a11c1d61d4bc-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-e9b04a71181a41cf97a7a11c1d61d4bc-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-7cb78ac95b1a4ac0a641eff93f7c79bb-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-7cb78ac95b1a4ac0a641eff93f7c79bb-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-9dd98f83fa0d4f5e9e44e40eef594e3a-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-9dd98f83fa0d4f5e9e44e40eef594e3a-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-bdb8f294f50f4b0fb80d1f6c1287ad89-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-bdb8f294f50f4b0fb80d1f6c1287ad89-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-3823a1f318bd4f0f94ee11edb3803f5d-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-3823a1f318bd4f0f94ee11edb3803f5d-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-03925bf351674080a686ac0273b6e1d9-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-03925bf351674080a686ac0273b6e1d9-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-52d765a479ba4755b05644a999f93171-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-52d765a479ba4755b05644a999f93171-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-c62a046337794c3cb386a21a3841f604-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-c62a046337794c3cb386a21a3841f604-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-db60dfed812c4e90835196c62d69d3b9-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-db60dfed812c4e90835196c62d69d3b9-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-2fbeb2064dfc49bd8bdd51de767f741b-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-2fbeb2064dfc49bd8bdd51de767f741b-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-ee9f626281664ab1beb27cc1d590a6fc-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-ee9f626281664ab1beb27cc1d590a6fc-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-f5a2127cbad14b0fa18c39f2101f9346-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-f5a2127cbad14b0fa18c39f2101f9346-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-55756ad709c4496d8e490d629f4aaf2a-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-55756ad709c4496d8e490d629f4aaf2a-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-1cff0faf861245ec806f6be92036f444-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-1cff0faf861245ec806f6be92036f444-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-08c2b8983a464c1a8c22b2d8429b5a37-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-08c2b8983a464c1a8c22b2d8429b5a37-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-d7a800cd47974b608a993a98420c76ec-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-d7a800cd47974b608a993a98420c76ec-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-293e9edf3015408bb2b37ae9fb9671b9-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-293e9edf3015408bb2b37ae9fb9671b9-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-87b5e4ba7ff44c1fb841e2feedbffbe7-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-87b5e4ba7ff44c1fb841e2feedbffbe7-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-416fee690cc54f74ac35a647fa5cefb1-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-416fee690cc54f74ac35a647fa5cefb1-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-5aed8a8719144cad994712681eb1d5e9-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-5aed8a8719144cad994712681eb1d5e9-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-e43df0dbee9146ea9361e82054c59309-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-e43df0dbee9146ea9361e82054c59309-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-007c4e3e3ab44fc9bab2dbe9f4c49aec-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-007c4e3e3ab44fc9bab2dbe9f4c49aec-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-498ba3f82b104cf8b841f152425478b1-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-498ba3f82b104cf8b841f152425478b1-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-6d01afaa110e49a4994ec39045fcf04c-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-6d01afaa110e49a4994ec39045fcf04c-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-56ba1eea00cd408ca4283a3a8c1b2cdb-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-56ba1eea00cd408ca4283a3a8c1b2cdb-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-8121ed38fd5342a6840353a56c2a90ee-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-8121ed38fd5342a6840353a56c2a90ee-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-08a7eaa809ce4b21b7c1ffa1015842f0-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-08a7eaa809ce4b21b7c1ffa1015842f0-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-2ab0670fac444c0da5359f25da18fc01-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-2ab0670fac444c0da5359f25da18fc01-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-e1d371fb70ac4d71b12ee64619140553-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-e1d371fb70ac4d71b12ee64619140553-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-341c5d0de1914de692e077453dbc4380-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-341c5d0de1914de692e077453dbc4380-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-7ebfcc5a0b474e319e895efa8d9bb35c-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-7ebfcc5a0b474e319e895efa8d9bb35c-1.shtml[/url]
[url]http://groups.tianya.cn/post-235369-88bd5c1623394f7497e9781a815cc643-1.shtml[/url]
[url]http://groups.tianya.cn/m/post-235369-88bd5c1623394f7497e9781a815cc643-1.shtml[/url]