ep8 - Anuradha Annaswamy: Adaptive Control - From the "Brave Era" to Reinforcement Learning and Back
Listen now
Description
In this episode, our guest is Anuradha Annaswamy. Anu is the Director of the Active-Adaptive Control Laboratory and Senior Research Scientist at the Massachusetts Institute of Technology in the Deparment of Mechanical Engineering.  We delve into adaptive control and its exciting history, ranging from the Brave Era to the audacious X15 tests and to modern intersections with Reinforcement Learning. Outline 02:15 - Anu's background 05:20 - What is adaptation? 08:30 - The Brave Era 15:17 - The X15 accident  23:16 - Exploration vs exploitation 28:35 - Beyond linearity and time invariance 45:05 - Adaptive control vs Reinforcement Learning 52:12 - The future of adaptive control 54:34 - Outro Episode links Anu's lab:  http://aaclab.mit.edu/ NCCR Symposium: https://tinyurl.com/bdz84p4c Book - Stable adaptive systems: https://tinyurl.com/mw4saame X-15 Flight 3-65-97: https://tinyurl.com/2kbe7nsy Paper - Adaptive Control and the NASA X-15-3 Flight Revisited: https://tinyurl.com/2p83k7ez Paper - A historical perspective of adaptive control and learning: https://tinyurl.com/yck89rcd Paper -Adaptive Control and Intersections with Reinforcement Learning: https://tinyurl.com/yc27rsyd KYP Lemma: https://tinyurl.com/mkf35jjt Persistence of excitation: https://tinyurl.com/bpfwp9n9 Dual control: https://tinyurl.com/ywduzm5x Paper - Robust adaptive control in the presence of bounded disturbances:  https://tinyurl.com/4pztx23z Paper -  Reinforcement learning is direct adaptive optimal control https://tinyurl.com/appnjzyn MRAC: https://tinyurl.com/bdzzphju Self Tuning Control: https://tinyurl.com/3mjs3skm Podcast info Podcast website: https://www.incontrolpodcast.com/ Apple Podcasts: https://tinyurl.com/5n84j85j Spotify: https://tinyurl.com/4rwztj3c RSS: https://feeds.buzzsprout.com/1632769.rss Youtube: https://tinyurl.com/bdbvhsj6 Facebook: https://tinyurl.com/3z24yr43 Twitter: https://twitter.com/IncontrolP Instagram: https://www.instagram.com/incontrol_podcast/ Acknowledgments and sponsors This episode was supported by the National Centre of Competence in Research on «Dependable, ubiquitous automation» and the IFAC Activity fund. The podcast benefits from the help of an incredibly talented and passionate team. Special thanks to B. Seward, E. Cahard, F. Banis, F. Dörfler, J. Lygeros, as well as the ETH and mirrorlake studios. Music was composed by A New Element.  Support the show
More Episodes
Outline00:00 - Intro02:14 - Early steps in control05:36 - L1 control17:09 - Relay feedback systems24:32 - Agile robotic maneuvers29:31 - Abstractions and models41:59 - Causality49:35 - Markets and power grids1:00:20 - Role of network structure1:05:03 - Data, systems, and society1:16:17 - On...
Published 10/17/24
Outline00:00 - Intro00:49 - Early education and PhD in control10:35 - Non-negative linear algebra & modelling uncertainty principle22:50 - Influence of Willems & the Frisch scheme34:27 - Subspace identification & stochastic behavioural system theory38:39 - Stanford experience with...
Published 08/21/24
Published 08/21/24