ep 5 - Sean Meyn: Markov chains, networks, reinforcement learning, beekeeping and jazz
Description
In this episode, our guest is Sean Meyn, Professor and Robert C. Pittman Eminent Scholar Chair in the Department of Electrical and Computer Engineering at the University of Florida. The episode features Sean’s adventures in the areas of Markov chains, networks and Reinforcement Learning (RL) as well as anecdotes and trivia about beekeeping and jazz.
Outline
00:00 - Intro
00:22 - Sean’s early steps
03:53 - Markov chains
08:45 - Networks
18:26 - Stochastic approximation
25:00 - Reinforcement Learning
38:57 - The intersection of Reinforcement Learning and Control
42:37 - Favourite theorem
44:05 - Beekeeping and jazz
48:47 - Outro
Episode links
Sean’s website: https://meyn.ece.ufl.edu/
Sean’s books: shorturl.at/CFGRY (and T. Sargent's review: shorturl.at/hlGNR)
G. Zames: shorturl.at/JPRWX (see also: shorturl.at/chiw5)
State space model: shorturl.at/hST07
The life and work of A.A. Markov: shorturl.at/qsv35
Fluid model: shorturl.at/HKN56
M/M/1 queue: shorturl.at/dQW36
Borkar-Meyn theorem: shorturl.at/eSTV4
NCCR Automation Symposia: shorturl.at/csv03 (see also shorturl.at/ekpZ3)
V. Konda’s PhD Thesis: shorturl.at/bdrv7
Podcast info
Podcast website: https://www.incontrolpodcast.com/
Apple Podcasts: https://podcasts.apple.com/us/podcast/incontrol/id1624068002
Spotify: https://open.spotify.com/show/7dZvt77XNtHxyrFqM8YTwf
RSS: https://feeds.buzzsprout.com/1632769.rss
Youtube: https://www.youtube.com/channel/UCl83hwBSVRLYj2NWS08P9bg/featured
Facebook: https://www.facebook.com/InControl-podcast-114303337936834
Twitter: https://twitter.com/IncontrolP
Instagram: https://www.instagram.com/incontrol_podcast/
Patreon: https://www.patreon.com/incontrolpodcast/
Acknowledgments and sponsors
This episode was supported by the National Centre of Competence in Research on «Dependable, ubiquitous automation» and the IFAC Activity fund.
The podcast benefits from the help of an incredibly talented and passionate team. Special thanks to A. Bastani, B. Sawicki, E. Cahard, F. Banis, F. Dörfler, J. Lygeros, as well as the ETH and mirrorlake studios.
Music was composed by A New Element.
Support the show
Outline00:00 - Intro02:14 - Early steps in control05:36 - L1 control17:09 - Relay feedback systems24:32 - Agile robotic maneuvers29:31 - Abstractions and models41:59 - Causality49:35 - Markets and power grids1:00:20 - Role of network structure1:05:03 - Data, systems, and society1:16:17 - On...
Published 10/17/24
Outline00:00 - Intro00:49 - Early education and PhD in control10:35 - Non-negative linear algebra & modelling uncertainty principle22:50 - Influence of Willems & the Frisch scheme34:27 - Subspace identification & stochastic behavioural system theory38:39 - Stanford experience with...
Published 08/21/24