ep5 - Sean Meyn: Markov chains, networks, reinforcement learning, beekeeping and jazz

inControl

Aug 18 2022 • 53 mins

In this episode, our guest is Sean Meyn, Professor and Robert C. Pittman Eminent Scholar Chair in the Department of Electrical and Computer Engineering at the University of Florida. The episode features Sean’s adventures in the areas of Markov chains, networks and Reinforcement Learning (RL) as well as anecdotes and trivia about beekeeping and jazz.

Outline
00:00 - Intro
00:22 - Sean’s early steps
03:53 - Markov chains
08:45 - Networks
18:26 - Stochastic approximation
25:00 - Reinforcement Learning
38:57 - The intersection of Reinforcement Learning and  Control
42:37 - Favourite theorem
44:05 - Beekeeping and jazz
48:47 - Outro

Episode links
Sean’s website: https://meyn.ece.ufl.edu/
Sean’s books: shorturl.at/CFGRY (and T. Sargent's review: shorturl.at/hlGNR)
G. Zames: shorturl.at/JPRWX (see also: shorturl.at/chiw5)
State space model: shorturl.at/hST07
The life and work of A.A. Markov: shorturl.at/qsv35
Fluid model: shorturl.at/HKN56
M/M/1 queue: shorturl.at/dQW36
Borkar-Meyn theorem: shorturl.at/eSTV4
NCCR Automation Symposia: shorturl.at/csv03 (see also shorturl.at/ekpZ3)
V. Konda’s PhD Thesis: shorturl.at/bdrv7

Support the show

Podcast info
Podcast website: https://www.incontrolpodcast.com/
Apple Podcasts: https://tinyurl.com/5n84j85j
Spotify: https://tinyurl.com/4rwztj3c
RSS: https://tinyurl.com/yc2fcv4y
Youtube: https://tinyurl.com/bdbvhsj6
Facebook: https://tinyurl.com/3z24yr43
Twitter: https://twitter.com/IncontrolP
Instagram: https://tinyurl.com/35cu4kr4

Acknowledgments and sponsors
This episode was supported by the National Centre of Competence in Research on «Dependable, ubiquitous automation» and the IFAC Activity fund. The podcast benefits from the help of an incredibly talented and passionate team. Special thanks to L. Seward, E. Cahard, F. Banis, F. Dörfler, J. Lygeros, ETH studio and mirrorlake . Music was composed by A New Element.

You Might Like

Hidden Brain
Hidden Brain
Hidden Brain, Shankar Vedantam
Radiolab
Radiolab
WNYC Studios
Science Friday
Science Friday
Science Friday and WNYC Studios
StarTalk Radio
StarTalk Radio
Neil deGrasse Tyson
Sasquatch Chronicles
Sasquatch Chronicles
Sasquatch Chronicles - Bigfoot Encounters
Something You Should Know
Something You Should Know
Mike Carruthers | OmniCast Media | Cumulus Podcast Network
Paranormal Mysteries Podcast
Paranormal Mysteries Podcast
Paranormal Mysteries | Unexplained Supernatural Stories
This Podcast Will Kill You
This Podcast Will Kill You
Exactly Right Media – the original true crime comedy network
Tooth & Claw: True Stories of Animal Attacks
Tooth & Claw: True Stories of Animal Attacks
Wes Larson, Jeff Larson, Mike Smith | QCODE
Science Vs
Science Vs
Spotify Studios
The Confessionals
The Confessionals
Merkel Media
Blurry Creatures
Blurry Creatures
Blurry Creatures
Real Ghost Stories Online
Real Ghost Stories Online
Real Ghost Stories Online | Paranormal, Supernatural & Horror Radio