inControl ep5 - Sean Meyn: Markov chains, networks, reinforcement learning, beekeeping and jazz
27 snips
Aug 18, 2022 AI Snips
Chapters
Transcript
Episode notes
Markov Chains Defined
- A Markov chain is a stochastic state-space model where the state is sufficient for future predictions.
- It generalizes dynamical systems by incorporating randomness.
Entering Queueing Networks
- Brian Anderson advised Meyn to study queueing networks and collaborate with P. R. Kumar at the University of Illinois.
- Meyn took his advice and delved into queueing networks despite having no prior experience.
Control's Impact on Queueing
- Control theory adds a practical, data-driven approach to queueing theory, contrasting with the exact computations favored in operations research.
- It emphasizes simpler models, online tuning, and parameterized decision rules.