Multi-armed bandits See these combined and condensed notes of Chapters 2 and 6 from Bayesian Hackers book.