Bayesian Decision-making Algorithms - Alexander Terenin, 2026. Working draft on Bayesian decision making algorithms, including decision-making under uncertainty and explore-exploit tradeoffs.
Bayesian Optimization - Roman Garnett, 2023. Theory-first textbook with a free HTML edition.