I used to work for an A/B testing company, and we used both contextual and non-contextual Bayesian multi-armed bandit approaches.

Here's a cool talk my former colleague Austin Rochford gave at the 2018 PyData NYC conference about how we implemented it and made it work at scale:

https://www.youtube.com/watch?v=vupP9MYXeFM