The Multi-Armed Bandit Problem and Its Solutions

Lilian Weng · 8 years ago

The multi-armed bandit problem describes an algorithmic dilemma where systems must balance between exploiting known good options and exploring potentially better alternatives. Implementations exist for Bernoulli bandits in the lilianweng/multi-armed-bandit repository. This trade-off applies to real-world scenarios from restaurant selection to ad recommendation systems.