Alex Gilotte, researcher at the Criteo AI Lab, details how counterfactual reasoning may be applied to evaluate a recommender system. The first posts introduce the topic and the intuitions behind the mathematics of counterfactual reasoning, and the later posts will detail how we dealt at Criteo with the practical challenges which arise when using those methods.