This paper introduces a methodology to generate review-based natural language justifications supporting personalized suggestions returned by a recommender system. The hallmark of our strategy lies in the fact that natural language justifications are adapted to the different contextual situations in which the items will be consumed. In particular, our strategy relies on the following intuition. Just like the selection of the most suitable item is influenced by the contexts of usage, a justification that supports a recommendation should vary as well. As an example, depending on whether a person is going out with her friends or her family, a justification that supports a restaurant recommendation should include different concepts and aspects. Accordingly, we designed a pipeline based on distributional semantics models to generate a vector space representation of each context. Such a representation, which relies on a term-context matrix, is used to identify the most suitable review excerpts that discuss aspects that are particularly relevant for a certain context. The methodology was validated by means of two user studies, carried out in two different domains (i.e., movies and restaurants). Moreover, we also analyzed whether and how our justifications impact on the perceived transparency of the recommendation process and allow the user to make more informed choices. As shown by the results, our intuitions were supported by the user studies.