Our reviews, ratings & rules of engagement image 1

Our reviews, ratings & rules of engagement

Words by Simon Difford

Unlike numerous other websites and most competitions, we don't charge to review and rate a product-be that a wine, beer, spirit, liqueur, soda, book, or item of bar equipment. However, due to the work involved, we do charge a fee for creating dedicated product pages and are committed to working with brands to ensure information and packaging are as up-to-date as possible.

In May 2016, we introduced Difford's Guide Quality Stamps to certify the technical quality and contents of drink products. Quality Stamps encourage producers to supply additional product information.

Our reviews and Quality Stamps are aimed at informing and reassuring trade (drinks industry) and consumers alike.

Score out of five

I have been continuously publishing my ratings for products out of five since I published my first drinks magazine in August 1997. Hotels have long been rated out of five, so it seemed an obvious and simple scale. Plus, Dan, our art director, warned against graphically illustrating scales out of 10, 20, or even 100.

That said, assessors such as Mr Parker, who use the 100 scale, seem to start at around 50 points and score only between 50 and 100 points. So, it could be argued they are actually only scoring out of 50 and that I am merely dividing their scale by a factor of ten when I score out of five.

Considering this, and after studying others' rating scales, I believe the following table best illustrates our Difford's rating scale compared to others:

ency 51 image

Sample solicitation

Most of the products reviewed are sent to us for review. We also buy items that we find interesting, but we rely on receiving samples to afford to review and reassess the thousands of products on this website.

If you have a product you'd like reviewed then please first complete our online Product Listing form giving as much information as possible. We will then give you the correct address to send your sample(s).

We expect, and take on trust, that samples are representative of regular production. We make a point of retrospectively highlighting and publicising cases where we believe we have been duped.

Reviews of sponsors' & advertisers' products

To afford to run one of the world's biggest drinks websites, we accept sponsorship and advertising from drinks companies. This ranges from straightforward banner advertising to sponsorship of cocktail recipes, but whatever form such product promotions on this site take, we do not consciously let this financial support affect our judgement. Indeed, we are particularly rigorous in our reviews of sponsors' products and reassess them frequently.

Honest & unbiased reviews

We aim to write dispassionate, honest and unbiased reviews. We do not favour products that sponsor or advertise with us (see above). On the contrary, we only accept cocktail sponsorships for products that we like and have rated at least four stars. We do not accept sponsorship for products we haven't tried or don't like. To paraphrase Victor Bergeron, anyone who says I'm generous when rating sponsor's products is a dirty stinker.

Blind tasting

I don't believe in tasting blind, so we don't. Fact is, the presentation of food and drink affects our perception of it. The same goes for the packaging and marketing surrounding a product. Consumers and, indeed, bartenders are affected by these, and so we want to assess products with the same influences they have. That said, I believe we are a lot less influenced by packaging and marketing and more swayed by good liquid.

Value-for-money

As a general rule in life, "you get what you pay for". Now and then, superb quality is available at a very affordable price. Most really great products - especially high-end whiskies - are over-priced but we enjoy a market economy, supplies are limited and people are more than prepared to pay the prices being asked. In our rating of products we do not penalise for products being expensive, we do, however, score generously to products that we consider excellent value-for-money.

"Craft" versus mega brand

Value-for-money applies to some of the largest brands in the drinks industry, offering consistently good products that are made available to mass-market consumers at an affordable price. E.g. Tio Pepe sherry, Ketel One vodka, Johnnie Walker Scotch and Heineken beer.

We recognise they enjoy economies of scale, but similarly, such brands are also challenged by consistency and the logistics of broad distribution. We are proud not to knock the big brands for the sake of knocking the big brands and reserve our criticism for the ones we believe deserve it - big or small. We are also proud to support small independent producers and offer a platform for their products.

Bar reviews

The pubs and bars we review are among the best in the world. Some have a great atmosphere; some have an idyllic location; others have bar staff who are not only friendly but also make great drinks and a rare few have all this and more.

To be adjudged worthy of a high Difford's Guide rating, a hostelry must in addition to great drinks (whether they be wine, beer or cocktails) also offer good service, preferably bar snacks/food and certainly be the kinda of place you'd want to go back to time and time again.

• Unlike other bar reviewers, we usually review bars without prior notice of our visit unless necessitated by restricted entry in venues such as members' bars. And we prefer and expect to pay for all our drinks.

• We focus on the best bars in the world's most visited and influential cities. (We haven't made it to or found reviewers in them all yet.) The cities selected are influenced by our peers.

• We consider a bar to be only as good as our worst drink/ experience. Even if we've only visited once and had a bad time, then the chances are you'll have a bad drink/experience too.

• We only review bars, not restaurants. In case of doubt, bars welcome drinkers without a requirement to purchase food.

• We don't review nightclubs and other venues which are more focused on music and dance than drinks. (The editor can't and won't dance.)

• We don't review pop-ups or bars open for only a short periods - we seek the world's truly great bars, bars that strive to last for decades and to be appreciated by successive generations. Longevity is ultimately the best test of a bar.

• We rate bars out of five and score according to our overall experience: drinks, service, ambience, décor, cleanliness, and food. Unless a bar has some redeeming feature, such as heritage or atmosphere, we generally don't write about bars scoring less than 4 out of 5.

• We try not to visit bars during their first few weeks of operation in the belief that this is an unfair period to judge a venue properly and that truly discerning drinkers are not preoccupied with continually seeking the next new thing. We seek the best, not the newest. If we do visit a bar during a 'soft launch' discounted drinks period, then we will not review that bar until it is fully open.

• We aim to continually revisit bars to update reviews and amend our rating where appropriate.

Personal taste

I (Simon Difford) personally sample every product reviewed and rated here on Difford's Guide, so the ratings on this website are inevitably governed by my personal tastes, likes, and dislikes. While I have visited a large number of the bars reviewed, sadly, I have not been to them all. We often rely on the taste, discernment, and judgment of our local reviewers. However, we do choose these reviewers carefully.

We realize that you also have a choice of reviewer, and I liken selecting a reviewer whose judgment to trust to choosing a DJ-your own tastes need to align with theirs. I hope we'll one day have the chance to enjoy a drink together and that we'll find our tastes similar. In the meantime, I'm sure we both consider ourselves to have good taste. We are Discerning Drinkers.

Welcome to Difford's Guide

All editorial and photography on this website is copyright protected

© Odd Firm of Sin 2024