Ranking Score Explained

Kia ora, thanks for your interest in how we calculate an experience's ranking score. It's at the core of Rankers so I'm pleased you're curious.

The ranking score percentage is used to compare and sort experiences in ranking tables. It is not necessarily a direct measurement of the quality of a particular experience as rated by its customers. I've found it a useful tool to allow me to find the best experiences with confidence. But I've also found it important to read the customer reviews before making any final judgements!

We calculate an experience's ranking score using a multi-factor data model instead of a raw data average (mean). This model takes into account several important questions. For instance - is there a trusted body of reviews? What is the age of a review and is the review from a credible source?

Below you'll find details around some of the important factors that went into calculating the ranking score for Hot Water Beach.

If you have any questions or comments about our ranking score calculation please get in touch at info@rankers.co.nz. We don't believe this is perfect or complete so we're always interested in ways we might make improvements.

Cymen Crick's avatar

Cymen Crick

Rankers Owner

Hot Water Beach

Valid Reviews

255 Valid Reviews

The Hot Water Beach experience has a total of 255 valid reviews. There are no invalid reviews that are excluded from the calculation. Reviews can be excluded only when a reviewer is not verified or after an investigation by our team determines the reviewer is not genuine.

Below is the distribution of ratings for the 255 valid reviews:

Rating Count Percentage
10/10 71
28%
9/10 65
25%
8/10 53
21%
7/10 36
14%
6/10 8
3%
5/10 10
4%
4/10 7
3%
3/10 4
2%
2/10 1
0%
1/10 0
0%

82.78% Average

The raw data average (mean) for all the Hot Water Beach valid reviews is 82.78% and is based on 255 valid reviews. This value is not used to calculate the ranking score and it only provided here as a comparison to the weighted average.

Face-to-Face Reviews

226 Face-to-Face Reviews

The Rankers team meets with travellers while they’re in New Zealand and conducts face-to-face surveys. These reviews, in our opinion, are the most trusted in the industry and represent a critical control sample. To our knowledge, we are the only travel review website in the world that has gone to this extent.

More about face-to-face reviews

Within the 255 valid reviews, the experience has 226 face-to-face reviews collected during interviews by our team.

Below is the distribution of ratings for the 226 face-to-face reviews:

Rating Count Percentage
10/10 64
28%
9/10 58
26%
8/10 47
21%
7/10 31
14%
6/10 7
3%
5/10 10
4%
4/10 6
3%
3/10 3
1%
2/10 0
0%
1/10 0
0%

83.19% Average

The raw data average (mean) for all the Hot Water Beach face-to-face reviews is 83.19% and is based on 226 face-to-face reviews. This value is not used to calculate the ranking score and it only provided here for comparison purposes.

Weighted Average

81.16%

Rankers calculates a weighted mean as a base average on which we can improve. Individual review's ratings are given a weight based on several factors. The weight of a review determines the overall impact it'll have on the final weighted average.

Recent reviews have more weight as they are more relevant and reflect the experience as it currently operates. Over time reviews become less relevant and loose their impact on the ranking score.

Low rating reviews carry slightly less weight. This dampens the effect of very low ratings for every experience across the board. This is especially important when the experience has few reviews overall and a single negative rating can grossly mischaracterise an experience. Consistent poor reviews will still result in the experience receiving a comparitively low ranking score.

Credible sources provide reviews that can be trusted. If we have verified a reviewer is genuine via a face-to-face meeting then the review carries additional weight.

Reviewer Rating Age Relative Weight
Ian 2/10 33 days 48%
Travel1 9/10 278 days 100%
Himanshu Jaswal 10/10 522 days 89%
Mike 3/10 2164 days 2%
Edward Lowe 4/10 2256 days 3%
Patricio Vidal 10/10 2348 days 4%
Jeny Smolders 10/10 2597 days 4%
Elli 5/10 2907 days 2%
Carina Weber 5/10 2909 days 2%
David 10/10 2912 days 3%
Gretha 9/10 2914 days 3%
May 4/10 2937 days 2%
Rik van der Niet 6/10 2939 days 3%
Lea Celerier 8/10 2965 days 3%
Leigh Dodds 8/10 2982 days 3%
Elizabeth Braidotti 9/10 3022 days 3%
Bernd Muller 9/10 3149 days 3%
Jana Ebelina 9/10 3153 days 3%
Celina 8/10 3153 days 2%
Alberto 8/10 3167 days 2%
Camilla Geert 4/10 3180 days 2%
Bas Marinus 9/10 3184 days 2%
Virginia Saez 7/10 3188 days 2%
Philipp 3/10 3189 days 1%
Matthew Palmer 7/10 3190 days 2%
Andre 8/10 3192 days 2%
Sybille 8/10 3192 days 2%
Stefan Hahn 6/10 3197 days 2%
Manibod Vannaphone 8/10 3197 days 2%
Alex Schott 10/10 3200 days 2%
Matias Santos 5/10 3206 days 2%
Ruben Toorwe 7/10 3206 days 2%
Pablo Garcia 10/10 3207 days 2%
Boukje Diijkstra 9/10 3208 days 2%
Aaron Stalley 3/10 3208 days 1%
Clement Delrue 7/10 3212 days 2%
Theo Pargemin 8/10 3212 days 2%
Floren Hoenschler 7/10 3214 days 2%
Johannes Koch 7/10 3214 days 2%
Feline Herbst 9/10 3216 days 2%
Dawn Howard 7/10 3217 days 2%
Verena 7/10 3218 days 2%
Jakub Ira 7/10 3220 days 2%
Michal Putnar 10/10 3220 days 2%
Ales Bronec 10/10 3220 days 2%
Aneta Hambergeroua 7/10 3220 days 2%
Patrick Veber 4/10 3220 days 2%
Megan Lenox 9/10 3222 days 2%
Briony 5/10 3229 days 2%
David Schelensky 7/10 3229 days 2%
Theresa Huelk 5/10 3236 days 2%
Eric Hertort 10/10 3237 days 2%
Christian Meyer 10/10 3237 days 2%
Miriam Hack 8/10 3242 days 2%
Livia and Dave 7/10 3246 days 2%
Rafaella 8/10 3272 days 2%
Sebastian and Susanna 6/10 3286 days 2%
Jessica and Leonie 7/10 3287 days 2%
Fabienne Strobel 10/10 3292 days 2%
Julia Waenninger 7/10 3299 days 2%
Jan B 6/10 3300 days 2%
Dan 10/10 3311 days 2%
Ahmed Mohsen Aly 7/10 3320 days 2%
Richard Thompson 9/10 3352 days 2%
Emma Keegan 7/10 3534 days 2%
Elisabeth Ringswandl 8/10 3554 days 2%
Thomas Haslbeck 7/10 3554 days 2%
Stuart Cook 10/10 3555 days 2%
Daniela Wall 8/10 3555 days 2%
Carmen 10/10 3556 days 2%
Jade Cownley 10/10 3579 days 2%
Martha Taatz 10/10 3600 days 2%
Maria Ulitzsch 10/10 3641 days 2%
Antoine Lerin 7/10 3648 days 1%
isabel Zander 10/10 3899 days 1%
Franz Birkefeld 10/10 3910 days 1%
Rainer 8/10 3924 days 1%
Laura 9/10 3925 days 1%
Phil Bromby 10/10 3928 days 1%
Joanna Mulcahy 10/10 3928 days 1%
Hirsch Svenja 9/10 3934 days 1%
Mahr Svenja 10/10 3934 days 1%
Konrad Ullmann 9/10 3937 days 1%
Lukas Lehmeyer 9/10 3937 days 1%
Friederike Kranzin 10/10 3938 days 1%
Sarah 7/10 3939 days 1%
Daniel Garcia Dezgado 10/10 3940 days 1%
Jennifer Garner 10/10 3944 days 1%
Emeline Brocard 10/10 3945 days 1%
Marvin Koever 9/10 3945 days 1%
Luisa Bach 10/10 3947 days 1%
Klaus Petersen 8/10 3949 days 1%
Alex Sheldon 9/10 3956 days 1%
Piotr Jurkowski 10/10 3975 days 1%
Anne Collet 9/10 3983 days 1%
Evian Bolz 7/10 3988 days 1%
Chen Levin 8/10 3988 days 1%
nimrod yaron 10/10 3989 days 1%
Pioter Jurkowski 10/10 3990 days 1%
Alex Artigues 8/10 3993 days 1%
Brian 6/10 4082 days 1%
Mark Hayes 10/10 4112 days 1%
Anton Thisted 9/10 4263 days 0%
Josefine Sjodin 9/10 4263 days 0%
Katie Fleck 9/10 4263 days 0%
FlyingKiwiGirl 8/10 4265 days 0%
Mark Faulk 8/10 4265 days 0%
Iban Dupont 7/10 4279 days 0%
Guillaume Boudrand 8/10 4279 days 0%
Lorraine Doyle 6/10 4282 days 0%
Sean Hurley 5/10 4282 days 0%
LiseMarie Leger 9/10 4286 days 0%
Jeremy Eng 7/10 4296 days 0%
Stephanie Belanger 10/10 4299 days 0%
Brendon Furney 10/10 4300 days 0%
Sebastian 7/10 4300 days 0%
Selina Lott 8/10 4300 days 0%
Annika 5/10 4300 days 0%
Fabian 8/10 4300 days 0%
Jonas Herrmann 5/10 4300 days 0%
Missy and Chaz 8/10 4306 days 0%
Neele & Philipp 5/10 4306 days 0%
Fabian Koitka 7/10 4316 days 0%
Jill Fischer 10/10 4324 days 0%
Christina Rodewald 9/10 4329 days 0%
Andre and Marina 9/10 4329 days 0%
Jo Sutton 9/10 4355 days 0%
Lauret Stulemeyer 9/10 4374 days 0%
Aurelie Morin 8/10 4377 days 0%
Paul Lawrence 7/10 4384 days 1%
Andreas and Christine and Nora Busch 10/10 4385 days 1%
Doan 10/10 4391 days 1%
Milena Heinrich 10/10 4392 days 1%
Faassen 9/10 4394 days 1%
Julie Lamart 9/10 4395 days 1%
Henzen 8/10 4395 days 1%
Eric and Jen Popma 9/10 4396 days 1%
suemax 10/10 4630 days 1%
Jonathan Tuthill 9/10 4646 days 1%
Heiner Reinecke 10/10 4653 days 1%
Jens Moller 7/10 4654 days 1%
Chris Sylvia 9/10 4654 days 1%
Selwindt 9/10 4655 days 1%
Michael Touzer 8/10 4656 days 1%
A Ormsby 8/10 4658 days 1%
Jaroslav Gajdos 8/10 4664 days 1%
Carolin Haas 7/10 4671 days 1%
Thomas 10/10 4672 days 1%
Peter Dellen 8/10 4673 days 1%
Tom Pratt 9/10 4673 days 1%
Elise Violet 8/10 4674 days 1%
Eline Vakentijn 8/10 4675 days 1%
Lepied 8/10 4677 days 1%
Slangen 8/10 4683 days 1%
Samplonius 9/10 4685 days 1%
Guillaume Milcent 9/10 4687 days 1%
Roberto Hallblom 8/10 4688 days 1%
Mike1952 7/10 4690 days 1%
Sandy & Michaela 8/10 4703 days 1%
CMJ 8/10 4721 days 1%
Nick Selzler 9/10 4735 days 1%
Manuela Zimmerti 7/10 4753 days 1%
Robert Carswell 7/10 4758 days 1%
Steve Neilson 10/10 4759 days 1%
Natascha & Greg 8/10 4764 days 1%
Andy Lever 10/10 4767 days 1%
Waldemar Schuler 9/10 4768 days 1%
Rudy Witt 9/10 4768 days 1%
JadesWorld 8/10 4782 days 1%
Max Grimmeiss 8/10 4966 days 1%
Ralph & Marloes Meyers 7/10 4995 days 1%
Julie Norton 10/10 4997 days 1%
Lindsey Clough 8/10 5005 days 1%
Knapen 4/10 5007 days 1%
Andreas Blessing 10/10 5007 days 1%
Franzi & Tobi 10/10 5007 days 1%
Boehmer 6/10 5011 days 1%
Nicola Thackray 10/10 5014 days 1%
Wheeler 8/10 5016 days 1%
Andy Johnson 9/10 5018 days 1%
Kari Tervo 4/10 5019 days 1%
Katy Bourne 9/10 5021 days 1%
Roman & Esther 10/10 5024 days 1%
Lauren McKeone 4/10 5025 days 1%
Alan Munday 9/10 5025 days 1%
S and A Koehue 10/10 5027 days 1%
Mirka Tinterova 9/10 5029 days 1%
Anne 10/10 5029 days 1%
Claudio 10/10 5033 days 1%
H Hensen 7/10 5041 days 1%
Selina Mueller 10/10 5041 days 1%
Birgette Weiner 7/10 5041 days 1%
Valerie 10/10 5041 days 1%
Tayler Gray 9/10 5042 days 1%
Mike 9/10 5043 days 1%
Luise Jaeger 5/10 5045 days 1%
David 9/10 5045 days 1%
Jessie Currie 3/10 5046 days 1%
Jonathon Heaney 7/10 5048 days 1%
Sue & Graham Mullin 9/10 5050 days 1%
Elinor Bell 9/10 5050 days 1%
Brandt 9/10 5052 days 1%
penz 9/10 5270 days 1%
Gea Middelbos 10/10 5324 days 1%
David 8/10 5325 days 1%
joycevanb 9/10 5331 days 1%
heather Cardinal 8/10 5347 days 1%
Bjorn Sall 6/10 5373 days 1%
Brian Bishop 10/10 5378 days 1%
Silke Seemann 8/10 5383 days 1%
Matilda Hansson 9/10 5383 days 1%
Mark and Natasha UK 8/10 5394 days 1%
Kay Beaumont 8/10 5394 days 1%
David Milner 9/10 5398 days 1%
Gail Mckinstry 7/10 5398 days 1%
Elisabeth Egerup 10/10 5399 days 1%
Mike Brunt 10/10 5400 days 1%
Wolfgang Engelke 10/10 5401 days 1%
Peter Koeck 10/10 5401 days 1%
Sue Bennett 9/10 5402 days 1%
Will Jemma 10/10 5405 days 1%
Fam Leinden 8/10 5414 days 1%
Mick Thexton 8/10 5415 days 1%
Arne van Schol 8/10 5416 days 1%
Wim Van Gastel 9/10 5418 days 1%
Sebastien Briant 8/10 5419 days 1%
Ines Diana 10/10 5419 days 1%
Pizzanelli 7/10 5419 days 1%
Jakob Jurgen 8/10 5434 days 1%
Beute Hjel 10/10 5436 days 1%
Sabine Locker 8/10 5436 days 1%
deanlaw 10/10 5465 days 1%
menzel 9/10 5465 days 1%
ursinab 9/10 5466 days 1%
friasj 10/10 5466 days 1%
Lynn Maguire 10/10 5468 days 1%
jameswhite 10/10 5474 days 1%
gereldineb 9/10 5476 days 1%
asiacritics 10/10 5482 days 1%
Sandra M 9/10 5484 days 1%
Tim Beuzeval 9/10 5489 days 1%
Christy 9/10 5492 days 1%
Rebecca Jenner 9/10 5493 days 1%
Hansjoerg Ehrmann 9/10 5493 days 1%
Christine Van Den Berg Michele Imbach 10/10 5505 days 1%
Wim Put 8/10 5508 days 1%
Karen Fisher 9/10 5508 days 1%
CarinaB1 10/10 5710 days 1%
BryonyS 10/10 5714 days 1%
BouterG 9/10 5722 days 1%
Arjan Muis 8/10 5728 days 1%
Mikey 9/10 5731 days 1%
Viktoria Stoffel 10/10 5733 days 1%
Falk 9/10 5742 days 1%
WiebkeS 10/10 5742 days 1%

Adjustments

No Adjustment

Several adjustments to the weighted average may be added to improve relevancy and credibility. Hot Water Beach does not meet the criteria for any of these adjustments to apply.

Balancing Adjustment

2.69% Adjustment

Every experience's review score is adjusted to balance out the disproportional number of negative reviews that are contributed.

You won't be surprised to learn that disgruntled folk are more likely to leave a review than happy ones. They are motivated to share their experience and warn others. We consider this a good thing and it's why reading the reviews is important. However we've learned it can misrepresent the experience in a more overall sense.

We apply a balancing adjustment to counteract this effect and ensure the ranking score is a more fair representation of the experience. This adjustment is applied equally to all experiences.

Final Ranking Score

84%

The final ranking score once any adjustments, ratings, and rounding has been applied. This value is recalculated each day and a short rolling average is applied. Therefore it may not be precisely accurate based on the other values presented.