Ranking Score Explained

Hi, thanks for your interest in how we calculate an experience's ranking score. It's at the core of Rankers so I'm pleased you're curious.

The ranking score percentage is used to compare and sort experiences in ranking tables. It is not necessarily a direct measurement of the quality of a particular experience as rated by its customers. I've found it a useful tool to allow me to find the best experiences with confidence. But I've also found it important to read the customer reviews before making any final judgements!

We calculate an experience's ranking score using a multi-factor data model instead of a raw data average (mean). This model takes into account several important questions. For instance - is there a trusted body of reviews? What is the age of a review and is the review from a credible source?

Below you'll find details around some of the important factors that went into calculating the ranking score for Te Anau Glowworm Caves.

If you have any questions or comments about our ranking score calculation please get in touch at info@rankers.co.nz. We don't believe this is perfect or complete so we're always interested in ways we might make improvements.

Cymen Crick's avatar

Cymen Crick

Rankers Owner

Te Anau Glowworm Caves

Valid Reviews

190 Valid Reviews

The Te Anau Glowworm Caves experience has a total of 191 reviews. There are 190 valid reviews that are included when calculating the ranking score and 1 invalid review that are excluded from the calculation. Reviews can be excluded only when a reviewer is not verified or after an investigation by our team determines the reviewer is not genuine.

Below is the distribution of ratings for the 190 valid reviews:

Rating Count Percentage
10/10 49
26%
9/10 43
23%
8/10 41
22%
7/10 34
18%
6/10 9
5%
5/10 8
4%
4/10 5
3%
3/10 0
0%
2/10 1
1%
1/10 0
0%

82.05% Average

The raw data average (mean) for all the Te Anau Glowworm Caves valid reviews is 82.05% and is based on 190 valid reviews. This value is not used to calculate the ranking score and it only provided here as a comparison to the weighted average.

Face-to-Face Reviews

176 Face-to-Face Reviews

The Rankers team meets with travellers while they’re in New Zealand and conducts face-to-face surveys. These reviews, in our opinion, are the most trusted in the industry and represent a critical control sample. To our knowledge, we are the only travel review website in the world that has gone to this extent.

More about face-to-face reviews

Within the 190 valid reviews, the experience has 176 face-to-face reviews collected during interviews by our team.

Below is the distribution of ratings for the 176 face-to-face reviews:

Rating Count Percentage
10/10 45
26%
9/10 39
22%
8/10 38
22%
7/10 34
19%
6/10 8
5%
5/10 8
5%
4/10 3
2%
3/10 0
0%
2/10 1
1%
1/10 0
0%

82.10% Average

The raw data average (mean) for all the Te Anau Glowworm Caves face-to-face reviews is 82.10% and is based on 176 face-to-face reviews. This value is not used to calculate the ranking score and it only provided here for comparison purposes.

Weighted Average

83.66%

Rankers calculates a weighted mean as a base average on which we can improve. Individual review's ratings are given a weight based on several factors. The weight of a review determines the overall impact it'll have on the final weighted average.

Recent reviews have more weight as they are more relevant and reflect the experience as it currently operates. Over time reviews become less relevant and loose their impact on the ranking score.

Low rating reviews carry slightly less weight. This dampens the effect of very low ratings for every experience across the board. This is especially important when the experience has few reviews overall and a single negative rating can grossly mischaracterise an experience. Consistent poor reviews will still result in the experience receiving a comparitively low ranking score.

Credible sources provide reviews that can be trusted. If we have verified a reviewer is genuine via a face-to-face meeting then the review carries additional weight.

Reviewer Rating Age Relative Weight
Dorothy and Graham Glen 9/10 2989 days 100%
Dan Coates 9/10 3222 days 83%
Dominik 9/10 3222 days 83%
Holloway 10/10 3245 days 82%
Christina 6/10 3313 days 67%
Barbara Knops 9/10 3315 days 76%
Manu Liberta 10/10 3325 days 77%
Bruno 9/10 3335 days 75%
Kirsty Smith 10/10 3358 days 74%
Sophia Satter 8/10 3369 days 72%
Afiya Levy 10/10 3590 days 57%
Johannes Eisel 6/10 3599 days 49%
Alexander Mattea 5/10 3599 days 43%
Timea Bagosi 9/10 3602 days 56%
Riviere 8/10 3613 days 54%
Dani 8/10 3615 days 54%
Benoit Leclerc 7/10 3617 days 51%
Anna Stoehr 10/10 3635 days 54%
Kai Krchmar 6/10 3688 days 43%
Kristina Farkas 5/10 3983 days 22%
Sophia Kadel 10/10 4013 days 26%
Laura and Marie 7/10 4019 days 24%
Rachel S 10/10 4027 days 25%
Joris Giullemot 8/10 4335 days 3%
Laura Metz 7/10 4346 days 2%
Hubertus Thost 7/10 4346 days 2%
Amanda 4/10 4361 days 0%
S B 10/10 4374 days 0%
M K 10/10 4374 days 0%
Maya Bakker-deDreu 8/10 4382 days 36%
Christin Woelk 9/10 4662 days 36%
Maria Klister 7/10 4682 days 34%
Lydia Kleinkoenen 9/10 4702 days 36%
Jessica Grewe 9/10 4702 days 36%
Hannah Lia-Isis Kubillus 9/10 4702 days 36%
Jan Zimmerman 8/10 4713 days 36%
Margaret and Derek McNeil 10/10 4773 days 37%
Frank and Suzanne 8/10 4788 days 36%
RollingMoon 8/10 4849 days 36%
Marcel & Kim Meichtry 7/10 5069 days 34%
Howell Davies 5/10 5072 days 28%
Baas 7/10 5072 days 34%
Pete & Pat Etheridge 8/10 5072 days 36%
Siegfried Richter 7/10 5073 days 34%
Melanie Mathiak 10/10 5075 days 37%
Sig Schrattner 8/10 5075 days 36%
Rebecca Doehl 7/10 5076 days 34%
Seth & Carla 7/10 5077 days 34%
Gabriele Wendt 9/10 5077 days 36%
Tadej Ferjan 8/10 5077 days 36%
Mary Mitchell 10/10 5077 days 37%
Emily Wikston 9/10 5078 days 36%
Andreas & Leonie Fehr 10/10 5084 days 37%
Horst Langstein 9/10 5085 days 36%
Marco Scheiber 9/10 5086 days 36%
Friedrich Kaltner 10/10 5088 days 37%
Frank & Julia 10/10 5091 days 37%
Thyg Lingdal 10/10 5091 days 37%
Nicole van Bergen 8/10 5091 days 36%
Mike & April Prince 7/10 5105 days 34%
Alfred & Henrike 8/10 5117 days 36%
Lyn Stainton 6/10 5166 days 32%
Ken Talan 10/10 5394 days 37%
Jon_and_Family 9/10 5398 days 36%
Gertz 10/10 5402 days 37%
Katarina Bokor 8/10 5406 days 36%
Mark Franklin 6/10 5406 days 32%
Gordon Agent 10/10 5406 days 37%
Maureen Hardy 8/10 5406 days 36%
AJ van Pelt 8/10 5406 days 36%
Werner and Rita 9/10 5413 days 36%
Richard Dudfield 10/10 5415 days 37%
Sayaka 7/10 5415 days 34%
Urs and Isabella 7/10 5416 days 34%
Juliane Kleiu 10/10 5419 days 37%
Linda Kremer 9/10 5420 days 36%
Rebecca Johnston 9/10 5420 days 36%
David Mellard 10/10 5421 days 37%
Bruce & Elaine Chote 10/10 5421 days 37%
Paul Nickson 8/10 5421 days 36%
Monique 8/10 5421 days 36%
Beat & Connie 10/10 5423 days 37%
Alex Stil 9/10 5423 days 36%
Pein van Nosrt 7/10 5428 days 34%
Raith 9/10 5428 days 36%
Elise van Haastert 8/10 5428 days 36%
Claudia 10/10 5430 days 37%
Carolin Ranner 6/10 5430 days 32%
Winskowsky 9/10 5431 days 36%
Hvid 9/10 5445 days 36%
Judith K. 6/10 5447 days 32%
Ruben and Jetske 7/10 5447 days 34%
Roy Seymour 9/10 5448 days 36%
Tom Hill 10/10 5452 days 37%
Ruua Reyrink 7/10 5453 days 34%
Patrick Hugener 9/10 5453 days 36%
JohnHaestad 4/10 5457 days 24%
dollimyxture 10/10 5488 days 37%
aggiemary04 10/10 5580 days 37%
victoriauk 4/10 5702 days 24%
Baumgarten 8/10 5730 days 36%
travelbunnyadventures 8/10 5733 days 36%
Don & Geraldine 10/10 5769 days 37%
Matthias & Ceristiane 8/10 5781 days 36%
Hilary and Chris Ayton 9/10 5782 days 36%
Lis & Rob Tate 9/10 5784 days 36%
ccthornton100 10/10 5794 days 37%
Bob Kusesia 10/10 5795 days 37%
Yssel de Schepper 7/10 5800 days 34%
Janny Meerdinnk Veldboow 7/10 5800 days 34%
Arie Ascher 9/10 5801 days 36%
Wolfgang Engelke 10/10 5803 days 37%
Thomas K 9/10 5803 days 36%
Loleit 7/10 5815 days 34%
Mattias Thorm 9/10 5816 days 36%
Vincente Garrido 4/10 5817 days 24%
R Gilge 10/10 5818 days 37%
Erik Hummelmose 8/10 5818 days 36%
Ian E 6/10 5818 days 32%
Nadine Schaee 9/10 5819 days 36%
Belinda Godhard 2/10 5819 days 17%
Uwe Rieper 10/10 5821 days 37%
E.M. Prideaux 10/10 5836 days 37%
Elizabeth E 8/10 5838 days 36%
Stevens Frans 8/10 5839 days 36%
Heinrich Hax 9/10 5842 days 36%
tanh 7/10 5869 days 34%
Stephanie Steiner 8/10 5888 days 36%
Julia May 9/10 5895 days 36%
X Neils 7/10 5906 days 34%
Sarah Smith 5/10 5910 days 28%
Anna 6/10 5914 days 32%
OliverG1 7/10 6116 days 34%
Philipp 5/10 6128 days 28%
JasminA 5/10 6128 days 28%
ChristinaV 8/10 6138 days 36%
JuergenSchnitzer 9/10 6144 days 36%
AstridVG 7/10 6144 days 34%
NatasjaV 7/10 6146 days 34%
JimmyK 7/10 6146 days 34%
MarcoJ 9/10 6148 days 36%
LucyPoland 9/10 6149 days 36%
Stolz 7/10 6152 days 34%
BrzezinskaM 10/10 6153 days 37%
AndreB 10/10 6153 days 37%
Linda 7/10 6160 days 34%
Susan 8/10 6161 days 36%
Byleveld 7/10 6161 days 34%
JoseB 8/10 6162 days 36%
JetteG 10/10 6162 days 37%
CarolF 7/10 6163 days 34%
Rachel 9/10 6177 days 36%
Claire 7/10 6177 days 34%
Denise 8/10 6179 days 36%
Denk 8/10 6190 days 36%
Klalis 10/10 6193 days 37%
Thomas 4/10 6196 days 24%
Mike 5/10 6197 days 28%
Debbie Mossman 9/10 6203 days 36%
Johann 10/10 6205 days 37%
Carina 10/10 6207 days 37%
Mat 8/10 6245 days 36%
Anette 7/10 6247 days 34%
midlands_missus 8/10 6250 days 36%
David 7/10 6306 days 34%
Suyin 10/10 6326 days 37%
Franz 10/10 6499 days 37%
Jennifer Baulch 7/10 6504 days 34%
George Jeffs 10/10 6507 days 37%
Jacob 9/10 6511 days 36%
Aharon 10/10 6526 days 37%
D.A. Mulder 8/10 6527 days 36%
Knol 8/10 6529 days 36%
Cole Penelope 8/10 6532 days 36%
Jody 7/10 6540 days 34%
Anna 5/10 6540 days 28%
Pauline Thai 8/10 6547 days 36%
Dan Adamson 8/10 6547 days 36%
Stephen Brightman 8/10 6556 days 36%
Madeleine Rowland 8/10 6556 days 36%
Bronwyn Gaby 9/10 6574 days 36%
Free_ride 9/10 6590 days 36%
Michael 9/10 6613 days 36%
Raul 10/10 6863 days 37%
TeamFlorida 9/10 6865 days 36%
TeamFlorida 8/10 6865 days 36%
James 9/10 6878 days 36%
Rudi 10/10 6882 days 37%
Rolf Kruger 10/10 6906 days 37%
Brian 10/10 6910 days 37%

Adjustments

Several adjustments to the weighted average are added to improve relevancy and credibility. These adjustments apply equally to all experiences that meet the criteria.

Sample Size Adjustment

No Adjustment

A reasonable number of reviews are necessary in order for the average to be credible and for an experience to take a prime position within the ranking tables. As such, experiences with only a few reviews have a moderated score. This does not mean that the experience or the reviews can't be trusted. The Te Anau Glowworm Caves experience has plenty of reviews and does not meet the criteria for any adjustment.

Recent Reviews Adjustment

-4.05% Adjustment

There may be an adjustment if this experience hasn't received any reviews within the last 44 days. However the Te Anau Glowworm Caves experience does not meet the criteria for any adjustment.

In addition, an experience's ranking score may be adjusted for each day there is no new ranking. After 1 day the adjustment comes into effect. The maximum number of days that can be adjusted for is 200 days. Due to the seasonal nature of many businesses, this adjustment is applied dynamically throughout the year.

The Te Anau Glowworm Caves experience has been adjusted for 200 days. Adjustments are according to the following table.

Days Adjustment
197 -3.99%
198 -4.01%
199 -4.03%
200 -4.05%
201 -4.07%
202 -4.09%
203 -4.11%

Balancing Adjustment

3.11% Adjustment

Every experience's review score is adjusted to balance out the disproportional number of negative reviews that are contributed.

You won't be surprised to learn that disgruntled customers are more likely to leave a review than happy ones. They are motivated to share their experience and warn others. We consider this a good thing and it's why reading the reviews is important. However we've learned it can misrepresent the experience in a more overall sense.

We apply a balancing adjustment to counteract this effect and ensure the ranking score is a more fair representation of the experience. This adjustment is applied equally to all experiences.

Final Ranking Score

83%

The final ranking score once any adjustments, ratings, and rounding has been applied. This value is recalculated each day and a short rolling average is applied. Therefore it may not be precisely accurate based on the other values presented.