Ranking Score Explained

Hi there, thanks for your interest in how we calculate an experience's ranking score. It's at the core of Rankers so I'm pleased you're curious.

The ranking score percentage is used to compare and sort experiences in ranking tables. It is not necessarily a direct measurement of the quality of a particular experience as rated by its customers. I've found it a useful tool to allow me to find the best experiences with confidence. But I've also found it important to read the customer reviews before making any final judgements!

We calculate an experience's ranking score using a multi-factor data model instead of a raw data average (mean). This model takes into account several important questions. For instance - is there a trusted body of reviews? What is the age of a review and is the review from a credible source?

Below you'll find details around some of the important factors that went into calculating the ranking score for Shotover Jet.

If you have any questions or comments about our ranking score calculation please get in touch at info@rankers.co.nz. We don't believe this is perfect or complete so we're always interested in ways we might make improvements.

Nick Morrison's avatar

Nick Morrison

Rankers owner

Shotover Jet

Valid Reviews

267 Valid Reviews

The Shotover Jet experience has a total of 269 reviews. There are 267 valid reviews that are included when calculating the ranking score and 2 invalid reviews that are excluded from the calculation. Reviews can be excluded only when a reviewer is not verified or after an investigation by our team determines the reviewer is not genuine.

Below is the distribution of ratings for the 267 valid reviews:

Rating Count Percentage
10/10 86
32%
9/10 65
24%
8/10 50
19%
7/10 35
13%
6/10 18
7%
5/10 8
3%
4/10 2
1%
3/10 2
1%
2/10 0
0%
1/10 1
0%

84.38% Average

The raw data average (mean) for all the Shotover Jet valid reviews is 84.38% and is based on 267 valid reviews. This value is not used to calculate the ranking score and it only provided here as a comparison to the weighted average.

Face-to-Face Reviews

234 Face-to-Face Reviews

The Rankers team meets with travellers while they’re in New Zealand and conducts face-to-face surveys. These reviews, in our opinion, are the most trusted in the industry and represent a critical control sample. To our knowledge, we are the only travel review website in the world that has gone to this extent.

More about face-to-face reviews

Within the 267 valid reviews, the experience has 234 face-to-face reviews collected during interviews by our team.

Below is the distribution of ratings for the 234 face-to-face reviews:

Rating Count Percentage
10/10 70
30%
9/10 55
24%
8/10 46
20%
7/10 33
14%
6/10 18
8%
5/10 7
3%
4/10 2
1%
3/10 2
1%
2/10 0
0%
1/10 1
0%

83.42% Average

The raw data average (mean) for all the Shotover Jet face-to-face reviews is 83.42% and is based on 234 face-to-face reviews. This value is not used to calculate the ranking score and it only provided here for comparison purposes.

Weighted Average

85.93%

Rankers calculates a weighted mean as a base average on which we can improve. Individual review's ratings are given a weight based on several factors. The weight of a review determines the overall impact it'll have on the final weighted average.

Recent reviews have more weight as they are more relevant and reflect the experience as it currently operates. Over time reviews become less relevant and loose their impact on the ranking score.

Low rating reviews carry slightly less weight. This dampens the effect of very low ratings for every experience across the board. This is especially important when the experience has few reviews overall and a single negative rating can grossly mischaracterise an experience. Consistent poor reviews will still result in the experience receiving a comparitively low ranking score.

Credible sources provide reviews that can be trusted. If we have verified a reviewer is genuine via a face-to-face meeting then the review carries additional weight.

Reviewer Rating Age Face-to-Face Weight Relative Weight
Josh Mills 9/10 537 days true 65.17 100%
Alex Hah 9/10 579 days true 56.63 87%
Nicola 6/10 585 days true 55.46 85%
Jair 10/10 607 days true 51.28 79%
Louise Walker 10/10 628 days 39.56 61%
Hazel Norman 10/10 668 days true 40.67 62%
Gavin Moffatt 7/10 879 days true 14.87 23%
Jeeyoung Kim 10/10 889 days true 14.07 22%
Kim Rasun 10/10 889 days true 14.07 22%
Anke Vater 7/10 893 days true 13.76 21%
Joerg 7/10 894 days true 13.68 21%
George Bellwood 10/10 894 days true 13.68 21%
Katrina 8/10 910 days true 12.51 19%
Leonie Prendeville 6/10 939 days true 10.63 16%
Ivan Dupont 9/10 944 days true 10.34 16%
Madita and Lisann 9/10 978 days true 8.6 13%
Andy Jobst 6/10 1359 days true 5.57 9%
Antoine Vernay 3/10 1364 days true 5.14 8%
Andi Kermode 9/10 1512 days 4.43 7%
Patricia Erni 10/10 1612 days true 5.15 8%
Robert Erni 10/10 1612 days true 5.15 8%
Manuel Bleiker 9/10 1612 days true 5.15 8%
Laura Metz 10/10 1647 days true 5.09 8%
Hubertus Thost 9/10 1647 days true 5.09 8%
Emma Wallace 10/10 1668 days true 5.06 8%
Michael Sheridan 10/10 1674 days true 5.05 8%
Ben Sheridan 8/10 1674 days true 5.05 8%
Ruben Garcia Raiuiro 8/10 1683 days true 5.03 8%
Anne and Steve Bartlett 9/10 1685 days true 5.03 8%
Nicolas Trezeguet 7/10 1694 days true 5.02 8%
hendrik king 8/10 1907 days 3.89 6%
Andy Cummins 10/10 1986 days true 4.54 7%
Sharyn Crosby 10/10 1999 days 3.76 6%
Guillot 8/10 2006 days true 4.5 7%
Michal Maly 9/10 2025 days true 4.47 7%
Karin Genyn 10/10 2075 days true 4.39 7%
Michael Kretzschmar 9/10 2075 days true 4.39 7%
Tom and Jemima Rawlings 8/10 2080 days true 4.38 7%
Franz Schueler 10/10 2081 days true 4.38 7%
Meryem Buchwitz 10/10 2102 days true 4.34 7%
Karsten Meyer 8/10 2104 days true 4.34 7%
Michel Vourbraak 5/10 2105 days true 4.34 7%
TheHoon 9/10 2333 days 3.3 5%
Simon Rawlinson 10/10 2345 days true 3.95 6%
Norman UK 10/10 2356 days true 3.93 6%
Larry Curtiss 10/10 2361 days true 3.92 6%
Madeleine Mueller 10/10 2369 days true 3.91 6%
Jaap & Susanne 8/10 2373 days true 3.9 6%
Anne King 6/10 2373 days true 3.9 6%
Fleming Lauridsen 9/10 2373 days true 3.9 6%
Robert & Bridget Holden 9/10 2373 days true 3.9 6%
Howell Davies 10/10 2373 days true 3.9 6%
Linda Kosters 10/10 2373 days true 3.9 6%
Aridne Giraud 9/10 2376 days true 3.89 6%
Kolen 10/10 2376 days true 3.89 6%
Helen Chilton 8/10 2381 days true 3.89 6%
Tim Gamblen 10/10 2381 days true 3.89 6%
Jonathan Philp 7/10 2385 days true 3.88 6%
Clemens 6/10 2386 days true 3.88 6%
Heike 10/10 2388 days true 3.87 6%
Frank & Julia 7/10 2392 days true 3.87 6%
FlyKiwiFly 7/10 2393 days 3.22 5%
joerem 5/10 2393 days 3.22 5%
Colin Jenkins 8/10 2404 days true 3.85 6%
deJong 8/10 2459 days true 3.76 6%
Gerard Crothers 10/10 2462 days true 3.75 6%
Christoph 7/10 2464 days true 3.75 6%
Steve 9/10 2469 days true 3.74 6%
Helle Thomsen 10/10 2471 days true 3.74 6%
Wendy Ashmore 10/10 2471 days true 3.74 6%
James McColl 6/10 2485 days true 3.72 6%
katel86 10/10 2546 days 3.01 5%
Kimberly St Louis 10/10 2669 days 2.84 4%
Sam papworth 10/10 2698 days true 3.36 5%
Josephine Hartley 1/10 2698 days true 2.94 5%
Nicola Young 5/10 2698 days true 3.36 5%
Schury 10/10 2701 days true 3.36 5%
Rob O'Neill 9/10 2701 days true 3.36 5%
Katarina Bokor 10/10 2707 days true 3.35 5%
Sue Carren 8/10 2707 days true 3.35 5%
Mark Franklin 8/10 2707 days true 3.35 5%
Emma Cross 9/10 2709 days true 3.35 5%
John & Lorraine 8/10 2709 days true 3.35 5%
Hanggi 9/10 2710 days true 3.35 5%
Julie and Russ Charles 10/10 2712 days true 3.34 5%
Berger 10/10 2714 days true 3.34 5%
Juliane Kleiu 10/10 2720 days true 3.33 5%
Claudia 10/10 2720 days true 3.33 5%
Siggi Wick 10/10 2721 days true 3.33 5%
Birga 9/10 2727 days true 3.32 5%
Cameron and Kim 10/10 2729 days true 3.31 5%
Ebi & Beate 8/10 2730 days true 3.31 5%
taniadeanryanbrittany 8/10 2730 days 2.76 4%
Alice Galley 8/10 2733 days true 3.31 5%
Alice 9/10 2734 days true 3.31 5%
Alexander & Stephanie 8/10 2735 days true 3.3 5%
Lauren Pestell 8/10 2737 days true 3.3 5%
Bob Warne 9/10 2741 days true 3.29 5%
Jol Balder 4/10 2746 days true 3.09 5%
Irene and Thib Schneider 9/10 2746 days true 3.29 5%
Doris Schollenberger 9/10 2748 days true 3.28 5%
Roger Lows 9/10 2749 days true 3.28 5%
Glenn 9/10 2749 days true 3.28 5%
Ryan Tull 7/10 2753 days true 3.27 5%
Hull 10/10 2753 days true 3.27 5%
Brandt 10/10 2755 days true 3.27 5%
Emma Wilkinson 6/10 2757 days true 3.27 5%
Lyndell 9/10 2820 days 2.64 4%
KAA 10/10 2881 days 2.55 4%
Andrew Hammond 10/10 2881 days 2.55 4%
kristy 9/10 2911 days 2.51 4%
Behrenot 8/10 3012 days true 2.85 4%
M Schram 7/10 3013 days true 2.85 4%
garfield 9/10 3034 days 2.34 4%
BelindaT 10/10 3042 days true 2.8 4%
nuwee 9/10 3064 days 2.3 4%
Hana Vokata 10/10 3069 days true 2.76 4%
Wyss A 10/10 3076 days true 2.74 4%
katrina Marshall 9/10 3081 days true 2.74 4%
Pam & Norman 9/10 3088 days true 2.72 4%
Chris Bil 10/10 3090 days true 2.72 4%
Sue S 8/10 3090 days true 2.72 4%
Rod C 10/10 3093 days true 2.72 4%
Richard 5/10 3099 days true 2.71 4%
Doris Resch 10/10 3101 days true 2.7 4%
Matthiis & Femke 8/10 3102 days true 2.7 4%
Ed & Pat Mitchell 9/10 3103 days true 2.7 4%
Jenny 8/10 3103 days true 2.7 4%
Neal 10/10 3108 days true 2.69 4%
Yona 7/10 3109 days true 2.69 4%
Mathias 10/10 3110 days true 2.69 4%
Jamie 10/10 3115 days true 2.68 4%
Lewis 10/10 3116 days true 2.68 4%
kararina Kosten 9/10 3117 days true 2.68 4%
Vincente Garrido 7/10 3118 days true 2.67 4%
Ingrid Overes 9/10 3122 days true 2.67 4%
S Luis Van Oler 9/10 3128 days true 2.66 4%
nigelst 9/10 3129 days true 2.66 4%
Dale W 8/10 3132 days true 2.65 4%
Omar Frenchy 9/10 3132 days true 2.65 4%
Marons 7/10 3174 days true 2.58 4%
Sena 7/10 3195 days true 2.55 4%
Kyle Riseley 8/10 3196 days true 2.55 4%
Rebecca Jenner 8/10 3196 days true 2.55 4%
Carl and Angela Rapihana 6/10 3208 days true 2.53 4%
nancyburns 10/10 3215 days 2.1 3%
marleen451 9/10 3246 days 2.05 3%
Jackie Anderson 10/10 3276 days 2.01 3%
bogaard 8/10 3311 days true 2.36 4%
Katie 10/10 3368 days 1.89 3%
Charles Lyne 10/10 3399 days 1.84 3%
TillE412 10/10 3414 days true 2.19 3%
ElleGermany 9/10 3417 days true 2.18 3%
JonK 10/10 3417 days true 2.18 3%
BeckieM 9/10 3419 days true 2.18 3%
Anji Sprinks 9/10 3426 days true 2.17 3%
SteveB 10/10 3429 days true 2.16 3%
annysp 10/10 3429 days true 2.16 3%
davidne 6/10 3429 days true 2.16 3%
Jeremy 9/10 3429 days true 2.16 3%
Daniel 9/10 3435 days true 2.15 3%
Richard 9/10 3438 days true 2.15 3%
MichaelS1 9/10 3445 days true 2.14 3%
ChrisD 10/10 3445 days true 2.14 3%
AstridVG 8/10 3445 days true 2.14 3%
Lucas 9/10 3445 days true 2.14 3%
StijnH 7/10 3446 days true 2.14 3%
TobiasK 8/10 3448 days true 2.13 3%
Michael 9/10 3453 days true 2.12 3%
amyd 9/10 3460 days 1.76 3%
Linda 6/10 3460 days true 2.11 3%
Kelly 10/10 3461 days true 2.11 3%
CarleyJ 7/10 3463 days true 2.11 3%
VictoriaH 9/10 3464 days true 2.11 3%
RobC1 7/10 3464 days true 2.11 3%
JoT 8/10 3464 days true 2.11 3%
RobH 7/10 3465 days true 2.1 3%
Eileen Harris 9/10 3467 days 1.75 3%
Brian 10/10 3468 days true 2.1 3%
Amanda Williams 10/10 3469 days 1.75 3%
CarinnaGermany 7/10 3471 days true 2.09 3%
Trevor 10/10 3472 days true 2.09 3%
David 7/10 3477 days true 2.08 3%
Conway 9/10 3479 days true 2.08 3%
Ralf 9/10 3481 days true 2.08 3%
Christina 10/10 3493 days true 2.06 3%
John 10/10 3498 days true 2.05 3%
Jon 8/10 3500 days true 2.05 3%
Karen 8/10 3500 days true 2.05 3%
Bernd 6/10 3502 days true 2.04 3%
Kori 8/10 3541 days true 1.98 3%
David 7/10 3542 days true 1.98 3%
Dan 9/10 3560 days true 1.95 3%
Nicole 6/10 3563 days true 1.94 3%
Stephanie Schikora 10/10 3572 days 1.61 2%
Gaurav M 7/10 3591 days 1.58 2%
Kate 7/10 3615 days true 1.86 3%
Robin 10/10 3618 days 1.54 2%
Mike 9/10 3624 days true 1.84 3%
Felicity 8/10 3627 days true 1.84 3%
Suyin 10/10 3627 days true 1.84 3%
Fothergill 7/10 3635 days true 1.82 3%
Christopher 8/10 3639 days true 1.82 3%
James 9/10 3639 days true 1.82 3%
jillian 6/10 3648 days true 1.8 3%
Andy 7/10 3661 days true 1.78 3%
loumac 8/10 3664 days 1.48 2%
Gray 10/10 3665 days true 1.78 3%
Lucchi 3/10 3681 days true 1.62 2%
Ashlee Roberts 10/10 3726 days 1.4 2%
L1z4rd 10/10 3759 days 1.35 2%
Kori Barton 7/10 3771 days true 1.6 2%
Franz 9/10 3800 days true 1.55 2%
Daniela 6/10 3805 days true 1.55 2%
Daniel 10/10 3809 days true 1.54 2%
Wendy 6/10 3813 days true 1.53 2%
Mikel 6/10 3813 days true 1.53 2%
Dunet 9/10 3813 days true 1.53 2%
Jeanette 8/10 3815 days true 1.53 2%
Christian 7/10 3816 days true 1.53 2%
Neil 6/10 3820 days true 1.52 2%
Marian Mckinney 8/10 3822 days true 1.52 2%
Stephanie Grisel 9/10 3822 days true 1.52 2%
Dirk 10/10 3828 days true 1.51 2%
Jurg Meister 5/10 3829 days true 1.51 2%
Lisa Tame 7/10 3830 days true 1.5 2%
Steven 10/10 3830 days true 1.5 2%
Ian and Judy 10/10 3830 days true 1.5 2%
Erwin de Kleijn 8/10 3834 days true 1.5 2%
Reina Lohaye 8/10 3844 days true 1.48 2%
Marc Hertogs 7/10 3845 days true 1.48 2%
V Wood 5/10 3845 days true 1.48 2%
paulonline 8/10 3847 days 1.23 2%
Pauline Thai 10/10 3848 days true 1.47 2%
Bex 9/10 3856 days 1.22 2%
Stephen Brightman 9/10 3857 days true 1.46 2%
Madeleine Rowland 10/10 3857 days true 1.46 2%
Swen Schroder 8/10 3869 days true 1.44 2%
Tim 10/10 3869 days true 1.44 2%
Bronwyn Gaby 8/10 3875 days true 1.43 2%
Ard 7/10 3904 days true 1.38 2%
Patricia Leighton 10/10 4031 days true 1.17 2%
Andy Chapman 8/10 4031 days true 1.17 2%
Tanja 4/10 4135 days true 0.94 1%
Alan 7/10 4140 days true 0.99 2%
Svenja 6/10 4145 days true 0.99 2%
Michael 8/10 4147 days true 0.98 2%
Akiko&Shibotsu 9/10 4147 days true 0.98 2%
Roger&Shirley 8/10 4153 days true 0.97 1%
Fred 9/10 4159 days true 0.96 1%
Kathryn 7/10 4162 days true 0.96 1%
Michaela 8/10 4183 days true 0.92 1%
Ian 7/10 4183 days true 0.92 1%
Pete 8/10 4183 days true 0.92 1%
Anne 9/10 4183 days true 0.92 1%
Malon 7/10 4185 days true 0.92 1%
Vibeke 8/10 4194 days true 0.91 1%
beesom 10/10 4195 days true 0.9 1%
Hirsh 9/10 4199 days true 0.9 1%
Kerry 5/10 4204 days true 0.89 1%
Alison 8/10 4204 days true 0.89 1%
Jim 10/10 4205 days true 0.89 1%
Peter&Amy 7/10 4205 days true 0.89 1%
Franz-Josef 10/10 4211 days true 0.88 1%
Marc 5/10 4212 days true 0.88 1%
JuanPablo 9/10 4218 days true 0.87 1%
Moritz 10/10 5591 days 0.0 0%

Adjustments

Several adjustments to the weighted average are added to improve relevancy and credibility. These adjustments apply equally to all experiences that meet the criteria.

Sample Size Adjustment

No Adjustment

A reasonable number of reviews are necessary in order for the average to be credible and for an experience to take a prime position within the ranking tables. As such, experiences with only a few reviews have a moderated score. This does not mean that the experience or the reviews can't be trusted. The Shotover Jet experience has plenty of reviews and does not meet the criteria for any adjustment.

Recent Reviews Adjustment

-7.28% Adjustment

There may be an adjustment if an experience hasn't received any reviews within the last 60 days. However the Shotover Jet experience does not meet the criteria for any adjustment.

In addition, an experience's ranking score may be adjusted for each day there is no new ranking. After 1 day the adjustment comes into effect. The maximum number of days that can be adjusted for is 364 days.

The Shotover Jet experience has been adjusted for 364 days. Adjustments are according to the following table.

Days Adjustment
361 -7.22%
362 -7.24%
363 -7.26%
364 -7.28%
365 -7.30%
366 -7.32%
367 -7.34%

Final Ranking Score

79%

The final ranking score once adjustments and rounding has been applied. This value is cached and recalculated each day. Therefore it may not be precisely accurate based on the other values presented.

If you have any questions or comments about our ranking score calculation please get in touch at info@rankers.co.nz.