Ranking Score Explained

Hi there, thanks for your interest in how we calculate an experience's ranking score. It's at the core of Rankers so I'm pleased you're curious.

The ranking score percentage is used to compare and sort experiences in ranking tables. It is not necessarily a direct measurement of the quality of a particular experience as rated by its customers. I've found it a useful tool to allow me to find the best experiences with confidence. But I've also found it important to read the customer reviews before making any final judgements!

We calculate an experience's ranking score using a multi-factor data model instead of a raw data average (mean). This model takes into account several important questions. For instance - is there a trusted body of reviews? What is the age of a review and is the review from a credible source?

Below you'll find details around some of the important factors that went into calculating the ranking score for Shotover Jet.

If you have any questions or comments about our ranking score calculation please get in touch at info@rankers.co.nz. We don't believe this is perfect or complete so we're always interested in ways we might make improvements.

Nick Morrison's avatar

Nick Morrison

Rankers owner

Shotover Jet

Valid Reviews

267 Valid Reviews

The Shotover Jet experience has a total of 269 reviews. There are 267 valid reviews that are included when calculating the ranking score and 2 invalid reviews that are excluded from the calculation. Reviews can be excluded only when a reviewer is not verified or after an investigation by our team determines the reviewer is not genuine.

Below is the distribution of ratings for the 267 valid reviews:

Rating Count Percentage
10/10 86
32%
9/10 65
24%
8/10 50
19%
7/10 35
13%
6/10 18
7%
5/10 8
3%
4/10 2
1%
3/10 2
1%
2/10 0
0%
1/10 1
0%

84.38% Average

The raw data average (mean) for all the Shotover Jet valid reviews is 84.38% and is based on 267 valid reviews. This value is not used to calculate the ranking score and it only provided here as a comparison to the weighted average.

Face-to-Face Reviews

234 Face-to-Face Reviews

The Rankers team meets with travellers while they’re in New Zealand and conducts face-to-face surveys. These reviews, in our opinion, are the most trusted in the industry and represent a critical control sample. To our knowledge, we are the only travel review website in the world that has gone to this extent.

More about face-to-face reviews

Within the 267 valid reviews, the experience has 234 face-to-face reviews collected during interviews by our team.

Below is the distribution of ratings for the 234 face-to-face reviews:

Rating Count Percentage
10/10 70
30%
9/10 55
24%
8/10 46
20%
7/10 33
14%
6/10 18
8%
5/10 7
3%
4/10 2
1%
3/10 2
1%
2/10 0
0%
1/10 1
0%

83.42% Average

The raw data average (mean) for all the Shotover Jet face-to-face reviews is 83.42% and is based on 234 face-to-face reviews. This value is not used to calculate the ranking score and it only provided here for comparison purposes.

Weighted Average

85.66%

Rankers calculates a weighted mean as a base average on which we can improve. Individual review's ratings are given a weight based on several factors. The weight of a review determines the overall impact it'll have on the final weighted average.

Recent reviews have more weight as they are more relevant and reflect the experience as it currently operates. Over time reviews become less relevant and loose their impact on the ranking score.

Low rating reviews carry slightly less weight. This dampens the effect of very low ratings for every experience across the board. This is especially important when the experience has few reviews overall and a single negative rating can grossly mischaracterise an experience. Consistent poor reviews will still result in the experience receiving a comparitively low ranking score.

Credible sources provide reviews that can be trusted. If we have verified a reviewer is genuine via a face-to-face meeting then the review carries additional weight.

Reviewer Rating Age Face-to-Face Weight Relative Weight
Josh Mills 9/10 719 days true 32.88 100%
Alex Hah 9/10 761 days true 27.21 83%
Nicola 6/10 767 days true 26.46 80%
Jair 10/10 789 days true 23.81 72%
Louise Walker 10/10 809 days 17.96 55%
Hazel Norman 10/10 850 days true 17.41 53%
Gavin Moffatt 7/10 1061 days true 6.22 19%
Jeeyoung Kim 10/10 1071 days true 6.11 19%
Kim Rasun 10/10 1071 days true 6.11 19%
Anke Vater 7/10 1075 days true 6.08 18%
Joerg 7/10 1076 days true 6.07 18%
George Bellwood 10/10 1076 days true 6.07 18%
Katrina 8/10 1092 days true 6.0 18%
Leonie Prendeville 6/10 1121 days true 5.96 18%
Ivan Dupont 9/10 1126 days true 5.95 18%
Madita and Lisann 9/10 1160 days true 5.89 18%
Andy Jobst 6/10 1541 days true 5.27 16%
Antoine Vernay 3/10 1546 days true 4.86 15%
Andrew Kermode 9/10 1694 days 4.18 13%
Patricia Erni 10/10 1794 days true 4.85 15%
Robert Erni 10/10 1794 days true 4.85 15%
Manuel Bleiker 9/10 1794 days true 4.85 15%
Laura Metz 10/10 1829 days true 4.79 15%
Hubertus Thost 9/10 1829 days true 4.79 15%
Emma Wallace 10/10 1850 days true 4.76 14%
Michael Sheridan 10/10 1856 days true 4.75 14%
Ben Sheridan 8/10 1856 days true 4.75 14%
Ruben Garcia Raiuiro 8/10 1865 days true 4.73 14%
Anne and Steve Bartlett 9/10 1867 days true 4.73 14%
Nicolas Trezeguet 7/10 1876 days true 4.72 14%
hendrik king 8/10 2089 days 3.64 11%
Andy Cummins 10/10 2168 days true 4.24 13%
Sharyn Crosby 10/10 2181 days 3.51 11%
Guillot 8/10 2188 days true 4.2 13%
Michal Maly 9/10 2207 days true 4.17 13%
Karin Genyn 10/10 2257 days true 4.09 12%
Michael Kretzschmar 9/10 2257 days true 4.09 12%
Tom and Jemima Rawlings 8/10 2262 days true 4.08 12%
Franz Schueler 10/10 2263 days true 4.08 12%
Meryem Buchwitz 10/10 2284 days true 4.05 12%
Karsten Meyer 8/10 2286 days true 4.04 12%
Michel Vourbraak 5/10 2287 days true 4.04 12%
TheHoon 9/10 2515 days 3.05 9%
Simon Rawlinson 10/10 2527 days true 3.65 11%
Norman UK 10/10 2538 days true 3.63 11%
Larry Curtiss 10/10 2543 days true 3.62 11%
Madeleine Mueller 10/10 2551 days true 3.61 11%
Jaap & Susanne 8/10 2555 days true 3.6 11%
Anne King 6/10 2555 days true 3.6 11%
Fleming Lauridsen 9/10 2555 days true 3.6 11%
Robert & Bridget Holden 9/10 2555 days true 3.6 11%
Howell Davies 10/10 2555 days true 3.6 11%
Linda Kosters 10/10 2555 days true 3.6 11%
Aridne Giraud 9/10 2558 days true 3.6 11%
Kolen 10/10 2558 days true 3.6 11%
Helen Chilton 8/10 2563 days true 3.59 11%
Tim Gamblen 10/10 2563 days true 3.59 11%
Jonathan Philp 7/10 2567 days true 3.58 11%
Clemens 6/10 2568 days true 3.58 11%
Heike 10/10 2570 days true 3.58 11%
Frank & Julia 7/10 2574 days true 3.57 11%
FlyKiwiFly 7/10 2575 days 2.97 9%
joerem 5/10 2575 days 2.97 9%
Colin Jenkins 8/10 2586 days true 3.55 11%
deJong 8/10 2641 days true 3.46 11%
Gerard Crothers 10/10 2644 days true 3.45 11%
Christoph 7/10 2646 days true 3.45 10%
Steve 9/10 2651 days true 3.44 10%
Helle Thomsen 10/10 2653 days true 3.44 10%
Wendy Ashmore 10/10 2653 days true 3.44 10%
James McColl 6/10 2667 days true 3.42 10%
katel86 10/10 2728 days 2.76 8%
Kimberly St Louis 10/10 2851 days 2.59 8%
Sam papworth 10/10 2880 days true 3.07 9%
Josephine Hartley 1/10 2880 days true 2.68 8%
Nicola Young 5/10 2880 days true 3.07 9%
Schury 10/10 2883 days true 3.06 9%
Rob O'Neill 9/10 2883 days true 3.06 9%
Katarina Bokor 10/10 2889 days true 3.05 9%
Sue Carren 8/10 2889 days true 3.05 9%
Mark Franklin 8/10 2889 days true 3.05 9%
Emma Cross 9/10 2891 days true 3.05 9%
John & Lorraine 8/10 2891 days true 3.05 9%
Hanggi 9/10 2892 days true 3.05 9%
Julie and Russ Charles 10/10 2894 days true 3.04 9%
Berger 10/10 2896 days true 3.04 9%
Juliane Kleiu 10/10 2902 days true 3.03 9%
Claudia 10/10 2902 days true 3.03 9%
Siggi Wick 10/10 2903 days true 3.03 9%
Birga 9/10 2909 days true 3.02 9%
Cameron and Kim 10/10 2911 days true 3.01 9%
Ebi & Beate 8/10 2912 days true 3.01 9%
taniadeanryanbrittany 8/10 2912 days 2.51 8%
Alice Galley 8/10 2915 days true 3.01 9%
Alice 9/10 2916 days true 3.01 9%
Alexander & Stephanie 8/10 2917 days true 3.0 9%
Lauren Pestell 8/10 2919 days true 3.0 9%
Bob Warne 9/10 2923 days true 3.0 9%
Jol Balder 4/10 2928 days true 2.81 9%
Irene and Thib Schneider 9/10 2928 days true 2.99 9%
Doris Schollenberger 9/10 2930 days true 2.98 9%
Roger Lows 9/10 2931 days true 2.98 9%
Glenn 9/10 2931 days true 2.98 9%
Ryan Tull 7/10 2935 days true 2.98 9%
Hull 10/10 2935 days true 2.98 9%
Brandt 10/10 2937 days true 2.97 9%
Emma Wilkinson 6/10 2939 days true 2.97 9%
Lyndell 9/10 3002 days 2.39 7%
KAA 10/10 3063 days 2.3 7%
Andrew Hammond 10/10 3063 days 2.3 7%
kristy 9/10 3093 days 2.26 7%
Behrenot 8/10 3194 days true 2.55 8%
M Schram 7/10 3195 days true 2.55 8%
garfield 9/10 3216 days 2.09 6%
BelindaT 10/10 3224 days true 2.5 8%
nuwee 9/10 3246 days 2.05 6%
Hana Vokata 10/10 3251 days true 2.46 7%
Wyss A 10/10 3258 days true 2.44 7%
katrina Marshall 9/10 3263 days true 2.44 7%
Pam & Norman 9/10 3270 days true 2.42 7%
Chris Bil 10/10 3272 days true 2.42 7%
Sue S 8/10 3272 days true 2.42 7%
Rod C 10/10 3275 days true 2.42 7%
Richard 5/10 3281 days true 2.41 7%
Doris Resch 10/10 3283 days true 2.4 7%
Matthiis & Femke 8/10 3284 days true 2.4 7%
Ed & Pat Mitchell 9/10 3285 days true 2.4 7%
Jenny 8/10 3285 days true 2.4 7%
Neal 10/10 3290 days true 2.39 7%
Yona 7/10 3291 days true 2.39 7%
Mathias 10/10 3292 days true 2.39 7%
Jamie 10/10 3297 days true 2.38 7%
Lewis 10/10 3298 days true 2.38 7%
kararina Kosten 9/10 3299 days true 2.38 7%
Vincente Garrido 7/10 3300 days true 2.38 7%
Ingrid Overes 9/10 3304 days true 2.37 7%
S Luis Van Oler 9/10 3310 days true 2.36 7%
nigelst 9/10 3311 days true 2.36 7%
Dale W 8/10 3314 days true 2.35 7%
Omar Frenchy 9/10 3314 days true 2.35 7%
Marons 7/10 3356 days true 2.28 7%
Sena 7/10 3377 days true 2.25 7%
Kyle Riseley 8/10 3378 days true 2.25 7%
Rebecca Jenner 8/10 3378 days true 2.25 7%
Carl and Angela Rapihana 6/10 3390 days true 2.23 7%
nancyburns 10/10 3397 days 1.85 6%
marleen451 9/10 3428 days 1.8 5%
Jackie Anderson 10/10 3458 days 1.76 5%
bogaard 8/10 3493 days true 2.06 6%
Katie 10/10 3550 days 1.64 5%
Charles Lyne 10/10 3581 days 1.59 5%
TillE412 10/10 3596 days true 1.89 6%
ElleGermany 9/10 3599 days true 1.88 6%
JonK 10/10 3599 days true 1.88 6%
BeckieM 9/10 3601 days true 1.88 6%
Anji Sprinks 9/10 3608 days true 1.87 6%
SteveB 10/10 3611 days true 1.86 6%
annysp 10/10 3611 days true 1.86 6%
davidne 6/10 3611 days true 1.86 6%
Jeremy 9/10 3611 days true 1.86 6%
Daniel 9/10 3617 days true 1.85 6%
Richard 9/10 3620 days true 1.85 6%
MichaelS1 9/10 3627 days true 1.84 6%
ChrisD 10/10 3627 days true 1.84 6%
AstridVG 8/10 3627 days true 1.84 6%
Lucas 9/10 3627 days true 1.84 6%
StijnH 7/10 3628 days true 1.84 6%
TobiasK 8/10 3630 days true 1.83 6%
Michael 9/10 3635 days true 1.82 6%
amyd 9/10 3642 days 1.51 5%
Linda 6/10 3642 days true 1.81 6%
Kelly 10/10 3643 days true 1.81 6%
CarleyJ 7/10 3645 days true 1.81 5%
VictoriaH 9/10 3646 days true 1.81 5%
RobC1 7/10 3646 days true 1.81 5%
JoT 8/10 3646 days true 1.81 5%
RobH 7/10 3647 days true 1.8 5%
Eileen Harris 9/10 3649 days 1.5 5%
Brian 10/10 3650 days true 1.8 5%
Amanda Williams 10/10 3651 days 1.5 5%
CarinnaGermany 7/10 3653 days true 1.8 5%
Trevor 10/10 3654 days true 1.79 5%
David 7/10 3659 days true 1.79 5%
Conway 9/10 3661 days true 1.78 5%
Ralf 9/10 3663 days true 1.78 5%
Christina 10/10 3675 days true 1.76 5%
John 10/10 3680 days true 1.75 5%
Jon 8/10 3682 days true 1.75 5%
Karen 8/10 3682 days true 1.75 5%
Bernd 6/10 3684 days true 1.74 5%
Kori 8/10 3723 days true 1.68 5%
David 7/10 3724 days true 1.68 5%
Dan 9/10 3742 days true 1.65 5%
Nicole 6/10 3745 days true 1.64 5%
Stephanie Schikora 10/10 3754 days 1.36 4%
Gaurav M 7/10 3773 days 1.33 4%
Kate 7/10 3797 days true 1.56 5%
Robin 10/10 3800 days 1.29 4%
Mike 9/10 3806 days true 1.54 5%
Felicity 8/10 3808 days true 1.54 5%
Suyin 10/10 3808 days true 1.54 5%
Fothergill 7/10 3817 days true 1.53 5%
Christopher 8/10 3821 days true 1.52 5%
James 9/10 3821 days true 1.52 5%
jillian 6/10 3830 days true 1.5 5%
Andy 7/10 3843 days true 1.48 5%
loumac 8/10 3846 days 1.23 4%
Gray 10/10 3846 days true 1.48 4%
Lucchi 3/10 3863 days true 1.34 4%
Ashlee Roberts 10/10 3908 days 1.15 3%
L1z4rd 10/10 3941 days 1.1 3%
Kori Barton 7/10 3953 days true 1.3 4%
Franz 9/10 3982 days true 1.25 4%
Daniela 6/10 3987 days true 1.25 4%
Daniel 10/10 3991 days true 1.24 4%
Wendy 6/10 3995 days true 1.23 4%
Mikel 6/10 3995 days true 1.23 4%
Dunet 9/10 3995 days true 1.23 4%
Jeanette 8/10 3997 days true 1.23 4%
Christian 7/10 3998 days true 1.23 4%
Neil 6/10 4002 days true 1.22 4%
Marian Mckinney 8/10 4004 days true 1.22 4%
Stephanie Grisel 9/10 4004 days true 1.22 4%
Dirk 10/10 4010 days true 1.21 4%
Jurg Meister 5/10 4011 days true 1.21 4%
Lisa Tame 7/10 4012 days true 1.2 4%
Steven 10/10 4012 days true 1.2 4%
Ian and Judy 10/10 4012 days true 1.2 4%
Erwin de Kleijn 8/10 4016 days true 1.2 4%
Reina Lohaye 8/10 4026 days true 1.18 4%
Marc Hertogs 7/10 4027 days true 1.18 4%
V Wood 5/10 4027 days true 1.18 4%
paulonline 8/10 4029 days 0.98 3%
Pauline Thai 10/10 4030 days true 1.18 4%
Bex 9/10 4038 days 0.97 3%
Stephen Brightman 9/10 4039 days true 1.16 4%
Madeleine Rowland 10/10 4039 days true 1.16 4%
Swen Schroder 8/10 4051 days true 1.14 3%
Tim 10/10 4051 days true 1.14 3%
Bronwyn Gaby 8/10 4057 days true 1.13 3%
Ard 7/10 4086 days true 1.08 3%
Patricia Leighton 10/10 4213 days true 0.87 3%
Andy Chapman 8/10 4213 days true 0.87 3%
Tanja 4/10 4317 days true 0.66 2%
Alan 7/10 4322 days true 0.7 2%
Svenja 6/10 4327 days true 0.69 2%
Michael 8/10 4329 days true 0.68 2%
Akiko&Shibotsu 9/10 4329 days true 0.68 2%
Roger&Shirley 8/10 4335 days true 0.67 2%
Fred 9/10 4341 days true 0.66 2%
Kathryn 7/10 4344 days true 0.66 2%
Michaela 8/10 4365 days true 0.62 2%
Ian 7/10 4365 days true 0.62 2%
Pete 8/10 4365 days true 0.62 2%
Anne 9/10 4365 days true 0.62 2%
Malon 7/10 4367 days true 0.62 2%
Vibeke 8/10 4376 days true 0.61 2%
beesom 10/10 4377 days true 0.6 2%
Hirsh 9/10 4381 days true 0.6 2%
Kerry 5/10 4386 days true 0.59 2%
Alison 8/10 4386 days true 0.59 2%
Jim 10/10 4387 days true 0.59 2%
Peter&Amy 7/10 4387 days true 0.59 2%
Franz-Josef 10/10 4393 days true 0.58 2%
Marc 5/10 4394 days true 0.58 2%
JuanPablo 9/10 4400 days true 0.57 2%
Moritz 10/10 5773 days 0.0 0%

Adjustments

Several adjustments to the weighted average are added to improve relevancy and credibility. These adjustments apply equally to all experiences that meet the criteria.

Sample Size Adjustment

No Adjustment

A reasonable number of reviews are necessary in order for the average to be credible and for an experience to take a prime position within the ranking tables. As such, experiences with only a few reviews have a moderated score. This does not mean that the experience or the reviews can't be trusted. The Shotover Jet experience has plenty of reviews and does not meet the criteria for any adjustment.

Recent Reviews Adjustment

-7.28% Adjustment

There may be an adjustment if an experience hasn't received any reviews within the last 60 days. However the Shotover Jet experience does not meet the criteria for any adjustment.

In addition, an experience's ranking score may be adjusted for each day there is no new ranking. After 1 day the adjustment comes into effect. The maximum number of days that can be adjusted for is 364 days.

The Shotover Jet experience has been adjusted for 364 days. Adjustments are according to the following table.

Days Adjustment
361 -7.22%
362 -7.24%
363 -7.26%
364 -7.28%
365 -7.30%
366 -7.32%
367 -7.34%

Final Ranking Score

78%

The final ranking score once adjustments and rounding has been applied. This value is cached and recalculated each day. Therefore it may not be precisely accurate based on the other values presented.

If you have any questions or comments about our ranking score calculation please get in touch at info@rankers.co.nz.