Ranking Score Explained

Hi there, thanks for your interest in how we calculate an experience's ranking score. It's at the core of Rankers so I'm pleased you're curious.

The ranking score percentage is used to compare and sort experiences in ranking tables. It is not necessarily a direct measurement of the quality of a particular experience as rated by its customers. I've found it a useful tool to allow me to find the best experiences with confidence. But I've also found it important to read the customer reviews before making any final judgements!

We calculate an experience's ranking score using a multi-factor data model instead of a raw data average (mean). This model takes into account several important questions. For instance - is there a trusted body of reviews? What is the age of a review and is the review from a credible source?

Below you'll find details around some of the important factors that went into calculating the ranking score for Shotover Jet.

If you have any questions or comments about our ranking score calculation please get in touch at info@rankers.co.nz. We don't believe this is perfect or complete so we're always interested in ways we might make improvements.

Nick Morrison's avatar

Nick Morrison

Rankers owner

Shotover Jet

Valid Reviews

267 Valid Reviews

The Shotover Jet experience has a total of 269 reviews. There are 267 valid reviews that are included when calculating the ranking score and 2 invalid reviews that are excluded from the calculation. Reviews can be excluded only when a reviewer is not verified or after an investigation by our team determines the reviewer is not genuine.

Below is the distribution of ratings for the 267 valid reviews:

Rating Count Percentage
10/10 86
32%
9/10 65
24%
8/10 50
19%
7/10 35
13%
6/10 18
7%
5/10 8
3%
4/10 2
1%
3/10 2
1%
2/10 0
0%
1/10 1
0%

84.38% Average

The raw data average (mean) for all the Shotover Jet valid reviews is 84.38% and is based on 267 valid reviews. This value is not used to calculate the ranking score and it only provided here as a comparison to the weighted average.

Face-to-Face Reviews

234 Face-to-Face Reviews

The Rankers team meets with travellers while they’re in New Zealand and conducts face-to-face surveys. These reviews, in our opinion, are the most trusted in the industry and represent a critical control sample. To our knowledge, we are the only travel review website in the world that has gone to this extent.

More about face-to-face reviews

Within the 267 valid reviews, the experience has 234 face-to-face reviews collected during interviews by our team.

Below is the distribution of ratings for the 234 face-to-face reviews:

Rating Count Percentage
10/10 70
30%
9/10 55
24%
8/10 46
20%
7/10 33
14%
6/10 18
8%
5/10 7
3%
4/10 2
1%
3/10 2
1%
2/10 0
0%
1/10 1
0%

83.42% Average

The raw data average (mean) for all the Shotover Jet face-to-face reviews is 83.42% and is based on 234 face-to-face reviews. This value is not used to calculate the ranking score and it only provided here for comparison purposes.

Weighted Average

85.82%

Rankers calculates a weighted mean as a base average on which we can improve. Individual review's ratings are given a weight based on several factors. The weight of a review determines the overall impact it'll have on the final weighted average.

Recent reviews have more weight as they are more relevant and reflect the experience as it currently operates. Over time reviews become less relevant and loose their impact on the ranking score.

Low rating reviews carry slightly less weight. This dampens the effect of very low ratings for every experience across the board. This is especially important when the experience has few reviews overall and a single negative rating can grossly mischaracterise an experience. Consistent poor reviews will still result in the experience receiving a comparitively low ranking score.

Credible sources provide reviews that can be trusted. If we have verified a reviewer is genuine via a face-to-face meeting then the review carries additional weight.

Reviewer Rating Age Face-to-Face Weight Relative Weight
Josh Mills 9/10 628 days true 47.47 100%
Alex Hah 9/10 670 days true 40.35 85%
Nicola 6/10 676 days true 39.38 83%
Jair 10/10 698 days true 35.97 76%
Louise Walker 10/10 718 days 27.52 58%
Hazel Norman 10/10 759 days true 27.47 58%
Gavin Moffatt 7/10 970 days true 8.97 19%
Jeeyoung Kim 10/10 980 days true 8.51 18%
Kim Rasun 10/10 980 days true 8.51 18%
Anke Vater 7/10 984 days true 8.34 18%
Joerg 7/10 985 days true 8.3 17%
George Bellwood 10/10 985 days true 8.3 17%
Katrina 8/10 1001 days true 7.68 16%
Leonie Prendeville 6/10 1030 days true 6.8 14%
Ivan Dupont 9/10 1035 days true 6.68 14%
Madita and Lisann 9/10 1069 days true 6.13 13%
Andy Jobst 6/10 1450 days true 5.42 11%
Antoine Vernay 3/10 1455 days true 5.0 11%
Andi Kermode 9/10 1603 days 4.3 9%
Patricia Erni 10/10 1703 days true 5.0 11%
Robert Erni 10/10 1703 days true 5.0 11%
Manuel Bleiker 9/10 1703 days true 5.0 11%
Laura Metz 10/10 1738 days true 4.94 10%
Hubertus Thost 9/10 1738 days true 4.94 10%
Emma Wallace 10/10 1759 days true 4.91 10%
Michael Sheridan 10/10 1765 days true 4.9 10%
Ben Sheridan 8/10 1765 days true 4.9 10%
Ruben Garcia Raiuiro 8/10 1774 days true 4.88 10%
Anne and Steve Bartlett 9/10 1776 days true 4.88 10%
Nicolas Trezeguet 7/10 1785 days true 4.87 10%
hendrik king 8/10 1998 days 3.76 8%
Andy Cummins 10/10 2077 days true 4.39 9%
Sharyn Crosby 10/10 2090 days 3.64 8%
Guillot 8/10 2097 days true 4.35 9%
Michal Maly 9/10 2116 days true 4.32 9%
Karin Genyn 10/10 2166 days true 4.24 9%
Michael Kretzschmar 9/10 2166 days true 4.24 9%
Tom and Jemima Rawlings 8/10 2171 days true 4.23 9%
Franz Schueler 10/10 2172 days true 4.23 9%
Meryem Buchwitz 10/10 2193 days true 4.2 9%
Karsten Meyer 8/10 2195 days true 4.19 9%
Michel Vourbraak 5/10 2196 days true 4.19 9%
TheHoon 9/10 2424 days 3.18 7%
Simon Rawlinson 10/10 2436 days true 3.8 8%
Norman UK 10/10 2447 days true 3.78 8%
Larry Curtiss 10/10 2452 days true 3.77 8%
Madeleine Mueller 10/10 2460 days true 3.76 8%
Jaap & Susanne 8/10 2464 days true 3.75 8%
Anne King 6/10 2464 days true 3.75 8%
Fleming Lauridsen 9/10 2464 days true 3.75 8%
Robert & Bridget Holden 9/10 2464 days true 3.75 8%
Howell Davies 10/10 2464 days true 3.75 8%
Linda Kosters 10/10 2464 days true 3.75 8%
Aridne Giraud 9/10 2467 days true 3.74 8%
Kolen 10/10 2467 days true 3.74 8%
Helen Chilton 8/10 2472 days true 3.74 8%
Tim Gamblen 10/10 2472 days true 3.74 8%
Jonathan Philp 7/10 2476 days true 3.73 8%
Clemens 6/10 2477 days true 3.73 8%
Heike 10/10 2479 days true 3.72 8%
Frank & Julia 7/10 2483 days true 3.72 8%
FlyKiwiFly 7/10 2484 days 3.1 7%
joerem 5/10 2484 days 3.1 7%
Colin Jenkins 8/10 2495 days true 3.7 8%
deJong 8/10 2550 days true 3.61 8%
Gerard Crothers 10/10 2553 days true 3.6 8%
Christoph 7/10 2555 days true 3.6 8%
Steve 9/10 2560 days true 3.59 8%
Helle Thomsen 10/10 2562 days true 3.59 8%
Wendy Ashmore 10/10 2562 days true 3.59 8%
James McColl 6/10 2576 days true 3.57 8%
katel86 10/10 2637 days 2.89 6%
Kimberly St Louis 10/10 2760 days 2.72 6%
Sam papworth 10/10 2789 days true 3.22 7%
Josephine Hartley 1/10 2789 days true 2.81 6%
Nicola Young 5/10 2789 days true 3.22 7%
Schury 10/10 2792 days true 3.21 7%
Rob O'Neill 9/10 2792 days true 3.21 7%
Katarina Bokor 10/10 2798 days true 3.2 7%
Sue Carren 8/10 2798 days true 3.2 7%
Mark Franklin 8/10 2798 days true 3.2 7%
Emma Cross 9/10 2800 days true 3.2 7%
John & Lorraine 8/10 2800 days true 3.2 7%
Hanggi 9/10 2801 days true 3.2 7%
Julie and Russ Charles 10/10 2803 days true 3.19 7%
Berger 10/10 2805 days true 3.19 7%
Juliane Kleiu 10/10 2811 days true 3.18 7%
Claudia 10/10 2811 days true 3.18 7%
Siggi Wick 10/10 2812 days true 3.18 7%
Birga 9/10 2818 days true 3.17 7%
Cameron and Kim 10/10 2820 days true 3.16 7%
Ebi & Beate 8/10 2821 days true 3.16 7%
taniadeanryanbrittany 8/10 2821 days 2.64 6%
Alice Galley 8/10 2824 days true 3.16 7%
Alice 9/10 2825 days true 3.16 7%
Alexander & Stephanie 8/10 2826 days true 3.15 7%
Lauren Pestell 8/10 2828 days true 3.15 7%
Bob Warne 9/10 2832 days true 3.14 7%
Jol Balder 4/10 2837 days true 2.95 6%
Irene and Thib Schneider 9/10 2837 days true 3.14 7%
Doris Schollenberger 9/10 2839 days true 3.13 7%
Roger Lows 9/10 2840 days true 3.13 7%
Glenn 9/10 2840 days true 3.13 7%
Ryan Tull 7/10 2844 days true 3.12 7%
Hull 10/10 2844 days true 3.12 7%
Brandt 10/10 2846 days true 3.12 7%
Emma Wilkinson 6/10 2848 days true 3.12 7%
Lyndell 9/10 2911 days 2.51 5%
KAA 10/10 2972 days 2.43 5%
Andrew Hammond 10/10 2972 days 2.43 5%
kristy 9/10 3002 days 2.39 5%
Behrenot 8/10 3103 days true 2.7 6%
M Schram 7/10 3104 days true 2.7 6%
garfield 9/10 3125 days 2.22 5%
BelindaT 10/10 3133 days true 2.65 6%
nuwee 9/10 3155 days 2.18 5%
Hana Vokata 10/10 3160 days true 2.61 5%
Wyss A 10/10 3167 days true 2.59 5%
katrina Marshall 9/10 3172 days true 2.59 5%
Pam & Norman 9/10 3179 days true 2.57 5%
Chris Bil 10/10 3181 days true 2.57 5%
Sue S 8/10 3181 days true 2.57 5%
Rod C 10/10 3184 days true 2.57 5%
Richard 5/10 3190 days true 2.56 5%
Doris Resch 10/10 3192 days true 2.55 5%
Matthiis & Femke 8/10 3193 days true 2.55 5%
Ed & Pat Mitchell 9/10 3194 days true 2.55 5%
Jenny 8/10 3194 days true 2.55 5%
Neal 10/10 3199 days true 2.54 5%
Yona 7/10 3200 days true 2.54 5%
Mathias 10/10 3201 days true 2.54 5%
Jamie 10/10 3206 days true 2.53 5%
Lewis 10/10 3207 days true 2.53 5%
kararina Kosten 9/10 3208 days true 2.53 5%
Vincente Garrido 7/10 3209 days true 2.52 5%
Ingrid Overes 9/10 3213 days true 2.52 5%
S Luis Van Oler 9/10 3219 days true 2.51 5%
nigelst 9/10 3220 days true 2.51 5%
Dale W 8/10 3223 days true 2.5 5%
Omar Frenchy 9/10 3223 days true 2.5 5%
Marons 7/10 3265 days true 2.43 5%
Sena 7/10 3286 days true 2.4 5%
Kyle Riseley 8/10 3287 days true 2.4 5%
Rebecca Jenner 8/10 3287 days true 2.4 5%
Carl and Angela Rapihana 6/10 3299 days true 2.38 5%
nancyburns 10/10 3306 days 1.97 4%
marleen451 9/10 3337 days 1.93 4%
Jackie Anderson 10/10 3367 days 1.89 4%
bogaard 8/10 3402 days true 2.21 5%
Katie 10/10 3459 days 1.76 4%
Charles Lyne 10/10 3490 days 1.72 4%
TillE412 10/10 3505 days true 2.04 4%
ElleGermany 9/10 3508 days true 2.03 4%
JonK 10/10 3508 days true 2.03 4%
BeckieM 9/10 3510 days true 2.03 4%
Anji Sprinks 9/10 3517 days true 2.02 4%
SteveB 10/10 3520 days true 2.01 4%
annysp 10/10 3520 days true 2.01 4%
davidne 6/10 3520 days true 2.01 4%
Jeremy 9/10 3520 days true 2.01 4%
Daniel 9/10 3526 days true 2.0 4%
Richard 9/10 3529 days true 2.0 4%
MichaelS1 9/10 3536 days true 1.99 4%
ChrisD 10/10 3536 days true 1.99 4%
AstridVG 8/10 3536 days true 1.99 4%
Lucas 9/10 3536 days true 1.99 4%
StijnH 7/10 3537 days true 1.99 4%
TobiasK 8/10 3539 days true 1.98 4%
Michael 9/10 3544 days true 1.97 4%
amyd 9/10 3551 days 1.64 3%
Linda 6/10 3551 days true 1.96 4%
Kelly 10/10 3552 days true 1.96 4%
CarleyJ 7/10 3554 days true 1.96 4%
VictoriaH 9/10 3555 days true 1.96 4%
RobC1 7/10 3555 days true 1.96 4%
JoT 8/10 3555 days true 1.96 4%
RobH 7/10 3556 days true 1.95 4%
Eileen Harris 9/10 3558 days 1.63 3%
Brian 10/10 3559 days true 1.95 4%
Amanda Williams 10/10 3560 days 1.62 3%
CarinnaGermany 7/10 3562 days true 1.94 4%
Trevor 10/10 3563 days true 1.94 4%
David 7/10 3568 days true 1.93 4%
Conway 9/10 3570 days true 1.93 4%
Ralf 9/10 3572 days true 1.93 4%
Christina 10/10 3584 days true 1.91 4%
John 10/10 3589 days true 1.9 4%
Jon 8/10 3591 days true 1.9 4%
Karen 8/10 3591 days true 1.9 4%
Bernd 6/10 3593 days true 1.89 4%
Kori 8/10 3632 days true 1.83 4%
David 7/10 3633 days true 1.83 4%
Dan 9/10 3651 days true 1.8 4%
Nicole 6/10 3654 days true 1.79 4%
Stephanie Schikora 10/10 3663 days 1.48 3%
Gaurav M 7/10 3682 days 1.46 3%
Kate 7/10 3706 days true 1.71 4%
Robin 10/10 3709 days 1.42 3%
Mike 9/10 3715 days true 1.69 4%
Felicity 8/10 3717 days true 1.69 4%
Suyin 10/10 3718 days true 1.69 4%
Fothergill 7/10 3726 days true 1.68 4%
Christopher 8/10 3730 days true 1.67 4%
James 9/10 3730 days true 1.67 4%
jillian 6/10 3739 days true 1.65 3%
Andy 7/10 3752 days true 1.63 3%
loumac 8/10 3755 days 1.36 3%
Gray 10/10 3755 days true 1.63 3%
Lucchi 3/10 3772 days true 1.48 3%
Ashlee Roberts 10/10 3817 days 1.27 3%
L1z4rd 10/10 3850 days 1.23 3%
Kori Barton 7/10 3862 days true 1.45 3%
Franz 9/10 3891 days true 1.4 3%
Daniela 6/10 3896 days true 1.4 3%
Daniel 10/10 3900 days true 1.39 3%
Wendy 6/10 3904 days true 1.38 3%
Mikel 6/10 3904 days true 1.38 3%
Dunet 9/10 3904 days true 1.38 3%
Jeanette 8/10 3906 days true 1.38 3%
Christian 7/10 3907 days true 1.38 3%
Neil 6/10 3911 days true 1.37 3%
Marian Mckinney 8/10 3913 days true 1.37 3%
Stephanie Grisel 9/10 3913 days true 1.37 3%
Dirk 10/10 3919 days true 1.36 3%
Jurg Meister 5/10 3920 days true 1.36 3%
Lisa Tame 7/10 3921 days true 1.35 3%
Steven 10/10 3921 days true 1.35 3%
Ian and Judy 10/10 3921 days true 1.35 3%
Erwin de Kleijn 8/10 3925 days true 1.35 3%
Reina Lohaye 8/10 3935 days true 1.33 3%
Marc Hertogs 7/10 3936 days true 1.33 3%
V Wood 5/10 3936 days true 1.33 3%
paulonline 8/10 3938 days 1.11 2%
Pauline Thai 10/10 3939 days true 1.32 3%
Bex 9/10 3947 days 1.09 2%
Stephen Brightman 9/10 3948 days true 1.31 3%
Madeleine Rowland 10/10 3948 days true 1.31 3%
Swen Schroder 8/10 3960 days true 1.29 3%
Tim 10/10 3960 days true 1.29 3%
Bronwyn Gaby 8/10 3966 days true 1.28 3%
Ard 7/10 3995 days true 1.23 3%
Patricia Leighton 10/10 4122 days true 1.02 2%
Andy Chapman 8/10 4122 days true 1.02 2%
Tanja 4/10 4226 days true 0.8 2%
Alan 7/10 4231 days true 0.84 2%
Svenja 6/10 4236 days true 0.84 2%
Michael 8/10 4238 days true 0.83 2%
Akiko&Shibotsu 9/10 4238 days true 0.83 2%
Roger&Shirley 8/10 4244 days true 0.82 2%
Fred 9/10 4250 days true 0.81 2%
Kathryn 7/10 4253 days true 0.81 2%
Michaela 8/10 4274 days true 0.77 2%
Ian 7/10 4274 days true 0.77 2%
Pete 8/10 4274 days true 0.77 2%
Anne 9/10 4274 days true 0.77 2%
Malon 7/10 4276 days true 0.77 2%
Vibeke 8/10 4285 days true 0.76 2%
beesom 10/10 4286 days true 0.75 2%
Hirsh 9/10 4290 days true 0.75 2%
Kerry 5/10 4295 days true 0.74 2%
Alison 8/10 4295 days true 0.74 2%
Jim 10/10 4296 days true 0.74 2%
Peter&Amy 7/10 4296 days true 0.74 2%
Franz-Josef 10/10 4302 days true 0.73 2%
Marc 5/10 4303 days true 0.73 2%
JuanPablo 9/10 4309 days true 0.72 2%
Moritz 10/10 5682 days 0.0 0%

Adjustments

Several adjustments to the weighted average are added to improve relevancy and credibility. These adjustments apply equally to all experiences that meet the criteria.

Sample Size Adjustment

No Adjustment

A reasonable number of reviews are necessary in order for the average to be credible and for an experience to take a prime position within the ranking tables. As such, experiences with only a few reviews have a moderated score. This does not mean that the experience or the reviews can't be trusted. The Shotover Jet experience has plenty of reviews and does not meet the criteria for any adjustment.

Recent Reviews Adjustment

-7.28% Adjustment

There may be an adjustment if an experience hasn't received any reviews within the last 60 days. However the Shotover Jet experience does not meet the criteria for any adjustment.

In addition, an experience's ranking score may be adjusted for each day there is no new ranking. After 1 day the adjustment comes into effect. The maximum number of days that can be adjusted for is 364 days.

The Shotover Jet experience has been adjusted for 364 days. Adjustments are according to the following table.

Days Adjustment
361 -7.22%
362 -7.24%
363 -7.26%
364 -7.28%
365 -7.30%
366 -7.32%
367 -7.34%

Final Ranking Score

79%

The final ranking score once adjustments and rounding has been applied. This value is cached and recalculated each day. Therefore it may not be precisely accurate based on the other values presented.

If you have any questions or comments about our ranking score calculation please get in touch at info@rankers.co.nz.