Ranking Score Explained

Hi there, thanks for your interest in how we calculate an experience's ranking score. It's at the core of Rankers so I'm pleased you're curious.

The ranking score percentage is used to compare and sort experiences in ranking tables. It is not necessarily a direct measurement of the quality of a particular experience as rated by its customers. I've found it a useful tool to allow me to find the best experiences with confidence. But I've also found it important to read the customer reviews before making any final judgements!

We calculate an experience's ranking score using a multi-factor data model instead of a raw data average (mean). This model takes into account several important questions. For instance - is there a trusted body of reviews? What is the age of a review and is the review from a credible source?

Below you'll find details around some of the important factors that went into calculating the ranking score for Shotover Jet.

If you have any questions or comments about our ranking score calculation please get in touch at info@rankers.co.nz. We don't believe this is perfect or complete so we're always interested in ways we might make improvements.

Nick Morrison's avatar

Nick Morrison

Rankers owner

Shotover Jet

Valid Reviews

267 Valid Reviews

The Shotover Jet experience has a total of 269 reviews. There are 267 valid reviews that are included when calculating the ranking score and 2 invalid reviews that are excluded from the calculation. Reviews can be excluded only when a reviewer is not verified or after an investigation by our team determines the reviewer is not genuine.

Below is the distribution of ratings for the 267 valid reviews:

Rating Count Percentage
10/10 86
32%
9/10 65
24%
8/10 50
19%
7/10 35
13%
6/10 18
7%
5/10 8
3%
4/10 2
1%
3/10 2
1%
2/10 0
0%
1/10 1
0%

84.38% Average

The raw data average (mean) for all the Shotover Jet valid reviews is 84.38% and is based on 267 valid reviews. This value is not used to calculate the ranking score and it only provided here as a comparison to the weighted average.

Face-to-Face Reviews

234 Face-to-Face Reviews

The Rankers team meets with travellers while they’re in New Zealand and conducts face-to-face surveys. These reviews, in our opinion, are the most trusted in the industry and represent a critical control sample. To our knowledge, we are the only travel review website in the world that has gone to this extent.

More about face-to-face reviews

Within the 267 valid reviews, the experience has 234 face-to-face reviews collected during interviews by our team.

Below is the distribution of ratings for the 234 face-to-face reviews:

Rating Count Percentage
10/10 70
30%
9/10 55
24%
8/10 46
20%
7/10 33
14%
6/10 18
8%
5/10 7
3%
4/10 2
1%
3/10 2
1%
2/10 0
0%
1/10 1
0%

83.42% Average

The raw data average (mean) for all the Shotover Jet face-to-face reviews is 83.42% and is based on 234 face-to-face reviews. This value is not used to calculate the ranking score and it only provided here for comparison purposes.

Weighted Average

85.98%

Rankers calculates a weighted mean as a base average on which we can improve. Individual review's ratings are given a weight based on several factors. The weight of a review determines the overall impact it'll have on the final weighted average.

Recent reviews have more weight as they are more relevant and reflect the experience as it currently operates. Over time reviews become less relevant and loose their impact on the ranking score.

Low rating reviews carry slightly less weight. This dampens the effect of very low ratings for every experience across the board. This is especially important when the experience has few reviews overall and a single negative rating can grossly mischaracterise an experience. Consistent poor reviews will still result in the experience receiving a comparitively low ranking score.

Credible sources provide reviews that can be trusted. If we have verified a reviewer is genuine via a face-to-face meeting then the review carries additional weight.

Reviewer Rating Age Relative Weight
Josh Mills 9/10 356 days 100%
Alex Hah 9/10 398 days 94%
Nicola 6/10 404 days 93%
Jair 10/10 426 days 89%
Louise Walker 10/10 447 days 71%
Hazel Norman 10/10 487 days 78%
Gavin Moffatt 7/10 698 days 38%
Jeeyoung Kim 10/10 708 days 36%
Kim Rasun 10/10 708 days 36%
Anke Vater 7/10 712 days 35%
Joerg 7/10 713 days 35%
George Bellwood 10/10 713 days 35%
Katrina 8/10 729 days 33%
Leonie Prendeville 6/10 758 days 29%
Ivan Dupont 9/10 763 days 28%
Madita and Lisann 9/10 797 days 24%
Andy Jobst 6/10 1178 days 6%
Antoine Vernay 3/10 1183 days 6%
Andi Kermode 9/10 1331 days 5%
Patricia Erni 10/10 1431 days 6%
Robert Erni 10/10 1431 days 6%
Manuel Bleiker 9/10 1431 days 6%
Laura Metz 10/10 1466 days 6%
Hubertus Thost 9/10 1466 days 6%
Emma Wallace 10/10 1487 days 6%
Michael Sheridan 10/10 1493 days 6%
Ben Sheridan 8/10 1493 days 6%
Ruben Garcia Raiuiro 8/10 1502 days 6%
Anne and Steve Bartlett 9/10 1504 days 6%
Nicolas Trezeguet 7/10 1513 days 6%
hendrik king 8/10 1726 days 4%
Andy Cummins 10/10 1805 days 5%
Sharyn Crosby 10/10 1818 days 4%
Guillot 8/10 1825 days 5%
Michal Maly 9/10 1844 days 5%
Karin Genyn 10/10 1894 days 5%
Michael Kretzschmar 9/10 1894 days 5%
Tom and Jemima Rawlings 8/10 1899 days 5%
Franz Schueler 10/10 1900 days 5%
Meryem Buchwitz 10/10 1921 days 5%
Karsten Meyer 8/10 1923 days 5%
Michel Vourbraak 5/10 1924 days 5%
TheHoon 9/10 2152 days 4%
Simon Rawlinson 10/10 2164 days 4%
Norman UK 10/10 2175 days 4%
Larry Curtiss 10/10 2180 days 4%
Madeleine Mueller 10/10 2188 days 4%
Jaap & Susanne 8/10 2192 days 4%
Anne King 6/10 2192 days 4%
Fleming Lauridsen 9/10 2192 days 4%
Robert & Bridget Holden 9/10 2192 days 4%
Howell Davies 10/10 2192 days 4%
Linda Kosters 10/10 2192 days 4%
Aridne Giraud 9/10 2195 days 4%
Kolen 10/10 2195 days 4%
Helen Chilton 8/10 2200 days 4%
Tim Gamblen 10/10 2200 days 4%
Jonathan Philp 7/10 2204 days 4%
Clemens 6/10 2205 days 4%
Heike 10/10 2207 days 4%
Frank & Julia 7/10 2211 days 4%
FlyKiwiFly 7/10 2212 days 4%
joerem 5/10 2212 days 4%
Colin Jenkins 8/10 2223 days 4%
deJong 8/10 2278 days 4%
Gerard Crothers 10/10 2281 days 4%
Christoph 7/10 2283 days 4%
Steve 9/10 2288 days 4%
Helle Thomsen 10/10 2290 days 4%
Wendy Ashmore 10/10 2290 days 4%
James McColl 6/10 2304 days 4%
katel86 10/10 2365 days 3%
Kimberly St Louis 10/10 2488 days 3%
Sam papworth 10/10 2517 days 4%
Josephine Hartley 1/10 2517 days 3%
Nicola Young 5/10 2517 days 4%
Schury 10/10 2520 days 4%
Rob O'Neill 9/10 2520 days 4%
Katarina Bokor 10/10 2526 days 4%
Sue Carren 8/10 2526 days 4%
Mark Franklin 8/10 2526 days 4%
Emma Cross 9/10 2528 days 4%
John & Lorraine 8/10 2528 days 4%
Hanggi 9/10 2529 days 4%
Julie and Russ Charles 10/10 2531 days 4%
Berger 10/10 2533 days 4%
Juliane Kleiu 10/10 2539 days 4%
Claudia 10/10 2539 days 4%
Siggi Wick 10/10 2540 days 4%
Birga 9/10 2546 days 4%
Cameron and Kim 10/10 2548 days 4%
Ebi & Beate 8/10 2549 days 4%
taniadeanryanbrittany 8/10 2549 days 3%
Alice Galley 8/10 2552 days 4%
Alice 9/10 2553 days 4%
Alexander & Stephanie 8/10 2554 days 4%
Lauren Pestell 8/10 2556 days 4%
Bob Warne 9/10 2560 days 4%
Jol Balder 4/10 2565 days 4%
Irene and Thib Schneider 9/10 2565 days 4%
Doris Schollenberger 9/10 2567 days 4%
Roger Lows 9/10 2568 days 4%
Glenn 9/10 2568 days 4%
Ryan Tull 7/10 2572 days 4%
Hull 10/10 2572 days 4%
Brandt 10/10 2574 days 4%
Emma Wilkinson 6/10 2576 days 4%
Lyndell 9/10 2639 days 3%
KAA 10/10 2700 days 3%
Andrew Hammond 10/10 2700 days 3%
kristy 9/10 2730 days 3%
Behrenot 8/10 2831 days 3%
M Schram 7/10 2832 days 3%
garfield 9/10 2853 days 3%
BelindaT 10/10 2861 days 3%
nuwee 9/10 2883 days 3%
Hana Vokata 10/10 2888 days 3%
Wyss A 10/10 2895 days 3%
katrina Marshall 9/10 2900 days 3%
Pam & Norman 9/10 2907 days 3%
Chris Bil 10/10 2909 days 3%
Sue S 8/10 2909 days 3%
Rod C 10/10 2912 days 3%
Richard 5/10 2918 days 3%
Doris Resch 10/10 2920 days 3%
Matthiis & Femke 8/10 2921 days 3%
Ed & Pat Mitchell 9/10 2922 days 3%
Jenny 8/10 2922 days 3%
Neal 10/10 2927 days 3%
Yona 7/10 2928 days 3%
Mathias 10/10 2929 days 3%
Jamie 10/10 2934 days 3%
Lewis 10/10 2935 days 3%
kararina Kosten 9/10 2936 days 3%
Vincente Garrido 7/10 2937 days 3%
Ingrid Overes 9/10 2941 days 3%
S Luis Van Oler 9/10 2947 days 3%
nigelst 9/10 2948 days 3%
Dale W 8/10 2951 days 3%
Omar Frenchy 9/10 2951 days 3%
Marons 7/10 2993 days 3%
Sena 7/10 3014 days 3%
Kyle Riseley 8/10 3015 days 3%
Rebecca Jenner 8/10 3015 days 3%
Carl and Angela Rapihana 6/10 3027 days 3%
nancyburns 10/10 3034 days 2%
marleen451 9/10 3065 days 2%
Jackie Anderson 10/10 3095 days 2%
bogaard 8/10 3130 days 3%
Katie 10/10 3187 days 2%
Charles Lyne 10/10 3218 days 2%
TillE412 10/10 3233 days 3%
ElleGermany 9/10 3236 days 3%
JonK 10/10 3236 days 3%
BeckieM 9/10 3238 days 3%
Anji Sprinks 9/10 3245 days 3%
SteveB 10/10 3248 days 3%
annysp 10/10 3248 days 3%
davidne 6/10 3248 days 3%
Jeremy 9/10 3248 days 3%
Daniel 9/10 3254 days 3%
Richard 9/10 3258 days 3%
MichaelS1 9/10 3264 days 3%
ChrisD 10/10 3264 days 3%
AstridVG 8/10 3264 days 3%
Lucas 9/10 3264 days 3%
StijnH 7/10 3265 days 3%
TobiasK 8/10 3267 days 3%
Michael 9/10 3272 days 3%
amyd 9/10 3279 days 2%
Linda 6/10 3279 days 3%
Kelly 10/10 3280 days 3%
CarleyJ 7/10 3282 days 3%
VictoriaH 9/10 3283 days 3%
RobC1 7/10 3283 days 3%
JoT 8/10 3283 days 3%
RobH 7/10 3284 days 3%
Eileen Harris 9/10 3287 days 2%
Brian 10/10 3287 days 2%
Amanda Williams 10/10 3288 days 2%
CarinnaGermany 7/10 3290 days 2%
Trevor 10/10 3291 days 2%
David 7/10 3296 days 2%
Conway 9/10 3299 days 2%
Ralf 9/10 3300 days 2%
Christina 10/10 3312 days 2%
John 10/10 3317 days 2%
Jon 8/10 3319 days 2%
Karen 8/10 3319 days 2%
Bernd 6/10 3321 days 2%
Kori 8/10 3361 days 2%
David 7/10 3361 days 2%
Dan 9/10 3379 days 2%
Nicole 6/10 3382 days 2%
Stephanie Schikora 10/10 3391 days 2%
Gaurav M 7/10 3410 days 2%
Kate 7/10 3434 days 2%
Robin 10/10 3437 days 2%
Mike 9/10 3443 days 2%
Felicity 8/10 3446 days 2%
Suyin 10/10 3446 days 2%
Fothergill 7/10 3454 days 2%
Christopher 8/10 3459 days 2%
James 9/10 3459 days 2%
jillian 6/10 3467 days 2%
Andy 7/10 3480 days 2%
loumac 8/10 3483 days 2%
Gray 10/10 3484 days 2%
Lucchi 3/10 3500 days 2%
Ashlee Roberts 10/10 3545 days 2%
L1z4rd 10/10 3578 days 2%
Kori Barton 7/10 3590 days 2%
Franz 9/10 3619 days 2%
Daniela 6/10 3624 days 2%
Daniel 10/10 3628 days 2%
Wendy 6/10 3632 days 2%
Mikel 6/10 3632 days 2%
Dunet 9/10 3632 days 2%
Jeanette 8/10 3634 days 2%
Christian 7/10 3635 days 2%
Neil 6/10 3639 days 2%
Marian Mckinney 8/10 3641 days 2%
Stephanie Grisel 9/10 3641 days 2%
Dirk 10/10 3647 days 2%
Jurg Meister 5/10 3648 days 2%
Lisa Tame 7/10 3649 days 2%
Steven 10/10 3649 days 2%
Ian and Judy 10/10 3649 days 2%
Erwin de Kleijn 8/10 3653 days 2%
Reina Lohaye 8/10 3663 days 2%
Marc Hertogs 7/10 3664 days 2%
V Wood 5/10 3664 days 2%
paulonline 8/10 3666 days 2%
Pauline Thai 10/10 3667 days 2%
Bex 9/10 3675 days 2%
Stephen Brightman 9/10 3676 days 2%
Madeleine Rowland 10/10 3676 days 2%
Swen Schroder 8/10 3688 days 2%
Tim 10/10 3688 days 2%
Bronwyn Gaby 8/10 3694 days 2%
Ard 7/10 3723 days 2%
Patricia Leighton 10/10 3850 days 2%
Andy Chapman 8/10 3850 days 2%
Tanja 4/10 3954 days 1%
Alan 7/10 3959 days 1%
Svenja 6/10 3964 days 1%
Michael 8/10 3966 days 1%
Akiko&Shibotsu 9/10 3966 days 1%
Roger&Shirley 8/10 3972 days 1%
Fred 9/10 3978 days 1%
Kathryn 7/10 3981 days 1%
Michaela 8/10 4002 days 1%
Ian 7/10 4002 days 1%
Pete 8/10 4002 days 1%
Anne 9/10 4002 days 1%
Malon 7/10 4004 days 1%
Vibeke 8/10 4013 days 1%
beesom 10/10 4014 days 1%
Hirsh 9/10 4018 days 1%
Kerry 5/10 4023 days 1%
Alison 8/10 4023 days 1%
Jim 10/10 4024 days 1%
Peter&Amy 7/10 4024 days 1%
Franz-Josef 10/10 4030 days 1%
Marc 5/10 4031 days 1%
JuanPablo 9/10 4037 days 1%
Moritz 10/10 5410 days 0%

Adjustments

Several adjustments to the weighted average are added to improve relevancy and credibility. These adjustments apply equally to all experiences that meet the criteria.

Sample Size Adjustment

No Adjustment

A reasonable number of reviews are necessary in order for the average to be credible and for an experience to take a prime position within the ranking tables. As such, experiences with only a few reviews have a moderated score. This does not mean that the experience or the reviews can't be trusted. The Shotover Jet experience has plenty of reviews and does not meet the criteria for any adjustment.

Recent Reviews Adjustment

-4.60% Adjustment

There may be an adjustment if an experience hasn't received any reviews within the last 60 days. However the Shotover Jet experience does not meet the criteria for any adjustment.

In addition, an experience's ranking score may be adjusted for each day there is no new ranking. After 1 day the adjustment comes into effect. The maximum number of days that can be adjusted for is 364 days.

The Shotover Jet experience has been adjusted for 230 days. Adjustments are according to the following table.

Days Adjustment
227 -4.54%
228 -4.56%
229 -4.58%
230 -4.60%
231 -4.62%
232 -4.64%
233 -4.66%

Final Ranking Score

81%

The final ranking score once adjustments and rounding has been applied. This value is cached and recalculated each day. Therefore it may not be precisely accurate based on the other values presented.

If you have any questions or comments about our ranking score calculation please get in touch at info@rankers.co.nz.