Back

Ranking Score Explained

G'day, thanks for your interest in how we calculate an experience's ranking score. It's at the core of Rankers so I'm pleased you're curious.

The ranking score percentage is used to compare and sort experiences in ranking tables. It is not necessarily a direct measurement of the quality of a particular experience as rated by its customers. I've found it a useful tool to allow me to find the best experiences with confidence. But I've also found it important to read the customer reviews before making any final judgements!

We calculate an experience's ranking score using a multi-factor data model instead of a raw data average (mean). This model takes into account several important questions. For instance - is there a trusted body of reviews? What is the age of a review and is the review from a credible source?

Below you'll find details around some of the important factors that went into calculating the ranking score for Kahu Kayaks.

If you have any questions or comments about our ranking score calculation please get in touch at info@rankers.co.nz. We don't believe this is perfect or complete so we're always interested in ways we might make improvements.

Cymen Crick's avatar

Cymen Crick

Rankers Owner

Kahu Kayaks

Valid Reviews

223 Valid Reviews

The Kahu Kayaks experience has a total of 224 reviews. There are 223 valid reviews that are included when calculating the ranking score and 1 invalid review that are excluded from the calculation. Reviews can be excluded only when a reviewer is not verified or after an investigation by our team determines the reviewer is not genuine.

Below is the distribution of ratings for the 223 valid reviews:

Rating Count Percentage
10/10 112
50%
9/10 62
28%
8/10 36
16%
7/10 9
4%
6/10 3
1%
5/10 0
0%
4/10 0
0%
3/10 1
0%
2/10 0
0%
1/10 0
0%

91.93% Average

The raw data average (mean) for all the Kahu Kayaks valid reviews is 91.93% and is based on 223 valid reviews. This value is not used to calculate the ranking score and it only provided here as a comparison to the weighted average.

Face-to-Face Reviews

174 Face-to-Face Reviews

The Rankers team meets with travellers while they’re in New Zealand and conducts face-to-face surveys. These reviews, in our opinion, are the most trusted in the industry and represent a critical control sample. To our knowledge, we are the only travel review website in the world that has gone to this extent.

More about face-to-face reviews

Within the 223 valid reviews, the experience has 174 face-to-face reviews collected during interviews by our team.

Below is the distribution of ratings for the 174 face-to-face reviews:

Rating Count Percentage
10/10 74
43%
9/10 55
32%
8/10 33
19%
7/10 8
5%
6/10 3
2%
5/10 0
0%
4/10 0
0%
3/10 1
1%
2/10 0
0%
1/10 0
0%

90.57% Average

The raw data average (mean) for all the Kahu Kayaks face-to-face reviews is 90.57% and is based on 174 face-to-face reviews. This value is not used to calculate the ranking score and it only provided here for comparison purposes.

Weighted Average

93.24%

Rankers calculates a weighted mean as a base average on which we can improve. Individual review's ratings are given a weight based on several factors. The weight of a review determines the overall impact it'll have on the final weighted average.

Recent reviews have more weight as they are more relevant and reflect the experience as it currently operates. Over time reviews become less relevant and loose their impact on the ranking score.

Low rating reviews carry slightly less weight. This dampens the effect of very low ratings for every experience across the board. This is especially important when the experience has few reviews overall and a single negative rating can grossly mischaracterise an experience. Consistent poor reviews will still result in the experience receiving a comparitively low ranking score.

Credible sources provide reviews that can be trusted. If we have verified a reviewer is genuine via a face-to-face meeting then the review carries additional weight.

Reviewer Rating Age Relative Weight
Kara 10/10 1354 days 100%
Seaghan & Dune 10/10 1444 days 75%
Pat Burns 10/10 2481 days 21%
Sabine Gauss 9/10 3204 days 13%
Rashi Birla 10/10 3224 days 13%
Alex Patteron 10/10 3264 days 12%
Marcel Felder 10/10 3300 days 12%
Tom Rogers 8/10 3303 days 12%
Olde Vogel 8/10 3303 days 12%
Lieke vol Velde 9/10 3303 days 12%
Katharina 8/10 3308 days 12%
Eurard Achille 8/10 3316 days 12%
Nickolas Jonkergouw 9/10 3332 days 11%
Miriam Gamble 9/10 3347 days 11%
Michelle O'Regen 10/10 3544 days 9%
Dahlia Ahmed 9/10 3567 days 9%
Lee Sandberg 10/10 3594 days 9%
Tina Rust 10/10 3595 days 9%
Alice and James 7/10 3613 days 8%
Chloe Guerillot 6/10 3618 days 7%
Christopher Rotsch 8/10 3652 days 8%
Tarillon Family 7/10 3932 days 5%
Charles Aubry 9/10 3964 days 5%
Arvid Hellquist 9/10 3974 days 4%
Damaris Mayer 8/10 3981 days 4%
David and Stephan 10/10 4011 days 4%
Devan Sheppard 9/10 4029 days 4%
Christina 7/10 4289 days 1%
Kathrin Lerch 10/10 4289 days 1%
Erik Nestlez 10/10 4290 days 1%
Nina Helmling 8/10 4305 days 1%
Steffen 9/10 4305 days 1%
Barbara 10/10 4319 days 1%
Marinette 8/10 4319 days 1%
Luca Scheuemeier 10/10 4319 days 1%
Kristina 8/10 4350 days 0%
Volker 8/10 4350 days 0%
jonas meier 9/10 4371 days 0%
Romina Bolz 8/10 4371 days 0%
Paul Balfour 8/10 4376 days 0%
Eric and Nienke 9/10 4397 days 6%
Julie Hatch 10/10 4458 days 6%
Rampon 9/10 4659 days 6%
Debiesse 10/10 4660 days 6%
Hendrik Rother 10/10 4663 days 6%
Claire 8/10 4672 days 6%
Jana Simcikova 10/10 4674 days 6%
Fabian Koitka 9/10 4692 days 6%
Michal Maly 8/10 4698 days 6%
JohnHyde 10/10 4731 days 6%
Aurelie Morin 7/10 4753 days 5%
Natalie Nubler 10/10 4754 days 6%
Anne Sutkowi 7/10 4762 days 5%
Sasha and Sandra Bonavia 9/10 4762 days 6%
Erik Funk 9/10 4769 days 6%
Harald Prinz 8/10 4773 days 6%
James Darren Tennant 10/10 4774 days 6%
scoopy 10/10 5006 days 6%
Goran Backlund 9/10 5022 days 6%
Tinne Cis 6/10 5034 days 5%
Richard and Janet 10/10 5040 days 6%
Michael Jefferies 10/10 5040 days 6%
Harald 10/10 5046 days 6%
Anne King 9/10 5046 days 6%
Matt Kelley 9/10 5046 days 6%
Lotte Zwail 9/10 5046 days 6%
Hannah Bean 8/10 5048 days 6%
Mike & Jennie 9/10 5048 days 6%
Mike & Mandy 8/10 5048 days 6%
pamr 8/10 5050 days 6%
Villa 9/10 5051 days 6%
Richard Spandonk 8/10 5054 days 6%
Franziska & Katrin 10/10 5058 days 6%
Clemens 10/10 5059 days 6%
Devon Urlacher 8/10 5060 days 6%
Thomas Krause 8/10 5060 days 6%
Lilja Bjork Hermannsdottir 7/10 5065 days 5%
Remy van Heugten 8/10 5065 days 6%
Keith_W 10/10 5066 days 6%
Annika 10/10 5066 days 6%
ToGy 8/10 5066 days 6%
Alfred & Henrike 10/10 5091 days 6%
Barbsldh 10/10 5097 days 6%
Deirdre Hayes 8/10 5134 days 6%
Cornelia & Josef 9/10 5140 days 6%
Fran & Roger 10/10 5145 days 6%
Mark Bakker 8/10 5145 days 6%
Gert 9/10 5158 days 6%
katel86 10/10 5219 days 6%
Martin Potter 9/10 5370 days 6%
Anezka Hlavacova 9/10 5386 days 6%
Dave Jones 9/10 5387 days 6%
Rolf 8/10 5394 days 6%
Wouter Moui 9/10 5395 days 6%
Canada 10/10 5395 days 6%
Michael Long 10/10 5396 days 6%
Beat & Connie 10/10 5397 days 6%
Jacob Nube 9/10 5399 days 6%
Andy Cameron-Daniels 10/10 5401 days 6%
khs 9/10 5403 days 6%
Ann Parry 10/10 5407 days 6%
Adam Hayley 7/10 5415 days 5%
Katie Nicol 10/10 5416 days 6%
Darren Bruestle 9/10 5418 days 6%
Tom 9/10 5421 days 6%
Russell Stevens 8/10 5421 days 6%
Philipp Rau 9/10 5422 days 6%
Luc Marchand 10/10 5423 days 6%
Julia 10/10 5423 days 6%
Leslie Aldridge 10/10 5424 days 6%
Jorgen vahl Rasmussen 9/10 5424 days 6%
pjfranke 10/10 5431 days 6%
Beate Godsk 9/10 5431 days 6%
Bunthorne 10/10 5462 days 6%
emthekiwi 10/10 5554 days 6%
Demmers 10/10 5646 days 6%
Phineas Smith-Fox 9/10 5704 days 6%
wilsoneng 10/10 5737 days 6%
Maria 9/10 5737 days 6%
Tim Smith 10/10 5759 days 6%
BenH 10/10 5768 days 6%
Flora 10/10 5770 days 6%
Vera Van Schie 10/10 5776 days 6%
Thomas K 9/10 5777 days 6%
Jannievan Osnabrugge 10/10 5778 days 6%
Helen B 9/10 5778 days 6%
Ferth 10/10 5782 days 6%
Roos 9/10 5782 days 6%
Klass 9/10 5782 days 6%
Hannah Clark 10/10 5789 days 6%
Ingrid Overes 10/10 5795 days 6%
Tracey Buschl 10/10 5796 days 6%
Mitchell Mapletree 10/10 5812 days 6%
Maki 10/10 5827 days 6%
nigelwaterhouse 9/10 5827 days 6%
Ed 10/10 5827 days 6%
Dogmatix 10/10 5827 days 6%
sophiep 9/10 5842 days 6%
biene 10/10 5842 days 6%
Susann Koschmeider 10/10 5862 days 6%
Karen Raven 8/10 5865 days 6%
Eimear Doyle 10/10 5870 days 6%
Ton Buil 9/10 5870 days 6%
amzbellz 10/10 5919 days 6%
Kurt Smudzinski 10/10 5949 days 6%
bertel 10/10 5985 days 6%
desl 10/10 6102 days 6%
martinat 10/10 6102 days 6%
Van Lent 8/10 6103 days 6%
S Schlesinger 10/10 6106 days 6%
Andrew Smith 9/10 6108 days 6%
BevanLisa 9/10 6119 days 6%
Barry Smith 9/10 6122 days 6%
Mia 10/10 6123 days 6%
Soeren Rasmussen 10/10 6124 days 6%
eatc 10/10 6133 days 6%
A 9/10 6133 days 6%
Charles 8/10 6134 days 6%
Dalibor 10/10 6136 days 6%
ChristopherD 8/10 6136 days 6%
CarolB 10/10 6136 days 6%
Emma Louise 9/10 6145 days 6%
Christina 8/10 6150 days 6%
Rachel 10/10 6151 days 6%
AlastairP 10/10 6159 days 6%
mike smith 10/10 6159 days 6%
Caroline 9/10 6159 days 6%
Busson 8/10 6164 days 6%
Hans 7/10 6166 days 5%
Nicole 10/10 6166 days 6%
Tanja 10/10 6166 days 6%
Dianne 9/10 6170 days 6%
LeaM 9/10 6172 days 6%
AndreM 10/10 6172 days 6%
JohannesE 7/10 6172 days 5%
Bernd 10/10 6172 days 6%
KTinga 9/10 6173 days 6%
Lucas 10/10 6174 days 6%
Josefine 10/10 6174 days 6%
alex 10/10 6174 days 6%
Richard Rodd 10/10 6180 days 6%
rar 10/10 6180 days 6%
Melanie 10/10 6182 days 6%
Katherine 10/10 6206 days 6%
Claire 9/10 6214 days 6%
Tim 10/10 6222 days 6%
Maureen 10/10 6222 days 6%
lming60 10/10 6227 days 6%
peter_lowles 10/10 6232 days 6%
mike brett 8/10 6236 days 6%
RhysandSteffi 10/10 6252 days 6%
Paula Semmens 9/10 6260 days 6%
StephR 10/10 6261 days 6%
Rudolf Meredith 10/10 6262 days 6%
Max 9/10 6337 days 6%
Rhea 9/10 6410 days 6%
annemarie_and_markus 10/10 6453 days 6%
charlotte 9/10 6474 days 6%
jahirst 10/10 6484 days 6%
Liz 9/10 6485 days 6%
Barnie 10/10 6488 days 6%
Christine 10/10 6488 days 6%
Kolacny 10/10 6488 days 6%
Mie Toft Pedersen 9/10 6498 days 6%
Emily Houston 10/10 6499 days 6%
Dirk 10/10 6501 days 6%
Ian Ridgeway 10/10 6503 days 6%
Loodle 9/10 6513 days 6%
Zurcher Marco 3/10 6529 days 3%
Anna 10/10 6542 days 6%
Hugh McCarthy 6/10 6549 days 5%
Tony and Ken 10/10 6549 days 6%
Anneli 8/10 6550 days 6%
holly parker 10/10 6560 days 6%
Vince 10/10 6569 days 6%
Lena 10/10 6580 days 6%
Carolr 9/10 6591 days 6%
MarkReid 10/10 6792 days 6%
Hazel 9/10 6826 days 6%
Magnus 8/10 6832 days 6%
Katie 10/10 6835 days 6%
Heather 10/10 6839 days 6%
Jacob Mille 10/10 6846 days 6%

Adjustments

Several adjustments to the weighted average are added to improve relevancy and credibility. These adjustments apply equally to all experiences that meet the criteria.

Sample Size Adjustment

No Adjustment

A reasonable number of reviews are necessary in order for the average to be credible and for an experience to take a prime position within the ranking tables. As such, experiences with only a few reviews have a moderated score. This does not mean that the experience or the reviews can't be trusted. The Kahu Kayaks experience has plenty of reviews and does not meet the criteria for any adjustment.

Recent Reviews Adjustment

-4.06% Adjustment

There may be an adjustment if this experience hasn't received any reviews within the last 42 days. However the Kahu Kayaks experience does not meet the criteria for any adjustment.

In addition, an experience's ranking score may be adjusted for each day there is no new ranking. After 1 day the adjustment comes into effect. The maximum number of days that can be adjusted for is 200 days. Due to the seasonal nature of many businesses, this adjustment is applied dynamically throughout the year.

The Kahu Kayaks experience has been adjusted for 200 days. Adjustments are according to the following table.

Days Adjustment
… …
197 -4.00%
198 -4.02%
199 -4.04%
200 -4.06%
201 -4.08%
202 -4.10%
203 -4.12%
… …

Balancing Adjustment

1.11% Adjustment

Every experience's review score is adjusted to balance out the disproportional number of negative reviews that are contributed.

You won't be surprised to learn that disgruntled customers are more likely to leave a review than happy ones. They are motivated to share their experience and warn others. We consider this a good thing and it's why reading the reviews is important. However we've learned it can misrepresent the experience in a more overall sense.

We apply a balancing adjustment to counteract this effect and ensure the ranking score is a more fair representation of the experience. This adjustment is applied equally to all experiences.

Final Ranking Score

90%

The final ranking score once any adjustments, ratings, and rounding has been applied. This value is recalculated each day and a short rolling average is applied. Therefore it may not be precisely accurate based on the other values presented.