Ranking Score Explained

Hi there, thanks for your interest in how we calculate an experience's ranking score. It's at the core of Rankers so I'm pleased you're curious.

The ranking score percentage is used to compare and sort experiences in ranking tables. It is not necessarily a direct measurement of the quality of a particular experience as rated by its customers. I've found it a useful tool to allow me to find the best experiences with confidence. But I've also found it important to read the customer reviews before making any final judgements!

We calculate an experience's ranking score using a multi-factor data model instead of a raw data average (mean). This model takes into account several important questions. For instance - is there a trusted body of reviews? What is the age of a review and is the review from a credible source?

Below you'll find details around some of the important factors that went into calculating the ranking score for Stray.

If you have any questions or comments about our ranking score calculation please get in touch at info@rankers.co.nz. We don't believe this is perfect or complete so we're always interested in ways we might make improvements.

Nick Morrison's avatar

Nick Morrison

Rankers owner

Stray

Valid Reviews

195 Valid Reviews

The Stray experience has a total of 202 reviews. There are 195 valid reviews that are included when calculating the ranking score and 7 invalid reviews that are excluded from the calculation. Reviews can be excluded only when a reviewer is not verified or after an investigation by our team determines the reviewer is not genuine.

Below is the distribution of ratings for the 195 valid reviews:

Rating Count Percentage
10/10 62
32%
9/10 42
22%
8/10 36
18%
7/10 31
16%
6/10 9
5%
5/10 7
4%
4/10 3
2%
3/10 5
3%
2/10 0
0%
1/10 0
0%

83.03% Average

The raw data average (mean) for all the Stray valid reviews is 83.03% and is based on 195 valid reviews. This value is not used to calculate the ranking score and it only provided here as a comparison to the weighted average.

Face-to-Face Reviews

101 Face-to-Face Reviews

The Rankers team meets with travellers while they’re in New Zealand and conducts face-to-face surveys. These reviews, in our opinion, are the most trusted in the industry and represent a critical control sample. To our knowledge, we are the only travel review website in the world that has gone to this extent.

More about face-to-face reviews

Within the 195 valid reviews, the experience has 101 face-to-face reviews collected during interviews by our team.

Below is the distribution of ratings for the 101 face-to-face reviews:

Rating Count Percentage
10/10 10
10%
9/10 15
15%
8/10 30
30%
7/10 28
28%
6/10 6
6%
5/10 4
4%
4/10 3
3%
3/10 5
5%
2/10 0
0%
1/10 0
0%

74.65% Average

The raw data average (mean) for all the Stray face-to-face reviews is 74.65% and is based on 101 face-to-face reviews. This value is not used to calculate the ranking score and it only provided here for comparison purposes.

Weighted Average

86.82%

Rankers calculates a weighted mean as a base average on which we can improve. Individual review's ratings are given a weight based on several factors. The weight of a review determines the overall impact it'll have on the final weighted average.

Recent reviews have more weight as they are more relevant and reflect the experience as it currently operates. Over time reviews become less relevant and loose their impact on the ranking score.

Low rating reviews carry slightly less weight. This dampens the effect of very low ratings for every experience across the board. This is especially important when the experience has few reviews overall and a single negative rating can grossly mischaracterise an experience. Consistent poor reviews will still result in the experience receiving a comparitively low ranking score.

Credible sources provide reviews that can be trusted. If we have verified a reviewer is genuine via a face-to-face meeting then the review carries additional weight.

Reviewer Rating Age Face-to-Face Weight Relative Weight
Atte 6/10 648 days 30.43 100%
Tom C 10/10 1438 days 4.33 14%
Jodie 10/10 1438 days 4.33 14%
Paul 10/10 1438 days 4.33 14%
Christin Ossege 10/10 1560 days 4.09 13%
Theodore Trozinski 9/10 1620 days 3.97 13%
Phil Hartmann 10/10 1773 days 3.67 12%
dana forrest 10/10 1865 days 3.49 11%
Abbi Smith 10/10 1926 days 3.37 11%
Nicko Wong 10/10 1957 days 3.31 11%
Jodine 10/10 1985 days 3.26 11%
Samuel Berwick 10/10 1985 days 3.26 11%
Amy Jellings 10/10 2077 days 3.08 10%
Anna Elden 9/10 2077 days 3.08 10%
Andrea Leichtl 10/10 2292 days 2.66 9%
Johanna Molenaar 7/10 2292 days 2.42 8%
Claudia Bauch 3/10 2321 days true 2.0 7%
Charlotte Wilson 10/10 2322 days 2.6 9%
Chris Luebbi 8/10 2323 days 2.47 8%
jason beinstein 9/10 2350 days 2.54 8%
discoveringaway 9/10 2351 days 2.54 8%
ieva m 8/10 2382 days 2.36 8%
Sonia 10/10 2382 days 2.48 8%
Zsolt 10/10 2382 days 2.48 8%
Victoria Wander 10/10 2382 days 2.48 8%
TtotheT13 9/10 2413 days 2.42 8%
Kim O'Neill 10/10 2443 days 2.36 8%
Maia Kazaks 8/10 2443 days 2.24 7%
Colette Keely 10/10 2474 days 2.3 8%
Jen Hards 10/10 2504 days 2.24 7%
Thomas Jones 10/10 2535 days 2.18 7%
Raj Singh 10/10 2535 days 2.18 7%
Sohie 9/10 2693 days true 1.87 6%
Robin Andersson 9/10 2716 days 1.83 6%
Megan Gallagher 10/10 2747 days 1.77 6%
Andy Brown 10/10 2747 days 1.77 6%
Vinnie K 10/10 2808 days 1.65 5%
Heather_Oz 9/10 2869 days 1.53 5%
luciasolda 10/10 2931 days 1.41 5%
jennyj 10/10 2961 days 1.35 4%
dwehrtmann 9/10 2992 days 1.29 4%
Evaislief 10/10 3022 days 1.23 4%
Malena 10/10 3053 days 1.17 4%
navilink 10/10 3053 days 1.17 4%
meganb04 10/10 3053 days 1.17 4%
MaryG 10/10 3053 days 1.17 4%
JoPycroft 10/10 3053 days 1.17 4%
lovebyname 9/10 3053 days 1.17 4%
Sonia Sennane 7/10 3054 days true 1.06 3%
Tamara McVey 7/10 3065 days true 1.04 3%
Rachel 7/10 3067 days true 1.04 3%
Danielle & Jobbe 8/10 3067 days true 1.08 4%
Andy Bridgman 8/10 3067 days true 1.08 4%
Fiona Finke 6/10 3073 days true 0.94 3%
Miron & Hendrik 8/10 3077 days true 1.07 4%
marielou 10/10 3082 days 1.11 4%
iainmcgin 10/10 3082 days 1.11 4%
redkeels 10/10 3082 days 1.11 4%
lulu 6/10 3113 days 0.87 3%
Boogie 5/10 3144 days 0.8 3%
isha 9/10 3144 days 0.99 3%
pepper 9/10 3174 days 0.93 3%
Kez 10/10 3205 days 0.87 3%
Brilly01 8/10 3205 days 0.83 3%
yens123 9/10 3205 days 0.87 3%
louiset 9/10 3205 days 0.87 3%
siek09 9/10 3235 days 0.81 3%
rosey 10/10 3266 days 0.75 2%
Cadz 10/10 3266 days 0.75 2%
natalietrueman84 10/10 3297 days 0.69 2%
Josie 10/10 3297 days 0.69 2%
Scott_and_Stephanie 9/10 3388 days 0.51 2%
Samantha 10/10 3388 days 0.51 2%
Tracey Airiscough 9/10 3410 days true 0.47 2%
Vanessa Hanzen 4/10 3411 days true 0.37 1%
Lauren McKeone 7/10 3417 days true 0.41 1%
Faye Cox 7/10 3417 days true 0.41 1%
pudddddin 9/10 3419 days 0.45 1%
alicevarren 9/10 3419 days 0.45 1%
irisheyes 7/10 3419 days 0.41 1%
Steff 7/10 3439 days true 0.38 1%
Forestal Youri 7/10 3439 days true 0.38 1%
Amanda Craig 8/10 3441 days true 0.39 1%
Olle Beide 8/10 3447 days true 0.38 1%
JonathanMills 8/10 3447 days 0.38 1%
lisa 9/10 3478 days 0.34 1%
phydough 6/10 3509 days 0.23 1%
zippy 10/10 3600 days 0.1 0%
TerriH 10/10 3631 days 0.04 0%
ciara 10/10 3662 days 0.0 0%
mel1407 10/10 3662 days 0.0 0%
Claram 9/10 3692 days 0.0 0%
joycevanb 7/10 3723 days true 0.0 0%
JohnG 10/10 3723 days 0.0 0%
nicolejr413 9/10 3753 days 0.0 0%
Antoine Migault 8/10 3774 days true 0.0 0%
Christine T 7/10 3778 days true 0.0 0%
Kay Beaumont 8/10 3786 days true 0.0 0%
Johan 7/10 3786 days true 0.0 0%
S Millet 9/10 3790 days true 0.0 0%
Jens van Evp 9/10 3808 days true 0.0 0%
Max Van der Zalm 9/10 3808 days true 0.0 0%
Emily Walters 7/10 3810 days true 0.0 0%
Brett Oz 9/10 3843 days 0.0 0%
greenbex 9/10 3843 days 0.0 0%
simonbo 3/10 3858 days true 0.0 0%
katesc 9/10 3863 days true 0.0 0%
martint 6/10 3867 days true 0.0 0%
richelle 7/10 3867 days true 0.0 0%
rosalindm 8/10 3868 days true 0.0 0%
katepat 8/10 3874 days true 0.0 0%
Beau 5/10 3874 days 0.0 0%
Debbie Rathbone 10/10 3881 days true 0.0 0%
Ricarda 3/10 3884 days true 0.0 0%
Malinka Nuefeld 4/10 3884 days true 0.0 0%
Martin 9/10 3884 days true 0.0 0%
Thomas Willi 8/10 3884 days true 0.0 0%
Jess Pasos 9/10 3893 days true 0.0 0%
stettim 10/10 3935 days 0.0 0%
Philipp 9/10 3935 days 0.0 0%
Holly Mrowiec 10/10 3965 days 0.0 0%
Sophie Keate 10/10 4002 days true 0.0 0%
Sam Lightfoot 10/10 4002 days true 0.0 0%
Jenny Lee 7/10 4024 days true 0.0 0%
Cat Payne 9/10 4031 days true 0.0 0%
Catherine Smiles 10/10 4032 days true 0.0 0%
Nikki Turner 9/10 4039 days true 0.0 0%
TaraD 10/10 4116 days true 0.0 0%
BiancaA 9/10 4116 days true 0.0 0%
hibbler 10/10 4118 days 0.0 0%
ferdinande 7/10 4119 days true 0.0 0%
mariea 8/10 4130 days true 0.0 0%
JennekeK 6/10 4130 days true 0.0 0%
Ross 5/10 4132 days 0.0 0%
MarielR 7/10 4136 days true 0.0 0%
NikW 8/10 4136 days true 0.0 0%
Anna Skeer 9/10 4159 days 0.0 0%
EmmaB1 8/10 4164 days true 0.0 0%
BethanD 9/10 4165 days true 0.0 0%
renanf 8/10 4169 days 0.0 0%
Laura Muser 9/10 4176 days 0.0 0%
Alan Gallagher 7/10 4177 days 0.0 0%
Ellen Perrin 9/10 4177 days 0.0 0%
Julia 7/10 4180 days true 0.0 0%
Philipp 10/10 4182 days true 0.0 0%
Marieke 3/10 4184 days true 0.0 0%
Katie 10/10 4187 days 0.0 0%
Ann-Kathren 7/10 4190 days true 0.0 0%
Sonja 8/10 4223 days true 0.0 0%
Claudia Schmidt 9/10 4234 days 0.0 0%
sylvia 8/10 4239 days true 0.0 0%
Amy Newton 10/10 4242 days 0.0 0%
debsnz 10/10 4255 days 0.0 0%
Nicole 3/10 4265 days true 0.0 0%
Spike 7/10 4324 days true 0.0 0%
Sam Prior 8/10 4333 days true 0.0 0%
Marco 7/10 4357 days true 0.0 0%
Meike Biel 8/10 4468 days true 0.0 0%
Helen 8/10 4468 days true 0.0 0%
Mark 7/10 4488 days true 0.0 0%
Julie 5/10 4498 days true 0.0 0%
Marlo 7/10 4505 days true 0.0 0%
Simon Mills 8/10 4515 days true 0.0 0%
Sayaka 4/10 4530 days true 0.0 0%
Camille 10/10 4531 days true 0.0 0%
Anders 9/10 4531 days true 0.0 0%
Laura 8/10 4554 days true 0.0 0%
Ian 7/10 4558 days true 0.0 0%
Carole Roccia 6/10 4559 days true 0.0 0%
Thierry Berdah 8/10 4561 days true 0.0 0%
Helena 8/10 4561 days true 0.0 0%
Peter Katafey 6/10 4561 days true 0.0 0%
Lindsey Woosnam 5/10 4561 days true 0.0 0%
Katherine 7/10 4564 days true 0.0 0%
Fred 6/10 4565 days true 0.0 0%
Rob 5/10 4565 days true 0.0 0%
Gav 10/10 4565 days true 0.0 0%
Tom Anson 8/10 4566 days true 0.0 0%
Paul Cowie 10/10 4593 days true 0.0 0%
Jim 8/10 4602 days true 0.0 0%
Willemien 7/10 4610 days true 0.0 0%
Helen 8/10 4836 days true 0.0 0%
David 5/10 4839 days true 0.0 0%
Stefan 7/10 4839 days true 0.0 0%
Gwen 8/10 4842 days true 0.0 0%
Hanneke 8/10 4846 days true 0.0 0%
Matt 7/10 4846 days true 0.0 0%
Alex 8/10 4846 days true 0.0 0%
Johnny 8/10 4846 days true 0.0 0%
Aaron 9/10 4846 days true 0.0 0%
Hilary 10/10 4855 days true 0.0 0%
Nina 8/10 4890 days true 0.0 0%
Italy 9/10 4890 days true 0.0 0%
Helle 7/10 4890 days true 0.0 0%
KikiNelissen 7/10 4896 days true 0.0 0%

Adjustments

Several adjustments to the weighted average are added to improve relevancy and credibility. These adjustments apply equally to all experiences that meet the criteria.

Sample Size Adjustment

No Adjustment

A reasonable number of reviews are necessary in order for the average to be credible and for an experience to take a prime position within the ranking tables. As such, experiences with only a few reviews have a moderated score. This does not mean that the experience or the reviews can't be trusted. The Stray experience has plenty of reviews and does not meet the criteria for any adjustment.

Recent Reviews Adjustment

-2.00% Adjustment

There may be an adjustment if this experience hasn't received any reviews within the last 125 days. However the Stray experience does not meet the criteria for any adjustment.

In addition, an experience's ranking score may be adjusted for each day there is no new ranking. After 1 day the adjustment comes into effect. The maximum number of days that can be adjusted for is 200 days. Due to the seasonal nature of many businesses, this adjustment is applied dynamically throughout the year.

The Stray experience has been adjusted for 200 days. Adjustments are according to the following table.

Days Adjustment
197 -1.97%
198 -1.98%
199 -1.99%
200 -2.00%
201 -2.01%
202 -2.02%
203 -2.03%

Final Ranking Score

85%

The final ranking score once adjustments and rounding has been applied. This value is cached and recalculated each day. Therefore it may not be precisely accurate based on the other values presented.

If you have any questions or comments about our ranking score calculation please get in touch at info@rankers.co.nz.