Ranking Score Explained

Hey, thanks for your interest in how we calculate an experience's ranking score. It's at the core of Rankers so I'm pleased you're curious.

The ranking score percentage is used to compare and sort experiences in ranking tables. It is not necessarily a direct measurement of the quality of a particular experience as rated by its customers. I've found it a useful tool to allow me to find the best experiences with confidence. But I've also found it important to read the customer reviews before making any final judgements!

We calculate an experience's ranking score using a multi-factor data model instead of a raw data average (mean). This model takes into account several important questions. For instance - is there a trusted body of reviews? What is the age of a review and is the review from a credible source?

Below you'll find details around some of the important factors that went into calculating the ranking score for Routeburn Track.

If you have any questions or comments about our ranking score calculation please get in touch at info@rankers.co.nz. We don't believe this is perfect or complete so we're always interested in ways we might make improvements.

Cymen Crick's avatar

Cymen Crick

Rankers Owner

Routeburn Track

Valid Reviews

137 Valid Reviews

The Routeburn Track experience has a total of 138 reviews. There are 137 valid reviews that are included when calculating the ranking score and 1 invalid review that are excluded from the calculation. Reviews can be excluded only when a reviewer is not verified or after an investigation by our team determines the reviewer is not genuine.

Below is the distribution of ratings for the 137 valid reviews:

Rating Count Percentage
10/10 59
43%
9/10 43
31%
8/10 26
19%
7/10 6
4%
6/10 2
1%
5/10 1
1%
4/10 0
0%
3/10 0
0%
2/10 0
0%
1/10 0
0%

90.80% Average

The raw data average (mean) for all the Routeburn Track valid reviews is 90.80% and is based on 137 valid reviews. This value is not used to calculate the ranking score and it only provided here as a comparison to the weighted average.

Face-to-Face Reviews

131 Face-to-Face Reviews

The Rankers team meets with travellers while they’re in New Zealand and conducts face-to-face surveys. These reviews, in our opinion, are the most trusted in the industry and represent a critical control sample. To our knowledge, we are the only travel review website in the world that has gone to this extent.

More about face-to-face reviews

Within the 137 valid reviews, the experience has 131 face-to-face reviews collected during interviews by our team.

Below is the distribution of ratings for the 131 face-to-face reviews:

Rating Count Percentage
10/10 55
42%
9/10 42
32%
8/10 25
19%
7/10 6
5%
6/10 2
2%
5/10 1
1%
4/10 0
0%
3/10 0
0%
2/10 0
0%
1/10 0
0%

90.61% Average

The raw data average (mean) for all the Routeburn Track face-to-face reviews is 90.61% and is based on 131 face-to-face reviews. This value is not used to calculate the ranking score and it only provided here for comparison purposes.

Weighted Average

91.40%

Rankers calculates a weighted mean as a base average on which we can improve. Individual review's ratings are given a weight based on several factors. The weight of a review determines the overall impact it'll have on the final weighted average.

Recent reviews have more weight as they are more relevant and reflect the experience as it currently operates. Over time reviews become less relevant and loose their impact on the ranking score.

Low rating reviews carry slightly less weight. This dampens the effect of very low ratings for every experience across the board. This is especially important when the experience has few reviews overall and a single negative rating can grossly mischaracterise an experience. Consistent poor reviews will still result in the experience receiving a comparitively low ranking score.

Credible sources provide reviews that can be trusted. If we have verified a reviewer is genuine via a face-to-face meeting then the review carries additional weight.

Reviewer Rating Age Relative Weight
Jan Christoph 10/10 2758 days 100%
Dorothy and Graham Glen 10/10 2758 days 100%
Laura Kudo 8/10 2983 days 82%
Melanie and Pascal 10/10 3009 days 82%
Remy and Rebecca Mans 10/10 3012 days 82%
Holloway 10/10 3014 days 82%
Fi 8/10 3035 days 78%
Simon 10/10 3056 days 79%
Mikkel Thomassen 10/10 3107 days 75%
Jannika Cao 10/10 3107 days 75%
Kat 8/10 3108 days 73%
Austin Jurgensmeyer 10/10 3133 days 73%
Susan H 10/10 3150 days 72%
Hector 9/10 3338 days 58%
Carlos 9/10 3338 days 58%
Ivanova R 10/10 3339 days 59%
Jenna Kuittinen 7/10 3351 days 53%
Stephen Timko 10/10 3355 days 58%
Jeeyoung Kim 10/10 3357 days 58%
Marie 10/10 3359 days 57%
Szu-Yi Hsu 8/10 3361 days 56%
Chao Lai 9/10 3361 days 57%
Virginia Fradin 8/10 3361 days 56%
Dominique 10/10 3362 days 57%
Derick Trotter 9/10 3362 days 57%
Kathryn Nolan 10/10 3364 days 57%
Molly Bogeberg 10/10 3365 days 57%
Pierre Mathis 8/10 3367 days 55%
Judy 9/10 3369 days 56%
Lea Kisbye 7/10 3370 days 52%
Max 7/10 3372 days 52%
Manuel El-Amine 8/10 3373 days 55%
Bernardo Galeazzo 8/10 3377 days 55%
Kim 8/10 3381 days 54%
Stephanie Pope 9/10 3387 days 55%
Maike Santelmann 9/10 3389 days 55%
Remi Lopez 10/10 3390 days 55%
Yarden Oliva 10/10 3392 days 55%
Mia Gaynor 10/10 3393 days 55%
Lisa 8/10 3394 days 54%
Gonne Clasen 8/10 3414 days 52%
Samantha Heim 10/10 3443 days 51%
Iker Peeters 10/10 3462 days 50%
Ixtaso Roncal 10/10 3495 days 48%
Sue Strebe 8/10 3755 days 29%
Elisa Felising 10/10 3761 days 29%
David McIntosh 9/10 3772 days 28%
Dawn Mulligan 8/10 3778 days 27%
Karolina Gren 9/10 4071 days 7%
Moritz Lepple 9/10 4088 days 6%
Simon Galpin 8/10 4100 days 5%
Andreas Jung 9/10 4109 days 4%
Maria = Moller Hansen 10/10 4113 days 4%
Bjorn Houlberg 9/10 4113 days 4%
Marinette 9/10 4117 days 4%
Barbara 9/10 4117 days 4%
Natalie Boehm 10/10 4118 days 4%
Guillaim Terrangle 7/10 4118 days 2%
Anna Guzewiez 7/10 4121 days 2%
David Krasner 8/10 4127 days 3%
Daryl 10/10 4156 days 1%
Trish Pope 10/10 4165 days 0%
Philipp Haass 10/10 4170 days 0%
Christin Woelk 5/10 4431 days 13%
Audrey Ripoche 9/10 4443 days 21%
Stientje van den Heuvel 10/10 4453 days 21%
Tom Somers 10/10 4453 days 21%
Andy Cummins 10/10 4454 days 21%
Cervenka Jaroslav 10/10 4459 days 21%
Jitka Zenahlikova 10/10 4459 days 21%
Katey Justice 9/10 4462 days 21%
Kathryn Pisco 10/10 4473 days 21%
Mike Pisco 10/10 4473 days 21%
Patrick O'Connell 10/10 4477 days 21%
Helen and Ogi 10/10 4480 days 21%
Francis Runge 10/10 4481 days 21%
Peter Moederer 8/10 4484 days 21%
Tobias Sowade 9/10 4493 days 21%
Liam Day 8/10 4543 days 21%
Alexandra van den Brack 9/10 4554 days 21%
Katharina Pape 9/10 4555 days 21%
Debbie 10/10 4558 days 21%
Michael Neumann 10/10 4819 days 21%
Oliver Hardt 8/10 4821 days 21%
Val Phillips 10/10 4825 days 21%
D Esson 8/10 4826 days 21%
Hanna Clement 8/10 4826 days 21%
Keith Helen 10/10 4832 days 21%
Fleming Lauridsen 9/10 4841 days 21%
Siegfried Richter 8/10 4842 days 21%
Beeny 9/10 4842 days 21%
Carolin Haas 9/10 4842 days 21%
Vincent & Lian 9/10 4842 days 21%
Alan Findlay 10/10 4847 days 21%
Lynn Robinson 10/10 4853 days 21%
Francis Corrigan 10/10 4862 days 21%
Jackie & Ray 9/10 4874 days 21%
Alex 10/10 4892 days 21%
Rob O'Neill 9/10 5169 days 21%
David Brown 9/10 5171 days 21%
David Taylor 6/10 5172 days 16%
R Tearle 9/10 5176 days 21%
Helen Evans 6/10 5181 days 16%
Helen 9/10 5188 days 21%
Katherine and Pete Smal 9/10 5188 days 21%
Wouter Moui 8/10 5190 days 21%
Ben Akin-Smith 7/10 5192 days 19%
K & J Overton 9/10 5192 days 21%
Estel la Prado 9/10 5192 days 21%
Elise van Haastert 9/10 5197 days 21%
Geert Van Tittelboom 9/10 5202 days 21%
Carmel 10/10 5202 days 21%
Janine Diehl 10/10 5203 days 21%
Daniel Hammersley 9/10 5203 days 21%
Becky Foley 10/10 5212 days 21%
Van den Borne 9/10 5212 days 21%
Angela Clarke 9/10 5213 days 21%
Liz Foxwell-Canning 10/10 5213 days 21%
Nataly Loewidt 9/10 5218 days 21%
Sue Haward 9/10 5221 days 21%
Christian Foerster 9/10 5226 days 21%
dollimyxture 10/10 5257 days 21%
mnm 9/10 5257 days 21%
Ann Michle 9/10 5483 days 21%
Victoria Slater 8/10 5537 days 21%
Margie 10/10 5541 days 21%
Inbar Yizhar Barnea 10/10 5551 days 21%
Graeme + Jane Ryan 10/10 5553 days 21%
Peter Brown 8/10 5559 days 21%
David Hobson 10/10 5583 days 21%
Ross & Catherine Litherland 8/10 5604 days 21%
Primavesi 10/10 5665 days 21%
Tim_P 8/10 5894 days 21%
Thomas1646 10/10 5904 days 21%
JuergenSchnitzer 10/10 5913 days 21%
Gillian 9/10 5917 days 21%
Mette 9/10 5941 days 21%

Adjustments

No Adjustment

Several adjustments to the weighted average may be added to improve relevancy and credibility. Routeburn Track does not meet the criteria for any of these adjustments to apply.

Balancing Adjustment

0.82% Adjustment

Every experience's review score is adjusted to balance out the disproportional number of negative reviews that are contributed.

You won't be surprised to learn that disgruntled folk are more likely to leave a review than happy ones. They are motivated to share their experience and warn others. We consider this a good thing and it's why reading the reviews is important. However we've learned it can misrepresent the experience in a more overall sense.

We apply a balancing adjustment to counteract this effect and ensure the ranking score is a more fair representation of the experience. This adjustment is applied equally to all experiences.

Final Ranking Score

92%

The final ranking score once any adjustments, ratings, and rounding has been applied. This value is recalculated each day and a short rolling average is applied. Therefore it may not be precisely accurate based on the other values presented.