RFC-15: Ratings Enhancement

Hi @BorisBerenberg ,
Thanks for understanding that these are just first steps and we plan to work continuously on our review system to improve it. Most of the items called out in the feedback are there in our backlog. We would like to get to them after working on rating enhancement.

Hi @MaelleCARTRON ,
Thank you for your detailed feedback. We are considering multiple options to transition to 5-star system.

  1. a simple extrapolation for all ratings,i.e. each star in the previous system will be counted as 1.25 stars in the new system.
  2. mapping 1 and 2 stars to the same values, while mapping 3 and 4 stars to 4 and 5 respectively.

We are considering other options and the final decision would be made after consulting with the legal team. We are open to other suggestions to transition to a 5-star system. Please let us know if you have any suggestions.

Thanks for the detailed review @ssidbury. We will not do away with the server ratings and will combine them with DC ratings in the future.
We will keep the formula for recency bias simple so that it is easy for everyone to understand. We would also make sure that one negative review/rating doesn’t affect the good work done by you in recent times.
Your concern is valid with respect to simple extrapolation. We are currently exploring other methods in addition to simple extrapolation. While the 4-star system is established, it is creating confusion as Google displays ratings out of 5 stars in search results. Additionally, other review platforms use a 5-star rating system for the same app. Therefore, we see value in standardizing the rating system to avoid confusion in the future.

Thank you for your valuable feedback on our rating enhancement RFC. We appreciate your concerns regarding recency bias and anonymous in-app ratings, and we have taken them into consideration. We will be implementing changes to ensure the accurate representation of ratings and to separate ratings by hosting type, as there is a general consensus regarding these changes. Additionally, we plan to discontinue the use of anonymous in-app ratings, but we will not delete past anonymous in-app ratings, as this could inadvertently remove genuine feedback.

What we won’t be doing now?

Regarding the issue of recency bias, we appreciate your concerns but remain convinced that its inclusion will ultimately prove beneficial for customers and serve as a reward for partners who work to improve their apps. While we will not be making any immediate changes, we are committed to exploring this matter further in order to develop a more comprehensive solution that addresses your concerns. We intend to implement a 4-star to 5-star conversation in conjunction with the addition of recency bias. However, these changes will be postponed for the time being. In the future, we will revisit this topic and present another RFC (tentatively in September) in which we will provide more detailed information about both of these developments. We look forward to receiving your feedback at that time.

Thank you!

Aditya, Associate Product Manager, Marketplace

2 Likes