67 posts
  • Exclusive Author
  • Has been a member for 0-1 years
  • India
  • Sold between 1 and 100 dollars
  • Won a Competition
Njanimator says

great,happy with this change :)

427 posts Code is Poetry
  • Elite Author
  • Sold between 50 000 and 100 000 dollars
  • Has been a member for 2-3 years
  • Europe
  • Exclusive Author
  • Referred between 10 and 49 users
  • Bought between 1 and 9 items
egemenerd says

Hi folks, if you haven’t encountered me before, I’m Justin French, Product Owner of the Marketplaces. As I’ve previously mentioned in other threads, the rating system is the next major pain point we’d like to focus on in improving the Marketplaces this year. There’s certainly no shortage of feedback and ideas!

Like many recent projects, we’re taking this potentially epic piece of work and splitting it into smaller pieces we can confidently ship really soon, and some more we will look at later.

Show a breakdown of the average

This is an incredibly popular and long-running request! We’re redesigning the sidebar of an item page to accomodate a little more detail, rather than just the overall average rating — buyers will see the number of people who have rated the item at each step (5 stars, 4 stars, etc), the total number of ratings received and the precise numerical value of the average (e.g. “4.6” or “3.9”). This work is mostly complete and will ship soon!

Rounding to half stars

Also requested, we’ll start rounding to the nearest half-star rather than whole star. Currently an average rating of “4.6” is rounded to “5”, “4.3” is rounded to “4”. By rounding to the nearest half star, an average “4.6” or “4.3” will be rounded to “4.5” instead. Some items will go “up” a half star, and others “down”, but overall, the graphical representation will be closer to the real numerical average. This work is mostly complete and will ship soon.

Encouraging more ratings

We want to encourage and remind buyers to provide a rating for any of their unrated purchases. We’ll start with an email follow-up a week after purchase and measure what effect this has on the number of ratings per item. This is also mostly complete and will ship soon.

What are we rating, exactly?

We don’t explicitly state anywhere what a buyer should be thinking about when they’re rating an item. Is it the technical quality? Aesthetics? The author’s support? Flexibility & configuration options? The author’s willingness to help with questions or customisation? The purchasing experience? The installation process? Value for money?

To help us better understand what’s already taking place, we’re going to run a survey, interview a range of authors and buyers, and start collecting the primary reason (selected from a short list of predefined options) from buyers as they rate each item. There’s no plans to display this data on the site (not even to the author), but it will help us better understand how the rating system is currently being used, and to plan our approach to some of the remaining feature requests.

Speaking of feature remaining requests…

Who rated this, and why?

An often-requested feature is buyers providing a comment when they rate an item, displayed alongside their username — some propose this should be required for all ratings, others just for one and five star ratings. There’s a lot of hidden features we might need here too (moderation & dispute resolution, marking reviews as unhelpful, etc).

The underlying goals of these requests are:

  • improve transparency for everyone
  • provide authors with insights to help improve their items
  • provide relevant ratings to buyers to help their purchasing decisions

These goals are important to us, but we’re not starting on the build right now — the data we’re collecting and the research we’re working on will help us design the details of a system that best meets the community’s needs, as well as ours.

We’ll update you with what we’ve learned (and our next steps) in a month or two.

Average averages?

We’re also working with a statistician to explore some alternatives to the existing method of averaging we use (including bayesian and median, which have been brought up a few times by the community). These are only experiments to review what happens to the data at this point. If it looks like we’re going to make a change in the future, we’ll keep you in the loop.

Ratings are forever?

Right now, a rating is forever — we calculate the average using every available rating since the item was first uploaded, which means it’s a mixture of historical and current ratings. We’re working with a statistician to explore the impact of ignoring older ratings. If an item has greatly improved over time, this might lead to a rating which is more reflective of what you’re buying today. Again, if it looks like we’re going to make a change in the future, we’ll discuss what we’ve learned.

Stay tuned!

I wanted to share this plan before we deploy the first batch of improvements so that you aren’t left wondering “is that it?”. There’s plenty more to be done, and this is the first step!

Edit: Made a small clarification to “What are we rating, exactly?” 4pm AEST (about 5hrs after the post).

It’s been 8 months and I still don’t see any significant improvement. Is there going to be an update for the rating system soon? :)

76 posts
  • United States
  • Exclusive Author
  • Has been a member for 2-3 years
  • Sold between 10 000 and 50 000 dollars
  • Bought between 10 and 49 items
  • Referred between 10 and 49 users
Mode54 says

I have followed this thread since it was first posted over 8months ago. Not sure what’s going on at Envato but it seems like this lost priority or something.

At least give us some feedback on the data you collected. Let us know what the plans are. I can’t imagine it taking this long to figure out what to do with ratings.

14 posts
  • Bought between 1 and 9 items
  • Exclusive Author
  • Has been a member for 2-3 years
  • Referred between 10 and 49 users
  • Sold between 50 000 and 100 000 dollars
  • United States
themeboutique says

I have followed this thread since it was first posted over 8months ago. Not sure what’s going on at Envato but it seems like this lost priority or something.

Sure, Envato spews their “we’re all about the community” propoganda on a regular basis, but it’s pretty clear that Envato doesn’t care about the opinion of authors. I don’t think this ever was a priority.

4601 posts
  • Envato Staff
  • Has been a member for 4-5 years
  • Attended a Community Meetup
  • Repeatedly Helped protect Envato Marketplaces against copyright violations
  • Bought between 50 and 99 items
  • Canada
  • Community Ambassador
  • Beta Tester
  • Contributed a Tutorial to a Tuts+ Site
+6 more
KingDog Staff says


I have followed this thread since it was first posted over 8months ago. Not sure what’s going on at Envato but it seems like this lost priority or something.
Sure, Envato spews their “we’re all about the community” propoganda on a regular basis, but it’s pretty clear that Envato doesn’t care about the opinion of authors. I don’t think this ever was a priority.

We never said it was a priority. Yes it’s something we’re working on and researching but we never said it was something you should expect in a weekend :)

2263 posts Bird is the word..
  • Elite Author
  • United States
  • Sold between 250 000 and 1 000 000 dollars
  • Has been a member for 6-7 years
  • Referred between 200 and 499 users
  • Bought between 100 and 499 items
  • Microlancer Beta Tester
  • Exclusive Author
+3 more
jonathan01 says



I have followed this thread since it was first posted over 8months ago. Not sure what’s going on at Envato but it seems like this lost priority or something.
Sure, Envato spews their “we’re all about the community” propoganda on a regular basis, but it’s pretty clear that Envato doesn’t care about the opinion of authors. I don’t think this ever was a priority.
We never said it was a priority. Yes it’s something we’re working on and researching but we never said it was something you should expect in a weekend :)

8 months… not a weekend. Just saying.

4601 posts
  • Envato Staff
  • Has been a member for 4-5 years
  • Attended a Community Meetup
  • Repeatedly Helped protect Envato Marketplaces against copyright violations
  • Bought between 50 and 99 items
  • Canada
  • Community Ambassador
  • Beta Tester
  • Contributed a Tutorial to a Tuts+ Site
+6 more
KingDog Staff says




I have followed this thread since it was first posted over 8months ago. Not sure what’s going on at Envato but it seems like this lost priority or something.
Sure, Envato spews their “we’re all about the community” propoganda on a regular basis, but it’s pretty clear that Envato doesn’t care about the opinion of authors. I don’t think this ever was a priority.
We never said it was a priority. Yes it’s something we’re working on and researching but we never said it was something you should expect in a weekend :)
8 months… not a weekend. Just saying.

Understood. But to be completely upfront, other projects had higher priority and we’ve needed to carefully examine how we wanted to approach any new additions to ratings as it could result in a large increase in time and staffing requirements. Thanks!

70 posts
  • Elite Author
  • Exclusive Author
  • Sold between 100 000 and 250 000 dollars
  • United States
  • Most Wanted Bounty Winner
  • Referred between 100 and 199 users
  • Bought between 10 and 49 items
  • Has been a member for 1-2 years
refaktor says




I have followed this thread since it was first posted over 8months ago. Not sure what’s going on at Envato but it seems like this lost priority or something.
Sure, Envato spews their “we’re all about the community” propoganda on a regular basis, but it’s pretty clear that Envato doesn’t care about the opinion of authors. I don’t think this ever was a priority.
We never said it was a priority. Yes it’s something we’re working on and researching but we never said it was something you should expect in a weekend :)
8 months… not a weekend. Just saying.

+1 to that.

“We’re working on it” is a phrase I’ve heard a million times from various people/companies. Heck I’ve used it before myself. This is clearly an issue that a lot of authors are concerned about (myself included) but it seems that not a whole lot is being done to address the issue. I for one am eagerly awaiting a more official response/position about what is being worked on/researched regarding item ratings other than those kinds of pacifying statements.

76 posts
  • United States
  • Exclusive Author
  • Has been a member for 2-3 years
  • Sold between 10 000 and 50 000 dollars
  • Bought between 10 and 49 items
  • Referred between 10 and 49 users
Mode54 says





I have followed this thread since it was first posted over 8months ago. Not sure what’s going on at Envato but it seems like this lost priority or something.
Sure, Envato spews their “we’re all about the community” propoganda on a regular basis, but it’s pretty clear that Envato doesn’t care about the opinion of authors. I don’t think this ever was a priority.
We never said it was a priority. Yes it’s something we’re working on and researching but we never said it was something you should expect in a weekend :)
8 months… not a weekend. Just saying.
Understood. But to be completely upfront, other projects had higher priority and we’ve needed to carefully examine how we wanted to approach any new additions to ratings as it could result in a large increase in time and staffing requirements. Thanks!

Thanks KingDog for jumping in

I think what would help is some communication about what’s going on every now and then. If plans change and ratings is pushed to the side for more important issues then just communicate that to us in this thread, blog post or something. The frustration doesn’t come from thinking you guys are ignoring us… more so that we have no idea where we stand. This thread in particular has gone months without any real feedback.

Also in my humble opinion… things like favorites should be lower priority then ratings… just saying :)

5543 posts
  • Exclusive Author
  • Author had a File in an Envato Bundle
  • Elite Author
  • Has been a member for 5-6 years
  • Sold between 100 000 and 250 000 dollars
  • Repeatedly Helped protect Envato Marketplaces against copyright violations
  • India
+3 more
VF says

:zipped:

by
by
by
by
by
by