3674 posts Community Moderator
  • Has been a member for 5-6 years
  • Contributed a Tutorial to a Tuts+ Site
  • Netherlands
  • Community Moderator
  • Envato Studio (Microlancer) Beta Tester
  • Sold between 10 000 and 50 000 dollars
  • Repeatedly Helped protect Envato Marketplaces against copyright violations
  • Exclusive Author
+4 more
Joost Volunteer moderator says

Still, the rating system is completely disfunctional. Pretty much every file is either not rated, or rated 4 or 5 star. Not rated means not many sales yet and 4 stars means there was someone who expected something different and probably didn’t read the description (or expected too much of the author, supportwise).. I don’t see how this contributes to giving an insight in the quality of the file.

629 posts
  • Bought between 10 and 49 items
  • Exclusive Author
  • Has been a member for 4-5 years
  • Sold between 100 and 1 000 dollars
Thecodingdude says
Joost said
Still, the rating system is completely disfunctional. Pretty much every file is either not rated, or rated 4 or 5 star. Not rated means not many sales yet and 4 stars means there was someone who expected something different and probably didn’t read the description (or expected too much of the author, supportwise).. I don’t see how this contributes to giving an insight in the quality of the file.

Agreed, the rating system is pretty useless as it is.

Instead there should be buyer feedback separated into categories. plus a rating in each category.

For example:

Functionality (3/5): The product worked great, but needed additional tweaks to make it work perfect with my wordpress installation.

Support (5/5): The support for this product has been excellent and punctual.

Overall (4/5): Could do with some minor tweaks, but decent product overall, and it’s a steal at $x

995 posts
  • Author had a File in a Mini Bundle
  • Author had a File in an Envato Bundle
  • Bought between 1 and 9 items
  • Envato Studio (Microlancer) Beta Tester
  • Exclusive Author
  • Has been a member for 3-4 years
  • Most Wanted Bounty Winner
  • Referred between 200 and 499 users
  • Sold between 10 000 and 50 000 dollars
mudi says

Thank you for this :)

5766 posts
  • Exclusive Author
  • Author had a File in an Envato Bundle
  • Elite Author
  • Has been a member for 6-7 years
  • Sold between 100 000 and 250 000 dollars
  • Repeatedly Helped protect Envato Marketplaces against copyright violations
  • India
+3 more
VF says
bloooming said
ThemeProvince said
No one here suggested this method.
Actually that’s not true, there have been several threads about this matter: http://themeforest.net/forums/thread/can-support-fix-a-mistake-with-theme-rating/35904 http://themeforest.net/forums/thread/rating-system/44343 http://themeforest.net/forums/thread/another-thread-about-the-file-rating-system/37723 ... and so on…. I guess authors were asking for a one time opportunity to correct a rating….

The suggestions were endless but none of the authors are immature enough to request rating system to allow infinite updates. I never heard about such a rating system. As someone pointed before, it would be understandable if such option available in case the item updated.

731 posts
  • Elite Author
  • Attended a Community Meetup
  • Has been a member for 4-5 years
  • Sold between 100 000 and 250 000 dollars
  • Bought between 50 and 99 items
  • Exclusive Author
  • Most Wanted Bounty Winner
+2 more
mordauk says
Joost said
Still, the rating system is completely disfunctional. Pretty much every file is either not rated, or rated 4 or 5 star. Not rated means not many sales yet and 4 stars means there was someone who expected something different and probably didn’t read the description (or expected too much of the author, supportwise).. I don’t see how this contributes to giving an insight in the quality of the file.

Well said.

Unfortunately, Devs, I have to agree with the majority of the sentiments here. I can think of a couple of times recently when a buyer of one of my files was extremely pleased with his initial purchase, then came asking for support, which I provided, but then when he asked for additional customizations and I was unable to give them for free (or within 12 hours), he completely reversed his opinion and gave a very nasty comment and rating. What if he had already rated it 5 stars after the purchase, but then 12 hours later (because of his obscene demands) decided that he wasn’t happy so changed it to 1 star? Just doesn’t seem right . . .

A confirmation popup would have been so simple . . .

7198 posts
  • Exclusive Author
  • Has been a member for 5-6 years
  • Sold between 10 000 and 50 000 dollars
  • Envato Studio (Microlancer) Beta Tester
  • Beta Tester
  • Repeatedly Helped protect Envato Marketplaces against copyright violations
  • Author had a Free File of the Month
  • Bought between 50 and 99 items
  • Referred between 10 and 49 users
+1 more
doru says

4901 posts
  • Senior Reviewer
  • Support Staff
  • Envato Staff
  • United States
  • Exclusive Author
  • Has been a member for 7-8 years
  • Sold between 5 000 and 10 000 dollars
+6 more
MarkBrodhuber Staff says

I’d just like to start off by quickly addressing the main point that keeps coming up in this thread. Everyone is assuming that buyers will rate a file high, and then after not getting proper support or customization (in their eyes), they’ll come back and maliciously rate your file lower. While it is possible right now, 1. I’ve noticed that most of the time files go completely unrated by the majority of buyers. 2. If someone does rate your file, I doubt they’re going to rate it 5 stars without ever looking at it, then request an unrealistic customization job, get denied, and drop the rating down.

More realistically, they’d probably not rate it at all, request the job, then rate it low. In the previous system there was no changing that negative rating, not even by the devs.

Being completely honest, I’ve never personally come across a ticket where a buyer rated a file high and asked if it could be lowered, for any reason. I have been assigned to a huge number of tickets from buyers saying they rated low by mistake. Or that they rated low, then fixed the issue that caused the low rating, and wanted it changed to a better rating. I’ve also personally got at least 20 – 30 tickets over the last few years from authors frustrated that when a buyer makes a rating it’s locked in permanently.

I don’t think there’s a simple solution within the current rating system to make it perfect, but we try our best to cover the issues that have the highest probability of occurrences.

Moving forward we’re going to look into improving the ratings system further and I can assure you that it wont stop here. This was meant to be a temporary fix that pushes us all a bit further in the right direction.

178 posts Challenge accepted.
  • Sold between 100 000 and 250 000 dollars
  • Austria
  • Elite Author
  • Bought between 10 and 49 items
  • Has been a member for 5-6 years
  • Exclusive Author
  • Referred between 100 and 199 users
  • Envato Studio (Microlancer) Beta Tester
bloooming says
MarkBrodhuber said

More realistically, they’d probably not rate it at all, request the job, then rate it low. In the previous system there was no changing that negative rating, not even by the devs.

Being completely honest, I’ve never personally come across a ticket where a buyer rated a file high and asked if it could be lowered, for any reason.

Ok, if this is really the case, then please make a down-rating impossible. A buyer should have the option to change the rating, but only upwards.

I have the feeling you guys think authors are being just paranoid ;-)

Well, here is a snippet from a recent thread in our support forum. Sadly, this is the reality we are dealing with:

[quote] ....I’m hoping for a satisfactory answer soon. Or I will have to post a negative recommendation on TF, to warn potential buyers that support is seriously lacking with this theme…. [/quote]

1579 posts Chris Robinson
  • United States
  • Sold between 250 000 and 1 000 000 dollars
  • Elite Author
  • Has been a member for 5-6 years
  • Author had a File in an Envato Bundle
  • Referred between 500 and 999 users
  • Author had a Free File of the Month
+5 more
contempoinc says
VF said
cspcreative said
That’s cool, but can I make another suggestion?

Star rating averages can be rather ‘unfriendly’ when you have a popluar item that gets low-balled by a low rating. Can the stars system be revised to be similar to that of eBay’s — where a % of the star is highlighted instead of it being either ON or OFF ?

The top two are GRs, the bottom one is a properly ‘averaged’ system from eBay.

Not that I overly care about rating systems (they can be easily abused), I just thought it would better reflect the quality of items. 4 out of 5 stars is like 80%, when really it could more like 98% (just had one or two low ratings out of 20 or 30 ratings). Know what I mean?

+1

Majority of rating variations falls between 4 star to 5 star (80 to 100%). The 5th star can be more detailed and safer if divided 4 parts to show 80 (full gray), 85, 90, 95 and 100%

Regarding the new system, I don’t think the ability to edit rating is a positive change for authors. It helps just to solve mistaken ratings but what about if a buyer with wrong mood modifies a 5 star into 1 star after 5 years. There should be a time limit like 2 months etc to be able to modify rating.

+2 and display a breakdown of the ratings a la Amazon:

Personally think it should be limited to a one time rating change. This update was made to alleviate the issue of a mistaken rating, not to allow someone to change ratings every other day. Unlimited changes is completely unnecessary.

4317 posts ThemeForest Reviewer
  • Envato Staff
  • Reviewer
  • Community Moderator
  • Repeatedly Helped protect Envato Marketplaces against copyright violations
  • Venezuela
  • Has been a member for 5-6 years
  • Envato Studio (Microlancer) Beta Tester
  • Sold between 10 000 and 50 000 dollars
  • Exclusive Author
+9 more
Ivor Reviewer says
contempoinc said

+2 and display a breakdown of the ratings a la Amazon:

Personally think it should be limited to a one time rating change. This update was made to alleviate the issue of a mistaken rating, not to allow someone to change ratings every other day. Unlimited changes is completely unnecessary.

Me likey alot! :)

by
by
by
by
by
by