Updating the star rating system

here are the ideas...

from WinCustomize Forums

The following is an extended explanation of my idea in how the actual rating system can improve; the goal of this is to lower down the amount of threads at the forum complaining and asking why their skins got a low rating.

Stars 2.0

One of the common arguments about the actual rating system is the “why I got a low rate?”; right now when you submit a skin at any gallery your work will be rated by a moderator, this person will even decide if your work is good enough or suitable to enter into the gallery, in fact, this procedure is quite necessary and it doesn’t need to change at all, we can consider that like the “start point” to begin the rating. Now, how should we rate in the correct way? My idea is quite simple:

  1. - Rate and add a comment.

To prevent skinners fury we can replace the little window showing the amount of stars to rate the skin with two things: at the top right side of the skinner description of the skin it could be a star-meter, just to show the rating the skin has. The other part is at the comments area: in there aside the guy/gal name it will appear the rate he/she gave to the skin and comment will be the reason of the amount of the stars he/she gave. Now, you will ask your self how in the name of God we can make that person to leave a comment and not just the rate? It’s simple, during the procedure of rating a comment it “must” be added a comment to apply the rate, if not it won’t let the user to apply any star at all. If a user rates any skin just righting some useless words or typing anything in a random way without any sense, the skinner can request to undo the rate and delete the comment. All this can be done just by making a pop-up window to appear (we can even add an edit button to leave the option open if the user want to change the rate or the comment he/she did). By doing this we can even prevent other users to spam or put a low rating just to damage the skinner work.

2.   - Hide the troll.

A plus to this idea is to add a “hide” button in every comment that can be use only by the owner of the skin, this is to leave the option of hiding useless comments with a low rating or other kind of comments that the skinner might consider unnecessary.

3.   - Flaming stars!

Other thing that it might be good is to give to the skin the honor of “flaming star”; it is something like a popular skin thing. A skin can get the title of flaming star when it gets more than 20 or 10 five star ratings (given by users).

  1. - Who can rate?

I don’t remember who are able to rate and who doesn’t, but to me, the only ones who must rate a skin are the Master Apprentice, Journeyman and Masters. Why of this? Not only because they are at certain point experts on what they do, they also make a great effort to make this site even better in many ways.

And that is all.., I really hope my idea(s) could be considered and be applied…

community
112,189 views 72 replies
Reply #1 from WinCustomize Forums Top
I don't think that would ever be put into use.
2. - Hide the troll.
A plus to this idea is to add a “hide” button in every comment that can be use only by the owner of the skin, this is to leave the option of hiding useless comments with a low rating or other kind of comments that the skinner might consider unnecessary.

With that option, the skin author could just simply hide all negative/constructive criticism comments that he/she feels speaks badly of the skin. It would unfairly skew the rating into a positive favor, in which case, why have ratings at all if only the positive ones will be shown?

I also don't like the fact that the rating will be shown next to each person who rated it. This should be done anoymously or it might deter people from giving honest ratings. However, it might be an idea to make the "rate this skin" option remain hidden until the download has been activated. How can someone fairly and honestly rate something they haven't even downloaded and evaluated? (see WOM's thread for a good discussion on that)
Reply #2 from WinCustomize Forums Top
only ones who must rate a skin are the Master Apprentice, Journeyman and Masters. Why of this? Not only because they are at certain point experts on what they do, they also make a great effort to make this site even better in many ways.


I must disagree there on several points.I'm a WC subscriber and it' a benefit,I'm no expert,but I know what I like,and lastly,I too have an interest in making the site better.I like it here. ;) One idea:Once given a starting rating by the mods,it can't go below that,but ratings can make it go up or back down to that level..I do think there is room for improvement,keep the ideas coming. :D
Sins of a Solar Empire II
Reply #3 from WinCustomize Forums Top
or you can not worry about ratings. If you feel the sytem is flawed then don't use it and ignore it. :)
+2 Loading…
Reply #4 from WinCustomize Forums Top
or you can not worry about ratings.


;)

Skin for fun.
Skin because you enjoy doing it.
Share it because you want to give people the opportunity to choose whether or not it is usable to them.
Reply #5 from WinCustomize Forums Top
just dropping by to say I dont care about the ratings..just the colours and the concepts.I submit to share :).Good day all.
+1 Loading…
Reply #6 from Stardock Forums Top
Skin for fun.Skin because you enjoy doing it.Share it because you want to give people the opportunity to choose whether or not it is usable to them.
This sounds so familiar.  ;)
Reply #7 from Stardock Forums Top
This sounds so familiar.


 :D 

It's a simple concept. I'm sure it's already been stated but it seemed fitting.  ;) 
Reply #8 from WinCustomize Forums Top
Ratings... who cares. You could get rid of them entirely as far as I am concerned. :)
Reply #9 from WinCustomize Forums Top
I've never paid too much attention to skin ratings since the system is too flawed as is.
It's better to go by the comments and download count to see how well it is liked.

As for me, I skin for my self and share because I like paying back for what I download.
+1 Loading…
Reply #10 from WinCustomize Forums Top
Reply #22
Zoomba


Member No.439,441
Karma+50
June 17, 2008 00:02:10
The ratings issue has been brought up over and over again in many threads by many different people over the years. If someone had a real, workable replacement to the star system that would still provide USERS with a meaningful score to browse skins by, I'm all ears.

Star ratings will go away if and only if a real, viable, and easy to understand method can be developed. It has to be something that is immediately understandable to anyone who comes to the site seeking skins.



...Zoomba ask for ideas, so i give ideas. :) Thank you everyone for the comments and yes., i do care about the rating in some of my skins (not all!) I know i shouldn't but it is me and many others who care about it.., and no', i dont make skins just to have a clean five stars rating, but it makes me feel bad to see a low rate in something that i took the few free time i have to do skins., i'm not at school any more and i dont have that huge amount of free time to spend in doing lots of skins. Right now i'm doing a skin that i started two months ago.., two months in one skin is too much for me...

Please try to understand my point and for the ones who say they don't care about the rating, it's ok., that means that at certain point you are more mature than me and others who do care. ;)


With that option, the skin author could just simply hide all negative/constructive criticism comments that he/she feels speaks badly of the skin. It would unfairly skew the rating into a positive favor, in which case, why have ratings at all if only the positive ones will be shown?


that is true and i'm sure it will happend, but remember that the comments are for the skinner and his/her skin, hiding good critics that the owner of the skin disagree it's just an inmature atitud from the skinner and that is something we shouldn't care...

thankx again for the comments, feel free to leave a comment.., the point of this thread is to give ideas...
Reply #11 from WinCustomize Forums Top
(see WOM's thread for a good discussion on that)


btw.., mmmh, i can't go into that link  :NOTSURE: 
Reply #12 from WinCustomize Forums Top
that is true and i'm sure it will happend, but remember that the comments are for the skinner and his/her skin, hiding good critics that the owner of the skin disagree it's just an inmature atitud from the skinner and that is something we shouldn't care...

That's not true. If there is a user-reported problem with the skin, you bet I want to know about it before I decide to use the skin. The comments are as much for other users as they are for the skinner; providing information, feedback, potential issues, links to corresponding skins, etc.

(see WOM's thread for a good discussion on that)

btw.., mmmh, i can't go into that link   

Forums were being crappy on me, borked the link.

https://forums.wincustomize.com/314998
Reply #13 from WinCustomize Forums Top
The only real problem I have with the rating system is the 5 star thing...We used to have 1 thru 10.(you cant give half star ratings).

I do like Tycus's idea about the rating buttons not working til the download has finished...would cut back on some drive by ratings.
Reply #14 from WinCustomize Forums Top
That's not true. If there is a user-reported problem with the skin, you bet I want to know about it before I decide to use the skin. The comments are as much for other users as they are for the skinner; providing information, feedback, potential issues, links to corresponding skins, etc.


ok, mmmh., what about flaging the comment, not hiding but flag the comment and ask a moderator to check it and see if it is spam or a useless comment(by saying useless i mean comments like "this sucks".., "get a life" or even the blanck comments)
Reply #15 from WinCustomize Forums Top
I do like Tycus's idea about the rating buttons not working til the download has finished...would cut back on some drive by ratings.

I think that was actually my idea.

Tycus' idea was to force people to also add a comment when they rate.

Although, like Zoomba has been saying, no system is foolproof. Sure...you might be prevented from rating unless you've downloaded the file in question, but what's to stop the person from skipping out on actually installing it and evaluating it first?

ok, mmmh., what about flaging the comment, not hiding but flag the comment and ask a moderator to check it and see if it is spam or a useless comment(by saying useless i mean comments like "this sucks".., "get a life" or even the blanck comments)

I'm hoping they'll add a "report" link to the skin comments just like we have it here in the forums.
Reply #16 from WinCustomize Forums Top
I think that was actually my idea


She is right.., i was even readying back all my comments and the article itself to see where i put that :P :LOL: ...that's an idea, so please give more!

I'm hoping they'll add a "report" link to the skin comments just like we have it here in the forums.


that's another good idea! :)

Reply #17 from WinCustomize Forums Top
but what's to stop the person from skipping out on actually installing it and evaluating it first?


I know...thats why I said 'some'. ;) 
Reply #18 from WinCustomize Forums Top
What will people do when a revamped rating system doesn't make all their skins 5 stars?
Reply #19 from WinCustomize Forums Top
Forget stars.....put us on the beer system.......

#of beers I'd buy the artist






#of beers I'd have to drink before downloading this item





Reply #21 from WinCustomize Forums Top
Forget stars.....put us on the beer system.......#of beers I'd buy the artist#of beers I'd have to drink before downloading this item


:D
would be nice ratings.. :D
Reply #22 from WinCustomize Forums Top
Forget stars.....put us on the beer system.......


I'll drink to that  :LOL:  ;) 
Reply #23 from WinCustomize Forums Top
I vote for Lantec new beer system  :CONGRAT:  :LOL: 
Reply #24 from WinCustomize Forums Top
:LOL: @ the beers system
Reply #25 from WinCustomize Forums Top

TYCUS,

Thank you for putting together this very detailed ratings proposal.  And thanks to everyone so far for the overall discussion.  These are the threads I want to see about site issues like the ratings system.  Reasoned discussion with new ideas as opposed to rants and complaints.

Because it's what I do best, I'm going to play devil's advocate here for a minute on the proposed points.  Basically, whenever we look at a new system or a change to any system for user feedback, we have to look at it both from the warm fuzzy side, and from the potentially negative side.

1.  Rate a skin, leave a comment...

There are a few problems I see here.  One is the already addressed issue of either junk comments or very negative comments being left on a skin.  I'll be honest here, I get a lot more complaints about mean comments on a skin than I do a low rating.  A rating dropping by half a star is a lot less personal than someone coming on and saying "THIS SKIN IS GARBAGE!"  Despite the complaints, I've seen more people talk about giving up skinning over negative comments than I have over a low score.

Next is the problem where you'll be able to tell exactly who dropped your score.  Even if they leave a glowing comment, it won't take a rocket scientist to figure out overall who gave the skin a low score.  This will create a great deal of conflict where none currently exists.  Having ratings be essentially anonymous (admins can see who rated what how, but users can't) lets people express honest opinions of a skin without fear of retribution. 

Counter idea:

Rate a skin, pick a reason...

When rating a skin, you have to pick one pre-defined reason from a drop-down menu.  Reasons could be things like "I love the skin!"  "I don't like the colors"  "It doesn't run on my PC"  "It's not my style"  "Very usable" etc.  With options depending on what score you gave the skin (so you can't give a skin a 1 star rating and say you loved it).

2.  Hide the Troll

Not all negative comments are trolling.  If someone posts an absolutely terrible skin, people should be able to call it like they see it.  Now, there are genuinely negative comments sometimes that serve no purpose and are just insulting, offensive and detract from the site.  But we don't want to create a system where only glowing praise is allowed.  There are users on DeviantArt, for example, who delete every single comment on their skin that is in any way not complete praise, including reports of skins not working.

Counter idea:

Digg-Style Comment Ratings...

On Digg, every user can give a thumbs-up or a thumbs-down to any given comment on an article.  Each user can only rate a comment once.  Once a comment passes below a certain threshold score, it is collapsed to one line showing the date, time and username, and a button to expand said comment.  It is never deleted, never hidden, and always accessible.  This allows the community as a whole to determine if a comment is appropriate, and doesn't leave it up to the whim of an individual skinner who may not want any criticism of any kind.

3.  Flaming Stars

I've got nothing against this idea.  I love it.  The mechanics behind it would probably need some tweaking (like make it a combination of downloads & ratings).  We have "Hot topics" on the forums already to indicate popular/very active threads, I like this as a method to single out skins.  I'll have to think more on this one to see how we'd possibly do it.  It could be a nice way to automatically feature very popular community content.

4.  Who Can Rate

It's going to stay at the current cutoff.  Apprentices are generally skinners too, and as creators of content they have the authority to rate other skins.  Subscribers are supporting the site and community by helping foot the bill, generally if they're going to sink the cash into the site, they're not the types to do meaningless drive-by ratings, they're very active skinning users who know what they like.