I'm thinking it might be time to adjust how we rate games. We have had the 1-10 scale since the site's inception. Initially, it allowed for decimals. So you would see scores like 7.3 or whatever. A number of years ago, we did away with the decimals and only allowed whole numbers.
Now, I'm thinking we would go to a five-star system, so you would see a little image of five stars next to one another, with a one-word description to the right, like so:
***** = Terrible
***** = Poor
***** = Unremarkable
***** = Good
***** = Awesome
It would look a bit prettier than that, maybe, but you get the idea.
If implemented, the new scale would go into place immediately, and would impact all future reviews. I'm thinking I would also remove the option to edit scores on all reviews.
So, why am I proposing a 5-star system? Mostly, it's because I'm as sick of the score debate as anyone. While I think a general score can be useful, worrying too much about the numbers 1 through 10 is a distraction. Basically, games fall into one of the five categories outlined above, and if you worry much beyond that, you're just trying to establish a pecking order. That's what Top 10 lists are for, right?
If I'm thinking about buying a game, I want to know if it's good, great, mediocre, crummy, or just plain awful. I don't care if it got a 7 or an 8. I want to know if I'll enjoy it. And I think the proposed revision to our scoring system accomplishes that.
However, if the grading system changes, I'd like to think that it won't change again for years to come, if ever. So it's worth making sure this system is one the site's community can get behind. Do you like the proposed change? Let me know!




EmP Staff Apr 25, 2015
Germ Apr 25, 2015
honestgamer Blogger Apr 25, 2015
So it seems to me like really, there are about five useful degrees. After that, numbers translate to "but how good is it?" or "how great is it?" I can see value in arguing between good and great, but not between good+1 and good+2, if that makes any sense. That's my motivation to move away from the 10-point scale that seems to do that.
Besides allowing for perhaps too much precision, a 10-point scale tends to mean one of two distinct things to different people. It either mean you're secretly following the school grading system, where (in the United States, at least) 7 out of 10 translates to average and anything lower pretty much means you're a drooling idiot, or you're following common sense where 5/10 is average, middle-of-the-road. Devotees from the two groups LOVE battling it out, and review discussion quickly becomes an exercise in pedantry that benefits no one.
So anyway, I'm not married to the 5-star system if we implement a change, but I like it a lot. The one-word descriptions nicely summarize the experience a person is likely to have with a game, and even "unremarkable" is a warning (since so many of us have less time than we would like to spend with entertainment) without being an indictment. But a five-star system without the one-word descriptions could certainly also work. I'm open to suggestions, for sure, and I hope that people who have any suggestions to make will feel welcome to continue offering them here for my consideration and to contribute to the discussion.
Roto13 Apr 25, 2015
EmP Staff Apr 25, 2015
I did not know that. Man, that suddenly makes so much make sense.
You lot are idiots.
overdrive Staff Apr 25, 2015
As for this, I think I personally favor the 10-point scale, but because so many people are stupid about how to do a 10-point scale, I wouldn't have any issue with going to a 1-5 star thing.
JoeTheDestroyer Staff Apr 25, 2015
honestgamer Blogger Apr 25, 2015
One approach sites have taken is letter grades, but to my mind, that converts too easily back into the 1/10 scale and removes none of the ambiguity. Some would argue that a 1-5 scale does the same thing, since you can easily multiply any number by 2 and suddenly you have a 10-point scale, but I still think it works better overall and a lot of people probably aren't going to bother with that math. The one-word explanations would also have helped make the score's meaning clear, but I can do without if that's what people want.
jerec Apr 25, 2015
joseph_valencia Apr 25, 2015
JoeTheDestroyer Staff Apr 25, 2015
That having been said, I think this is a step in the right direction. It shows you whether or not you're reading a positive, negative, or apathetic piece, and it establishes unambiguous terms for each rating without getting needlessly detailed. Just don't do half-stars. Those bug me.
dementedhut Apr 27, 2015
Like Roto said, though, as long as decimals don't make a return. I'm not a fan of the letter grading, either; readers would just get as hung up on looking at a B or a C as if they were looking at a 7/10 or 8/10.
dementedhut Apr 27, 2015
As someone who goes back and readjusts ratings, I'm not really a fan of that, either. xD
Suskie Apr 28, 2015
wolfqueen001 May 1, 2015
Really the only downsides to the five-star system that I can think of, and some of these make me kind of hesitant, have to do with the following:
1) The one-word summary idea kind of dumbs the whole thing down... While this may be the intention, it also may actually motivate readers to read less of the review because of the score. For example, they may just look at the score, shrug, then go away and take whatever their interpretation is of it with them. Now, that's not to say some people do this anyway, but for me, having the five-star system there almost makes it more likely, in my opinion.
2) This is more of a minor thing, but I know with places like Netflix, which uses the exact same system proposed here, I'll sometimes have the problem of deciding whether the movie should be one score or the other because sometimes the five-star system feels too restricted. Whereas, on a 10 scale, the choice would have been easy - e.g. a 9 - on the five star, I may struggle between a four and a five. Granted, this kind of thing isn't terribly common, but it's especially noticeable when trying to decide whether the movie should be a two or three, or a three or four.
Now, I actually kind of like the idea of not being able to change the score once you grade it because, well, as some have said, the scores are kind of arbitrary anyway, and a change in score may change the way readers actually read the review (that is, what tone they interpret from the review). Of course, we all know that the review itself should speak for itself, but even I will go into a review sometimes knowing the score ahead of time and then look for how the person wrote the review to reflect that opinion. The only problem I can see with not being able to change the score would be cases where someone actually clicked the wrong button when submitting it, or, if their opinion of the review changed completely and so substituted the review with another. Granted, I'm sure provisions would be set up for these kinds of eventualities, and in the case of the latter, the writer might just want to delete the review entirely and resubmit (like Suskie did with Dark Souls), or submit the new one under a different platform.
Anyway, as long as this post is, I ultimately feel indifferent about this as well because I really can see both sides to the issue here and so can understand both the pros and cons to either system. I may be biased from using the old system as long, but that might just be the part of me that doesn't like change. *shrug*
Oh, I do have one other question, about all this. If you do change the system, what happens to all the old reviews? Will they convert as well or will they continue to show the 10 scale?