All Channels
Popular
Approvals 6/5 ▼
thorstein (2) - 3849d ago Cancel
LostDjinn (2) - 3849d ago Cancel
SimonSmith (1) - 3849d ago Cancel
gangsta_red (1) - 3849d ago Cancel

Confirmation Bias and Video Game Reviews

Throughout my years on N4G there is one thing that I have noticed. People tend to support reviews that reinforce what they believe and reject those that don’t. 10/10 reviews are filled with the praise and admiration of everything related to the game. 6/10 reviews are filled with questions and concerns about the reviewer and the validity of the site. Each of them generating a crap ton of heat to reach the front page. While the median scored reviews get almost no comments. Now, this could be the result of ardent fanboys, click-bate, or some combination of the two. However, I believe that there might be another interesting phenomenon taking place. That is confirmation bias.

Confirmation bias, also known as myside bias or confirmatory bias, is a psychological phenomenon where people tend to favor information that confirms their preconceived notions despite any and all evidence to the contrary. In other words, people will search, reach, and look for information that confirms their individual beliefs while excluding any information that might run contradictory to them. Examples of this can be found in everything from scientific research to news media. Discussions about religion or politics are places where it can easily be seen.

As far as video game reviews are concerned, there seems to be a fair bit of confirmation bias not only in the creation of the reviews, but also in the way that we as a community react to them. How many times have we seen the comments section littered with the line: “There’s NO WAY IN HELL that ________game can be a 6 out of 10! It has_____, ______,_______ so it HAS to at least be a 9!”? Or,” no campaign??? Can’t be more than a 7!”? These are prime examples of confirmation bias. The first, obviously, had higher expectations for the game. Most likely because of a history with the franchise, pre-release hype, or the subjective fun that they had with a demo or beta. The second one has set an arbitrary standard for what makes a game. When the game doesn’t meet that standard, then it is considered a “lesser” game.

Now, I am not saying that you don’t have the right to be disappointed by a poor review of your favorite game. That is a natural progression of cognitive function. (as is confirmation bias) What I AM saying is that we must try better to understand when bias is used (whether it be in reading a review or reacting to one) and react more appropriately. With that being said, here are several ways to reduce and possibly avoid confirmation bias as a reviewer and as a reader of reviews.

1 )REMOVE YOUR EGO---The ego is what feeds confirmation bias. In general, we hate to be wrong and we crave the approval of others to validate our opinions. So, removing the EGO allows for us to be able to seek truth and not be locked into fallacious arguments that resort into eventually (maybe way down the line) facing how wrong we may have been.

2) SEEK DISAGREEMENT---Okay, so this one might be a bit contentious on forums (as the nature of forums seems to be trolls seeking disagreement). However, fostering an environment where disagreement isn’t automatically considered trolling allows for a better and more truthful dialog. Plus, it can eliminate misunderstandings and small sticking points that could be the key to the initial discussion. (I’ve found this useful when getting PM’d on N4G. Further explanation sometimes allows for more open and honest discussion…but don’t get your hopes up!!! LOL)

3) ASK BETTER QUESTIONS---Instead of saying “Why isn’t it a 10?” A better question could be “What would have made it a 10 in your mind?” Or even “What does a 10 game need to have for you?” In this way, you engage the other person and solicit a response.

4) IF YOU’RE GONNA GOOGLE, GOOGLE RIGHT (Google with me!?!? Anybody???)---The internet is HUGE. Therefore, if you are using Google to prove a point, you are bound to find some site that reinforces your idea. Don’t only search what you want to prove. Use more open-ended searches or perhaps search the opposite point of view and compare. Who knows…you might actually be WRONG (or at very least not as correct as you thought).

Confirmation bias is a real aspect of psychology and thusly a part of what happens in the perception and processing of information. It is not completely avoidable. But, it can be reduced. In order to have productive conversations about anything, including video games and reviews, truth (or as close as we can get) needs to be the driving force. This is extremely important when talking about reviews and the reviewing process.

Reviews are a fairly important part of our industry. Aside from a beta, these are truly the first looks that we gamers get into a finished product. (several big publishers use Metacritic as a bonus guide) Reviewers need to make sure that they are applying themselves (as much as possible) to being as free from confirmation bias as possible. In the end, we as gamers want the truth (even if it hurts) so that we can make informed decisions about games that we might be on the fence about. As gamers, we need to understand that reviewers are still human and bound by the same psychological “flaws” as we have. People will have differing opinions. The real question is whether or not these are supported by evidence to make them valid. Saying a game is a 6 is an opinion. Saying a game is a 6 and backing it up with reasoning (even if flawed) makes it at very least a more valid opinion. Regardless of all of this, one thing we ALL need to do is check our EGO at the door. Reviews are neither right nor wrong…they are just opinions. You are not wrong or right for disagreeing or agreeing with a review. However, if you use the tips to avoid confirmation bias, you might find a more truthful way to gauge your favorite games or unheralded new IP and the reviews that are written about them. This doesn't solve all of the problems of reviews. But, it does begin to touch on why there are such a wide ranch of scores and how we can begin to at least accept that opinions are like...nevermind! Either way, the most important thing is to just ENJOY gaming!

It's the questions Neo...

The answer is CLEARLY NO!!!

Create Report !X

Add Report

Reports

+ Updates (1)- Updates (1)

Updates

Changed from Pending to Approved
Community3849d ago
thorstein3849d ago (Edited 3849d ago )

"Reviews are a fairly important part of our industry."

Those who can, do. Those who can't, criticize.

The fact is, reviews and critics are not an important part of our industry. Or part of any industry wherein the "critic" examines art. That doesn't mean art can't be examined.

It simply means that people who cannot create art should not (and are not qualified) to critique that art.

Without naming games (because I don't want this to devolve into a "that games sucks/ that game is the best" argument) I know that I would have missed out on some amazing games based on what the critics have said.

Also, based on those same critics, I would have bought games that (in the end) were actually broken and couldn't be played.

Critics and their critique amount to a pile of dung. Actually, they don't. Because a pile of dung can be used as fertilizer. Critics have no place and are one of the reasons journalism lacks integrity.

Confirmation bias may play a part in this, but it is only a part. Game journalists exist in a world that is insular. They talk video games, they eat video games, and they breathe video games. Wherever they go, video games are part of their daily life.

When they talk about what they want out of a game, their wants and reactions are reified by feedback from their fellow journalists. This tends to further isolate and insulate them from the mainstream gaming community. And that insulation only continues to validate their perceptions of gaming as a culture.

There was nothing more egregious than when "Value" became an added part of reviews. The dollar/ gametime ratio somehow invalidates or validates a game.

So, what comes when Fallout 4 or No Man's Sky is released. To fully complete NMS, one would have to play for billions of years, which costs .00000002 of a cent per year to play. Will we see a review score that shows this? If not, then there is no integrity. You can't claim "value" for one game then suddenly forget it later.

This is a nice attempt to defend critics, but in reality, they are non contributing zeros that, when they die, will have not made this industry better.

iceman063849d ago

This isn't a defense of critics. This is an attempt to understand why reviewers and those that read reviews often have issues with objectivity. And, while I would wish that reviewers didn't have such a prominent role in the industry, the truth is that they do. As we know, many high profile publishers base decisions for bonuses or continuation of a franchise on Metacritic scores. These days, developers can be made or broken by reviews. (of course sales count as well) The issue that you brought up about how journalists isolate themselves from the mainstream community could be a function of confirmation bias...i.e., they seek out those with similar views and opinions to reinforce what they THINK they know and evade anything else that might contradict their opinion. (the EGO needs feeding and what better way to feed it then to get others to tell you that you are right...all of the time! LOL)
Also, I fully agree with the "value" argument (simply because value itself is extremely subjective)
So, while I don't think that critics and reviewers should have such a powerful role in the industry, I do think they serve the purpose of providing insight into a game that we might be interested in. That being said, I don't ever SOLELY rely on reviews as a basis of my decision to purchase a game. Thanks for taking the time to read this and I enjoyed your comment.

thorstein3848d ago

Yes. I see that it isn't a defense, now. Thanks for clarifying. I wasn't sure if this was but I agree with your blog (why I approved it) and thanks for replying to me to further explain.

NewMonday3847d ago

can't say a thing here without someone spinning it to console war BS, even when I talk about 3rd party multi-platform games.

garrettbobbyferguson3849d ago

Just because I'm not a chef at a kitchen doesn't mean I can't tell you your steak tastes like ass. And just because I have chosen not to program video games does not mean I can't tell you your game is also ass (whether that means unenjoyable, buggy, etc).

And stop bringing up this "billions of years" crap about No Man's Sky. You'll get no more playtime out of that game then you would out of Tetris or Donkey Kong or minecraft. All of which are theoretically limitless. So why do reviews for this upcoming game suddenly have to reflect that "limitlessness" but that viewpoint hasn't applied to arcade machines?

thorstein3848d ago

I didn't come up with the "value" criterion that was suddenly invented this generation in order to bash games that couldn't be bashed for any other reason.

But, once it is added, why is it dismissed for certain games then? That means there is no consistency and therefore no integrity.

ZombieGamerMan3848d ago

What you said is just the most moronic thing I have heard, critics are needed. We need people to play these games and come back with an analysis of games, if you want to argue that review scores are not needed than have at it cause I agree on that level. Look at the games that get greenlighted on steam there are tons of crap that come out of it especially those that are made by Digital Homicide, a shit tier developer but because we got guys like Jim Sterling playing those games and informing people of it's shittyness we save ourselves the agony of finding out the game is bad.

Now if you based all your purchasing on reviewers than what you need to do is find those you trust, not a site but a reviewer and when it's not the guy you trust you need to read the pros & cons of the game and decide from that whether the game is for you or not.

In short what you said was dumb as hell.

thorstein3848d ago (Edited 3848d ago )

No they are not. They are not needed in any way shape or form. Only a critic could defend critics.

Think about it this way: an author, an artist, a developer, a musician spends months, possibly years developing a piece of art. An unlearned critic comes by and tears down in one day what they (the critics) couldn't produce in a lifetime.

What I said was dumb as hell? Evidence. You disagree is what you mean, but you have no evidence that critics are needed or that what I said was dumb. What are you, twelve?

A developer is shitty? Then report on how they make broken games. That isn't a review. Those articles have always existed.

So what if you disagree with my opinion about the opinion of untalented morons? How does that mean what I said was dumb?

"You are a sad, strange little man." -Buzz Lightyear

3848d ago
thorstein3847d ago (Edited 3847d ago )

So, your inability to understand what others say is somehow an indication of their level of intelligence? That's a new one.

The ad hominem attacks are indicative of people that can't explain what they mean so they seek to demean others.

You don't understand that knowledgeable people are better at doing things than unknowledgeable people. That's awesome. Please, only follow this advice for yourself.

You see, if a surgeon decides to take on a new procedure, they will run it by their peers and see if it is feasible. If the surgery is publicized, as they may be, the doctor will receive feedback from other doctors. But, according to your ideology, the doctor's techniques should be critiqued by some uneducated zero and that opinion should be equivalent to those of doctors that have studied in that field.

What an odd way to go through life. Do people who have an education scare you?

Are you often confused when people use: words (which is evident by your unsolicited reply?)

Perhaps it is because you can't follow the simple logic. Perhaps it is because you are a reviewer who I most likely have criticized before (ironic, I know) and your butthurt because of it. I really don't care.

The funniest things about critics is that they can't take criticism of what they do.

Have a fun day! Keep up the personal attacks, I guess, it must make you happy.

Nicaragua3847d ago

@Thorstein

I would agree that critics are not required but your surgery metaphor is absurd - it relies upon fact to quantify itself, whereas a review is simply an opinion. There is no opinion on surgery, it will have a result that is either better, the same, or worse than another method.

Do we need critics - no. It is useful though to have someone play through numerous games that i would never find time for and post a review so i can make a informed decision on whether to purchase (assuming i trust the reviewers opinion).

+ Show (2) more repliesLast reply 3847d ago
coolbeans3846d ago (Edited 3846d ago )

Late to the party but there's a lot you stated in first comment that makes me scratch my head in bewilderment.

Criticism (whether by random people or critics) is a vital part of any art form. The principle of evaluating works across any medium is one of the best ways of challenging artists to impress us. I think it was a Greek philosopher who fell asleep during a play that went on a written rant the next morning about the importance of narrative structure way back then. In today's time, formalists from across the globe have constantly brought up new ways of thinking in creating narratives, typically across books and film.

Also, I believe others have rightly challenged the notion of "people who cannot create art should not (and are not qualified) to critique that art." But I want to tackle it with two different aspects to consider:

-The first would be the rough economic climate of simply learning the craft of game development, programming, etc. Considering the cost typically associated with a profitable AAA company and the cost of an IGN writer, which do you think would be the most lucrative? Of course game designers would more often than not go off to design games rather than talk about them.

-But let's say there ARE a bunch of game school grads that decide to take up reviewing as their full-time job. Wouldn't that mean your criticism of game journos being 'insular' ring doubly true in this hypothetical situation? These isolated, probably more pretentious, game designer wannabes waxing philosophically about what they want out of games would be even more foreign to the mainstream gaming audience.

Anyways, just something to consider.

UnRated3846d ago

That's bullshit. I'm an artist, a video game artist and I critique other media all the time.

You think critiques aren't important? They are. It doesn't matter where they come from.

thorstein3845d ago

No. You are exactly the person that should critique it. That is my point.

What I am finding funny is that people expect me to respect the opinion of the critiques but either personally attack me or call my opinion BS.

Since when are critics not supposed to be criticized?

Imalwaysright3845d ago

I'm just going to say this: we're critics and when I say we, I mean all of us.

SnotyTheRocket3843d ago

So, I have to be able to make a video game, or a film, to put my opinions of these things out into the world? Yeah, that's not how it works.

+ Show (4) more repliesLast reply 3843d ago
FlexLuger3848d ago (Edited 3848d ago )

Good blog. This theory is certainly not new, but it certainly applies to video game reviews I think. some of us even cal attention to the things you just mention...the lack of "opposing side" in 10/10 threads vs the abundance of "opposing side " on the lower scores. thats where it gets nasty. We all been there. We all got our hands dirty.

confirmation bias works both ways, it seems. If there was a XBL VS PSN thread right now we could all find something on google to base our points on. To actively go seeking that information in itself is a form of conformation bias. Its a closed minded way of simply hammering your own point. and yes ...I believe every one of us on here has done it at some point. Low bubs or high..we all do it.

I did it today in a certain thread (wont name the game) somebody countered with the same stance..and the merry go round went on, so to speak. "my 'proof' Vs your 'proof'".

The reality is this..nobody wins. Its all opinion. But we do it anyway. Its why we are here on N4G. Lets be real for a moment.

EDIT:You know what WILL radically change the way these ...'debates' (im trying to find a polite word for it all, cut me some slack) play out on here? The removal of the agree/disagree and bubble system. No more of this point scoring, based on likes/dislikes. lets see who can really argue there points around here in a solid way without leaning on agrees/disagrees ( that are blatantly abused..you pick a side and thast where you go, with it...)

Software_Lover3848d ago

On this website, I agree, the agree/disagree buttons need to go.

If they can't/don't go, atleast make it where you can see who is disagreeing/agreeing.

3848d ago
SteamPowered3847d ago

I would love to see who contributes to the Stealth Disagrees.

The disagrees dont really bother me, my views are usually divisive, but the fact there is no ownership to them lets people disagree with reckless abandon. They dont have to offer a counterpoint, just a simple click and they feel like they contributed by knocking you down.

thorstein3848d ago

I like what you said here and I agree except for the bubbles. (Though you only have two, I will bubble you up for a well said.)

The bubbles prevent trolls from trolling. That is the wondrous thing about them. Other forums and comment threads are riddled with the worst kind of trolls. Though trolls exist here, they are limited in what they can do. Then, on the flip side of that, people who comment well are rewarded.

That is excellent. People who respond well, are civil and well thought should be able to comment more.

Though there is some trolling, N4G is still one of the most civil places I visit regularly. And I say this after reading the post above by ZombieGamerMan wherein he called me moronic and dumb in the same post.

It is still more civil than most places.

starchild3847d ago

I couldn't disagree more. N4G, if anything, is filled with more trolls than usual. And the bubble system gives no real indication of who is a troll and who isn't. Some of the biggest trolls on the site have huge bubble counts, while many really good posters have few bubbles.

And I've seen no evidence the bubble system is truly community-driven anyway. It seems to me bubbles are added or taken away solely according to the whims of the mods.

It's a stupid system that only serves to censor or silence those who don't share the mods' particular biases.

thorstein3847d ago

Starchild,

While you disagree with me, I have no problem with what you say because you are civil and express a frustration with the system.

I voted you up for interesting, because it is. I have heard that when the new site launches, it will be gone.

Remember, I am not saying it is flawless, but, if you belong to any forum on the internet, you can see easily how quickly things get out of hand.

There used to be great spaces, there are still a few, but they are mostly destroyed by people who have no knowledge about something shouting about how all others are wrong.

Consider space.com which gets the most insane comments about astronomy!? Anyway, while we don't agree, it is nice to see that you didn't resort to name calling and vitriol.

iceman063848d ago

You pretty much nailed the reason why I wrote this. I know that it is not some new science. However, I don't think that many people are aware of just how much psychological bias goes in to a given discussion. This not only applies to confirmation bias, but also overconfidence bias (I know this because I study this...no way you could know more), gambler's fallacy (it happened before, so it has to happen again), and even anchoring (mind made up before getting enough information). I won't even start on the logic errors. I honestly don't mind opposing views. In fact, I welcome them. What annoys me are opposing views just for the sake of opposition. (purely subjective but stated as fact with little to no data to back it)
As for the system, there are problems. I was once labelled a 3 bubble troll for a simple (and civil) disagreement. I learned then that it's a losing battle trying to convince someone who is entrenched to see any other way. They are who they are. Now I understand that and only really engage those that are open to civil discussion. The fanboys can have the rest.

SegaGamer3848d ago

I personally don't see the point in reviews, it's ONE person's opinion. Why do people let one person's opinion influence their decisions ? If i listened to reviews, i would miss out on most of my favourite games.

3848d ago
iceman063847d ago (Edited 3847d ago )

One person's opinion, in isolation, can be completely useless. However, a collection of reviews from various sources at least shows a pattern for expectations. The collective subjective (or the idea that people together form a collective opinion) drives a lot of why reviews are written in the first place...that's for movies, music, art, games, etc. They aren't always right...or wrong...but they DO provide further insight and a starting point to discover something new or whether something has changed too drastically.
You don't have to listen to reviews but, as a collective, they can be a good source for people that are trying to decided on what to do with their money. That's why it's important for reviewers to do the best that they can in remaining objective and maintaining integrity. Though YOU might not use them others, including publishers and developers, DO use them.

Articuno763848d ago (Edited 3848d ago )

In the past I've reviewed many imports making me the only authority on the games I review. And I've had people who've never even played the game (let alone heard a word about them as I'm the only one reviewing them in English) tell me my reviews are flat out wrong.

Which is hilarious. THEY HAVEN'T EVEN PLAYED THE GAME!

And yet isn't the whole point of a review to inform some WHO HASN'T PLAYED THE GAME?!

Show all comments (38)
70°

Microsoft Gaming Revenue Drops 7% Year-on-Year, Content and Services Down 5%, Xbox Hardware Down 33%

Microsoft announced its financial results for Q3 of fiscal year 2026, including an update on its gaming Xbox business and more.

Read Full Story >>
simulationdaily.com
Create Report !X

Add Report

Reports

+ Updates (2)- Updates (2)

Updates

Changed from Pending to Approved
Community11d ago
Changed: credit url
Jin_Sakai11d ago (Edited 11d ago )

Not looking good. Hopefully Asha Sharma is able to turn Phil’s disaster around.

dveio11d ago

To me it's still quite remarkable how they can cash-in 5.3bn in revenue in a single quarter, since their hardware is basically dead.

Jingsing11d ago

The stock mark is what makes Microsoft remarkable, They have convinced every institutional and retail investor to just keep piling money into them. Like many big tech giants they are just a big growing pyramid scheme. As long as people keep dropping money into ETF's that cover the market Microsoft will always be liquid. At the same time it is completely stifling innovation and competition. People need to start being more discreet in how they invest their money as it's killing the system.

Tanktopmaster9211d ago

Once they re-evaluate exclusive all will be fine….

S2Killinit11d ago

Riiiiight because people will just flock back to them for one or two games per year.

Jingsing11d ago

15+ years of bad performance is what they call irreparable in business. It is time for them to sell off the assets and get out of entertainment.

Tanktopmaster9211d ago

These declines are on the back of extra revenue received from releasing games like Forza horizon 5 on PlayStation. So I’m being sarcastic here when I said they should go back to exclusives. Killing off a revenue stream from Ps5 sales will only make things worse

Show all comments (13)
40°

Games Done Quick is coming to Europe for the first time with 3 days of Gamescom speedruns

The charity event will be streamed live from Gamescom in August.

Read Full Story >>
videogameschronicle.com
Create Report !X

Add Report

Reports

+ Updates (1)- Updates (1)

Updates

Changed from Pending to Approved
Community11d ago
50°

Report: Injustice 3 in Development at NetherRealm Studios

Thanks to the slip-up of an artist working on the title, we now have more evidence that a new Injustice game is in the works.

Create Report !X

Add Report

Reports

+ Updates (1)- Updates (1)

Updates

Changed from Pending to Approved
Community11d ago