Confronting Disinformation Spreaders on Twitter Only Makes It Worse, MIT Scientists Say - Slashdot

Become a fan of Slashdot on Facebook

 



Forgot your password?
typodupeerror
×
Twitter Science

Confronting Disinformation Spreaders on Twitter Only Makes It Worse, MIT Scientists Say (vice.com) 79

According to a new study conducted by researchers at MIT, being corrected online just makes the original posters more toxic and obnoxious. From a report: Basically, the new thinking is that correcting fake news, disinformation, and horrible tweets at all is bad and makes everything worse. This is a "perverse downstream consequence for debunking," and is the exact title of MIT research published in the '2021 CHI Conference on Human Factors in Computing Systems.' The core takeaway is that "being corrected by another user for posting false political news increases subsequent sharing of low quality, partisan, and toxic content."

The MIT researchers' work is actually a continuation of their study into the effects of social media. This recent experiment started because the team had previously discovered something interesting about how people behave online. "In a recent paper published in Nature, we found that a simple accuracy nudge -- asking people to judge the accuracy of a random headline -- improved the quality of the news they shared afterward (by shifting their attention towards the concept of accuracy)," David Rand, an MIT researcher and co-author of the paper told Motherboard in an email. "In the current study, we wanted to see whether a similar effect would happen if people who shared false news were directly corrected," he said. "Direct correction could be an even more powerful accuracy prime -- or, it could backfire by making people feel defensive or focusing their attention on social factors (eg embarrassment) rather than accuracy."

This discussion has been archived. No new comments can be posted.

Confronting Disinformation Spreaders on Twitter Only Makes It Worse, MIT Scientists Say

Comments Filter:
  • Yes, we know (Score:5, Informative)

    by quonset ( 4839537 ) on Friday May 14, 2021 @06:54PM (#61385790)

    It's well known and well covered. It's called the Backfire Effect [jstor.org]. In short, when a person is presented with facts which contradict their beliefs, the person will dig in their heels and disregard the facts.

    Clearly this will apply to the bubbling intellectuals on Twitter. And Facebook. And Gab. And Parler.

    • Re:Yes, we know (Score:5, Insightful)

      by ShanghaiBill ( 739463 ) on Friday May 14, 2021 @07:39PM (#61385874)

      The purpose of confronting disinformation spreaders is not to convert the spreader, but to persuade the audience.

      That the spreader becomes angry and obnoxious is a good thing because it reduces their credibility.

    • by NFN_NLN ( 633283 )

      > . It's called the Backfire Effect [jstor.org]. In short, when a person is presented with facts which contradict their beliefs, the person will dig in their heels and disregard the facts.

      So if I say the NORMAL annual turnover of people is ~0.86%, and it increased by ~0.14% in 2020 - this only causes people to dig in more and claim 0.14% is a huge number of extra deaths?

      My anecdotal evidence seems to validate your theory.

      • Depends.
        .86 + .14, or .86 + (.86 * .14) ?
        If the former, that's in fact a fucking huge increase (16.2%)

        Being the latter is *highly* unlikely, I'm betting it's the former, and you just suck at math. I would love to be corrected, though.
        • Correction:
          .86 + .14 or .86 + (.86 * .0014)
        • by NFN_NLN ( 633283 )

          > If the former, that's in fact a fucking huge increase (16.2%)

          If your flaccid dick is 2 inches long AND with an erection it is 2.5 inches... I assure you, no one thinks you have a big dick.

          Small changes always look exaggerated when applied to small numbers.

          • If your flaccid dick is 2 inches long AND with an erection it is 2.5 inches... I assure you, no one thinks you have a big dick.

            Sure, that argument definitely holds water.
            However, the discussion was whether or not it represented a marked increase.
            16.2% is a marked increase. It's a huge increase.
            Is it still a large number, in absolute terms? Of course not.
            This isn't the black plague- it isn't wiping out a large portion of human civilization as we know it, but it still represents a huge increase from standard mortality.

    • And, as shown by the continued defence of Rebekah Jones on this website, Slashdot.

    • by SuperKendall ( 25149 ) on Friday May 14, 2021 @08:12PM (#61385958)

      ...when a person is presented with facts which contradict their beliefs, the person will dig in their heels and disregard the facts.

      Arguing with people on social media doesn't only have that backfire effect, it drags up engagement metrics which means Twitter is more likely to present it to other users!!!

      Twitter wins when a bunch of people get angry and pile on something, so of course the algorithms motivation is to show things that will make them angry.

    • Re: (Score:3, Insightful)

      by sfcat ( 872532 )

      It's well known and well covered. It's called the Backfire Effect [jstor.org]. In short, when a person is presented with facts which contradict their beliefs, the person will dig in their heels and disregard the facts.

      Clearly this will apply to the bubbling intellectuals on Twitter. And Facebook. And Gab. And Parler.

      On the other hand, "Physics moves forward one funeral at a time". So its not just non-scientists who are prone to be stuck in their ways and not respond well to new evidence. Part of this is the overreach of some people/scientists who believe they can predict things they just can't predict (often because they involves things they are not familiar with). Every physicist I have ever heard talk about energy production is informed, an expert and about 90% of the time they are wrong. Why? Because there are

      • Re:Yes, we know (Score:5, Insightful)

        by jhylkema ( 545853 ) on Saturday May 15, 2021 @02:00AM (#61386520)

        Squelching debates (which is what this misinformation prevention is about) is a terrible, terrible idea and that should be very apparent to thinking people these days.

        No.

        One, some viewpoints are not worthy of serious debate by serious people. Do we need to "look at both sides" of the "debate" on whether the Holocaust happened? Do we take the views of people like David Irving [wikipedia.org] seriously? Absolutely not. Those people are best ridiculed, ignored for their own good and, in some particularly rare and egregious cases [wikipedia.org], criminally prosecuted.

        Two, we're not talking about serious people trying to engage in a serious debate, but rather about deliberate, harmful disinformation promulgated by a small number of people acting in bad faith and with intent to cause harm [slashdot.org].

        • by gweihir ( 88907 )

          Very much this. There is, of course, areas where Science is not well verified or results are tentative, but there are vast areas were it is well verified and extraordinary proof is required to even start a debate. Anti-vaxxers, flat-earthers, climate-change deniers, religious people, etc. all do not have a leg to stand on. They live in their personal fantasy and their views do _not_ merit consideration.

        • Three, social media, the outrage media, the entertainment media, and even the mainstream media are all making money off of this. They have zero reason to suppress it.

          Four, evil but clever people have figured out that they can use these faulty viewpoints as a purity test for belonging to their group, effectively trapping people in believing or being outcast.

          We can't squelch dishonest debate when there's money to be made from it, and it's tied to a sense of belonging. We'd need a societal shift where people f

      • Re:Yes, we know (Score:5, Insightful)

        by Arnonyrnous Covvard ( 7286638 ) on Saturday May 15, 2021 @08:00AM (#61386938)

        Squelching debates (which is what this misinformation prevention is about)

        No, it is absolutely not about "squelching debates". A debate requires some ability and willingness to listen to arguments, reason about them and consider the other point of view. That's not what QAnon followers do at all. Disinformation isn't opposing information. It's literally the opposite of information. It strives to cloud the picture, to drown debate in nonsense. If you think you need to be allowed to convince others that Covid is in any way related to 5G and that the vaccines exist to genetically manipulate people or control them through computer chips, and that you have "evidence" of that, then you are the kind of blithering idiot who must be opposed not to convince you, but to warn others of your stupidity.

    • What if we charge people who post on social media for each recipient who gets their posts? Would that stop the lies?
    • accountability.
      there was a time when that was relevant.
      but one only consider the spanish american war to see what yellow press can accomplish

    • No. Different.

      This is more of a case of the "epic rebuke" effect. The way twitter works is that an epic rebuke like for example this one: https://twitter.com/endek_pl/s... [twitter.com] ends up being reposted, promoted shared on other media and so on.

      As a result the parent post gets promoted too. Law of unintended consequences.

    • Re: (Score:2, Flamebait)

      by gweihir ( 88907 )

      It's well known and well covered. It's called the Backfire Effect [jstor.org]. In short, when a person is presented with facts which contradict their beliefs, the person will dig in their heels and disregard the facts.

      Clearly this will apply to the bubbling intellectuals on Twitter. And Facebook. And Gab. And Parler.

      Without it, religion, flat-earthers, anti-vaxxers, climate-change deniers, trumpists, etc. would all not exist.

    • I don't like bad news. Nobody likes them, this is why I prefer not to read Twitter or any other news. If something serious actually happens, I totally would know about it. Right now, I'm more interested in this website https://www.onenightfriend.com... [www.onenightfriend.com] Has anyone tried it? I would love to hear your thoughts about it.
  • Pretty Much (Score:5, Insightful)

    by Jfetjunky ( 4359471 ) on Friday May 14, 2021 @06:57PM (#61385794)
    Seems like just some scientific basis for what we already knew: Twitter is a cesspool. People's behavior are rewarded for things that would make you a pariah in regular and common social interactions. Essentially, if most people acted the same way they do on twitter as they did with actual people, let's just say their "friends list" would probably dwindle to zero really fast.
    • Anyone having confronted a 4-year old, trapped in a temper-tantrum, experiences the same phenomenon. "no, no, no" is the only response. If they are that way by the time they are 4 it is quite probable they will be much the same until mid-20's, so say behavioral physiologists. Past that age, if they are ever to "grow up" they will listen. They might still disagree, but it will be disagreement, not obstinacy. Some, tho, cling to their beliefs regardless. Primarily, IMHOpinion, because they have been allo
    • by hawk ( 1151 )

      >People's behavior are rewarded for things that would make you a pariah in regular and common social interactions.

      there's a reason they're called "twits" . . .

      hawk

  • by Brain-Fu ( 1274756 ) on Friday May 14, 2021 @06:58PM (#61385804) Homepage Journal

    When people spread lies online, the absolute best and most effective thing to do is post responses in which you definitively prove them wrong and insult them a lot. The more profanity the better.

    This always shuts them right up.

    We have plenty of evidence right here on Slashdot to prove it.

    • by Anonymous Coward
      Can't tell if you're being sarcastic
    • Re:No it doesn't! (Score:4, Interesting)

      by alvinrod ( 889928 ) on Friday May 14, 2021 @07:42PM (#61385890)
      Although you're just being snarky, I think it's important to recognize that while posting a response to refute, debunk, or even just disagree to present another side to some argument is very unlikely to actually change the mind of the person you're responding to, it's probably going to to a good deal more to dissuade other neutral observers from adopting that position and probably a lot more skeptical towards it when they encounter it again in the future. If anyone's mind were that easy to change, it almost certainly would have already happened before you ever got involved. It's a much longer drawn out process that takes a good bit of time, but you won't get there at all if you never interact with that person initially.

      Besides, what's the alternative? Outright censorship of anything that gets deemed to be false, the inability to respond to anyone and engage in discourse less you disagree with them, banning people from posting online entirely?
    • by AmazingRuss ( 555076 ) on Friday May 14, 2021 @07:51PM (#61385914)
      This is fucking bullshit and you're a chucklehead and I FUCKED YOUR MOM!!!!
  • by e3m4n ( 947977 ) on Friday May 14, 2021 @06:59PM (#61385806)
    Dont feed the bears. Ive heard it all my life. The more you feed it the more credibility you give it. If you want to silently lower its score so it appears less often, fine. Any direct action will spawn an equal but opposite new conspiracy theory.

    " Come see the violence inherent in the system! Help! Help! Im being repressed! Did you see that? Did you see em repressin me? Thats what Im on about. "

    Even monty python understood this over 4 decades ago!
  • And yet (Score:2, Insightful)

    I've been saying this for years: Trump, QAnon, et al are not here to convince you. They are here to make noise. Their goal is to make you respond. Like a bully.

    The best strategy is to ignore their bullshit, and use just appropriate legal mechanisms to report all behavior that is reportable.

    • Re: (Score:1, Insightful)

      Would you care to address left wing disinformation?
    • That's why I've ignored all the major media for years. MSNBC, Fox, CNN, NY Times, NY Post ... all they do now is make noise and work very hard to suppress any information that is counter to the agenda they want to publish.

      Obama, Biden, AOC, Kamala, Pelosi ... all different sides of the same coin Donald Trump is. Attention whores who will say anything to advance their personal agenda and can't be trusted to tell the truth about anything.

      People complain about Congress not doing anything.

      I think it's
  • This is one of those articles where my mind just boggles that someone felt they had to run a study on the subject.

    In other news, water is wet at room temperature.

    • In other news, water is wet at room temperature.

      Below a pressure of 17 mm of Hg (0.023 Atm) water is a gas at room temperature.

  • According to a new study conducted by researchers at MIT, being corrected online just makes the original posters more toxic and obnoxious.

    Duty calls. [xkcd.com]

  • Post-rational. (Score:4, Insightful)

    by RyanFenton ( 230700 ) on Friday May 14, 2021 @07:18PM (#61385834)

    This isn't a everywhere, or forever thing.

    It's just the way the culture of the place is right at this time.

    That is - it's considered fashionable to avoid conflict by dismissing the other person and moving on - and people that don't do that are considered prey for mockery.

    It's a kind of post-rational culture on Twitter - which is why I never started with it myself, seeing how conversations went. You still can't escape folks posting links to threads, in a large percent of other media though.

    Lots of cultures hit points like that, where arguments become largely intentionally useless - especially ones with an assumption of mostly anonymity and relative impermanence.

    So, confrontation there isn't a matter of winning some fight - but getting out with the least complications.

    It's more a commentary on the uselessness of most emotions invested into Twitter than in being able to argue for rational skepticism or something.

    Ryan Fenton

    • by ljw1004 ( 764174 )

      This isn't a everywhere, or forever thing. It's just the way the culture of the place is right at this time. That is - it's considered fashionable to avoid conflict by dismissing the other person and moving on - and people that don't do that are considered prey for mockery.

      From the Old Testament, Proverbs 26:4, "Do not answer a fool according to his folly, or you yourself will be just like him."

      1878 quote, "Don’t argue with a fool, or the listener will say there is a pair of you." (ascribed to Mark Twain as "Never argue with a fool; onlookers may not be able to tell the difference.")

      I disagree that it's a current-culture thing. We've always had the admonition not to argue with fools. This admonition has in the past been based on you looking foolish too. What the researc

      • Your hidden assumption is that the disinformation spreader is a fool. On the contrary, Sartre noted that they may know exactly what they are on about:
        "Never believe that anti-Semites are completely unaware of the absurdity of their replies. They know that their remarks are frivolous, open to challenge. But they are amusing themselves, for it is their adversary who is obliged to use words responsibly, since he believes in words. The anti-Semites have the right to play. They even like to play with discourse f

  • ... when you try and build a computing device out of meat.
  • by jacks smirking reven ( 909048 ) on Friday May 14, 2021 @07:25PM (#61385840)

    Having met and "debated" 3 or 4 actual conspiracy theorists face to face I have found the best weapon is not studies or facts or data, they don't care about that. You just keep asking "who" and "why" after every claim and they will go deeper and deeper until eventually the engine sputters out from lack of fuel. All conspiracy theories will hit several points of contradiction at their core. Does this change their minds? Almost certainly never when you are a stranger to them. Only people close to them can ever really turn them around long term.

    Also most of them are not "wrong" about the core issues. There are evil "cabals" of "wealthy elites" who control politicians and the economy but they are just the straight up capitalists and corporations and they don't need some elaborate scheme, it's just business as usual all right out in the open. The difference now is while they used to be "X-Files lone gunmen" type libertarians or anarchists in thought now they are just about all intertwined with right-wing politics and a core contradiction is the very politicians who feed their theories credence and they end up supporting are the ones perpetuating the actual problems in the world they see.

    • All true except for the implication that left-wing politics are somehow not embroiled with the "capitalists and corporations" that constitute the controlling wealthy elite.

      Corruption is non-partisan. All political groups are equally guilty of it (more or less in proportion to the level of political clout they actually have). All political extremes are equally harmful, too.

      Sounds like you may have been taken in by the pleasing words of a group that panders to your specific bias.

      • Sure, I never meant to imply there's no conspiracy thinking on the left end of the spectrum. The hard-socialist/communist wing tends to see "CIA everywhere" when dealing with any other left wing country who struggles, which is not unfounded but also not to the extent they profess it is. You could also make a case for many people Russia obsession, they think all opposition is Russian troll farms, which is not unfounded but they exaggerate it's reach too much sometimes. There's also a minor plurality but si

    • Yep ... the best way to handle people who want to argue is to ask them questions about what they believe in. I remember someone going on about George Bush years ago. I asked him what a 'Trotskyite' is.

      He got all flustered and went away. And stopped pestering me with his conspiracy theories.

      He didn't stop believing in what he believed it, but at least he didn't waste my time anymore.

      Don't feed the trolls ....

      But, to be fair, this is a good practice in any disagreement. It's less confrontational
  • of bad education that fosters data retention and repetition over self thinking. promote better education and you'll see "didinformation" fizzle away, also it'll be harder to manipulate the masses
    • by OldUserBackAgain ( 6505346 ) on Saturday May 15, 2021 @04:58AM (#61386696)

      of bad education that fosters data retention and repetition over self thinking. promote better education and you'll see "didinformation" fizzle away, also it'll be harder to manipulate the masses

      Sorry, I wish it was that simple, but it isn't true.

      I was horrified to see that the assistant professor I was assigned to 20 years ago for my master thesis, now is one of the worst climate deniers I have ever come across. He is highly educated and very well-respected authority in his field, but when it comes to climate change he is completely ignorant, fighting that it exists, tooth and nail, with arguments that makes me nauseous.

      I have also examples of people with a very low educational background but heaps of common sense that laugh at disinformation and identifies it right way.

      So even though I think education is a good thing (I am an educator myself), it simply isn't a silver bullet in this case.

  • by account_deleted ( 4530225 ) on Friday May 14, 2021 @07:42PM (#61385892)
    Comment removed based on user account deletion
  • by Arnonyrnous Covvard ( 7286638 ) on Friday May 14, 2021 @07:50PM (#61385912)
    Of course someone who posts this nonsense is going to be defensive about it when confronted with direct objection. And of course people who have taken sides will reject all evidence and share the wrong information. Facts.don't matter in an us vs. them situation. But posting the facts is not about those people. It's about the people who haven't made up their mind yet. You absolutely want the correct information right then and there. Attention spans are short and clicking through to read articles is asking a lot. If the morons turn up the crazy in response, let them. It shows what they are.

    Trying to get everyone to agree is the wrong approach. It's impossible. The QAnon folks are a lost cause. A quarter to a third of people are too dumb to understand a moderately complex explanation. They can only be persuaded, but this never works if being persuaded means doing something they don't want to do (stop smoking, mask wearing, whatever). Policy needs to take this into account and make following the wrong path individually painful. The damage they do needs to be turned on them. There is a reason the law isn't just a book explaining why you shouldn't do some things.
  • I don't agree. I've convinced countless victims of misinformation over the years. Most people seem to just require proof and sometimes that's easy with my Google Fu. Trump and co don't bother avoiding lies about things that can be disproved with a quick Google search. It's easy to find a video of someone saying something to disprove a claim. Maxine waters was misquoted last year by Trump, he said she was talking about a supporters and not Republicans when she told a crowd to get in their face. The video is
  • we found that a simple accuracy nudge -- asking people to judge the accuracy of a random headline -- improved the quality of the news they shared afterward

    This kind of study -- a "simple... nudge" in some regard that has long-term effects afterward -- is called a "priming effect" and generally they're all bullshit. Bullshit that's cheap, from which it's easy and fast to make a study/paper, and hence get a PhD/psychology faculty position. From Wikipedia [wikipedia.org]:

    Although semantic, associative, and form priming are well established, some longer-term priming effects were not replicated in further studies, casting doubt on their effectiveness or even existence. Nobel laureate and psychologist Daniel Kahneman has called on priming researchers to check the robustness of their findings in an open letter to the community, claiming that priming has become a "poster child for doubts about the integrity of psychological research." Other critics have asserted that priming studies suffer from major publication bias, experimenter effect and that criticism of the field is not dealt with constructively.

  • When I point out that the only person killed at the "insurrection" was an unarmed woman who was shot by police, people get pretty irrational.
  • Sounds farfetched? It isn't. Former UK Labour leader and would-be Prime Minister Michael Foot (a/k/a Agent Boot) took money from the KGB to publish Soviet propaganda* [thesun.co.uk].

    *Yes, I know The Sun is a tabloid and thus not normally a reputable source, but this article's reporting on the content of Ben MacIntyre's book is accurate [amazon.com]. IOW, a stopped clock is right twice a day.

    Here's another article [theconversation.com] about Foot taking money from the KGB.

  • The real takeaway here is that people respond much better to more gentle suggestive approaches like "have you considered checking the accuracy of your statement" and badly to more direct approaches like "this is wrong because".
  • "You're wrong!" doesn't work so well. This and a squirrel that chews bread into the face of Jesus at 11!

  • They looked only at short term effects. There's still hope that the long term effects of challenging lies directly is salutary.

    Otherwise free speech doesn't work and we're all screwed.

  • by Rick Schumann ( 4662797 ) on Saturday May 15, 2021 @02:28PM (#61388038) Journal
    Fact: you cannot distinguish between internet trolls, and people who genuinely believe the bullshit they're posting.
    Fact: trolls want you to engage them, that's how they get their jollies.
    Fact: since the above are both true, society is presented with a quandary: people who actually believe the bullshit they're posting want to silence everyone who disagrees with them (which means their damage is allowed to spread unchecked), but if they're actually trolls, not engaging them is the only way to actually get them to knock it off (they'll get bored and go away if no one responds to them).
    This is why so-called 'social media' is such a failed experiment: it gives a wide-reaching platform for both of the above, but does precisely nothing to discourage them. Moderation on these platforms is virtually impossible due to how much human labor is required to manage them.
    'Social media' should be, in my opinion, abolished outright. We humans are clearly too irresponsible to have such a powerful tool at our fingertips, and the proof of that is right before everyones' eyes. Yes, that's right, I'm advocating 'throwing the baby out with the bathwater', but I don't see any way to fix the problem and keep 'social media' platforms around.

He has not acquired a fortune; the fortune has acquired him. -- Bion

Working...