https://www.extremetech.com/internet/scientists-use-ai-to-prove-people-can-be-talked-out-of-conspiracy-theories
From the article:
This chatbot experiment reveals that, contrary to popular belief, many conspiracy thinkers aren't 'too far gone' to reconsider their convictions and change their minds.
At first glance the major takeaway here might be that AI can do gish-gallop but with the truth instead of lies.
And it doesn't get exhausted with somebody's bad faith bullshit.
Another way of looking at it: "AI successfully used to manipulate people's opinions on certain topics." If it can persuade them to stop believing conspiracy theories, AI can also be used to make people believe conspiracy theories.
Anything can be used to make people believe them. That's not new or a challenge.
I'm genuinely surprised that removing such beliefs is feasible at all though.
If they're gullible enough to be suckered into it, they can similarly be suckered out of it - but clearly the effect would not be permanent.
I've always believed the adage that you can't logic someone out of a position they didn't logic themselves into. It protects my peace.
That doesn’t follow with the “if you didnt reason your way into a believe you can’t reason your way out” line. Considering religious ferver I’m more inclined to believe this line than yours.
No one said at all that AI used "reason" to talk people out of a conspiracy theory. In fact I would assume it's incredibly unlikely since AI in general is not reasonable.
Why? It works as a corollary - there's no logic involved in any of the stages described.
The researchers think a deep understanding of a given theory is vital to tackling errant beliefs. "Canned" debunking attempts, they argue, are too broad to address "the specific evidence accepted by the believer," which means they often fail. Because large language models like GPT-4 Turbo can quickly reference web-based material related to a particular belief or piece of "evidence," they mimic an expert in that specific belief; in short, they become a more effective conversation partner and debunker than can be found at your Thanksgiving dinner table or heated Discord chat with friends.
This is great news. The emotional labor needed to talk these people down is emotionally and mentally damaging. Offloading it to software is a great use of the technology that has real value.
More like LLMs are just another type of propaganda. The only thing that can effectively retool conspiracy thinkers is a better education with a focus on developing critical thinking skills.
Let me guess, the good news is that conspiracism can be cured but the bad news is that LLMs are able to shape human beliefs. I'll go read now and edit if I was pleasantly incorrect.
Edit: They didn't test the model's ability to inculcate new conspiracies, obviously that'd be a fun day at the office for the ethics review board. But I bet with a malign LLM it's very possible.
A piece of paper dropped on the ground can 'shape human beliefs'. That's literally a tool used in warfare.
The news here is that conspiratorial thinking can be relieved at all.
"AI is just a tool; is a bit naïve. The power of this tool and the scope makes this tool a devastating potential. It's a good idea to be concerned and talk about it.
Agreed - but acting surprised that it can change opinions (for the worse) doesn't make sense to me, that's obvious, since anything can. That AI can potentially do so even more effectively than other things is indeed worth talking about as a society (and is again pretty obvious)
I wasn't trying to downplay. If it can be wielded thoughtfully at scale, it could be life changing for literally millions.
The risk is that billionaires own these models, and far too often we see their interests aligned with fascism. If they choose to place a motive in this box, they now know it will have a quantifiable effect.
All of this can be mitigated much more by ensuring each citizen has a decent education by modern standards. Turns out most of our problems can be fixed by helping each other.
"Great! Billy doesn't believe 9/11 was an inside job, but now the AI made him believe Bush was actually president in 1942 and that Obama was never president."
In all seriousness I think an "unbiased" AI might be one of the few ways to reach people about this stuff because any Joe schmoe is just viewed as "believing what they want you to believe!" when they try to confront any conspiracy.
With the inherent biases present in any LLM training model, the issue of hallucinations that you've brought up, alongside the cost of running an LLM at scale being prohibitive to anyone besides private-state partnerships, do you think that will allay conspiracists' valid concerns about the centralization of information access, a la the reduction in quality google search results over the past decade and a half?
I think those people might not, but I was once a "conspiracy nut," had a circle of friends who were as well, and know that for a lot of those kinds of people YouTube is the majority of the "research" they do. For those people I think this could work as long as it's not hallucinating and can point to proper sources.