Loughborough University: COVID misinformation is a health risk – tech companies need to remove harmful content not tweak their algorithms
Often, this misinformation spreads through social media. At its worst, it can kill people. The UK’s Royal Society, noting the scale of the problem, has made online information the subject of its latest report. This puts forward arguments for how to limit misinformation’s harms.
The report is an ambitious statement, covering everything from deepfake videos to conspiracy theories about water fluoridation. But its key coverage is of the COVID pandemic and – rightly – the question of how to tackle misinformation about COVID and vaccines.
Here, it makes some important recommendations. These include the need to better support factcheckers, to devote greater attention to the sharing of misinformation on private messaging platforms such as WhatsApp, and to encourage new approaches to online media literacy.
But the main recommendation – that social media companies shouldn’t be required to remove content that is legal but harmful, but be asked to tweak their algorithms to prevent the viral spread of misinformation – is too limited. It is also ill suited to public health communication about COVID. There’s good evidence that exposure to vaccine misinformation undermines the pandemic response, making people less likely to get jabbed and more likely to discourage others from being vaccinated, costing lives.
The basic – some would say insurmountable – problem with this recommendation is that that it will make public health communication dependent on the good will and cooperation of profit-seeking companies. These businesses are poorly motivated to open up their data and processes, despite being crucial infrastructures of communication. Google search, YouTube and Meta (now the umbrella for Facebook, Facebook Messenger, Instagram and WhatsApp) have substantial market dominance in the UK. This is real power, despite these companies’ claims that they are merely “platforms”.
These companies’ business models depend heavily on direct control over the design and deployment of their own algorithms (the processes their platforms use to determine what content each user sees). This is because these algorithms are essential for harvesting mass behavioural data from users and selling access to that data to advertisers.
This fact creates problems for any regulator wanting to devise an effective regime for holding these companies to account. Who or what will be responsible for assessing how, or even if, their algorithms are prioritising and deprioritising content in such a way as to mitigate the spread of misinformation? Will this be left to the social media companies themselves? If not, how will this work? The companies’ algorithms are closely guarded commercial secrets. It is unlikely they will want to open them up to scrutiny by regulators.
Recent initiatives, such as Facebook’s hiring of factcheckers to identify and moderate misinformation on its platform, have not involved opening up algorithms. That has been off limits. As leading independent factchecker Full Fact has said: “Most internet companies are trying to use [artificial intelligence] to scale fact checking and none is doing so in a transparent way with independent assessment. This is a growing concern.”
Plus, tweaking algorithms will have no direct impact on misinformation circulating on private social media apps such as WhatsApp. The end-to-end encryption on these wildly popular services means shared news and information is beyond the reach of all automated methods of sorting content.
A better way forward
Requiring social media companies to instead remove harmful scientific misinformation would be a better solution than algorithmic tweaking.The key advantages are clarity and accountability.
Regulators, civil society groups and factcheckers can identify and measure the prevalence of misinformation, as they have done so far during the pandemic, despite constraints on access. They can then ask social media companies to remove harmful misinformation at the source, before it spreads across the platform and drifts out of public view on WhatsApp. They can show the world what the harmful content is and make a case for why it ought to be removed.