Source-linked AI summary

Exposure to Social Engagement Metrics Increases Vulnerability to Misinformation

Mihai Avram, Nicholas Micallef, Sameer Patil, Filippo Menczer

arXiv:2005.04682v2cs.CY

TL;DR

The paper asks how social engagement metrics in social feeds affect sharing and fact-checking of questionable content, a question with limited empirical research on feed elements. Using the Fakey news literacy game and a large deployment, the authors find higher displayed engagement accompanies more sharing and less fact-checking of low-credibility content.

  • Problem

    Empirical research on how social-feed elements affect misinformation spread has been limited, despite misinformation’s societal harms and the role of social media in spreading it.

    Source: Implications · p. 2
  • Method

    The authors analyzed game sessions in Fakey, which simulates a social media feed and displays randomly generated engagement metrics alongside news articles.

    Source: Essay summary · p. 1
  • Results

    ρ = 0.97 for the positive correlation between engagement level and liking or sharing, and ρ = −0.97 for its negative correlation with fact-checking of low-credibility articles.

    Source: Finding 1: High levels of social… · pp. 3–4
  • Takeaways & Limitations

    The findings suggest that platforms should reconsider how engagement metrics are displayed and investigate designs that avoid amplifying low-credibility information.

    Source: Essay summary · p. 1

    The game’s simulated setting differs from real platforms, and the study records only Like and Share actions to limit player burden.

    Source: Limitations · p. 6

Abstract

from arXiv · show

News feeds in virtually all social media platforms include engagement metrics, such as the number of times each post is liked and shared. We find that exposure to these social engagement signals increases the vulnerability of users to misinformation. This finding has important implications for the design of social media interactions in the misinformation age. To reduce the spread of misinformation, we call for technology platforms to rethink the display of social engagement metrics. Further research is needed to investigate whether and how engagement metrics can be presented without amplifying the spread of low-credibility information.

Research questions

The research questions ask whether exposure to social engagement metrics affects sharing propensity and whether high engagement changes responses to questionable content.

  • The study asks whether exposure to social engagement metrics affects people’s propensity to share content.Source: Research questions · p. 1
  • It asks whether high engagement increases liking or sharing of questionable content.Source: Research questions · p. 1
  • It also asks whether high engagement makes users less likely to fact-check low-credibility sources.Source: Research questions · p. 1

Essay summary

The study uses the Fakey news literacy game to examine how displayed engagement metrics relate to users’ interactions with low-credibility news. Its findings connect higher displayed engagement with more sharing and less fact-checking, prompting questions about how platforms display these metrics.

  • Fakey simulates a social media feed and presents current articles from mainstream and low-credibility sources with randomly generated engagement metrics.Source: Essay summary · p. 1
  • The 19-month deployment included over 8,500 users and approximately 120,000 articles, half from low-credibility sources.Source: Essay summary · p. 1
  • Higher displayed engagement was associated with greater propensity to share questionable content and less propensity to fact-check it.Source: Essay summary · p. 1
  • The authors call for platforms to reconsider how engagement metrics are displayed and for further research on designs that avoid facilitating misinformation or hindering legitimate information.Source: Essay summary · p. 1
  • Figure 1 depicts a news post in the simulated social media feed used by the game.Source: Figure 1 · p. 2

Implications

The paper situates engagement metrics within existing misinformation research and argues that they may increase vulnerability to low-credibility content. It discusses both the mechanism and the design and literacy questions that follow from this finding.

  • Existing responses include technical detection approaches and interface credibility indicators, which can reduce sharing of flagged content.Source: Implications · p. 2
  • Exposure to high engagement metrics is associated with less scrutiny of low-credibility content and greater likelihood of liking or sharing it.The authors interpret metrics as signals that can mimic repeated exposure and perceived validation by other users.Source: Implications · pp. 2–3
  • Prior work has examined environmental, emotional, and individual factors in online contagion, while empirical research on social-feed elements has been limited.Source: Implications · p. 2
  • Engagement metrics may be vulnerable to manipulation because users can mistake boosted counts for independent user activity.The authors note that disinformation campaigns use inauthentic accounts to create an initial appearance of virality.Source: Implications · p. 3
  • The authors call for research on alternative metric displays that reduce misinformation sharing without reducing sharing of legitimate, reliable content.Source credibility and topic sensitivity are proposed as properties that could inform differential display.Source: Implications · p. 3
  • The authors recommend investigating literacy campaigns that teach users to prioritize source trustworthiness over engagement signals.They also discuss combining literacy efforts with pauses, limits on automated or high-speed sharing, and other approaches.Source: Implications · p. 3

Findings

For low-credibility articles, higher displayed engagement correlated with more liking/sharing and less fact checking. At the individual level, both behaviors differed across engagement bins for low-credibility and mainstream articles.

Finding 1: High levels of social engagement results in lower fact checking and higher liking/sharing, especially for low-credibility content.

  • For low-credibility articles, social engagement correlated with liking/sharing (Spearman ρ = 0.97, p < 0.001) and fact checking (ρ = −0.97, p < 0.001).For mainstream articles, the corresponding correlations were weaker (ρ = 0.66 for liking/sharing; ρ = −0.62 for fact checking).Source: Finding 1: High levels of social… · pp. 3–4

Finding 2: People are more vulnerable to low-credibility content with high social engagement.

  • Figure 2 shows individual-level mean rates; for low-credibility articles, liking/sharing and fact-checking rates differed across all engagement-bin pairings (p < 0.001).Kruskal-Wallis tests found differences across bins for liking/sharing (χ2(2) = 417.14) and fact checking (χ2(2) = 214.26), both p < 0.001.Source: Figure 2 · p. 4, Finding 2: People are more vulnerable… · p. 4
  • For mainstream articles, engagement level also significantly affected liking/sharing (χ2(2) = 161.80, p < 0.001) and fact checking (χ2(2) = 576.37, p < 0.001) across bins.Source: Finding 2: People are more vulnerable… · p. 4

Methods

The study used Fakey, a social-feed simulation with current articles and randomized engagement metrics, and analyzed a 19-month deployment. The authors note limits of the simulated setting, source mix, and user and content information collected.

Social media simulation

  • Fakey 4 was an online news-literacy game simulating fact-checking in a Facebook- or Twitter-like feed, presenting batches of ten articles with social-engagement metrics and buttons to share, like, fact-check, or skip.The single metric combined shares and likes; values were randomly drawn from an approximately log-normal distribution and were not drawn from empirical data.Source: Social media simulation · p. 5

Content selection

  • Articles came from mainstream and low-credibility domains; five from each source type were randomly chosen per round, without topic filtering.Mainstream sources were manually selected; low-credibility sources were flagged by news and fact-checking organizations.Source: Content selection · p. 5

Data collection

  • A 19-month deployment yielded about 8,606 users and 120,000 articles; the study collected no demographics, and the mobile app was available in four English-speaking countries.Participants originated mostly from the United States (78%), followed by Australia (8%), the UK (4%), Canada (3%), Germany (3%), and Bulgaria (2%).Source: Data collection · pp. 5–6

Limitations

  • The simulated game differs from real platforms and captures only Like/Share; equal source representation and misinformation priming may raise fact-checking rates, though authors say these effects should not alter engagement-signal results.User backgrounds and content types may offer further insight into vulnerability but were not examined.Source: Limitations · p. 6

Funding

M.A. and F.M. received partial support from three named organizations, which had no role in the study.

Funding

  • M.A. and F.M. were partly supported by the Democracy Fund, Craig Newmark Philanthropies, and Knight Foundation; funders had no role in the study.Source: Funding · p. 9
Loading 2005.04682v2…