Source-linked AI summary

When Is Content "AI-Generated Enough"? Labelling Synthetic Media under the Digital Services Act and the AI Act

Marie-Therese Sekwenz

arXiv:2609.07727v1cs.CY

TL;DR

The paper examines how to decide when synthetic or manipulated content warrants labelling, given blurred authenticity categories and unresolved legal thresholds. It analyses the Article 50 implementation framework and DSA reporting snapshot, finding reported labelling far less frequent than removal and demotion.

  • Problem

    Varied forms of synthetic and manipulated media make it difficult to determine which content should be labelled and how legal duties translate into technical systems and user-facing disclosures.

    Source: §1 · pp. 1–2
  • Method

    The paper analyses the emerging Article 50 implementation framework and a DSA Statement of Reasons snapshot to examine labelling rules, governance tensions, and reported moderation practice.

    Source: §2 · p. 3, §3 · p. 3
  • Results

    Of 153,138,573 reported statements, 98.9% were visibility measures; removal (129.79 million) exceeded labelled-content cases (1.42 million), while 98.02% were platform-initiated.

    Source: §6 · p. 5
  • Takeaways & Limitations

    Meaningful implementation requires clear, contestable, user-facing disclosure systems that account for who triggers labels and how they interact with moderation and transparency mechanisms.

    Source: §8 · p. 6

    The dashboard figures count platform-submitted statements, not unique content or synthetic-media prevalence, and do not independently validate underlying records.

    Source: §6 · p. 5

Abstract

from arXiv · show

European platform and AI governance increasingly relies on transparency duties to address synthetic and manipulated media. Under the DSA, very large online platforms and search engines may use prominent markings and recipient-facing indication tools as systemic-risk mitigation measures. Under the AI Act, providers must support machine-readable marking, while deployers must disclose deepfakes and certain AI-generated or manipulated public-interest text, subject to statutory qualifications. This extended abstract examines when labelling is a meaningful regulatory response to synthetic media and when it risks becoming over-inclusive, under-inclusive, or ineffective. It argues that the central challenge is not only whether content should be labelled, but how legal thresholds, technical provenance systems, platform interfaces, and reporting practices determine when content is sufficiently generated, manipulated, or authentic-looking to trigger transparency obligations. Drawing on the emerging Article 50 AI Act implementation framework and a snapshot of the DSA Statement of Reasons database, the paper identifies four governance tensions: definitional ambiguity, interface and responsibility design, communicative effectiveness, and fairness and contestability. It conceptualises labelling as a socio-technical classification practice that distributes responsibility among AI providers, deployers, platforms, uploaders, and recipients.

1 Synthetic Media as a Regulatory Object

Labelling is a regulatory compromise between protecting against deception and preserving expressive and artistic freedom. But varied forms of synthetic and misleading media make it difficult to determine what should be labelled, by whom, and how.

1 Synthetic Media as a Regulatory Object

  • Labelling discloses artificial generation or manipulation rather than prohibiting all synthetic media, balancing protection against deception with expressive freedom.The paper frames this as a compromise between freedom of expression, artistic freedom, innovation, and protection against deception, manipulation, and disinformation.Source: §1 · p. 1
  • Media practices blur authentic and fake, from AI-assisted edits to fully generated people and misleadingly framed images.The resulting challenge concerns unstable categories of deception, not only deepfakes.Source: §1 · p. 2
  • The paper asks how the DSA, AI Act, and Article 50 implementation framework define deepfake transparency and translate duties into technical systems, interfaces, and disclosures.It asks what practical problems arise in that translation.Source: §1 · p. 2

2 Regulatory and Implementation Background

The DSA and AI Act regulate synthetic media through distinct but related duties, while the Article 50 implementation framework links technical marking to user-facing disclosures. Key threshold questions remain unresolved, and the paper examines governance tensions and platform reporting practice.

2 Regulatory and Implementation Background

  • The DSA addresses deepfake-like content through VLOP and VLOSE systemic-risk measures, including prominent markings and an easy-to-use user indication function.The AI Act separately defines deepfakes and requires deployers to disclose qualifying generated or manipulated media and certain public-interest text, subject to exceptions.Source: §2 · p. 2
  • The Code separates provider-side machine-readable marking and detection from deployer-side user-facing labels for deepfakes and qualifying public-interest text.Its provider measures include digitally signed metadata and watermarking; deployer disclosures may use icons, labels, or disclaimers.Source: §2 · p. 2
  • Forthcoming Commission guidelines are to address definitions and exceptions, leaving unresolved when content is sufficiently generated, manipulated, authentic-looking, or public-interest-oriented to require disclosure.The paper identifies this as a central threshold problem.Source: §2 · p. 3
  • The paper frames labelling as socio-technical classification, identifies four governance tensions, and uses a DSA Statement of Reasons snapshot to compare labelling with other restrictions.The tensions are definitional ambiguity, interface and responsibility design, communicative usefulness, and fairness and contestability.Source: §2 · p. 3

3 Labelling as Provenance and Platform Governance

Implementation treats labelling as provenance infrastructure and platform governance, linking richer technical provenance with visible disclosures and user-facing tools. The framework also involves uploader-side self-disclosure and interfaces for users to label and retain labels on shared content.

3 Labelling as Provenance and Platform Governance

  • The Code encourages provenance metadata identifying the AI system and provider, generation or manipulation time, and the operation performed.It also proposes distinguishable deployer disclosures, potentially with a common EU icon and a more detailed second layer.Source: §3 · p. 3
  • DSA electoral guidelines recommend prominent markings, easy-to-use user labelling tools, recognisable labels, and retaining labels when content is reshared on the same platform.Labelling sits alongside mitigation measures such as demotion, removal, watermarks, metadata, and adapted moderation systems.Source: §3 · p. 3
  • Uploader-side disclosure can be built into publication through an upload toggle, disclosure field, or advertising-label option.This makes disclosure part of the ordinary publication workflow.Source: §3 · p. 3

4 EU Icon Categories and Regulatory Thresholds

The emerging icon categories distinguish fully AI-generated content from pre-existing content modified with AI, but do not settle which AI-assisted changes cross disclosure thresholds. Visible icons are only one layer of a framework that also relies on provenance technologies and platform interfaces.

4 EU Icon Categories and Regulatory Thresholds

  • The “AI GENERATED” icon covers content generated entirely through AI, while “AI MODIFIED” applies to pre-existing content partially altered using AI.The basic icon may pair with customised text or an interactive second layer describing the nature and location of AI involvement.Source: §4 · p. 4
  • Minor enhancement, noise reduction, automated subtitling, and colour correction may not qualify as a deepfake or qualifying manipulated public-interest text.The categories leave unresolved when AI assistance becomes sufficient to trigger disclosure.Source: §4 · p. 4
  • Visible icons form one layer alongside machine-readable metadata, watermarking, provenance information, and detection mechanisms; interfaces govern display, reporting, and contesting classifications.Table 1 situates the icon categories within overlapping AI Act, DSA, and Code perspectives.Source: §4 · pp. 3–4

5 Fairness, Differential Effects, and Contestability

Labelling errors can distribute visibility harms unevenly, making procedural fairness and opportunities to contest decisions as important as classification accuracy. Users need explanations of what was classified and what consequences followed.

5 Fairness, Differential Effects, and Contestability

  • Warning-label studies document false positives and false negatives, while synthetic-media errors may cause unjustified demotion, reduced visibility, or removal of authentic content [12] [18].One TikTok analysis found 37.3% of examined videos with benign information were labelled, while 7.7% of harmful or misleading videos were not [12].Source: §5 · p. 4
  • Label effects vary with design, source, visibility, content, and audience; political congruence and label wording can also affect engagement and interpretation [11].Source: §5 · p. 4
  • Classification categories may encode assumptions from training data, annotation practices, and platform-specific moderation policies, rather than functioning as value-neutral technical labels [10].Source: §5 · p. 4
  • Affected users need to understand why content was labelled, which elements were identified, and what consequences followed; contestability research highlights representation, clear communication, and ways to challenge decisions.Source: §5 · p. 4
  • Accessible explanations, correction and appeal mechanisms, and opportunities to provide contextual evidence are proposed as components of contestable synthetic-media labelling.Source: §5 · p. 5

6 Statement of Reasons Data and Reported Practice

In the DSA dashboard snapshot, reported synthetic-media moderation was predominantly visibility intervention, while labelling appeared much less frequently. These figures describe platform-reported statements, not unique content or the prevalence of synthetic media.

6 Statement of Reasons Data and Reported Practice

  • The filtered “Synthetic Media” view contained 153,138,573 statements from 25 September 2023 to 28 April 2026, with Facebook and Instagram accounting for approximately 118.33 million and 31.36 million.X accounted for approximately 2.74 million statements and Threads for approximately 717,000.Source: §6 · p. 5
  • 151.46 million cases (98.9%) were visibility measures; removal accounted for approximately 129.79 million statements, demotion 19.08 million, and labelled content 1.42 million.The distribution indicates that platforms reported removal or demotion more often than labelling in this filtered view.Source: §6 · p. 5
  • 150.10 million statements (98.02%) were based on platforms’ own initiative, while other notification types accounted for approximately 299,000 cases (0.20%).The passage raises whether recipient-facing tools do much practical work compared with internal or automated detection and enforcement.Source: §6 · p. 5
  • The dashboard counts platform-classified statements, not unique content or synthetic-media prevalence, and do not establish that a restriction was imposed because content was synthetic.The analysis does not independently validate records, and low reported labelling counts cannot establish how often platforms label synthetic media outside this dataset.Source: §6 · p. 5

7 Preliminary Argument

Deepfake labelling raises four linked governance tensions: how to classify content, design interfaces and allocate responsibility, achieve communicative effects, and ensure fairness and contestability. The relevant distinction is not simply whether AI was used, but whether it changes content’s communicative status.

7 Preliminary Argument

  • The threshold question is whether AI materially changes content’s communicative status, so borderline cases require more granular categories than “real” and “fake.”Examples include beauty filters, AI-generated captions, background extension, and face-swapping.Source: §7 · p. 6
  • Recipient-facing reporting tools make users part of the labelling infrastructure, although users may misidentify AI content or strategically misuse deepfake allegations.Label visibility, salience, and timing shape the intervention’s effect.Source: §7 · p. 6
  • A disclosure’s value depends on whether users notice, understand, and appropriately interpret it; in political contexts, claims that authentic content is AI-generated may serve as denial.Source: §7 · p. 6
  • Classification errors may fall unevenly across languages, cultural contexts, and expression, while false labels may lead to demotion, removal, or reputational harm.The paper identifies accessible explanations and meaningful opportunities to challenge erroneous decisions as fairness requirements.Source: §7 · p. 6

8 Conclusion

EU deepfake regulation is developing into a broader regime of provenance, marking, detection, and interface design. Meaningful implementation depends on who triggers disclosure, how it is interpreted, and how it interacts with moderation and transparency mechanisms.

8 Conclusion

  • The DSA addresses platform-level mitigation, while the AI Act and Code distinguish provider-side marking from deployer-side labelling.The conclusion calls for clear, contestable, user-facing disclosure systems.Source: §8 · p. 6

A EU Icon Categories and Regulatory Thresholds

Table 1 relates EU icon categories to the AI Act, the DSA, the Code of Practice, and the paper’s threshold analysis.

  • Table 1 situates EU icon categories within the AI Act framework.Source: Table 1 · p. 9
  • Table 1 relates EU icon categories to the DSA.Source: Table 1 · p. 9
  • Table 1 also relates the categories to the Code of Practice and the paper’s threshold analysis.Source: Table 1 · p. 9

“AI MODIFIED”

The section frames AI-modified disclosure around materiality, communicative significance, and false-authenticity risk rather than AI involvement alone. It distinguishes technical provenance from visible labelling and raises questions about classification, user-facing support, and the limits of technical origin information.

“AI MODIFIED”

  • Disclosure should turn on materiality, communicative significance, and false-authenticity risk rather than mere AI involvement.Source: “AI MODIFIED” · p. 9
  • Users need usable categories, explanations, detection support, and ways to challenge erroneous classification, but are not responsible for deciding legal qualification.Source: “AI MODIFIED” · p. 9
  • Provenance and visible labelling perform different functions, and metadata alone may not satisfy the objective of prominent disclosure.Source: “AI MODIFIED” · p. 9
  • Technical origin information does not itself determine whether content is misleading, harmful, satirical, or legally subject to disclosure.Source: “AI MODIFIED” · p. 9

B Statement of Reasons Dashboard Screenshots

The dashboard screenshots filter submissions classified as synthetic media and show their platform distribution, restriction types, daily patterns, and reporting dimensions.

B Statement of Reasons Dashboard Screenshots

  • The screenshots were collected on 30 April 2026; Figure 1 filters synthetic-media submissions from 25 September 2023 to 28 April 2026.The filter dates refer to submission dates, and values displayed in thousands are rounded.Source: B Statement of Reasons Dashboard… · p. 10, Figure 1 · p. 10
  • 153,138,573 statements are reported overall, concentrated on Facebook, Instagram, X, and Threads.Source: Figure 2 · p. 10
  • Approximately 1.42 million statements concern labelled content, while removal and demotion dominate the restriction breakdown.Source: Figure 3 · p. 11
  • Approximately 98.9% of statements involve visibility-only restrictions; the treemap displays reported violation categories.Source: Figure 4 · p. 11
  • The daily-submissions chart reverses the temporal axis, and its displayed late-April spike is driven primarily by Facebook.Source: Figure 5 · p. 12
  • Daily submissions are broken down by violation category in absolute and proportional terms, with a lower-right panel showing violations by platform.The temporal axis is reversed.Source: Figure 6 · p. 12
  • Figure 7 covers content type, information source, restriction grounds, and decision and detection automation; own voluntary initiative accounts for approximately 98.02% of statements.Source: Figure 7 · p. 13
Loading 2609.07727v1…