Source-linked AI summary

Biases in Generative Art -- A Causal Look from the Lens of Art History

Ramya Srinivasan, Kanji Uchino

arXiv:2010.13266v2cs.AI

TL;DR

Generative-art systems can encode biases because their problem definitions, datasets, and algorithms inadequately represent art creation and its historical context. The paper uses structural causal models and art-historical case studies to analyze these biases, finding recurring framing, dataset, selection, confounding, and transportability problems with socio-cultural consequences. It concludes that accountability and interdisciplinary scrutiny are needed across the generative-art pipeline.

  • Problem

    The paper addresses the limited analysis of ethical and socio-cultural biases in AI-generated art, especially biases affecting art history and the representation of artists, movements, and historical events.

    Source: §8 · p. 10
  • Method

    The paper surveys AI art papers, platforms, and apps focused on established art movements or artists’ styles, then analyzes case studies with structural causal models.

    Source: §1 · p. 1, §6.1.1 · p. 6, §6.2.1 · p. 6
  • Results

    The analysis identifies framing, dataset, selection, confounding, and transportability biases arising when current methods fall short of modeling art creation and its historical context.

    Source: §8 · p. 10, §9 · p. 10
  • Takeaways & Limitations

    Generative-art accountability requires examining design choices, sociopolitical contexts, representative datasets, reliable labels, measurement practices, and the involvement of domain experts such as art historians.

    Source: §8 · p. 10

    Unobserved subjective factors such as emotions, prior beliefs, and cultural values make the true style of any artist impossible to model accurately.

    Source: §6.1.1 · p. 6

Abstract

from arXiv · show

With rapid progress in artificial intelligence (AI), popularity of generative art has grown substantially. From creating paintings to generating novel art styles, AI based generative art has showcased a variety of applications. However, there has been little focus concerning the ethical impacts of AI based generative art. In this work, we investigate biases in the generative art AI pipeline right from those that can originate due to improper problem formulation to those related to algorithm design. Viewing from the lens of art history, we discuss the socio-cultural impacts of these biases. Leveraging causal models, we highlight how current methods fall short in modeling the process of art creation and thus contribute to various types of biases. We illustrate the same through case studies, in particular those related to style transfer. To the best of our knowledge, this is the first extensive analysis that investigates biases in the generative art AI pipeline from the perspective of art history. We hope our work sparks interdisciplinary discussions related to accountability of generative art.

1 INTRODUCTION

Generative art has expanded rapidly, but its systems can encode racial, stylistic, historical, and other biases with lasting socio-cultural consequences. The paper analyzes these biases through art history, causal models, and case studies spanning movements, artists, materials, genres, and geographies.

1 INTRODUCTION

  • Generative art uses autonomous systems, most commonly algorithms or computer programs, to create artworks.Its applications include hybrid images, portrait-to-cartoon generation, and style creation.Source: §1 · p. 1
  • Rapid adoption, commercial sales, museums, and accessible applications have made AI-based generative art increasingly prominent.The paper notes major auction sales and growing institutional and user interest.Source: §1 · p. 1
  • Training data and algorithms can embed racial and gender bias, stereotype artists’ styles, overlook intent and emotion, and distort historical or cultural understanding.The paper illustrates these concerns with lightened skin in AIportraits and lost affect in a generated “Van Gogh” image.Source: §1 · p. 2

1.1 Contributions

  • The paper investigates biases from problem formulation through algorithm design, using causal models to represent art-creation processes and case studies across art-historical settings.Its cases cover art movements, artists, materials, genres, and geographies, including framing, confounding, selection, and transportability concerns.Source: §1.1 · p. 2

1.2 Case study selection

  • The case studies focus on established art movements and artists’ styles, including Renaissance, Modern, and Ukiyo-e art across varied genres, materials, and artists.Ukiyo-e is the only non-western art form included because existing AI applications studying non-western forms are scarce.Source: §1.2 · pp. 2–3

2 AI FOR ART GENERATION

Computer-generated art developed from early programmatic systems into deep-learning models, neural style transfer, recurrent drawing systems, GANs, and accessible art applications. This expansion also motivates systematic analysis of bias in AI-generated art from an art-historical perspective.

2 AI FOR ART GENERATION

  • Computer-generated art has a long history spanning AARON, interactive computer experiences, animation tools, paint programs, Processing, and OpenFrameworks.These systems enabled artists to create paintings, interactive works, animations, and code-based art.Source: §2 · p. 3
  • Deep learning expanded AI art through neural style transfer, CNN-based visualization, recurrent stroke-based drawing, and GAN-based generation.Neural style transfer blends one image’s content with another’s style, while other systems generate drawings or artworks.Source: §2 · p. 3
  • Applications let users transform portraits, convert photos into artworks, combine images, transfer styles, and create cartoons with limited technical effort.The paper names AIportraits, GANbreeder, and other tools as examples.Source: §2 · p. 3
  • The paper argues that widespread tools, a growing art market, and demands for diversity make bias analysis in generative art particularly pertinent.It positions its work as an extensive art-history-based analysis addressing a gap in prior studies.Source: §2 · p. 3

3 ART-HISTORICAL ASPECTS OF ARTWORKS

Art-historical analysis groups artworks by movements, materials, genres, and artists, but these dimensions interact and include abstract cultural and cognitive factors. Consequently, modeling an artist’s style is not a straightforward computational task.

3 ART-HISTORICAL ASPECTS OF ARTWORKS

  • Art historians classify artworks using significant qualities such as artistic approach, material, movement, and genre.These aspects provide the framework for analyzing generative-art biases.Source: §3 · p. 3

3.1 Art Movements

  • Art movements reflect shared philosophies shaped by culture, geography, politics, and historical period, while individual movements contain distinct stylistic subcategories.Impressionism and Post-Impressionism illustrate how related movements can differ in colors, brushwork, subjects, and emotional expression.Source: §3.1 · p. 4

3.2 Art material

  • Materials and techniques influence artists and artworks, with different periods and movements favoring materials such as marble, paint, wood, or mosaics.The paper treats material and technique as art-historical dimensions relevant to artwork classification.Source: §3.2 · p. 4

3.3 Genre

  • Genres organize artworks by depicted themes and objects, including history painting, portraiture, genre painting, landscapes, still life, and abstract or figurative art.Artists may work across genres even when art historians associate them primarily with one.Source: §3.3 · p. 4

3.4 Artists

  • An artist’s style combines movement, material, genre, cultural background, artistic lineage, cognition, beliefs, and prejudices.Cezanne’s changing colors, genres, movements, emotions, and constructive brushstrokes exemplify this multidimensionality.Source: §3.4 · p. 4
  • Because artists’ works span genres, movements, and subtle cognitive aspects, style is difficult to quantify and is often defined to suit model performance.The paper identifies this modeling choice as a source of bias examined in the following section.Source: §3.4 · p. 4

4 BIASES DUE TO PROBLEM FORMULATION

Problem formulation can itself create framing-effect bias when style-transfer systems reduce complex art-historical concepts to convenient model-specific definitions. The paper shows that color-based definitions can miss defining characteristics of movements such as Ukiyo-e.

4 BIASES DUE TO PROBLEM FORMULATION

  • Framing-effect bias arises when researchers define an artistic problem in a way that suits model performance.Style may refer to an art movement or an individual artist, and each notion contains multiple aspects.Source: §4 · p. 4
  • Models have treated Ukiyo-e style primarily as yellowish coloration, even though Ukiyo-e also includes foreshortening, asymmetry, flat color, and imaginative cropping.The cited examples therefore do not capture several characteristics of the movement.Source: §4 · pp. 4–5
  • Inappropriate problem formulation can introduce and perpetuate bias throughout the generative-art AI pipeline.The paper distinguishes this issue from additional biases arising from model design.Source: §4 · p. 5

5 STRUCTURAL CAUSAL MODELS

The paper uses causal DAGs and structural causal models to represent assumptions about artwork-related variables and analyze biases under alternative expert-specified scenarios. It then introduces d-separation and interventions as tools for identifying conditional independence and quantifying causal effects.

5 STRUCTURAL CAUSAL MODELS

  • Causal DAGs encode relationships among artwork variables, expose assumptions about data, models, and analysis, and support bias analysis under multiple expert-specified scenarios.The paper frames DAGs as accessible visualization and analysis tools for art historians.Source: §5 · p. 5

5.1 d-separation

  • D-separation determines whether variables X and Z are independent given Y by treating connected paths as dependence and separated paths as independence.The framework analyzes mediation, confounding, and collider structures, with admissible adjustment sets blocking all backdoor paths without descendants of X.Source: §5.1 · p. 5, Figure 3 · p. 5

5.2 Interventions

  • The do operator sets an intervened variable to a chosen value while removing other influences, allowing expressions such as P(Z|do(X = x)) to quantify causal effects.Do-calculus provides rules for manipulating observations and interventions and eliminating do operators from expressions.Source: §5.2 · p. 5

6 BIASES RELATED TO ALGORITHM

The paper uses causal models to show that algorithmic assumptions about art creation can produce confounding, selection, and transportability biases in generative art. Case studies show these biases can distort artist style, cultural meaning, and historical representation.

6.1 Confounding bias

  • Ignoring art movements and other confounders can introduce omitted-variable and confounding bias, misrepresenting artistic intent, culture, and style.The causal effect P(Z|do(X=x)) can differ from the observational distribution P(Z=z|X=x); their difference defines confounding bias.Source: §6.1.1 · p. 6
  • Causal modeling of artist style requires representing the artwork-creation process, because unobserved emotions, cultural values, and art movements can confound the artist–artwork relationship.When emotions are unobserved, even the joint distribution of genre, material, and art movement cannot identify the artist’s causal style effect.Source: §6.1.1 · p. 6

6.2.1 Case Study 2.

  • Selecting only engravings for ArtGAN analysis makes Gustave Dore’s style non-identifiable because the selection mechanism remains directly connected to generated-image characteristics.Dore’s paintings include non-greyish colors absent from the selected engravings, so the sample does not represent his broader style.Source: §6.2.1 · pp. 6–7

6.2 Sample Selection bias

  • Selection bias also affects portrait generation when predominantly white Renaissance portraits are used, producing fair-skinned outputs because the selection criterion is associated with both inputs and outputs.The selection backdoor criterion fails because the path between selection and generated images is not blocked.Source: §6.2.2 · p. 7, §6.2.1 · p. 7

6.3 Transportability bias

  • Style transfer is transportable only when domain differences do not disrupt the causal effect; differences in artists, genres, media, or unobserved factors can therefore create transportability bias.Selection variables encode structural differences between populations, and effects are not transportable when those differences are associated with the target artwork.Source: §6.3 · p. 7, §6.3.1 · pp. 7–8
  • Across case studies, style-transfer systems omit defining features of Cubism, Futurism, Expressionism, and Cezanne’s style, while gender and racial translations exhibit culturally dependent stereotypes.Examples include missing kinetic patterns, absent subject distortion and gestural brushstrokes, missing geometric rhythms, red or blue facial tinting, and long-haired Renaissance men rendered as women.Source: §6.3.2 · p. 8, §6.3.3 · pp. 8–9, §6.3.1 · p. 8

7 BIASES IN DATASETS

The paper identifies dataset biases arising from unrepresentative artwork collections and inconsistent annotations, showing how both can distort generative art models.

7 BIASES IN DATASETS

  • The dataset-bias discussion covers both unrepresentative datasets and annotation inconsistencies as distinct sources of bias in generative art.These sources correspond to representational bias and label bias, respectively.Source: §7 · p. 9, §7.1 · p. 9, §7.2 · p. 9

7.1 Representational bias

  • Representational bias occurs when art datasets do not reflect the real world, including imbalances across genres, artists, art movements, and other categories.Dataset availability and curator preferences can both constrain representativeness.Source: §7.1 · p. 9
  • A portrait generator trained on about 45,000 mostly white Renaissance portraits performs poorly on dark-skinned people because racial diversity was not represented.The paper models this imbalance as selection bias in which artwork type influences dataset inclusion.Source: §7.1.1 · p. 9

7.2 Label bias

  • Label bias arises when annotators use inconsistent categories, such as labeling a cloudy scene as either “cloudscape” or “landscape.”Subjective preferences, culture, beliefs, and introspective capabilities can also make emotion labels noisy.Source: §7.2 · p. 9
  • ArtGAN’s genre, media, and style labels may be unreliable because categories such as “sketch and study” contain heterogeneous artworks.Across annotators, inconsistent target labels make the causal effect of style on artwork unidentifiable, making label-driven generation prone to bias.Source: §7.2.1 · p. 10

8 DISCUSSION

The discussion argues that generative art must preserve artists’ cognitive and historical meanings rather than optimize narrowly defined stylistic proxies. It connects these failures to ethical representation, distorted historical knowledge, and the need for domain expertise.

8 DISCUSSION

  • Because art conveys moral, empathetic, and symbolic knowledge, generative systems that fail to promote diversity and inclusiveness can communicate unethical values.The discussion treats representation as consequential beyond aesthetic similarity.Source: §8 · p. 10
  • Generative art that models style through narrow proxies can overlook artists’ cognitive abilities and movement-specific techniques, producing stereotyped representations.Examples include reducing Van Gogh to brushstrokes or colors, Cezanne to limited geometric patterns, and obscuring Ukiyo-e foreshortening and perspective.Source: §8 · p. 10
  • Defining latent-vector combinations as “hypothetical children” frames a difficult and ethically questionable face-generation task as a simple operation.The paper also notes that the depicted people may not have been related or had children.Source: §8 · p. 10
  • Framing and algorithmic biases can produce inaccurate historical knowledge by omitting subtle artistic features that convey social, cultural, and political contexts.The paper argues that style translation should preserve characteristics such as Futurist visual patterns expressing views on war.Source: §8 · p. 10
  • Automation bias and evaluation by people without relevant domain knowledge can lead audiences to endorse historically inaccurate generated art.The paper therefore calls for art historians and other domain experts to participate in the generative art pipeline.Source: §8 · p. 10

9 CONCLUSIONS

The paper uses structural causal models and an art-history perspective to expose biases in the generative art AI pipeline and their socio-cultural impacts.

  • Structural causal models reveal framing, dataset, selection, confounding, and transportability biases in generative art AI pipelines.The analysis highlights shortcomings in how current methods model the process of art creation.Source: §9 · p. 10
  • The paper connects these biases to socio-cultural consequences and calls for interdisciplinary discussion about generative-art accountability.Source: §9 · p. 10
Loading 2010.13266v2…