Source-linked AI summary

The Zeno's Paradox of `Low-Resource' Languages

Hellina Hailu Nigatu, Atnafu Lambebo Tonja, Benjamin Rosman, Thamar Solorio, Monojit Choudhury

arXiv:2410.20817v1cs.CL

TL;DR

The paper addresses the lack of consensus over what makes a language “low-resource,” which complicates tracking progress and judging interventions. It qualitatively analyzes 150 papers and identifies four interacting aspects of resourcedness. The authors conclude that explicit terminology and documentation are needed because languages can be constrained in multiple, interacting ways.

  • Problem

    NLP research commonly labels under-studied languages “low-resource,” but the term lacks consensus and complicates progress tracking, intervention assessment, and community-fit evaluation.

    Source: §1 · p. 1
  • Method

    The authors qualitatively analyze 150 papers to examine how they define, study, and classify low-resource languages.

    Source: §1 · p. 2
  • Results

    The analysis identifies four interacting aspects of resourcedness: socio-political conditions, resources, artifacts, and community agency.

    Source: §1 · p. 2, §3 · p. 3
  • Takeaways & Limitations

    Researchers should explicitly state which resource dimensions they mean and document how those dimensions affect a language and its technologies.

    Source: §6 · p. 9, §7 · p. 9

    The qualitative sample does not cover all venues or papers, makes no quantitative claims, and cannot support longitudinal analysis.

    Source: §8 · pp. 9–10

Abstract

from arXiv · show

The disparity in the languages commonly studied in Natural Language Processing (NLP) is typically reflected by referring to languages as low vs high-resourced. However, there is limited consensus on what exactly qualifies as a `low-resource language.' To understand how NLP papers define and study `low resource' languages, we qualitatively analyzed 150 papers from the ACL Anthology and popular speech-processing conferences that mention the keyword `low-resource.' Based on our analysis, we show how several interacting axes contribute to `low-resourcedness' of a language and why that makes it difficult to track progress for each individual language. We hope our work (1) elicits explicit definitions of the terminology when it is used in papers and (2) provides grounding for the different axes to consider when connoting a language as low-resource.

1 Introduction

NLP commonly labels under-studied languages as “low-resource,” but the term lacks consensus, making progress, interventions, stopping points, and community fit difficult to assess. The paper surveys how researchers define and classify the term and identifies interacting dimensions of resourcedness.

  • The NLP community has focused on a small set of languages, while many Global South languages remain neglected and are labeled “low-resource.”Source: §1 · p. 1
  • The high-resource/low-resource framing resembles Zeno’s paradox because less-studied languages continually pursue a research goalpost established for better-resourced languages.Source: §1 · p. 1
  • Data alone oversimplifies low-resourcedness because languages also differ in speakers, non-digital archives, and available experts.Source: §1 · pp. 1–2
  • “Low-resource” lacks consensus, complicating progress tracking, intervention assessment, classification boundaries, and evaluation of whether technologies meet community needs.Source: §1 · p. 2
  • The authors qualitatively analyze 150 papers to examine definitions, studied languages, and classification criteria for “low-resource” and “under-resource.”Source: §1 · p. 2
  • The analysis identifies four interacting aspects of resourcedness and uses real-world examples to connect them to interventions, followed by stakeholder recommendations.Source: §1 · p. 2

2 Methodology

The study narrows keyword-search results to papers about actual low-resource languages, then qualitatively codes a random sample for definitions, languages, and related challenges. Its corpus and sampling process distinguish simulated settings from language-level classifications.

2 Methodology

  • Keyword searches across the ACL Anthology, INTERSPEECH, and ICASSP produced a final corpus of 868 unique papers.Source: §2 · p. 2
  • The analysis excluded papers treating low resource solely as missing labeled data or simulated under-sampling, while retaining studies combining simulated and actual low-resource languages.Source: §2 · p. 2
  • The researchers manually labeled 541 papers and randomly sampled 150 papers published from 2017–2023 for qualitative analysis of non-simulated low-resource languages.Source: §2 · p. 2
  • Researchers annotated how papers define low-resource, which languages they study, and what additional challenges they associate with low-resourcedness, using inductive thematic analysis.Source: §2 · p. 2
  • Table 1 separates keyword-search results into task/domain data scarcity, simulated low-resource settings, and studies of low-resource languages.Source: Table 1 · p. 2

3 What is a ‘low-resource’ language?

The survey finds that papers classify languages as low-resource through four interacting aspects: socio-political conditions, human and digital resources, artifacts, and community agency. These aspects encompass constraints beyond data quantity and shape which technologies are built and for whom.

3 What is a ‘low-resource’ language?

  • Definitions draw on four aspects: socio-political conditions, human and digital resources, linguistic and technological artifacts, and community agency.Source: §3 · p. 3

3.1 Socio-Political

  • Socio-political constraints include financial barriers and limited representation in mainstream media, government, and education.Source: §3.1 · p. 3

3.2 Resource

  • Resource scarcity includes limited native speakers, linguistic experts, researchers, digital access, and data suitable for crawling or scraping; large speaker populations do not necessarily remove low-resourcedness.Source: §3.2 · pp. 3–4

3.3 Artifacts

  • Artifact-related low-resourcedness includes missing computational tools, pretrained-model coverage, compute, linguistic descriptions, standardization, and labeled, unlabeled, or benchmark data.Source: §3.3 · pp. 4–5

3.4 Agency

  • Community agency connects resource and artifact conditions to whose values guide technology, with detached tools offering minimal utility and active engagement embedding community values.Source: §3.4 · p. 5
  • Figure 2 shows diverse language-family coverage, with Indo-European languages most represented in the sample, followed by Niger-Congo and Austronesian families.Source: Figure 2 · p. 5

4 What Languages are Studied as ‘Low-Resource’?

The sampled papers study languages across diverse families and contexts, with criteria for calling them ‘low-resource’ varying beyond data availability.

  • Studies range from detailed monolingual accounts to broad multilingual inventories spanning 101 languages.The Gondi study describes historical, political, and linguistic context, whereas the 101-language study reports standardized metadata and available data.Source: §4 · p. 5
  • The sample covers diverse language families, with Indo-European languages most represented, followed by Niger-Congo and Austronesian.Source: §4 · p. 5
  • Figure 3 summarizes how criteria are distributed across the top 20 most frequently studied languages.Source: Figure 3 · p. 6, §4 · p. 6
  • Lack of labeled data is the most common criterion, appearing in 39.8% of cases, while digitized text and online data appear less often.The reported shares are 1.7% for lack of digitized text and 6.9% for lack of online-available data.Source: §4 · p. 6
  • Although data is the most common criterion, papers also invoke computational tools and the number of native speakers when categorizing languages.Source: §4 · p. 6

5 Why does it matter?

Languages grouped together by data availability can differ sharply in vitality, speaker population, digital access, artifacts, and community agency. These interacting differences determine which interventions are appropriate and show why data-based classes alone are insufficient.

5 Why does it matter?

  • Numma-guhooni and Warlpiri share a data class but differ in speakers, vitality, digital support, and available NLP tools.Warlpiri has four times as many speakers, is stable with emerging digital support, and has tools such as KirrKirr; Numma-guhooni is endangered with no digital support.Source: §5 · p. 6
  • Cherokee and Kalaallisut likewise diverge: Cherokee is endangered but has vital digital support, whereas Kalaallisut is institutional with ascending digital support.Cherokee is spoken by around 2,000 people in the cited community, while Kalaallisut is spoken by about 50,000 and is Greenland’s official federal language.Source: §5 · p. 6
  • isiZulu and Konkani have similar vitality, digital access, and NLP-tool availability but differ substantially in speaker population and language trajectory.isiZulu has about six times as many speakers and is South Africa’s most common first language, while Konkani has declining speakers in parts of its primary region.Source: §5 · p. 6
  • Languages in the same data-availability class show drastic differences in other available resources and language circumstances.Figure 4 profiles six languages across three data-based classes, while the examples compare languages within those classes.Source: §5 · p. 6, Figure 4 · p. 7
  • Socio-political constraints can reduce human resources and digital presence, which then restrict artifact creation and community agency.The paper links assimilation, colonial policies, limited funding, scarce digital data, and a shortage of native-speaker researchers across these aspects.Source: §5 · pp. 7–8
  • Targeted interventions should follow each language’s specific constraints, such as preservation for endangered Cherokee, digital-data growth for Kalaallisut, and learning or translation tools for Numma-guhooni and Konkani.Cherokee and Kalaallisut differ in vitality and institutional support, while Numma-guhooni and Konkani face assimilation toward dominant local languages.Source: §5 · p. 8

6 What can we do?

The paper recommends making resource terminology explicit and tailoring research and support to language-specific conditions and community priorities. It assigns roles to researchers, communities, conferences, institutions, industry, governments, and funders.

6 What can we do?

  • Explicit terminology should identify which resource is limited because differing definitions affect which languages programs include and serve.The paper notes that programs can select different languages even when those languages have the same amount of data.Source: §6 · p. 9
  • Researchers should engage speakers, document how language characteristics limit their work, and state the criteria used to call a language low-resource.Community-led organizations can support collaborative technology building and include native speakers outside NLP when deciding which tools to build.Source: §6 · p. 9
  • Conferences and academic institutions can improve representation through alternative tracks, reduced participation costs, diversified venues, interdisciplinary collaboration, and partnerships supporting documentation.The recommendations target both access for researchers from underrepresented communities and preservation of marginalized languages.Source: §6 · p. 9
  • Industry, governments, and funding agencies can support language diversity through resources, accessible products, preservation policies, digital inclusion, and grants tied to community relevance.The recommendations include subsidizing community resources, prioritizing accessibility, and funding underrepresented researchers and language-specific technologies.Source: §6 · p. 9

7 Conclusion

The paper concludes that ‘low-resource’ languages should be described through explicit, detailed terminology because four interacting resource aspects can shape their needs. Such documentation clarifies which problems a technology addresses for a particular language.

7 Conclusion

  • The paper identifies four interacting aspects of resourcedness and recommends terminology that explicitly states which resource makes a language low-resource.The authors acknowledge that a language may lack several aspects, especially in multilingual settings, but still call for detailed documentation.Source: §7 · p. 9

8 Limitations

The study’s qualitative sample does not provide comprehensive definitions or quantitative claims across all searched venues, languages, or time periods.

  • The analysis does not cover definitions from all papers in all searched venues.Source: §8 · p. 9
  • The study makes no quantitative claims and focuses instead on nuanced qualitative analysis with direct evidence from sampled papers.Source: §8 · p. 10
  • Its language-study findings are limited to the 150-paper sample and could be supplemented by automated extraction at scale.Source: §8 · p. 10
  • The sample size prevented longitudinal analysis, leaving evolution in the use of ‘low-resource’ for future work.Source: §8 · p. 10

A Labels for Classifying Languages

The paper introduces labels for classifying languages using vitality and digital-access descriptions, with the labels organized for use in Figure 4.

A.1 Vitality

The paper uses an Ethnologue-derived vitality scale and a digital-access taxonomy, then compares these labels with criteria used to identify low-resource languages.

A.1 Vitality

  • A.1 Vitality uses an Ethnologue scale derived from the Expanded Graded Intergenerational Disruption Scale.Source: §A.1 · p. 20
  • The vitality labels range from Institutional and Stable through Endangered to Extinct, based on language use, transmission, and institutional support.Source: §A.1 · p. 20

A.2 Digital Access

  • A.2 Digital Access classifies languages from Still and Emerging through Ascending, Vital, and Thriving as digital support expands.Source: §A.2 · p. 20

B Criteria used in Studying Languages

C Most frequently studied languages

The sample is concentrated among a small set of frequently studied languages, while the paper groups definitions around resource and artifact criteria used to classify languages as low-resource.

C Most frequently studied languages

D Categories used to define low-resource

Resources

Artifacts

  • Artifact criteria include data and technology, covering the materials and computational tools available for a language.Source: Artifacts · pp. 21–22
Loading 2410.20817v1…