Source-linked AI summary

Unlocking the Regulatory Genome by ARGUS: An Evidence-Constrained Agentic Framework for Interpreting Single Nucleotide Variants

Pratik Dutta, Matthew B. Obusan, Max Chao, Rekha Sathian, Nimisha Papineni, Ramana V. Davuluri

arXiv:2610.12281v1q-bio.GNcs.AIcs.LG

TL;DR

Functional interpretation of noncoding regulatory variants remains a bottleneck in translating GWAS findings into biological mechanisms. ARGUS separates deterministic biological classification from LLM reasoning and uses a hypothesis-directed loop where the planner selects actions and the verifier interprets observations. At rs6983267, the same planner produced divergent TF trajectories: FOXA1 was rescued in one tool call, while KLF6 and RAD21 followed the same three-tool path and abstained for different reasons.

  • Problem

    Functional interpretation of noncoding regulatory variants remains a bottleneck in translating GWAS findings into biological mechanisms.

    Source: §1 · p. 1
  • Method

    ARGUS separates deterministic biological classification from LLM reasoning and uses a hypothesis-directed loop where the planner selects actions and the verifier interprets observations.

    Source: §1 · p. 2, §2.2 · p. 3
  • Results

    At rs6983267, the same planner produced divergent TF trajectories: FOXA1 was rescued in one tool call, while KLF6 and RAD21 followed the same three-tool path and abstained for different reasons.

    Source: §3.1 · p. 5, §3.2 · p. 6
  • Takeaways & Limitations

    Observation-dependent investigation can produce auditable conclusions that are actively tested against evidence rather than merely plausible.

    Source: §5 · p. 8

    The evaluation covers five TF hypotheses at two loci and demonstrates trajectories, not predictive accuracy or controlled hallucination reduction.

    Source: §4.4 · p. 8

Abstract

from arXiv · show

Over 90% of disease-associated variants from genome-wide association studies fall in noncoding regulatory regions, yet their functional interpretation remains a central open problem in genomic medicine. Large language models prompted to interpret such variants routinely hallucinate transcription factor (TF) binding changes, fabricate experimental support, and assign biological significance to statistically negligible signals. We present ARGUS (Agentic Regulatory Genomics for an Uncertainty-aware Scientist), which strictly separates deterministic biological computation from LLM-mediated reasoning. ARGUS wraps 458 DNABERT-based TF binding models in a hypothesis-directed investigation loop where a planner selects evidence sources based on current uncertainty, a verifier deterministically interprets each observation, and intermediate results change the investigation path. On variant rs6983267 at the 8q24 cancer risk locus, the same planner produces four divergent trajectories for four TFs. FOXA1 is rescued in 3 steps when real ADASTRA allele-specific binding data (15 experiments, FDR = 0.030) reveals a model false negative masked by saturation. KLF6 traverses 8 steps across ADASTRA, JASPAR motif analysis, and ENCODE cCRE regulatory annotation before abstaining due to mixed indirect evidence. RAD21 abstains in 8 steps after ADASTRA returns a coverage-qualified but nonsignificant allelic test (5 experiments, FDR = 0.65), and SP1, which shares FOXA1's saturated retained prediction, abstains because no direct experimental evidence exists at this locus. All observations come from real ADASTRA, JASPAR, and ENCODE cCRE queries; none are simulated. A comparison of fixed-priority and LLM-mediated planning shows that the LLM planner reaches identical verdicts with fewer tool calls by declining evidence that cannot resolve the claim under test.

1 Introduction

Interpreting noncoding variants remains a bottleneck in translating GWAS findings into biological mechanisms. ARGUS separates deterministic evidence classification from LLM-directed investigation to address hallucinated or unsupported variant interpretations.

1 Introduction

  • Noncoding regulatory variants can affect transcription factor binding, chromatin accessibility, or enhancer-promoter contacts, making functional interpretation a GWAS-to-mechanism bottleneck.A typical GWAS locus contains dozens of variants in linkage disequilibrium.Source: §1 · p. 1
  • Prediction and interpretation are distinct: interpreting a predicted binding change requires tissue context, disease relevance, independent evidence, and uncertainty assessment.AlphaGenome Atlas precomputes predictions for all 9 billion possible single nucleotide variants, but does not distinguish model predictions from independent support.Source: §1 · p. 2
  • An LLM prototype called SP1 binding gained from a log-odds ratio of 3.02, although both allele probabilities were below the 0.5 active-binding threshold.The reference and alternate probabilities were 0.007 and 0.0009, respectively; neither indicated binding.Source: §1 · p. 2
  • ARGUS keeps biological classification in auditable rule-based code while allowing the LLM to select evidence-gathering actions; observations change the next investigation step.The LLM cannot classify evidence or assign verdicts, which are constrained by pre-classified facts.Source: §1 · p. 2

2 Architecture

ARGUS combines deterministic variant prediction and classification with an investigation loop that selects evidence in response to uncertainty. A deterministic verifier interprets observations, while the reporter generates narrative from pre-classified facts it cannot override.

2 Architecture

  • ARGUS has a deterministic prediction stage and an agentic investigation stage that subjects predictions to evidence-based scrutiny.The prediction stage is shared with the DeepVRegulome pipeline.Source: §2 · p. 2

2.1 Prediction Stage

  • For each variant, ARGUS selects TF models from 458 DNABERT-based models and classifies allele probabilities using a 0.5 active-binding threshold.The classifier distinguishes threshold-crossing changes, quantitative shifts, retained binding, and no confident binding; it flags saturation when both probabilities exceed 0.95.Source: §2.1 · p. 2

2.2 Investigation Stage: The Agentic Loop

  • The investigation is a stateful loop in which a planner selects evidence based on current uncertainty and a deterministic verifier updates the hypothesis state after each observation.The planner's priority policy tries ADASTRA first, then JASPAR and ENCODE cCRE if the hypothesis remains unresolved, and abstains when no admissible source remains.Source: §2.2 · p. 3
  • ADASTRA tables match 445 of the 458 TF models, defining the current scope of direct experimental falsification.JASPAR motif evidence uses a directional relative-score threshold of 0.05 and cannot independently establish or refute experimental binding.Source: §2.2 · p. 4
  • The verifier treats ADASTRA findings according to significance, power, direction, and saturation; JASPAR is indirect computational evidence, while ENCODE cCRE supplies regulatory context.The stopping rule can assign partially_supported or abstained, but reserves supported, contradicted, and rescued verdicts for direct experimental evidence.Source: §2.2 · p. 4

2.3 Evidence-Constrained Reporter

  • The reporter generates narrative from pre-classified facts and cannot alter evidence, verdicts, state transitions, or claim experimental confirmation when disallowed.The authors note that constrained state transitions do not guarantee factuality of unrestricted downstream prose.Source: §2.3 · p. 4

3 Results

At rs6983267, ARGUS’s planner followed different evidence paths for four TFs as observations changed, while frontier LLMs made confident variant-specific claims without verifying them. In a five-hypothesis comparison, LLM-mediated planning reached the same verdicts with fewer tool calls than fixed-priority planning.

3.1 Divergent Trajectories at rs6983267

  • FOXA1 was rescued after significant ADASTRA binding evidence (FDR = 0.030; 15 experiments) exposed a possible model false negative, while KLF6, RAD21, and SP1 abstained after eight-step investigations.KLF6 had conflicting motif and cCRE evidence; RAD21 had a coverage-qualified nonsignificant test (FDR = 0.65); SP1 lacked direct experimental evidence at the locus.Source: §3.1 · p. 5

3.2 Observation-Dependent Branching

  • The same planner produced structurally different trajectories because intermediate observations differed, continuing when evidence left a hypothesis unresolved and stopping when it was sufficient.The FOXA1 and KLF6 trajectories took three and eight steps, respectively, under the same code path.Source: §3.2 · p. 6

3.3 Frontier LLM Baseline

  • Frontier LLMs confidently conflated 8q24/MYC biology with variant-specific TF binding claims and did not distinguish tissue expression from allele-specific binding at this position.This was an informal observation, not a controlled benchmark.Source: §3.3 · p. 6

3.4 AlphaGenome Atlas Cross-Reference

  • AlphaGenome’s variant-level AVI score was 0.570, but its TF-specific predictions were excluded from planner and verifier decisions because the score was identical across TFs and could not drive observation-dependent branching.The queried TF tracks showed substantial biosample dependence.Source: §3.4 · p. 6

3.5 Fixed vs. LLM-Mediated Planning

  • The LLM planner reached identical verdicts in all five cases using 9 calls rather than the fixed planner’s 13, declining cCRE queries that could not resolve TF-specific binding or direction.LLM planner sequences were identical across three replicates; the comparison does not establish a general planning advantage.Source: §3.5 · pp. 6–7, Table 2 · p. 7

4 Discussion

ARGUS separates deterministic evidence classification from LLM reasoning and treats predictions as hypotheses to test against independent evidence. Its discussion emphasizes explicit uncertainty while noting limits in evaluation, planning, evidence coverage, and biological interpretation.

4.1 Architecture Enforces What Prompting Cannot

  • Architectural enforcement, rather than prompting, keeps biological classification deterministic and prevents LLMs from overriding pre-classified evidence.The LLM may select investigation actions or write reports, but cannot classify evidence or assign verdicts.Source: §4.1 · p. 7

4.2 Prediction vs. Interpretation

  • ARGUS addresses the downstream question of whether a predicted variant effect is supported, rather than competing with upstream prediction models.Its planner, verifier, and stopping rules are model-agnostic.Source: §4.2 · p. 7

4.3 Falsification as a Design Pattern for Agentic Science

  • ARGUS treats predictions as testable hypotheses, using explicit epistemic states and data-structure flags to distinguish computational evidence from experimental claims.States communicate what has been tested and what remains unknown; experimental claims require direct experimental evidence.Source: §4.3 · p. 7

4.4 Limitations

  • The evaluation covers five hypotheses at two loci, not predictive accuracy, controlled hallucination reduction, or end-to-end natural-language inference.Initial DVR outputs are precomputed.Source: §4.4 · p. 8
  • The planner uses a fixed evidence priority rather than a learned or value-of-information policy, while the falsification battery covers only three evidence sources.The paper identifies adaptive planning and additional sources such as eQTL, ATAC-seq, literature, and independent model predictions as possible extensions.Source: §4.4 · p. 8
  • DNABERT blind spots include saturation and limited sensitivity outside core motifs; interpretation also depends on tissue matching, assay aggregation, and allele harmonization.Saturation rescue addresses the most severe blind spot, while systematic characterization of model failures remains ongoing.Source: §4.4 · p. 8
  • The local ENCODE cCRE lookup uses the same underlying data as SCREEN but lacks its biosample-specific activity annotations.Source: §4.4 · p. 8

5 Conclusion

ARGUS demonstrates an auditable approach to agentic genomic interpretation by separating deterministic science from agentic reasoning and testing predictions against evidence. At rs6983267, one planner produced four divergent, observation-dependent trajectories from real evidence.

  • Four divergent trajectories at rs6983267 show that observation-dependent investigation can be achieved within an auditable framework using real evidence.ARGUS separates deterministic science from agentic reasoning and makes each verdict traceable to a specific evidence observation.Source: §5 · p. 8
Loading 2610.12281v1…