Source-linked AI summary

Advancing the Physical Internet with GraphRAG: A New Way to Review and Integrate Existing Research

Hisatoshi Naganawa, Enna Hirata, Russell G. Thompson, Akira Yamada

arXiv:2609.29083v1cs.SI

TL;DR

PI research has expanded, but past and future research summaries are sporadic, and an integrated way to organize current work is needed. This study applies GraphRAG to PI literature and reports that GraphRAG outperformed GPT on both prompts; it presents the approach as a new way to synthesize research and inform policy and research agendas.

  • Problem

    PI research has grown, while summaries remain sporadic and an integrated method is needed to organize current research and address future challenges.

    Source: §2.1 · p. 2
  • Method

    The study applies GraphRAG to analyze PI research using a knowledge graph integrating IPIC proceedings and the ALICE and Japan PI roadmaps.

    Source: §1 · p. 2, §3 · p. 3
  • Results

    In both prompts, GraphRAG outperformed GPT, demonstrating higher lexical density, readability, and similarity of responses.

    Source: §6 · p. 7
  • Takeaways & Limitations

    The study presents GraphRAG as a new approach to reviewing and synthesizing PI research, with potential to support policy development and research agendas.

    Source: §1 · p. 2, §6 · p. 7

    The dataset consists primarily of IPIC proceedings, which lack the technical depth and detailed information associated with the topic.

    Source: §6 · p. 7

Abstract

from arXiv · show

Physical Internet (PI) is an emerging concept that applies the digital internet as a design metaphor for the development of sustainable, interoperable, and collaborative freight transportation. It is considered a way to bring logistics into the next generation of transformation. Effective tools for organizing and integrating knowledge are essential for navigating the emerging research in this area. In this study, we explore the application of Graph Retrieval Augmented Generation (GraphRAG) in the context of PI, using GPT-4o mini and Neo4j to construct a knowledge graph and systematically analyze existing PI-related literature. Our approach synthesizes scattered research findings, highlights emerging trends, and identifies knowledge gaps. Furthermore, we demonstrate that GraphRAG improves accessibility by structuring complex information into interconnected graphs and provides a deeper understanding of underlying research dynamics. This research will contribute to future research and innovation by providing a new method of information analysis in the PI domain.

1 Introduction

The Physical Internet (PI) is a sustainable freight-network concept whose research has advanced from theory toward empirical work. This study applies GraphRAG to analyze existing research and assess its potential for policy development and research agendas.

1 Introduction

  • PI applies the digital-internet concept to physical-goods transportation to develop a sustainable global logistics network.The concept has progressed from a theoretical framework to active empirical research.Source: §1 · p. 1
  • GraphRAG combines information retrieval and generation to retrieve relevant information for queries and generate content from those results.The introduction describes it as useful for gaining deeper insights from existing literature.Source: §1 · pp. 1–2
  • The study assesses how GraphRAG can analyze existing PI research and support policy development and research-agenda formulation.It is presented as the first application of GraphRAG to PI-related studies.Source: §1 · p. 2

2 Literature Review

The literature review describes PI's expanding research base and the need for integrated synthesis. It also outlines generative AI's knowledge limitations and GraphRAG's graph-based approach to retrieving and connecting information.

2.1 Brief overview on Physical Internet

  • PI uses the digital internet as a design metaphor for sustainable, interoperable, coordinated freight transport, including modular containers routed through hubs.As PI literature has grown, summaries have remained sporadic, creating a need for an integrated way to organize research and address future challenges.Source: §2.1 · p. 2

2.2 Brief overview on generative AI

  • GPT systems generate humanlike text from large datasets but rely on existing training data and can produce inaccurate responses when information is unknown.The review connects these limitations to applications requiring high reliability (Rawte et al., 2023).Source: §2.2 · p. 2

2.3 GraphRAG

  • GraphRAG structures retrieved information as a graph, where nodes represent concepts and edges their relationships, supporting research synthesis and policy development.The review notes applications to supplier discovery and automotive failure analysis.Source: §2.3 · p. 3

3 Data

The study builds a PI-specific knowledge graph from conference proceedings and PI roadmaps. It converts source PDFs to text for subsequent analysis.

3 Data

  • The PI knowledge graph integrates IPIC proceedings, the ALICE PI roadmap, and Japan's METI PI roadmap.Table 1 lists the study's data sources.Source: §3 · p. 3, Table 1 · p. 3
  • A Python script converts the source PDF documents into text data for subsequent analysis.The study obtains the proceedings and roadmaps from their respective conference or organization websites.Source: §3 · p. 3
  • The IPIC proceedings span 2016–2024, while the ALICE and METI roadmap sources are dated 2020 and 2022, respectively.The listed collection methods are downloads from the IPIC repository and the ALICE and METI websites.Source: §3 · p. 3

4 Methodology

The methodology integrates PI-related sources, prepares them for GraphRAG, generates responses through different search strategies, and evaluates model outputs using performance metrics.

4 Methodology

  • The research flow comprises data collection, preprocessing, response generation, and performance measurement.Source: §4 · p. 4

4.1 Preprocessing

  • Preprocessing integrates IPIC proceedings with ALICE and Japan roadmap data, removes standard and domain-specific stop words, then loads the refined text into GraphRAG.Source: §4.1 · p. 4

4.2 Response generation based on GraphRAG

  • Local Search retrieves semantically close graph nodes and edges, Global Search summarizes relevant graph communities, and Hybrid Search combines both approaches.The four models also include GPT-Only; GraphRAG was built with Neo4j Desktop and GPT-4o mini.Source: §4.2 · p. 4

4.3 Performance metrics

  • Each model is evaluated using five metrics, including WC, TTR, ADD, and FKG; sentence embeddings support cosine-similarity calculation.Source: §4.3 · pp. 4–5

5 Results and Discussion

Across two prompts, the study compares GPT-Only with three GraphRAG search strategies. GraphRAG models outperform GPT-Only on all reported metrics except word count, with Hybrid Search achieving the highest scores.

5.1 Prompts and Reponses

  • Four models answered prompts about research gaps against the ALICE and Japan roadmaps and proposals for PI's social implementation in Japan.Source: §5.1 · p. 5, Table 4 · p. 5, Table 5 · p. 5
  • Model outputs identified gaps ranging from interoperability and secure data sharing to transport protocols, container development, and hub inventory management.Source: Table 4 · p. 5
  • The intuitive comparison portrays GPT-Only responses as broader and more general, while RAG-based responses are more specific and targeted.Source: §5.1 · p. 6

5.2 Performance Metrics

  • GraphRAG models II–IV outperformed GPT model I on all metrics except WC, and Model IV (HS) achieved the highest scores.Source: Table 6 · p. 6, §5.2 · p. 6

6 Conclusion

The conclusion presents GraphRAG as a new approach to analyzing PI-related text and reports stronger response metrics than GPT in two prompt settings. It also identifies dataset, computational-cost, and validation limitations.

6 Conclusion

  • In both prompt settings, GraphRAG outperformed GPT in lexical density, readability, and response similarity.Source: §6 · p. 7
  • The study presents the first application of GraphRAG to PI research and compares local, global, and hybrid search strategies.It also applies large-scale NLP to capture academic literature, internet data, public opinion, and industry perspectives.Source: §6 · p. 7
  • The dataset draws primarily on IPIC proceedings, which lack the technical depth and detail associated with PI; hybrid search also raises computational costs that may limit real-time scalability.Source: §6 · p. 7
  • The conclusions were not compared with official logistics data or expert opinion, limiting their validation.Source: §6 · p. 7
  • Future work should broaden source coverage and improve validation and interpretation of AI-generated insights.The authors also propose studying AI-driven analytics' influence on government regulations and industry standards for sustainable logistics.Source: §6 · p. 7
Loading 2609.29083v1…